Skip to content

Examples

The examples/ directory contains Docker Compose stacks for running debezium-postgres2lake end-to-end on a local machine.

Available stacks

Stack Format Catalog Docs page
examples/avro Avro N/A Avro
examples/avro-spi-s3-readiness Avro N/A Avro + external SPI JAR
examples/parquet Parquet N/A Parquet
examples/orc ORC N/A ORC
examples/iceberg-jdbc Iceberg JDBC Iceberg JDBC
examples/iceberg-nessie Iceberg Nessie Iceberg Nessie
examples/iceberg-hive Iceberg Hive Iceberg Hive
examples/paimon-jdbc Paimon JDBC Paimon JDBC
examples/paimon-hive Paimon Hive Paimon Hive

Common flow

  • Build application container images:
   ./scripts/build-container-images.sh
  • Start one stack:
cd examples/parquet
docker compose up -d
  • Generate CDC input traffic:
docker compose cp ../common/python-scripts/generate_data.py jupyter:/tmp/generate_data.py
docker compose exec jupyter python /tmp/generate_data.py

Notes