Examples
The examples/ directory contains Docker Compose stacks for running debezium-postgres2lake end-to-end on a local machine.
Available stacks
| Stack | Format | Catalog | Docs page |
|---|---|---|---|
examples/avro |
Avro | N/A | Avro |
examples/avro-spi-s3-readiness |
Avro | N/A | Avro + external SPI JAR |
examples/parquet |
Parquet | N/A | Parquet |
examples/orc |
ORC | N/A | ORC |
examples/iceberg-jdbc |
Iceberg | JDBC | Iceberg JDBC |
examples/iceberg-nessie |
Iceberg | Nessie | Iceberg Nessie |
examples/iceberg-hive |
Iceberg | Hive | Iceberg Hive |
examples/paimon-jdbc |
Paimon | JDBC | Paimon JDBC |
examples/paimon-hive |
Paimon | Hive | Paimon Hive |
Common flow
- Build application container images:
./scripts/build-container-images.sh
- Start one stack:
cd examples/parquet
docker compose up -d
- Generate CDC input traffic:
docker compose cp ../common/python-scripts/generate_data.py jupyter:/tmp/generate_data.py
docker compose exec jupyter python /tmp/generate_data.py
Notes
- For full details, prerequisites, and scripts, see
examples/README.md. - For output-specific configuration keys and examples, see:
- Avro format config
- Parquet format config
- ORC format config
- Iceberg format config
- Paimon format config