End-to-end pipeline examples using the authenticated Ingest Engine HTTP API. Each walkthrough creates source and sink tables, validates its SQL, starts a pipeline, and monitors it through /api/v1.
- Kafka to Iceberg - Stream JSON clickstream events from a Kafka topic into a partitioned Iceberg table.
- PostgreSQL CDC to Iceberg - Replicate PostgreSQL tables into Iceberg with an initial snapshot and live WAL changes.
- HTTP to Iceberg - Accept JSON events over HTTP and write them to an Iceberg table.
- Filesystem to Iceberg - Read newline-delimited JSON files from S3 and write them to an Iceberg table in AWS Glue.
Last modified on October 1, 2026
