all-things-risingwave
How does initial data ingestion work when using postgres-cdc with RisingWave?
Madis is curious about the initial data ingestion process when using postgres-cdc with RisingWave, specifically how existing data is ingested into a table and a materialized view.
Ma
Madis Liias
Asked on Aug 22, 2023
- Initial data ingestion with postgres-cdc in RisingWave involves creating a consistent snapshot of existing data at the time of creating sources.
- The existing data is fetched all at once during the snapshot creation.
- Subsequent transactions written to the WAL (Write-Ahead Logging) will be propagated to the source for real-time updates.
- Debezium is used to implement the CDC connector for data ingestion in RisingWave.
Aug 22, 2023Edited by