all-things-risingwave

How does initial data ingestion work when using postgres-cdc with RisingWave?

Madis is curious about the initial data ingestion process when using postgres-cdc with RisingWave, specifically how existing data is ingested into a table and a materialized view.

Ma

Madis Liias

Asked on Aug 22, 2023

  1. Initial data ingestion with postgres-cdc in RisingWave involves creating a consistent snapshot of existing data at the time of creating sources.
  2. The existing data is fetched all at once during the snapshot creation.
  3. Subsequent transactions written to the WAL (Write-Ahead Logging) will be propagated to the source for real-time updates.
  4. Debezium is used to implement the CDC connector for data ingestion in RisingWave.
Aug 22, 2023Edited by