How does MySQL CDC handle historical data and schema evolution?

I'm using MySQL CDC to retrieve data and I'm concerned about handling historical data and schema evolution. How can MySQL CDC support retrieving all historical data from the beginning and manage schema evolution smoothly?


Shelton Suen

Asked on Jan 04, 2024

  • Historical Data: When creating the source in RisingWave, a snapshot of the table is taken, allowing historical data to be injected into RW.

  • Schema Evolution: RisingWave requires users to define the schema of MySQL tables on creation. If the table schema needs to be modified (e.g., adding a new column), users need to manually execute alter table add column on the RW side. It's recommended to perform schema modifications on RW first before the upstream DB to ensure all rows are parsed correctly in their updated schema.

Jan 04, 2024Edited by