How does MySQL CDC handle historical data and schema evolution?
I'm using MySQL CDC to retrieve data and I'm concerned about handling historical data and schema evolution. How can MySQL CDC support retrieving all historical data from the beginning and manage schema evolution smoothly?
Shelton Suen
Asked on Jan 04, 2024
-
Historical Data: When creating the source in RisingWave, a snapshot of the table is taken, allowing historical data to be injected into RW.
-
Schema Evolution: RisingWave requires users to define the schema of MySQL tables on creation. If the table schema needs to be modified (e.g., adding a new column), users need to manually execute
alter table add columnon the RW side. It's recommended to perform schema modifications on RW first before the upstream DB to ensure all rows are parsed correctly in their updated schema.