I'm using MySQL CDC to retrieve data and I'm concerned about handling historical data and schema evolution. How can MySQL CDC support retrieving all historical data from the beginning and manage schema evolution smoothly?
Shelton Suen
Asked on Jan 04, 2024
Historical Data: When creating the source in RisingWave, a snapshot of the table is taken, allowing historical data to be injected into RW.
Schema Evolution: RisingWave requires users to define the schema of MySQL tables on creation. If the table schema needs to be modified (e.g., adding a new column), users need to manually execute alter table add column
on the RW side. It's recommended to perform schema modifications on RW first before the upstream DB to ensure all rows are parsed correctly in their updated schema.