troubleshooting
Do I need to reset the offset or drop and re-add the table after adding a column in Postgres CDC source?
I have added a Postgres CDC source and then added a column to the table. The data for the new column is not populating. Do I need to reset the offset in the internal table or drop and re-add the table altogether?
Je
Jesse Levier
Asked on Apr 17, 2024
- After ALTER TABLE in the Postgres CDC source, the added column will be filled with
null
for the data already ingested into the read-write table. - For new data coming from the upstream, it will contain the value of the added column.
- If you want the already ingested data to contain the value of the added column, you have to recreate the table in the read-write source.
Apr 17, 2024Edited by