troubleshooting

Do I need to reset the offset or drop and re-add the table after adding a column in Postgres CDC source?

I have added a Postgres CDC source and then added a column to the table. The data for the new column is not populating. Do I need to reset the offset in the internal table or drop and re-add the table altogether?

Je

Jesse Levier

Asked on Apr 17, 2024

  • After ALTER TABLE in the Postgres CDC source, the added column will be filled with null for the data already ingested into the read-write table.
  • For new data coming from the upstream, it will contain the value of the added column.
  • If you want the already ingested data to contain the value of the added column, you have to recreate the table in the read-write source.
Apr 17, 2024Edited by