The user is facing an issue with incomplete backfilling when using a shared postgres cdc source with a large amount of data in RisingWave. The backfilling completes quickly for a single CDC table but not for multiple tables. The developers are investigating the issue, and a workaround has been suggested by Siyuan Wang.
bestmike007
Asked on Mar 15, 2024
The workaround for incomplete backfilling in RisingWave when using a shared postgres cdc source with a large amount of data is to create a single CDC table instead of multiple tables.
This workaround is suggested due to a known issue with backfilling for data with a large amount of data.
The fix for this issue is being worked on and is expected to be included in version 1.7.2 of RisingWave.
The ETA for the fix is within a week from the time of the discussion.