troubleshooting

What is the workaround for incomplete backfilling in RisingWave when using a shared postgres cdc source with large amount of data?

The user is facing an issue with incomplete backfilling when using a shared postgres cdc source with a large amount of data in RisingWave. The backfilling completes quickly for a single CDC table but not for multiple tables. The developers are investigating the issue, and a workaround has been suggested by Siyuan Wang.

be

bestmike007

Asked on Mar 15, 2024

  • The workaround for incomplete backfilling in RisingWave when using a shared postgres cdc source with a large amount of data is to create a single CDC table instead of multiple tables.

  • This workaround is suggested due to a known issue with backfilling for data with a large amount of data.

  • The fix for this issue is being worked on and is expected to be included in version 1.7.2 of RisingWave.

  • The ETA for the fix is within a week from the time of the discussion.

Mar 15, 2024Edited by