troubleshooting

How to resolve an error with Risingwave PostgreSQL CDC connector in Kubernetes?

I encountered an error while setting up the Risingwave PostgreSQL CDC connector in Kubernetes. Martin provided some guidance on resolving the issue. Anon Z was able to resolve the issue with the help provided. Martin also mentioned a limitation of the current version of the connector and a bug report request.

An

Anon Z

Asked on Jul 27, 2023

  1. Check if connector-node is started, as postgres-cdc relies on it.

  2. Add the necessary configuration to the Risingwave Operator YAML file before applying it with kubectl apply. The configuration can be found at: connector-test.yaml.

  3. If deploying Risingwave on Kubernetes, follow the steps provided in the Risingwave documentation: Risingwave Kubernetes Deployment Guide.

  4. Download the Risingwave Operator YAML file from here and add the necessary configuration before applying it.

  5. Note that the current version of the PostgreSQL CDC connector is a single-thread version with a throughput of about 20K rows/s at most.

  6. If you encounter issues with data reading, such as incorrect charset, consider reporting a bug on the Risingwave GitHub repository: Report Bug.

Jul 27, 2023Edited by