How to resolve an error with Risingwave PostgreSQL CDC connector in Kubernetes?
I encountered an error while setting up the Risingwave PostgreSQL CDC connector in Kubernetes. Martin provided some guidance on resolving the issue. Anon Z was able to resolve the issue with the help provided. Martin also mentioned a limitation of the current version of the connector and a bug report request.
Anon Z
Asked on Jul 27, 2023
-
Check if
connector-node
is started, aspostgres-cdc
relies on it. -
Add the necessary configuration to the Risingwave Operator YAML file before applying it with
kubectl apply
. The configuration can be found at: connector-test.yaml. -
If deploying Risingwave on Kubernetes, follow the steps provided in the Risingwave documentation: Risingwave Kubernetes Deployment Guide.
-
Download the Risingwave Operator YAML file from here and add the necessary configuration before applying it.
-
Note that the current version of the PostgreSQL CDC connector is a single-thread version with a throughput of about 20K rows/s at most.
-
If you encounter issues with data reading, such as incorrect charset, consider reporting a bug on the Risingwave GitHub repository: Report Bug.