I'm trying to create a source table in RisingWave (RW) after setting up a Debezium connector for Postgres CDC. However, I'm encountering an error that says QueryError: Bind error: column "transfer_id" named in key does not exist. Here's the script I used for the Debezium connector:
curl -i -X POST -H "Accept:application/json" -H "Content-Type: application/json" 172.25.49.135:8083/connectors/ -d '{
"name":"postgres-debezium-source-mtx_header",
"config":{
"connector.class":"io.debezium.connector.postgresql.PostgresConnector",
...
"table.include.list":"public.mtx_transaction_header_2023_09",
...
}
}'Do I need to specify all the columns in the source table creation in RW, or is it enough to specify only the primary key when using AVRO format?
Vijay Shankar
Asked on Sep 22, 2023
When creating a source table in RisingWave, you need to specify the column types before you can use them as primary keys. If you're using the AVRO format, you still need to define the schema with all the columns, not just the primary key. Make sure that the column transfer_id is correctly defined in your schema and that it exists in the source data you are trying to ingest.