troubleshooting

How to resolve RisingWave error with Avro 'Ref' type?

I'm trying to create a source in RisingWave using Avro format with data ingested from Redpanda using Debezium, but I'm encountering an error related to the Avro 'Ref' type. Here's the script I used to create the source:

WITH (
   connector='kafka',
   topic='topic_name',
   properties.bootstrap.server='redpanda_server:9090',
   scan.startup.mode='earliest'
)
ROW FORMAT AVRO 
ROW SCHEMA LOCATION CONFLUENT SCHEMA REGISTRY '<http://redpanda_server:8081>';```

The error message I received is:

ERROR: QueryError: internal error: unsupported type in Avro: Ref { name: Name { name: "Value", namespace: None } }


How can I resolve this issue?
Sa

Saif Yousif

Asked on May 05, 2023

Currently, RisingWave does not support the Avro 'Ref' type. The RisingWave team is aware of this limitation and is considering adding support for it. In the meantime, you may need to use a different data format that is supported by RisingWave, such as Debezium JSON, or wait for the feature to be implemented if Avro is a requirement for your use case.

Jun 09, 2023Edited by