all-things-risingwave
Is it possible to route data in Risingwave using a table column as the topic name for a Kafka/pulsar sink?
Gio Gutierrez is exploring the possibility of using a table column to route data in Risingwave, specifically as the topic name for a Kafka/pulsar sink. Yuhao Su mentioned that it's not currently supported but is willing to discuss further. Eric also discussed the idea of creating multiple sinks with different filter conditions based on topics.
Gi
Gio Gutierrez
Asked on Mar 04, 2024
- Currently, Risingwave does not support using a table column as the topic name for a Kafka/pulsar sink.
- Eric mentioned the idea of creating multiple sinks with different filter conditions based on topics, but highlighted potential performance concerns with a large number of topics.
- There is interest in supporting this feature for MQTT sink/source, especially considering the common practice in MQTT to have lots of topics, such as one for each device.
- The proposal of having a sink parameter with the column name was considered sufficient for implementing this feature.
Mar 08, 2024Edited by