all-things-risingwave

Can I use 'offset' in a materialized view creation query for a Kafka source in RisingWave?

I tried to create a materialized view 'source_mv1' from a Kafka source 's1' with an offset of 10000, but it resulted in failure. Is using 'offset' not supported or am I using it wrong?

ji

jie

Asked on May 18, 2022

  • Kafka's 'offset' is different from the 'offset' in SQL.
  • Specifying 'offset' in a materialized view creation query for a Kafka source in RisingWave is not supported.
  • Streaming events in Kafka are not ordered, so using 'offset' to skip events may not produce stable results.
  • To specify the offset of a Kafka topic, refer to the kafka.time.offset parameter in the RisingWave documentation.
  • The offset of Kafka corresponds to multiple partitions, making it challenging to determine the consumption position of all partitions with just one Kafka offset.
May 18, 2022Edited by