Is it possible to include a column containing the Kafka message key when creating a Kafka source?

The user is asking if there is a way to include a column for the Kafka message key when setting up a Kafka source. They mention that they are using normal JSON format messages.


Jf p

Asked on Jul 09, 2023

  • For CDC (Change Data Capture) formats like Debezium, the message key is already supported as a hidden column.
  • For normal JSON/Avro/Protobuf formats, support for including the message key as a column will be added soon.
  • As a workaround for normal JSON messages, you can manually add the key into the message for now.
Jul 10, 2023Edited by