all-things-risingwave
How often does RisingWave integration write to Apache Iceberg and can the frequency of writes be configured?
Andrei Nesterov mentioned that frequent writes to Apache Iceberg result in a large number of small files on S3. Tianxiao Shen provided information on the frequency of writes and configuration options for RisingWave integration with Apache Iceberg.
An
Andrei Nesterov
Asked on Jun 28, 2023
- RisingWave integration writes to Apache Iceberg when creating a checkpoint.
- The frequency of writes can be configured using the
checkpoint_frequencyparameter. - The
checkpoint_frequencyparameter determines how often RisingWave commits to Apache Iceberg. - The
checkpoint_frequencysetting can be adjusted to control the frequency of writes to Apache Iceberg. - For more details, refer to the RisingWave documentation: RisingWave System Parameters
Jun 28, 2023Edited by