all-things-risingwave

Is high IO usage normal when creating a materialized view with high data throughput?

I was creating a materialized view with a high data throughput of 400 pieces per second. The SQL statement used to create the view is provided. Is it normal to experience high IO usage during this process?

ye

yefeng

Asked on Jan 13, 2023

  • High IO usage during the creation of a materialized view with high data throughput is expected, as historical data in the table needs to be processed.
  • If the high IO usage persists after creating the materialized view, it could be due to performance issues with the storage system, such as MinIO.
  • Performance tests with AWS S3 have shown better IO performance compared to MinIO on EC2 machines.
  • Sharing hardware configuration and queries can help in reproducing and identifying the cause of high IO usage.
Jan 13, 2023Edited by