all-things-risingwave

Is RisingWave capable of processing petabyte scale data per day?

I am interested in knowing if RisingWave has the capability to handle petabyte scale data processing per day based on the discussion thread.

Ri

RisingWaveArmy

Asked on Sep 03, 2023

  • RisingWave does not have a verified scenario for processing petabyte scale data per day.
  • While Facebook generates 4 petabytes of data per day and Twitter generates around 10 petabytes per year, RisingWave has not been tested at that scale.
  • RisingWave has successful stories in supporting large scale workloads, such as in cryptocurrency trading scenarios where the data volume is around terabytes per day.
  • RisingWave is scalable and optimized for queries with extra large internal states, ensuring scalability for tasks like multi-stream joins and window functions.
Sep 03, 2023Edited by