all-things-risingwave
Is RisingWave capable of processing petabyte scale data per day?
I am interested in knowing if RisingWave has the capability to handle petabyte scale data processing per day based on the discussion thread.
Ri
RisingWaveArmy
Asked on Sep 03, 2023
- RisingWave does not have a verified scenario for processing petabyte scale data per day.
- While Facebook generates 4 petabytes of data per day and Twitter generates around 10 petabytes per year, RisingWave has not been tested at that scale.
- RisingWave has successful stories in supporting large scale workloads, such as in cryptocurrency trading scenarios where the data volume is around terabytes per day.
- RisingWave is scalable and optimized for queries with extra large internal states, ensuring scalability for tasks like multi-stream joins and window functions.
Sep 03, 2023Edited by