Can RisingWave (RW) Replace Flink and OLAPs in Current Architectures?
I'm trying to understand the differences between RisingWave (RW) and other systems like Flink or OLAPs such as Apache Doris. Specifically, I want to know what RW can do in comparison to the combination of Flink and OLAPs, and the significance of adding RW to an existing architecture that already includes these systems.
pony lee
Asked on Feb 21, 2024
RisingWave (RW) can indeed replace Flink, especially in scenarios where Flink falls short in handling large state management and elastic scaling. RW is optimized for large state management and elastic scaling, offering productivity benefits due to simpler coding and cost efficiency. While RW does not provide a Java/Scala API like Flink, it supports Python/Java/C++/Rust UDFs and has a Python wrapper, making it suitable for ML engineers. Additionally, RW uses Postgres SQL, which is more advanced than Flink SQL. However, RW currently does not support timed triggering as well as Flink's stream API does, but there are workarounds using a big time list table and a temporal filter to simulate timed triggering. The RisingWave team is considering more user-friendly syntax and optimizations for such use cases.