all-things-risingwave
Can RisingWave replace a part of the data processing pipeline described in the SoundCloud blog post?
Martin is discussing the possibility of using RisingWave to replace a part of the data processing pipeline described in the SoundCloud blog post. Tao Wu provides insights on the use of SQL databases for structured data and text data processing. Martin further elaborates on the data indexing in Elasticsearch and the simplicity of the use case in MySQL. Tao Wu concludes by mentioning text parsing and projection.
Ma
Martin
Asked on May 25, 2022
- RisingWave can potentially replace a part of the data processing pipeline described in the SoundCloud blog post.
- SQL databases are traditionally designed for indexed, structured data rather than text data.
- RisingWave may not be suitable for complex indexing algorithms typically used for text data.
- MySQL can handle simple use cases like indexing basic fields such as title, description, and user.
- RisingWave can replace the rest of the pipeline and fetch data from MySQL using certain primary keys.
- The described use case involves simple text parsing and projection.
May 25, 2022Edited by