troubleshooting

Does RisingWave support pivot conversion for stream processing?

Xiang Chen is new in RisingWave and looking for support for pivot conversion in stream processing. He has data processing requirements involving row-column conversion in product with batch processing, and is unsure how to achieve this in stream processing.

xi

xiang chen

Asked on Mar 08, 2024

  • RisingWave does not currently support pivot conversion for stream processing.
  • The team does not have plans to implement this feature.
  • Xiang Chen mentioned data requirements for reports/BI that were previously processed statistically with batch processing, but faced timeliness issues at the hourly level.
  • Xiang Chen provided examples of dynamic column changes and row-column transformations based on original data values, previously handled using pandas for data rows processing.
  • Tianshuo Shi acknowledged that this use case is not typical for RisingWave but mentioned they will take a look at it.
Mar 08, 2024Edited by