I'm trying to understand the implications of adding new materialized views to an RW cluster. Specifically, I want to know if there's any overhead when no input data is coming in, and what the storage cost might be for maintaining metadata in the meta node and ETCD for each MV.
Nizar Hejazi
Asked on May 14, 2023
The overhead of adding a new MV to an RW cluster is negligible if there is no input data coming in. The implementation of an MV is a number of async functions in Rust that are scheduled by the async runtime Tokio. Without input data, these functions do not get scheduled, and the system remains idle with close to 0% CPU utilization. However, RW does need to store some metadata for each MV in the meta node and ETCD, but this storage cost is minimal, typically several hundred KB to low single-digit MB.
