all-things-risingwave

Can metadata be stored in a hummock in the meta node?

JJ is discussing the storage of metadata in the meta node using a hummock and questioning its feasibility based on the system design and architecture.

JJ

JJ

Asked on May 19, 2022

  • Metadata in the meta node is not stored in a hummock; instead, it uses etcd for storage.
  • Hummock is specific to RisingWave's streaming engine and not a general-purpose KV storage.
  • The metadata service stores metadata, and services like Hummock rely on this service for storing their metadata.
  • Worker nodes can retrieve old metadata from the meta service in case of system failures and restarts.
  • Storing old metadata locally may lead to duplicated data and is not considered a good choice in the system design.
May 19, 2022Edited by