Is the Meta node partitioned for better performance?

I saw the Master(Meta data & coordination) node is using Raft for reliable log replication. If the master a single node or it is partition for better performance?



Asked on Dec 30, 2022

  • The Meta node is not partitioned for better performance.
  • Raft is used for reliable log replication within the Meta node.
  • If the Meta node crashes, it can be restarted similar to how Google File System handled restarts.
  • Google's latest file system, Colossus, has abandoned the single master approach for improved performance in metadata services compared to GFS.
  • The team is considering options like FDB or TiKV for a distributed and scalable meta storage backend to enhance metadata scalability.
Jan 03, 2023Edited by