Metadata Consistency Model of GFS
Explore the metadata consistency model in Google File System. Understand how the manager node stores and replicates metadata to maintain strong consistency and support fault tolerance. Learn about synchronous replication, shadow managers, and the trade-offs between throughput and latency to keep metadata reliable in distributed environments.
We'll cover the following...
Metadata
The manager node stores all of the metadata in memory and serves user requests from there for good performance. Some part of the metadata is stored persistently on the hard disk of the manager node and also replicated on remote machines, while some metadata is not, as shown in the following illustration. (The part of the metadata that is not persistently stored can be rebuilt if needed. At times, such data is called a soft state.)
Note: In February 2017, AWS's S3 storage system suffered an
... outage https://aws.amazon.com/message/41926/