Fault Tolerance

What is fault tolerance?

Large-scale applications utilize hundreds of servers and databases to serve billions of users. To ensure data safety and avoid redoing computationally intensive tasks, these systems must eliminate single points of failure.

Fault tolerance is a system’s ability to continue operating even if one or more components (software or hardware) fail. While achieving 100% fault tolerance is practically impossible, systems aim to maximize persistence and minimize disruption.

Fault tolerance relies on two key qualities:

• Availability: The system remains accessible and receives client requests at any time.

• Reliability: The system consistently processes requests and performs the correct actions.

To prevent disruptions from a single point of failure, systems use two main approaches:

• Fault-removal: Uses forward or backward error recovery.

• Fault-masking: Using redundancy to prevent a fault from affecting the system’s output.

Systems also implement failover strategies to manage downtime:

• Hot failover: Instantly transfers workloads to a functioning backup (zero downtime).

• Warm or cold failover: Loads and starts the backup only when needed. This causes a delay but consumes fewer resources.

Note that fault tolerance offers limited protection against software failures, which remain a major cause of outages.

Let’s explore common techniques used to achieve fault tolerance.

Advantages of fault-tolerant systems

The primary purpose of fault tolerance is to prevent system unavailability. This is critical for safety-critical systems (like air traffic control) and platforms requiring high data integrity. However, these systems are expensive to implement because they require redundant hardware and complex synchronization logic.

Fault tolerance techniques

Failures occur at hardware or software levels. Common techniques to address these include:

Forward and Backward error recovery

Forward error recovery identifies and corrects the error state (e.g., ...