...

/

Performance Metrics for Distributed Systems: Latency, Round-Trip Time & Throughput

Performance Metrics for Distributed Systems: Latency, Round-Trip Time & Throughput

We will discuss the metrics used to measure performance like Latency, Round Trip Time, Throughput and Transfer times

Takeout dinner tonight?

Before we jump into the definitions, let’s look at a scenario.

Jack and Jill didn’t want to cook one day so they decided to have takeout for dinner. Jack offered to drive and pick up the food from a nearby restaurant.

Jack went to fetch food. Jill stayed at home :)
Jack went to fetch food. Jill stayed at home :)

Here’s how Jack’s journey progressed:

  1. He drove to the restaurant from home. It took him 10 minutes to reach the restaurant.

  2. When he arrived at the restaurant, there were 4 people ahead of him in the line. Each person took 1 minute to submit their order. He waited 5 minutes to reach the order counter.

  3. Once he had placed the order, his food was ready in 20 minutes.

  4. On his drive back to home, Jack experienced heavier than usual traffic and it took him 15 minutes to reach home.

  5. Waiting patiently at home, Jill observed that it took Jack 50 minutes to bring dinner. She didn’t know the breakdown of the time spent at each step.

Keeping this carryout trip in mind, let us look at the metrics that we will use to evaluate the performance of a distributed system.

System Performance Metrics

Consider a typical interaction between a client and a server.

  1. Client sends a Request.
  2. Server receives the request.
  3. Server keeps the request in a queue before processing it.
  4. Server does the work.
  5. Server sends the Response back.
  6. Client receives the response.
Typical Client-Server Interaction
Typical Client-Server Interaction

Using this client-server interaction as an example, we’ll look at the following common metrics used to measure the performance of the distributed systems

  1. Request Transfer Time
  2. Server Latency
  3. Processing Time
  4. Response Transfer Time
  5. Round Trip Time or Response Time
  6. Throughput
A note about Latency:

One thing that you might notice below is that almost every delay can be called “Latency” and different people use the word Latency to describe different delays.

Hence context is very important when you read ...

Access this course and 1400+ top-rated courses and projects.