Design of Distributed Search

High-level design

Let’s shape the overall design of a distributed search system before getting into a detailed discussion. There are two phases of such a system, as shown in the following illustration. The offline phase involves data crawling and indexing in which the user has to do nothing. The online phase consists of searching results against the search query by the user.