The Application Architecture Ecosystem

Get introduced to the general architecture and design guidelines for the batch application we build in this chapter.

Spark in practice

We are at a point in the course where we can apply some of the concepts learned previously and work with a project closer to a real-world solution. This whole chapter of the course explains how to build a Spark-based, big data batch application. In this lesson, we describe its generic architecture, including the collaborating services that it interacts with.

Next, we delve into the application’s design and explain it in detail.

Once we are familiar with the design and architecture, we move to the code implementation; this last part also produces a template for a big data batch application that we can re-use and adapt to different business needs.

Let’s begin with the architecture.


A possible generic architectural landscape for the batch application is illustrated in the following diagram:

Get hands-on with 1200+ tech skills courses.