Introduction to Big Data with Apache Spark

Apache Spark is a big data exploratory and analytical tool where large scale data processing becomes easy. In this module, we’ll explore Apache Spark in detail with a special focus on its architecture, differentiation, and its relation to big data. We’ll follow the lifecycle of a single Spark API, its execution, and some of the resilient distributed datasets. In the end, we’ll work with the projects like Spark Maven and Deep Dive and how to enrich basic DataFrame programs. Get a detailed overview of Spark differentiation and its architecture.

Spark Overview

## The trivial example

Let’s start our Spark journey with a very trivial example.


### Source code

Let’s walk through the code available in the widget below.






# The trivial example

Let’s start our Spark journey with a very trivial example.


## Source code

Let’s walk through the code available in the widget below.






Let’s run our first-ever Java Spark program.


Running the first Spark program

Let’s run our first-ever Java Spark program.

Spark Overview

Getting Started with Spark

Running the First Spark Program

The trivial example

Source code