Introduction
Explore Apache Spark, the modern big data processing platform that outperforms MapReduce by using in-memory computing and supporting interactive queries. Understand Spark’s architecture, rich APIs, and why it has become the preferred choice for efficient data processing in various use-cases such as iterative algorithms and ad-hoc analysis.
We'll cover the following...
Introduction
Spark, the ubiquitous platform for data processing, and has taken over the traditional MapReduce framework. Some technologists go so far as to declare MapReduce dead. Spark outperforms MapReduce by several orders of magnitude in numerous benchmarks and performance studies. Spark was started as a project in 2009 at University of California Berkeley and a research paper on the findings was published the following year. Later, the researchers created the ...