Search⌘ K
AI Features
Home
Courses
An Introduction to Spark

Higher-Order Function

Explore how to use Spark SQL higher-order functions like split, explode, transform, and collect_list on complex data types. Understand manipulating arrays and nested data to write effective queries on structured big data.

We'll cover the following...

So far, we have seen simple examples of user and built in functions, but Spark also offers functions that can work on more complex types. Let’s work through an example that’ll require ...