Execution of a Spark Application

Execution of a Spark Application

As discussed earlier, a Spark job is initiated when an action is performed. Internally, the SparkContext object’s runJob(...) method is invoked. The call is passed on the scheduler. The scheduler runs as part of the driver and has two parts:

• DAG Scheduler
• Task Scheduler