How to configure ports for network security on spark

Spark cluster and its services are not deployed on the public Internet, rather they are private services that should only be accessible within the company deploying Spark. Access to hosts and ports used by Spark should be limited to origin hosts that need to access the services.

Standalone mode only

The user provides key stores and configuration options for master and workers. They can also allow the executors to use SSL settings as set in the worker process.

The following table describes how to configure the primary ports for standalone mode.

All cluster managers

The following table shows how to configure settings for all the cluster managers.