Trusted answers to developer questions
Trusted Answers to Developer Questions

Related Tags

spark

Local storage encryption in Spark 3

Educative Answers Team
svg viewer

Spark ensures encryption for RPC Connections and it allows users to encrypt data they are storing on local drive (includes shuffle files, shuffle spills, and data blocks).

Note: Spark does not support the encryption of data generated by applications with APIs, such as “saveAsHadoopFile”, or temporary files created by the user.

The following table summarizes how to enable encryption for data that is written to script:

svg viewer

RELATED TAGS

spark
Copyright ©2022 Educative, Inc. All rights reserved
RELATED COURSES

View all Courses

Keep Exploring