Configure Authentication for Spark on YARN

When authentication is enabled, authentication keys are randomly generated for each job.

Complete the following step to manually configure authentication:
Configure the following property in the spark-defaults.conf file on each spark node:
spark.authenticate true

The spark-defaults.conf file is in the following location: /opt/mapr/spark/spark-<version>/conf/