With the binaries installation, the conf folder is located in the $SPARK_HOME/conf parent directory, which contains all of the templates related to environment, config parameters, slaves, metrics, logging, scheduler, and Docker. Based on the use case, we can copy to the same location and rename to corresponding names without .template suffix to the filename. Then those would be picked up during our initialization. There are some sets of parameters that can be passed without config during initialization; these need not be set and can be passed as parameters. An example format for spark-defaults.conf is as follows:
spark.master spark://127.0.0.1:7077spark.serializer org.apache.spark.serializer.KryoSerializerspark.driver.memory ...