Open
Description
code
spark-submit \
--master yarn \
--deploy-mode client \
--executor-memory 10G \
--executor-cores 3 \
--driver-memory 5g \
--conf "spark.driver.extraJavaOptions=-javaagent:/data/leo_jie/jvm-profiler-1.0.0.jar=reporter=com.uber.profiling.reporters.InfluxDBOutputReporter,tag=influxdb,configProvider=com.uber.profiling.YamlConfigProvider,configFile=/data/leo_jie/Influxdb.yaml,metricInterval=5000,sampleInterval=5000,ioProfiling=true" \
--files /data/leo_jie/Influxdb.yaml \
--jars /data/leo_jie/jvm-profiler-1.0.0.jar \
/data/leo_jie/spark_test.py
quistion
The spark application won't exit automatically when the application finished!
image
Metadata
Metadata
Assignees
Labels
No labels