Quantcast
Channel: Spark submit does automatically upload the jar to cluster? - Stack Overflow
Browsing latest articles
Browse All 4 View Live

Answer by JimLohse for Spark submit does automatically upload the jar to...

I see you are quoting the spark-submit page from Spark Docs but I would spend a lot more time on the Running Spark on YARN page. Bottom-line, look at:There are two deploy modes that can be used to...

View Article


Answer by noorul for Spark submit does automatically upload the jar to cluster?

Try adding --jars option before your /path/to/jar/filespark-submit --jars /tmp/test.jar

View Article


Answer by Markon for Spark submit does automatically upload the jar to cluster?

Yes and no. It depends on what you mean. Spark deploys the .jar to the nodes in the cluster. However, it won't upload your .jar file from your local machine to the cluster. You can find more info in...

View Article

Spark submit does automatically upload the jar to cluster?

I'm trying to submit a Spark app from local machine Terminal to my Cluster.I'm using --master yarn-cluster. I need to run the driver program on my Cluster too, not on the machine I do submit the...

View Article
Browsing latest articles
Browse All 4 View Live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>