↧
Answer by JimLohse for Spark submit does automatically upload the jar to...
I see you are quoting the spark-submit page from Spark Docs but I would spend a lot more time on the Running Spark on YARN page. Bottom-line, look at:There are two deploy modes that can be used to...
View ArticleAnswer by noorul for Spark submit does automatically upload the jar to cluster?
Try adding --jars option before your /path/to/jar/filespark-submit --jars /tmp/test.jar
View ArticleAnswer by Markon for Spark submit does automatically upload the jar to cluster?
Yes and no. It depends on what you mean. Spark deploys the .jar to the nodes in the cluster. However, it won't upload your .jar file from your local machine to the cluster. You can find more info in...
View ArticleSpark submit does automatically upload the jar to cluster?
I'm trying to submit a Spark app from local machine Terminal to my Cluster.I'm using --master yarn-cluster. I need to run the driver program on my Cluster too, not on the machine I do submit the...
View Article