Skip to content

Commit

Permalink
fix code
Browse files Browse the repository at this point in the history
  • Loading branch information
rpalloni authored Jun 13, 2022
1 parent dea8340 commit 133375e
Showing 1 changed file with 8 additions and 6 deletions.
14 changes: 8 additions & 6 deletions pyspark/sparkmoviesapp/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,12 +7,14 @@ $ make build


### spark submit
submit jobs to spark with additional commands
$ spark-submit \
--py-files jobs.zip, shared.zip \ # add jobs with zip
--files config.json \ # send config file to cluster
submit jobs to spark with additional commands:
~~~
$ spark-submit
--py-files jobs.zip, shared.zip # add jobs with zip
--files config.json # send config file to cluster
main.py --job job1


~~~
~~~
spark-submit --files config.json main.py --job job1
spark-submit --files config.json main.py --job job2
~~~

0 comments on commit 133375e

Please sign in to comment.