擅长:python、mysql、java
<p>将元素添加到--py文件时,使用逗号分隔元素,而不留任何空格。试试这个:</p>
<pre><code>confLocation=../conf/my_config_file.conf &&
executors=8 &&
memory=2G &&
entry_function=my_function_in_python &&
dos2unix $confLocation &&
spark-submit \
--master yarn-client \
--num-executors $executors \
--executor-memory $memory \
--py-files /home/full/path/to/file/python/my_python_file.py,$entry_function,$confLocation
</code></pre>