擅长:python、mysql、java
<p>我找到了一个解决方案,如何正确地将虚拟环境加载到主机和所有从工作机:</p>
<pre><code>virtualenv venv relocatable
cd venv
zip -qr ../venv.zip *
PYSPARK_PYTHON=./SP/bin/python spark-submit master yarn deploy-mode cluster conf spark.yarn.appMasterEnv.PYSPARK_PYTHON=./SP/bin/python driver-memory 4G archives venv.zip#SP filename.py
</code></pre>
<p>有关GitHub问题的更多详细信息:
<a href="https://github.com/maxpumperla/elephas/issues/80#issuecomment-371073492" rel="nofollow noreferrer">https://github.com/maxpumperla/elephas/issues/80#issuecomment-371073492</a></p>