擅长:python、mysql、java
<p>它与spark2.1.x兼容,很难在类路径中包括mongodbjava驱动程序以及连接器。编辑<code>spark-defaults.conf</code>,使其包含必要的jar文件:</p>
<pre><code>spark.driver.extraClassPath /opt/mongo-spark-connector_2.11-2.0.0.jar,/opt/mongo-java-driver-3.2.2.jar
spark.executor.extraClassPath /opt/mongo-spark-connector_2.11-2.0.0.jar,/opt/mongo-java-driver-3.2.2.jar
spark.driver.extraLibraryPath /opt/mongo-spark-connector_2.11-2.0.0.jar,/opt/mongo-java-driver-3.2.2.jar
spark.executor.extraLibraryPath /opt/mongo-spark-connector_2.11-2.0.0.jar,/opt/mongo-java-driver-3.2.2.jar
</code></pre>