我对使用Spark进行大数据应用还是个新手。出于某种原因,pyspark似乎没有连接到java?在
from pyspark import SQLContext sqlContext = SQLContext(sc) ERROR:py4j.java_gateway:An error occurred while trying to connect to the Java server (127.0.0.1:50383) Traceback (most recent call last): File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\py4j\java_gateway.py", line 929, in _get_connection connection = self.deque.pop() IndexError: pop from an empty deque
在处理上述异常时,发生了另一个异常:
Traceback (most recent call last):
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\py4j\java_gateway.py", line 1067, in start
self.socket.connect((self.address, self.port))
ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it
Traceback (most recent call last):
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\py4j\java_gateway.py", line 929, in _get_connection
connection = self.deque.pop()
IndexError: pop from an empty deque
在处理上述异常时,发生了另一个异常:
^{pr2}$在处理上述异常时,发生了另一个异常:
Traceback (most recent call last):
File "<pyshell#15>", line 1, in <module>
sqlContext = SQLContext(sc)
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pyspark\sql\context.py", line 77, in __init__
sparkSession = SparkSession.builder.getOrCreate()
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pyspark\sql\session.py", line 170, in getOrCreate
sparkConf = SparkConf()
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pyspark\conf.py", line 116, in __init__
self._jconf = _jvm.SparkConf(loadDefaults)
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\py4j\java_gateway.py", line 1649, in __getattr__
"\n" + proto.END_COMMAND_PART)
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\py4j\java_gateway.py", line 983, in send_command
connection = self._get_connection()
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\py4j\java_gateway.py", line 931, in _get_connection
connection = self._create_connection()
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\py4j\java_gateway.py", line 937, in _create_connection
connection.start()
File "C:\Users\CHESTER\AppData\Local\Programs\Python\Python37-32\lib\site-packages\py4j\java_gateway.py", line 1079, in start
raise Py4JNetworkError(msg, e)
py4j.protocol.Py4JNetworkError: An error occurred while trying to connect to the Java server (127.0.0.1:50383)
目前没有回答
相关问题 更多 >
编程相关推荐