用K实现Spark直接流媒体

Question

我正在尝试为卡夫卡实现Spark DirectStream下面是代码

    con = SparkConf().setMaster("local[2]").setAppName("Streamer")
sc = SparkContext(conf=con)
ssc = StreamingContext(sc, 10)
ssc.checkpoint("checkpoint")
#consumer(ssc)
kstream = KafkaUtils.createDirectStream(ssc, kafkaParams = {"bootstrap_servers": 'localhost:9092'},topics = ['twitter'])
tweets = kstream.map(lambda line: line.decode('ascii'))
text = tweets.map(lambda line: line.split(','))
print text.collect()

当我运行它时，我得到以下错误。怎么了？在

^{pr2}$

Answer 1

你确定它是bootstrap_servers？我想应该是bootstrap.servers

kstream = KafkaUtils.createDirectStream(ssc, ['twitter'], {"bootstrap.servers": 'localhost:9092'})

您可以查看here了解更多详细信息。确保转到python选项卡。在