无法使用streamParse提交拓扑“thriftpy.thrift.TApplicationException应用程序异常：内部错误处理beginFileUpload“

Question

我试图提交一个拓扑到一个远程ubuntu机器使用

sparse submit命令

得到以下错误

  File "...../bin/sparse", line 11, in <module>
    load_entry_point('streamparse==4.0.0', 'console_scripts', 'sparse')()
  File ".../lib/python3.6/site-packages/streamparse-4.0.0-py3.6.egg/streamparse/cli/sparse.py", line 85, in main
    args.func(args)
  File "../lib/python3.6/site-packages/streamparse-4.0.0-py3.6.egg/streamparse/cli/submit.py", line 391, in main
    active=args.active,
  File "../lib/python3.6/site-packages/streamparse-4.0.0-py3.6.egg/streamparse/cli/submit.py", line 295, in submit_topology
    remote_jar_path = _upload_jar(nimbus_client, local_jar_path)
  File "../lib/python3.6/site-packages/streamparse-4.0.0-py3.6.egg/streamparse/cli/submit.py", line 158, in _upload_jar
    upload_location = nimbus_client.beginFileUpload()
  File "../lib/python3.6/site-packages/thriftpy-0.3.9-py3.6-macosx-10.9-x86_64.egg/thriftpy/thrift.py", line 198, in _req
    return self._recv(_api)
  File "../lib/python3.6/site-packages/thriftpy-0.3.9-py3.6-macosx-10.9-x86_64.egg/thriftpy/thrift.py", line 215, in _recv
    raise x
thriftpy.thrift.TApplicationException: Internal error processing beginFileUpload

我还尝试让root访问安装在远程机器中的storm

这是我的配置

{
    "serializer": "json",
    "topology_specs": "topologies/",
    "virtualenv_specs": "virtualenvs/",
    "envs": {
        "prod": {
            "user": "abc",
            "ssh_password": "abc",
            "nimbus": "ip.ip.ip.ip",
            "workers": ["ip.ip.ip.ip"],
            "log": {
                "path": "",
                "max_bytes": 1000000,
                "backup_count": 10,
                "level": "debug"
            },
            "options": {
                "virtualenv_flags": "-p /usr/bin/python3.6",
                "supervisor.worker.timeout.secs" : 1800

            },
            "virtualenv_root": "/home/abc/virtualenvs",
            "use_ssh_for_nimbus": true

            }
        }
}

Answer 1

这里的问题是，拓扑提交到的ip是一个非领导主管。storm只接受Leader Supervisor节点上的拓扑提交