部署Scrapy时发生ValueError

2024-10-04 05:30:54 发布

您现在位置:Python中文网/ 问答频道 /正文

我正试图用scrapyd-deploy命令部署Scrapy,现在它抛出下一个错误:

    Packing version 1526919848
    Deploying to project "first_scrapy" in http://my_ip:6800/addversion.json
    Server response (200):
    {"node_name": "polo", "message": "Traceback (most recent call last):\n  File \"/usr/lib/python3.5/logging/config.py\", line 558, in configure\n    handler = self.configure_handler(handlers[name])\n
      File \"/usr/lib/python3.5/logging/config.py\", line 731, in configure_handler\n    result = factory(**kwargs)\n  File \"/usr/lib/python3.5/logging/__init__.py\", line 1008, in __init__\n    StreamHandler.__init__(self, self._open())\n
      File \"/usr/lib/python3.5/logging/__init__.py\", line 1037, in _open\n    return open(self.baseFilename, self.mode, encoding=self.encoding)\nNotADirectoryError: [Errno 20] Not a directory: '/tmp/first_scrapy-1526919848-13w8cqlm.egg/debug.log'\n\nDuring handling of the above exception, another exception occurred:\n\n
    Traceback (most recent call last):\n  File \"/usr/lib/python3.5/runpy.py\", line 184, in _run_module_as_main\n    \"__main__\", mod_spec)\n  File \"/usr/lib/python3.5/runpy.py\", line 85, in _run_code\n    exec(code, run_globals)\n
      File \"/home/chiefir/lib/python3.5/site-packages/scrapyd/runner.py\", line 40, in <module>\n    main()\n  File \"/home/chiefir/lib/python3.5/site-packages/scrapyd/runner.py\", line 37, in main\n    execute()\n  File \"/home/chiefir/lib/python3.5/site-packages/scrapy/cmdline.py\", line 109, in execute\n    settings = get_project_settings()\n
      File \"/home/chiefir/lib/python3.5/site-packages/scrapy/utils/project.py\", line 68, in get_project_settings\n    settings.setmodule(settings_module_path, priority='project')\n  File \"/home/chiefir/lib/python3.5/site-packages/scrapy/settings/__init__.py\", line 292, in setmodule\n    module = import_module(module)\n
      File \"/home/chiefir/lib/python3.5/importlib/__init__.py\", line 126, in import_module\n    return _bootstrap._gcd_import(name[level:], package, level)\n
      File \"<frozen importlib._bootstrap>\", line 986, in _gcd_import\n
  File \"<frozen importlib._bootstrap>\", line 969, in _find_and_load\n
  File \"<frozen importlib._bootstrap>\", line 958, in _find_and_load_unlocked\n
  File \"<frozen importlib._bootstrap>\", line 664, in _load_unlocked\n
  File \"<frozen importlib._bootstrap>\", line 634, in _load_backward_compatible\n
      File \"/tmp/first_scrapy-1526919848-13w8cqlm.egg/first_scrapy/settings.py\", line 25, in <module>\n  File \"/home/chiefir/lib/python3.5/site-packages/django/__init__.py\", line 22, in setup\n    configure_logging(settings.LOGGING_CONFIG, settings.LOGGING)\n
      File \"/home/chiefir/lib/python3.5/site-packages/django/utils/log.py\", line 75, in configure_logging\n    logging_config_func(logging_settings)\n  File \"/usr/lib/python3.5/logging/config.py\", line 795, in dictConfig\n    dictConfigClass(config).configure()\n
      File \"/usr/lib/python3.5/logging/config.py\", line 566, in configure\n    '%r: %s' % (name, e))\n

    ValueError: Unable to configure handler 'file': [Errno 20] Not a directory: '/tmp/first_scrapy-1526919848-13w8cqlm.egg/debug.log'\n", 

    "status": "error"}

第24行和第25行_刮擦设置它们是:

import django
django.setup()

这里是my_project.settings.LOGGING

LOGGING = {
    'version': 1,
    'disable_existing_loggers': False,
    'handlers': {
        'file': {
            'level': 'WARNING',
            'class': 'logging.FileHandler',
            'filename': os.path.join(BASE_DIR, 'debug.log'),
        },
        'mail_admins': {
              'level': 'ERROR',
              'class': 'django.utils.log.AdminEmailHandler'
        },
    },
    'loggers': {
        'django': {
            'handlers': ['file'],
            'level': 'WARNING',
            'propagate': True,
        },
    },
}

BASE_DIR = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))

当我没有意识到settings.LOGGING中有什么不对劲的地方,但我不能得到什么。你能帮助我吗?
这不是重复的。这是一个类似的问题,但我有不同的错误原因-我没有创建。我已经检查了问题上显示的所有内容-它在本地服务器上工作。你知道吗


Tags: inpyhomesettingsinitconfigurelibusr
1条回答
网友
1楼 · 发布于 2024-10-04 05:30:54

由于BASE_DIR是从scrapy方面声明和使用的,因此您在设置文件中设置的所有内容都以以下形式:

os.path.dirname(os.path.dirname(os.path.abspath(__file__)))

将引用scrapy工作的路径,在错误中显示为:

/tmp/first_scrapy-1526919848-13w8cqlm.egg

因此,最好在设置文件中定义您自己的LOG_DIR,而不是使用当前路径,在您可以使用的已知文件夹中:

LOG_DIR = '/path/to/logs/'

'filename': os.path.join(LOG_DIR, 'debug.log')

或者,在项目的其他文件(可能是django)中设置一个环境变量,以便从设置文件中轻松获取:

任何其他.py文件:

import os
os.environ['LOG_DIR'] = '/path/to/log/'

settings.py文件中:

LOG_DIR=os.environ['LOG_DIR']

'filename': os.path.join(LOG_DIR, 'debug.log')

也可以使用相对路径登录到/tmp,如下所示:

'filename': os.path.join(BASE_DIR, '..', 'debug.log')

相关问题 更多 >