Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

执行抓取任务遭遇配置异常: 'comments' #48

Open
dongdongGit opened this issue Jan 3, 2019 · 0 comments
Open

执行抓取任务遭遇配置异常: 'comments' #48

dongdongGit opened this issue Jan 3, 2019 · 0 comments

Comments

@dongdongGit
Copy link

dongdongGit commented Jan 3, 2019

系统 centos7.5
环境 Python 2.7.5
版本 spider163 2.7.6

spider163 get -s 1311319824 --path /download/music --debug

2019-01-03 15:41:29,520 (DEBUG) cement.core.foundation : laying cement for the 'Spider163' application
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'pre_setup'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'post_setup'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'pre_run'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'post_run'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'pre_argument_parsing'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'post_argument_parsing'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'pre_close'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'post_close'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'signal'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'pre_render'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : defining hook 'post_render'
2019-01-03 15:41:29,520 (DEBUG) cement.core.hook : registering hook 'add_handler_override_options' from cement.core.foundation into hooks['post_setup']
2019-01-03 15:41:29,521 (DEBUG) cement.core.hook : registering hook 'handler_override' from cement.core.foundation into hooks['post_argument_parsing']
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'extension' (IExtension)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'log' (ILog)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'config' (IConfig)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'mail' (IMail)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'plugin' (IPlugin)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'output' (IOutput)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'argument' (IArgument)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'controller' (IController)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : defining handler type 'cache' (ICache)
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : registering handler '<class 'cement.core.extension.CementExtensionHandler'>' into handlers['extension']['cement']
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : registering handler '<class 'spider163.bin.cli.VersionController'>' into handlers['controller']['base']
2019-01-03 15:41:29,521 (DEBUG) cement.core.handler : registering handler '<class 'spider163.bin.cli.DatabaseController'>' into handlers['controller']['database']
2019-01-03 15:41:29,522 (DEBUG) cement.core.handler : registering handler '<class 'spider163.bin.cli.SpiderController'>' into handlers['controller']['spider']
2019-01-03 15:41:29,522 (DEBUG) cement.core.handler : registering handler '<class 'spider163.bin.cli.QueryController'>' into handlers['controller']['query']
2019-01-03 15:41:29,522 (DEBUG) cement.core.handler : registering handler '<class 'spider163.bin.cli.WebController'>' into handlers['controller']['web']
2019-01-03 15:41:29,522 (DEBUG) cement.core.handler : registering handler '<class 'spider163.bin.cli.AuthController'>' into handlers['controller']['auth']
2019-01-03 15:41:29,522 (DEBUG) cement.core.foundation : now setting up the 'Spider163' application
2019-01-03 15:41:29,522 (DEBUG) cement.core.foundation : setting up Spider163.extension handler
2019-01-03 15:41:29,522 (DEBUG) cement.core.extension : loading the 'cement.ext.ext_dummy' framework extension
2019-01-03 15:41:29,523 (DEBUG) cement.core.handler : registering handler '<class 'cement.ext.ext_dummy.DummyOutputHandler'>' into handlers['output']['dummy']
2019-01-03 15:41:29,523 (DEBUG) cement.core.handler : registering handler '<class 'cement.ext.ext_dummy.DummyMailHandler'>' into handlers['mail']['dummy']
2019-01-03 15:41:29,523 (DEBUG) cement.core.extension : loading the 'cement.ext.ext_smtp' framework extension
2019-01-03 15:41:29,526 (DEBUG) cement.core.handler : registering handler '<class 'cement.ext.ext_smtp.SMTPMailHandler'>' into handlers['mail']['smtp']
2019-01-03 15:41:29,526 (DEBUG) cement.core.extension : loading the 'cement.ext.ext_plugin' framework extension
2019-01-03 15:41:29,527 (DEBUG) cement.core.handler : registering handler '<class 'cement.ext.ext_plugin.CementPluginHandler'>' into handlers['plugin']['cement']
2019-01-03 15:41:29,527 (DEBUG) cement.core.extension : loading the 'cement.ext.ext_configparser' framework extension
2019-01-03 15:41:29,528 (DEBUG) cement.core.handler : registering handler '<class 'cement.ext.ext_configparser.ConfigParserConfigHandler'>' into handlers['config']['configparser']
2019-01-03 15:41:29,528 (DEBUG) cement.core.extension : loading the 'cement.ext.ext_logging' framework extension
2019-01-03 15:41:29,528 (DEBUG) cement.core.handler : registering handler '<class 'cement.ext.ext_logging.LoggingLogHandler'>' into handlers['log']['logging']
2019-01-03 15:41:29,528 (DEBUG) cement.core.extension : loading the 'cement.ext.ext_argparse' framework extension
2019-01-03 15:41:29,530 (DEBUG) cement.core.handler : registering handler '<class 'cement.ext.ext_argparse.ArgparseArgumentHandler'>' into handlers['argument']['argparse']
2019-01-03 15:41:29,530 (DEBUG) cement.core.foundation : adding signal handler <function cement_signal_handler at 0x7f233f892140> for signal 15
2019-01-03 15:41:29,530 (DEBUG) cement.core.foundation : adding signal handler <function cement_signal_handler at 0x7f233f892140> for signal 2
2019-01-03 15:41:29,530 (DEBUG) cement.core.foundation : adding signal handler <function cement_signal_handler at 0x7f233f892140> for signal 1
2019-01-03 15:41:29,530 (DEBUG) cement.core.foundation : setting up Spider163.config handler
2019-01-03 15:41:29,530 (DEBUG) cement.core.config : config file '/etc/Spider163/Spider163.conf' does not exist, skipping...
2019-01-03 15:41:29,531 (DEBUG) cement.core.config : config file '/root/.Spider163.conf' does not exist, skipping...
2019-01-03 15:41:29,531 (DEBUG) cement.core.config : config file '/root/.Spider163/config' does not exist, skipping...
2019-01-03 15:41:29,531 (DEBUG) cement.core.foundation : setting up Spider163.mail handler
2019-01-03 15:41:29,531 (DEBUG) cement.core.handler : merging config defaults from '<cement.ext.ext_dummy.DummyMailHandler object at 0x7f2338835a10>' into section 'mail.dummy'
2019-01-03 15:41:29,531 (DEBUG) cement.core.foundation : no cache handler defined, skipping.
2019-01-03 15:41:29,531 (DEBUG) cement.core.foundation : setting up Spider163.log handler
2019-01-03 15:41:29,531 (DEBUG) cement.core.handler : merging config defaults from '<cement.ext.ext_logging.LoggingLogHandler object at 0x7f2338835bd0>' into section 'log.logging'
2019-01-03 15:41:29,532 (DEBUG) cement.ext.ext_logging : logging initialized for 'Spider163' using LoggingLogHandler
2019-01-03 15:41:29,532 (DEBUG) cement.core.foundation : setting up Spider163.plugin handler
2019-01-03 15:41:29,532 (DEBUG) cement.ext.ext_plugin : plugin config dir /etc/Spider163/plugins.d does not exist.
2019-01-03 15:41:29,532 (DEBUG) cement.ext.ext_plugin : plugin config dir /root/.Spider163/plugins.d does not exist.
2019-01-03 15:41:29,532 (DEBUG) cement.core.foundation : setting up Spider163.arg handler
2019-01-03 15:41:29,533 (DEBUG) cement.core.foundation : setting up Spider163.output handler
2019-01-03 15:41:29,533 (DEBUG) cement.core.foundation : setting up application controllers
2019-01-03 15:41:29,534 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.VersionController object at 0x7f2338846310>' into section 'controller.base'
2019-01-03 15:41:29,534 (DEBUG) cement.core.hook : running hook 'post_setup' (<function add_handler_override_options at 0x7f233f892050>) from cement.core.foundation
2019-01-03 15:41:29,534 (DEBUG) cement.core.foundation : running pre_run hook
2019-01-03 15:41:29,534 (DEBUG) cement.core.controller : collecting arguments/commands for <spider163.bin.cli.VersionController object at 0x7f2338846310>
2019-01-03 15:41:29,534 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.WebController object at 0x7f23388463d0>' into section 'controller.web'
2019-01-03 15:41:29,534 (DEBUG) cement.core.controller : collecting arguments/commands for <spider163.bin.cli.WebController object at 0x7f23388463d0>
2019-01-03 15:41:29,534 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.DatabaseController object at 0x7f2338846450>' into section 'controller.database'
2019-01-03 15:41:29,535 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.SpiderController object at 0x7f2338846450>' into section 'controller.spider'
2019-01-03 15:41:29,535 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.AuthController object at 0x7f2338846450>' into section 'controller.auth'
2019-01-03 15:41:29,535 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.VersionController object at 0x7f2338846450>' into section 'controller.base'
2019-01-03 15:41:29,535 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.QueryController object at 0x7f2338846450>' into section 'controller.query'
2019-01-03 15:41:29,535 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.DatabaseController object at 0x7f2338846450>' into section 'controller.database'
2019-01-03 15:41:29,535 (DEBUG) cement.core.controller : collecting arguments/commands for <spider163.bin.cli.DatabaseController object at 0x7f2338846450>
2019-01-03 15:41:29,535 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.WebController object at 0x7f2338846490>' into section 'controller.web'
2019-01-03 15:41:29,535 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.SpiderController object at 0x7f2338846490>' into section 'controller.spider'
2019-01-03 15:41:29,536 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.AuthController object at 0x7f2338846490>' into section 'controller.auth'
2019-01-03 15:41:29,536 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.VersionController object at 0x7f2338846490>' into section 'controller.base'
2019-01-03 15:41:29,536 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.QueryController object at 0x7f2338846490>' into section 'controller.query'
2019-01-03 15:41:29,536 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.SpiderController object at 0x7f2338846490>' into section 'controller.spider'
2019-01-03 15:41:29,536 (DEBUG) cement.core.controller : collecting arguments/commands for <spider163.bin.cli.SpiderController object at 0x7f2338846490>
2019-01-03 15:41:29,536 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.WebController object at 0x7f2338846550>' into section 'controller.web'
2019-01-03 15:41:29,536 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.DatabaseController object at 0x7f2338846550>' into section 'controller.database'
2019-01-03 15:41:29,536 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.AuthController object at 0x7f2338846550>' into section 'controller.auth'
2019-01-03 15:41:29,537 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.VersionController object at 0x7f2338846550>' into section 'controller.base'
2019-01-03 15:41:29,537 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.QueryController object at 0x7f2338846550>' into section 'controller.query'
2019-01-03 15:41:29,537 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.AuthController object at 0x7f2338846550>' into section 'controller.auth'
2019-01-03 15:41:29,537 (DEBUG) cement.core.controller : collecting arguments/commands for <spider163.bin.cli.AuthController object at 0x7f2338846550>
2019-01-03 15:41:29,537 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.WebController object at 0x7f23388465d0>' into section 'controller.web'
2019-01-03 15:41:29,537 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.DatabaseController object at 0x7f23388465d0>' into section 'controller.database'
2019-01-03 15:41:29,537 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.SpiderController object at 0x7f23388465d0>' into section 'controller.spider'
2019-01-03 15:41:29,537 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.VersionController object at 0x7f23388465d0>' into section 'controller.base'
2019-01-03 15:41:29,537 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.QueryController object at 0x7f23388465d0>' into section 'controller.query'
2019-01-03 15:41:29,538 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.QueryController object at 0x7f23388465d0>' into section 'controller.query'
2019-01-03 15:41:29,538 (DEBUG) cement.core.controller : collecting arguments/commands for <spider163.bin.cli.QueryController object at 0x7f23388465d0>
2019-01-03 15:41:29,538 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.WebController object at 0x7f2338846650>' into section 'controller.web'
2019-01-03 15:41:29,538 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.DatabaseController object at 0x7f2338846650>' into section 'controller.database'
2019-01-03 15:41:29,538 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.SpiderController object at 0x7f2338846650>' into section 'controller.spider'
2019-01-03 15:41:29,538 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.AuthController object at 0x7f2338846650>' into section 'controller.auth'
2019-01-03 15:41:29,538 (DEBUG) cement.core.handler : merging config defaults from '<spider163.bin.cli.VersionController object at 0x7f2338846650>' into section 'controller.base'
2019-01-03 15:41:29,540 (DEBUG) cement.core.hook : running hook 'post_argument_parsing' (<function handler_override at 0x7f233f8920c8>) from cement.core.foundation
执行抓取任务遭遇配置异常: 'comments'
2019-01-03 15:41:31,600 (DEBUG) cement.core.foundation : closing the Spider163 application

[2019-01-03 07:49:19.775868] ERROR: : 解析歌曲评论的时候出现问题:'comments' 歌曲ID:1311319824 页码:1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant