New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

作者，来源网站有点少啊，而且没有https的代理存活 #3

Open

roiding opened this issue Sep 27, 2024 · 1 comment

roiding commented Sep 27, 2024

你看是你自己加个spider函数，还是我pull了帮你加？
听别人说站大爷的有效性不错，现在没有https的资源，不太好用啊。
主要我帮你加的话，目前手头没空闲的机子来测试代码

Owner

Sage520 commented Nov 27, 2024

你看是你自己加个spider函数，还是我pull了帮你加？听别人说站大爷的有效性不错，现在没有https的资源，不太好用啊。主要我帮你加的话，目前手头没空闲的机子来测试代码

符合正则提取的直接改config.py common加一个地址，复杂自定义逻辑就得自己加一个函数然后配置cron，都在config.py里，至于https的最近考虑重新改一下，因为有歧义，支持https代理连接跟可以访问https网站是两回事，市面上容易搞混

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment