You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Jun 10, 2024. It is now read-only.
pyspider version: latest version, built the master branch using docker.
Operating system: macOS Catalina
Start up command: docker-compose -f docker-compose.yaml build && docker-compose up
Expected behavior
Either the response should interpret the base tags or, on setting response.url and response.orig_url, proper hrefs are constructed for relative hrefs.
Actual behavior
Proper href URLs are not formed.
How to reproduce
Try to crawl a website with <base href="...."> tag.
The text was updated successfully, but these errors were encountered:
agarwal-nitesh
changed the title
<base href='/relative_path' is not interpreted properly.
<base href='relative_path' is not interpreted properly.
Jan 23, 2022
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Expected behavior
Either the
response
should interpret the base tags or, on settingresponse.url
andresponse.orig_url
, proper hrefs are constructed for relative hrefs.Actual behavior
Proper href URLs are not formed.
How to reproduce
Try to crawl a website with
<base href="....">
tag.The text was updated successfully, but these errors were encountered: