Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

extracting text in hidden div blocks #157

Open
udgithub opened this issue Mar 8, 2024 · 0 comments
Open

extracting text in hidden div blocks #157

udgithub opened this issue Mar 8, 2024 · 0 comments

Comments

@udgithub
Copy link

udgithub commented Mar 8, 2024

Hello !

I like your gpt-crawler, but sometimes it does not return all text within a page.
E.g. on the FAQ page of our computing center
users find all questions but our CMS hides the answers by using style information like this:
style="height: 0px; overflow: hidden; display: none;"
Unfortunately your crawler does not return the answers.
Is it possible or configurable to make your crawler return also hidden text?

Thanks a lot in advance for your help and time.

Best regards, Uwe

@udgithub udgithub changed the title extracting also text in hidden div blocks extracting text in hidden div blocks Mar 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant