Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SLR not scraping #1815

Open
anon55661 opened this issue Aug 1, 2024 · 10 comments
Open

SLR not scraping #1815

anon55661 opened this issue Aug 1, 2024 · 10 comments

Comments

@anon55661
Copy link

None of the SLR websites seem to be scraping. Using version 0.4.28

@pops64
Copy link
Contributor

pops64 commented Aug 3, 2024

SLR has a max connection limit now. Ensure you set the --concurrent_scrapers to four or less

@Holywayyne
Copy link

Where would I find the Concurrent Scrapers setting to change it to four or less?

@anon55661
Copy link
Author

Can we add a new version with concurrent scrapers fixed for SLR please

@Havok456
Copy link

Havok456 commented Aug 6, 2024

i am using the windows version i do not see a setting for this how do i add --concurrent_scrapers to xbvr?

@pops64
Copy link
Contributor

pops64 commented Aug 10, 2024

Can we add a new version with concurrent scrapers fixed for SLR please

@anon55661 It already is fixed. You just have to launch XBVR with the option turned on

i am using the windows version i do not see a setting for this how do i add --concurrent_scrapers to xbvr?

@Havok456 https://github.com/xbapps/xbvr/blob/master/README.md It is a launch option. You have to run XBVR through the CLI for it

@anon55661
Copy link
Author

Still not working with concurrent scrapers set to anything under 4.

@pops64
Copy link
Contributor

pops64 commented Aug 10, 2024

Is this the error your getting? #1779 Then you more than likely can't connect to SLR from your machine running XBVR

crwxaj pushed a commit that referenced this issue Aug 28, 2024
* Fix for SLR Scraper Error

The Head request to check to ensure the image link was good didn't handle error. I have now added a switch that if it error out because of E.G DNS Resolution error it doesn't crash XBVR. Needs more testing has the conditions to cause the error are difficult to reproduce

* Format

* Delete slrstudios.go Woops

* Format placed in the correct dir
@moToroTor
Copy link

@Havok456 https://github.com/xbapps/xbvr/blob/master/README.md It is a launch option. You have to run XBVR through the CLI for it

This option isn't available for the Docker build yet.

@pops64
Copy link
Contributor

pops64 commented Sep 3, 2024

@moToroTor Like I said in #1835

Docker you can use the environmental variable the launch command sets. Append this to other -e switches if present for docker.

https://docs.docker.com/compose/environment-variables/set-environment-variables/
https://docs.docker.com/reference/cli/docker/container/run/#env

Also you shouldn't be messing with docker build. There are images available for amd64 and arm if I remember correctly. I will assume you meant docker run or docker compose

@anon55661
Copy link
Author

Fixed by using a VPN before scraping.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants