Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filter dead links #3

Open
nandi95 opened this issue Jan 13, 2021 · 3 comments
Open

Filter dead links #3

nandi95 opened this issue Jan 13, 2021 · 3 comments

Comments

@nandi95
Copy link

nandi95 commented Jan 13, 2021

It would be nice if there was a method devised that automatically removes dead links...

example link: https://github.com/aquadzn/learn-x-by-doing-y/blob/main/projects.csv#L125 returns the status code 410

Perhaps an action ran every (day/week) and remove lines from the csv file if a request to the endpoint fails?

@Tau5
Copy link

Tau5 commented Jan 13, 2021

Maybe it would be better to include a link to the latest internet archive snapshot as most of the links are mosly text-only

@aquadzn
Copy link
Owner

aquadzn commented Jan 13, 2021

It would be nice if there was a method devised that automatically removes dead links...

example link: https://github.com/aquadzn/learn-x-by-doing-y/blob/main/projects.csv#L125 returns the status code 410

Perhaps an action ran every (day/week) and remove lines from the csv file if a request to the endpoint fails?

https://medium.com/we-are-orb/linear-regression-in-python-without-scikit-learn-50aef4b8d122 is working for me personally

I will try to add a script that checks the response code of the different links.

@nandi95
Copy link
Author

nandi95 commented Jan 13, 2021

Maybe it would be better to include a link to the latest internet archive snapshot as most of the links are mosly text-only

Indeed, so it could be if the link's dead try the archive, if not just remove.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants