Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

crawl website and privacy policy URLs from playstore #131

Open
RDBinns opened this issue Jan 17, 2018 · 1 comment
Open

crawl website and privacy policy URLs from playstore #131

RDBinns opened this issue Jan 17, 2018 · 1 comment

Comments

@RDBinns
Copy link
Contributor

RDBinns commented Jan 17, 2018

Would be good to grab the website and privacy policy URLs in addition to the store_url. At the moment we only have the playstore URL, so if we want to grab the app's privacy policy or website we have to crawl the playstore page again
@RDBinns
Copy link
Contributor Author

RDBinns commented Jan 17, 2018

Ah, just noticed that the google-play-scraper node.js module we're using doesn't actually do that. so we could either change that module (no thanks) or write another scraper specifically to grab website and privacy policy urls. these should probably be either added to the playstore_apps table or a new table.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@RDBinns