Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Current page scraping #65

Open
ramiwi opened this issue Apr 8, 2021 · 4 comments
Open

Current page scraping #65

ramiwi opened this issue Apr 8, 2021 · 4 comments

Comments

@ramiwi
Copy link

ramiwi commented Apr 8, 2021

Allow instant scraping of the currently open page without creating a "Start URL" project.

@a1sabau
Copy link
Member

a1sabau commented Apr 9, 2021

This idea has the potential to make one page scraping a LOT easier but .. how do you define the plugin options to be used ? Maybe use the configuration of an already saved project ?

@ramiwi
Copy link
Author

ramiwi commented Apr 9, 2021

Maybe by adding an option to choose current page or a url pattern instead of "start url" for crawling in the scraper definition step when creating a project.
"Instant Data Scraper" and "Data Miner" chrome extensions opens a popup above the current page.

@a1sabau
Copy link
Member

a1sabau commented Apr 11, 2021

I'll add a checkbox option to have the "start url" dynamic, populated from current page url when creating a new project. All such projects will be available from a dropdown when clicking the extension icon. Scraped pages, regardless of domain, will be added to the same project.

Expect 2-3 weeks till I release a new extension version.

@a1sabau
Copy link
Member

a1sabau commented Sep 29, 2021

Those 2-3 weeks have turned in months... I'll definitely release a new version (this feature included) version sometime this fall.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants