Skip to content

v3.2.1

Compare
Choose a tag to compare
@andykais andykais released this 05 Mar 03:36
· 188 commits to master since this release

Breaking change

  • config has changed significantly to separate scraper definitions from the download flow. See readme.
  • separate reusable options from one-offs so scrape now has three parameters: config, options and params.
  • scraper is invoked differently. scrape(config, options, params) yields a query and start, where start triggers the scraper and folder creation. (#15)

Enhancements/fixes

  • add limit field on parse scraper configs (#9)
  • validate scraper names & input keys (#10)
  • add log file rotation
  • travis ci now supports tests on macos, windows coming soon!