Skip to content

Latest commit

 

History

History
44 lines (26 loc) · 1.3 KB

README.md

File metadata and controls

44 lines (26 loc) · 1.3 KB

souppyer

Purpose

This app was built to develop my skills as a Python developer. At its core, this is a web scraper.

Installation

Built with Python3

  1. Fork and clone
  2. cd souppyer
  3. Follow the virtualenv steps here
  4. pip install -r requirements.txt
  5. mkdir data
  6. Open app.py and comment out the lines where instructed to
  7. python app.py
  8. Check out what you scraped data/data.txt

Issues

403 Forbidden

SSL: CERTIFICATE_VERIFY_FAILED

Tools

Beautiful Soup

virtualenv

Resources

20+ Web Scraping Examples

Automate the Boring Stuff

How to Work with virtualenv

Introduction to Web Scraping (with Python and Beautiful Soup)

License

MIT License