Skip to content

Latest commit

 

History

History
58 lines (35 loc) · 913 Bytes

README.md

File metadata and controls

58 lines (35 loc) · 913 Bytes

Web Crawler - General info

This is a simple function which that takes a site URL as an argument and creates a mapping of that domain as a Python dictionary.

Technologies:

-Python 3.7

Modules, packages and libraries:

  • requests
  • BeautifulSoup
  • sys

Start-up:

To run this project, install it locally using for example cmd:

pip install bs4

You can run the script in terminal:

python web_crawler.py

Web Crawler - General info

Python Internship Tasks 2. General task was to write a Python function which takes a site URL as an argument and creates a mapping of that domain as a Python dictionary.

Technologies:

-Python 3.7

Modules, packages and libraries:

  • requests
  • BeautifulSoup
  • sys

Start-up:

To run this project, install it locally using for example cmd:

pip install bs4

You can run the script in terminal:

python web_crawler.py