This is a simple function which that takes a site URL as an argument and creates a mapping of that domain as a Python dictionary.
-Python 3.7
- requests
- BeautifulSoup
- sys
To run this project, install it locally using for example cmd:
pip install bs4
You can run the script in terminal:
python web_crawler.py
Python Internship Tasks 2. General task was to write a Python function which takes a site URL as an argument and creates a mapping of that domain as a Python dictionary.
-Python 3.7
- requests
- BeautifulSoup
- sys
To run this project, install it locally using for example cmd:
pip install bs4
You can run the script in terminal:
python web_crawler.py