Robots.txt for websites around the world.
This is to be used for educational purposes and Security Researchers and Bug Bounty Programs.
Only add sitemaps that are reasonable in size.
Any contributions you make are greatly appreciated.
- Fork the Project
- Commit your Changes
- Push to the Branch
- Open a Pull Request