The Repository contains different Web crawlers built using Python

1.) Travel Agency Crawler : url:http://www.india.com/travel/articles/10-of-the-best-travel-agencies-in-india-that-will-make-trip-planning-a-cake-walk-for-you/ This Crawler picks the title and links of the Top 10 Travel agencies.Also picks their brochure links if present. 2.) Spoj Problem Crawler : This Crawler crawls through selected Spoj pages and finds Titles and links to all Spoj Problems sorted according to the number of users who solved the problem (in Descending order)