Scrapyd Dashboard

A dashboard specifically used for scrapyd servers to manipulate scrapy spiders (start, stop, check status).

Features

• Scrapyd server status
• Tasks (add, remove, list)
• Authentification (Using the Django authentication system)
• Scheduled tasks (add, remove, list)
• View logs
• Multiple independent user support
• Task performance details

Demo

Demo website

Username: demo

Password: demo

Installing

1. Install the package

pip install scrapyd_dash

2. Add urls to your projects urls.py

from django.urls import include

urlpatterns = [
    ...
    path('scrapyd_dash/', include('scrapyd_dash.urls')),
]

Built With

• Django - The web framework used.
• ScrapyD - A service daemon to run Scrapy spiders.
• LogParser - A tool for parsing Scrapy log files.

Authors

• Dainius Preimantas - Initial work - Dainius-P

Contributing

1. Fork it
2. Create your feature branch (git checkout -b feature/fooBar)
3. Commit your changes (git commit -am 'Add some fooBar')
4. Push to the branch (git push origin feature/fooBar)
5. Create a new Pull Request

License

This project is licensed under the MIT License - see the LICENSE file for details.