Roost is a python-centric library for Twitter data collection and storage. The library provides the necessary tools to connect processes that collect content from Twitter directly to storage systems that hold the data in easy-to-access forms.
The library is based on an internal networkdynamics group utility that is now being made public. To ensure readability and maintainability, the library is being unrolled in several stages.
1. A module, python class, and command-line utility for making calls to the Twitter API
2. A framework for storing and retrieving Twitter data in a MySQL database
3. A command-line tool for collecting Twitter data using the API and storing the data into a MySQL database
4. A module and class connecting to the firehose in various forms
5. A command-line tool for collecting Twitter data from the firehose and storing the data into a MySQL database or flatfile
At present, only the first stage has been completed.
Please email the primary author of the tool, Derek Ruths, with any questions.