This app pulls data from RSS feeds, performs sentiment analysis on the data, and stores it in Deephaven for further analysis.
start.sh- A helper script to launch the application.docker-compose.yml- The Docker compose file that defines the Deephaven images.Dockerfile- The Dockerfile for the application. Simply extends Deephaven's base image with dependencies and app-mode scripts.requirements.txt- The Python dependencies for the app.
read_rss.py- Python script that defines the base method for the RSS reader.helper_functions.py- Python script that defines common helper functions for the RSS readers.read_rss_default_analysis.py- An RSS reader that uses NLKT's default sentiment analysis.read_rss_custom_analysis.py- An RSS reader that uses a user-defined sentiment analysis.app.app- The Deephaven App Mode config file
queries.py- Queries to run in Deephaven for extra analysis on the data.
This app pulls RSS data from the specified RSS feeds using Python's feedparser package. Custom methods to extract values from the RSS feed to analyze, and to extract the date-time value from the RSS feed, need to be written specifically for the RSS feed.
When data is pulled, sentiment analysis is performed on attributes of the RSS data and stored in a Deephaven table. Deephaven table operations are then used to further analyze the data.
This app shows two examples of sentiment analysis, one using the default analyzer from NLTK, and one using an analyzer trained from NLTK's built in data. The feed and attributes to analyze are customizable, so feel free to use this app to look at any RSS feed!
The code in this repository is built for Deephaven Community Core v0.12.0. No guarantee of forwards or backwards compatibility is given.