Real-time Financial Market Data Pipeline

Getting Started

1. Clone the repository:

   git clone https://github.com/HaTranThai/Real-time-financial-data-pipeline.git

2. Navigate to the project directory:

   cd Real-time-financial-data-pipeline

3. Run Docker Compose to spin up the services:

   docker-compose up -d

4. Run the spark_stream.py file to get data from kafka and put that data into cassandra:

   python spark_stream.py

5. Run the file sma.py:

   python sma.py

Visualization with Grafana