Cricsheet-ingest 🏏

This code will download ODI data from the website, pre-process it using spark and finally transfer to MySQL DB for analysis

Requirements

MySQL, Java & Python should’ve been installed. I cannot provide code for that since the process is different for different OS

JAVA_HOME variable should be set

Ubuntu - then write the following on terminal

JAVA_HOME=$(readlink -f $(which java) | sed -E 's/\/b.*//')
echo "export JAVA_HOME=${JAVA_HOME} >> ~/.bashrc"

Before running ensure that the MYSQL_PASSWORD variable is set to your root password in the .env file.

Open the folder on the terminal and run the following

pip install -r requirements.txt  && python main.py