This repository contains example code and sample data for Anatomy of Data Frame API session. Follow the below steps to clone code and setup your machine.
- Java
- Maven 3
git clone https://github.com/phatak-dev/anatomy_of_spark_dataframe_api
mvn clean install
then run the following command from code directory
java -cp target/spark-dataframe-examples.jar com.madhukaraphatak.spark.dataframe.DataFrameExample local
You can run all the examples from terminal. If you want to run from the IDE, follow the below steps
- IDEA 14
Install scala plugin. Once plugin is loaded you can load it as maven project.
Please pull before coming to the session to get the latest code.