README.md

StarkTechnology

Training materials for Stark Technology, 2015.

訓練教材是針對敦陽科技所設計。

Slides

• Hadoop (HDFS, AWS)
• Introduction to Spark

Objectives

• Demo for Hadoop Cluster setup (AWS)
• Review for Hadoop & HDFS
• Introduction to Spark
• Hadoop vs. Spark
• Spark Installation
• Resilient distributed dataset (RDD)
• Tips

Language

• Scala
• Python
• Linux

Environment

• Virtual Box
• Cloudera Quick Start VM 5.4
• Spark 1.4.1
• Spark 1.3.0
• Python 2.6.6

Reference

• Spark programming guide
• Databricks Spark Knowledge Base