New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spark相比较于hadoop的优势 #1

Open

FS1360472174 opened this issue Feb 14, 2017 · 1 comment

Owner

FS1360472174 commented Feb 14, 2017

No description provided.

Owner Author

FS1360472174 commented Feb 15, 2017

hadoop劣势
https://academy.datastax.com/resources/getting-started-apache-spark-and-cassandra?unit=getting-started-apache-spark-and-cassandra

所有内容都写到磁盘中，包括一些中间过渡的步骤
很多情况下，需要一系列工作分析，让#1变得更糟糕
写MapReduce code很痛苦，因为API很基础，很难去测试。
有些工具像Cascading,Pig,Hive等，但这更加证明hadoop的核心API更加基础。
需要大量的去完成最简单的任务

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment