The "Hello World" of MapReduce, implemented in Scala using Apache Spark.
-
Install Scala 2.10:
wget http://www.scala-lang.org/files/archive/scala-2.10.4.deb sudo dpkg -i scala-2.10.4.deb
-
Install sbt (tested with v0.13.5):
wget http://dl.bintray.com/sbt/debian/sbt-0.13.5.deb sudo dpkg -i sbt-0.13.5.deb
-
wget http://d3kbcqa49mib13.cloudfront.net/spark-1.0.0-bin-hadoop2.tgz tar -xzf spark-1.0.0-bin-hadoop2.tgz cd spark-1.0.0-bin-hadoop2 export SPARK_HOME=$(pwd) export PATH="$PATH $SPARK_HOME/bin"
cd /path/to/project
sbt package
spark-submit --class "App" target/app-1.0.jar