spark_cuda

Heterogenous Cluster - use GPU (CUDA) for highly intensive computing.

INIT

Download spark copy it to /opt folder and compile - I'm using scala 2.11 so need to switch spark to proper one:

dev/change-version-to-2.11.sh
mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package

Test if is working: ./bin/spark-shell

....

or

/opt/spark-1.3.0/bin/run-example SparkPi

Build this project

sbt package
sbt eclipse  // for eclipse

Run it

/opt/spark-1.3.0/bin/spark-submit --class "com.yarenty.spark.SimpleApp" --master local[4] target/scala-2.11/spark_cuda_2.11-1.0.0.jar