Skip to content

Install Spark

Jump to bottom
Awantik Das edited this page Feb 18, 2019 · 8 revisions

Java Installation

  1. sudo apt-get install software-properties-common
  2. sudo add-apt-repository ppa:webupd8team/java
  3. sudo apt-get update
  4. sudo apt-get install oracle-java8-installer

Download latest version of spark

  1. tar -xvf spark ...

Set Path

  1. vim ~/.bashrc, add the below commands in the bottom of file
  2. export SPARK_HOME=/home/sm/Downloads/spark-2.4.0-bin-hadoop2.7
  3. export PATH=$SPARK_HOME/bin:$PATH

Install Python

  1. sudo apt-get install python
  2. alias python=python3
Clone this wiki locally