To adjust logging level use sc.setLogLevel(newLevel). Using Sparks default log4j profile: org/apache/spark/log4j-defaults.properties Run the following command : ~$ spark-shell ~$ spark-shell To verify the installation, close the Terminal already opened, and open a new Terminal again. Now that we have installed everything required and setup the PATH, we shall verify if Apache Spark has been installed correctly.
Latest Apache Spark is successfully installed in your Ubuntu 16. export JAVA_HOME=/usr/lib/jvm/default-java/jre We shall use nano editor here : $ sudo nano ~/.bashrcĪnd add following lines at the end of ~/.bashrc file. To set JAVA_HOME variable and add /usr/lib/spark/bin folder to PATH, open ~/.bashrc with any of the editor. As a prerequisite, JAVA_HOME variable should also be set. Now we need to set SPARK_HOME environment variable and add it to the PATH. Then we moved the spark named folder to /usr/lib/. In the following terminal commands, we copied the contents of the unzipped spark folder to a folder named spark.
#INSTALL SPARK UBUNTU 14.04 ZIP#
To unzip the download, open a terminal and run the tar command from the location of the zip file. Before setting up Apache Spark in the PC, unzip the file.
0 kommentar(er)
