cis 612 lab4 2 spark hdfs installation 2020
TRANSCRIPT
![Page 1: CIS 612 Lab4 2 Spark HDFS Installation 2020](https://reader036.vdocuments.mx/reader036/viewer/2022062301/62a5a6abb14ca211b87a8b2d/html5/thumbnails/1.jpg)
Set Up Guide of Spark on HDFS
CIS612 Big Data and Parallel Database Processing Systems
Downloaded and installed Spark successfully on ubuntu and create collection on Spark RDD with JSON Files
move the extracted directory to /opt:
![Page 2: CIS 612 Lab4 2 Spark HDFS Installation 2020](https://reader036.vdocuments.mx/reader036/viewer/2022062301/62a5a6abb14ca211b87a8b2d/html5/thumbnails/2.jpg)
Configure the Environment
![Page 3: CIS 612 Lab4 2 Spark HDFS Installation 2020](https://reader036.vdocuments.mx/reader036/viewer/2022062301/62a5a6abb14ca211b87a8b2d/html5/thumbnails/3.jpg)
![Page 4: CIS 612 Lab4 2 Spark HDFS Installation 2020](https://reader036.vdocuments.mx/reader036/viewer/2022062301/62a5a6abb14ca211b87a8b2d/html5/thumbnails/4.jpg)
![Page 5: CIS 612 Lab4 2 Spark HDFS Installation 2020](https://reader036.vdocuments.mx/reader036/viewer/2022062301/62a5a6abb14ca211b87a8b2d/html5/thumbnails/5.jpg)
![Page 6: CIS 612 Lab4 2 Spark HDFS Installation 2020](https://reader036.vdocuments.mx/reader036/viewer/2022062301/62a5a6abb14ca211b87a8b2d/html5/thumbnails/6.jpg)
Reference:
https://www.edureka.co/blog/apache-hive-installation-on-ubuntu/comment-page-2/#comments
https://bigdataprogrammers.com/load-csv-file-in-hive/
https://www.liquidweb.com/kb/how-to-install-apache-spark-on-ubuntu/