data science: data analysis boot camp starting hadoop on linuxccartled/teaching/2020... · intro....

Data Science: Data Analysis Boot CampStarting Hadoop on Linux

Chuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhDChuck Cartledge, PhD

7 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 20207 February 2020

1/19

2/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Table of contents (1 of 1)

1 Intro.

2 Accessing LinuxStep-by-step

3 One time command

4 Everytime commands

Start and stop.5 Sometime commands

3/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

What are we going to cover?

Hadoop provides the map-reduceinfrastructure used by selected R scriptsin this boot camp. We will showcommands that:

1 Are executed once,

2 Must be executed everytime, and

3 Should be executed everytime.

4/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Step-by-step

Finding the Linux VM

Locate the hadoop shortcut onthe desktop

Find and start the LinuxVMware.

5/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Step-by-step

Same image.

Find and start the Linux VMware.

6/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Step-by-step

Starting the Linux VM

1 Locate the Hadoop label onthe left bar

2 Press the run button on thetop

3 Accept the various defaultwarnings and settings

Find and start the Linux VM.

7/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Step-by-step

Same image.

Find and start the Linux VM.

8/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Step-by-step

Log into the Linux/Ubuntu software

Login name is:ODUBootcamp

Password is: ODUBootcam

You will need the password manytimes.

9/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Step-by-step

Same image.

You will need the password many times.

10/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Step-by-step

Bring up a command/terminal window

Double click the terminal icon.

You have now accessed the LinuxVM and brought up a terminal

window.

11/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Step-by-step

Same image.

You have now accessed the Linux VM and brought up a terminalwindow.

12/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Format the Hadoop namenodes

In a terminal window; type thiscommand:/usr/local/hadoop/bin/hdfs

namenode -format

and press the Enter key.

This will generate lots of outputyou can ignore.

13/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Same image.

This will generate lots of output you can ignore.

14/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Start and stop.

Start the Hadoop applications

In a terminal window; type thiscommand:/usr/local/hadoop/sbin/start-all.sh

and press the Enter key.

You will be asked for theODUBootcamp password 4

times.

15/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Start and stop.

Same image.

You will be asked for the ODUBootcamp password 4 times.

16/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Start and stop.

Stop the Linux/Ubuntu software.

Locate and press the gear buttonin the upper left corner.

Press the “ShutDown. . . ”option, then the “Shut Down”

button.

17/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Start and stop.

Same image.

Press the “ShutDown. . . ” option, then the “Shut Down” button.

18/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Stop the Hadoop applications

In a terminal window; type thiscommand:/usr/local/hadoop/sbin/stop-all.sh

and press the Enter key.You will be asked for theODUBootcamp password 4times.

You should stop the Hadoopapplications in a controlled

manner.

19/19

Intro. Accessing Linux One time command Everytime commands Sometime commands

Same image.

You should stop the Hadoop applications in a controlled manner.