Download - 02 install cluster using npaci rocks
![Page 1: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/1.jpg)
Installations.Installations.
![Page 2: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/2.jpg)
2
Introduction to NPACI Rocks
• NPACI Rocks Cluster Distribution• Project by
– National Partnership for Advance Computational Infrastructure (NPACI)
– San Diego Supercomputer Center (SDSC)• http://rocks.npaci.edu/or• http://www.rocksclusters.org/• Latest release version is 4.0.0
![Page 3: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/3.jpg)
3
NPACI Rocks Cluster Distribution
• Goal: make clusters easy. • Uses an SQL database to store the
definitions of these global configurations• Supported Hardware
– Processors• x86 (ia32, AMD, etc.) • IA-64 (Itanium, McKinley, etc.)• x86_64 (AMD Opteron)
• Rocks base on CentOS 4.0 (RHEL 4.0)
![Page 4: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/4.jpg)
4
Physical Assembly• Frontend
– Nodes of this type are exposed to the outside world.
– Many services (NFS, NIS, DHCP, NTP, MySQL, HTTP, ...) run on these nodes.
• Compute – These are the workhorse nodes.
• Ethernet Network – All compute nodes are connected with ethernet
on the private network.
The every machine in cluster called “node”
![Page 5: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/5.jpg)
5
The Rocks cluster architecture
Strictly
![Page 6: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/6.jpg)
6
The Rocks & Rolls
• The Rocks & Rolls Contained : – Boot Roll 1 Disc. (Required)
– OS Roll 4 Disc (Required Disc 1,2)
area51 base ganglia grid hpc java kernel myrinet os sge vizjumbo
area51 base ganglia hpc java kernel vizviz
area51 base ganglia grid hpc java kernel sgegrid
area51 base ganglia hpc java kernel sge [recommended]compute
base hpc kernelbare bones
![Page 7: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/7.jpg)
7
The Rocks & Rolls (cont’d)
• Rocks Base – The linux system and standard cluster tools.
• HPC Roll– High Performance Computing – Contained more library for high performance
computing such as MPI (Message Passing Interface) library for parallel programming.
![Page 8: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/8.jpg)
8
The Rocks & Rolls (cont’d)
• SGE (Sun Grid Engine)– SGE is a distributed resource management
software• Grid Roll
– uses the NSF Middleware Initiative (NMI) Release 3.1 to provide Globus connectivity
![Page 9: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/9.jpg)
9
The Rocks & Rolls (cont’d)
• Intel Roll – install and configure the Intel C compiler
(version 8.0) and – the Intel Fortran compiler (version 8.0) for x86
or IA-64 machines. • The PBS Roll
– installs and configures the Open Portable Batch System scheduler.
![Page 10: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/10.jpg)
10
Minimum Hardware Requirements
• Frontend Node– Disk Capacity: 16 GB – Memory Capacity: 512 MB – Ethernet: 2 physical ports (e.g., "eth0" and
"eth1")• Compute Node
– Disk Capacity: 16 GB – Memory Capacity: 512 MB – Ethernet: 1 physical port (e.g., "eth0")
![Page 11: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/11.jpg)
11
Installation Preparing
• In our workshop, We will Install the pack of rocks consist of: – Boot Roll (compute roll)– OS Roll Disc 1– OS Roll Disc 2– Grid Rolls
• Check it, Your cluster and check it your self.
![Page 12: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/12.jpg)
12
Rocks Installation.
• Pick the Disc, The Rocks base disc 1 and HPC Roll.
• Insert the Rocks Base CD into your frontend machine and reset the frontendmachine.
• After the frontend boots off the CD, you will see the boot screen:
![Page 13: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/13.jpg)
13
Rocks installation 1
When you see the screen above, type: frontend
![Page 14: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/14.jpg)
14
you'll see a screen that looks like:
![Page 15: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/15.jpg)
15
Rocks installation 2
After the CD/DVD drive ejects,Put the OS - Disk 1 Roll CD and select 'Ok'
![Page 16: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/16.jpg)
16
Rocks installation 3
If you have not another roll choose “No”.
![Page 17: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/17.jpg)
17
Rocks installation 4
Fill information of your cluster.
![Page 18: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/18.jpg)
18
Rocks installation 5
Automatic is the default
![Page 19: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/19.jpg)
19
Automatic partitioning
remainder of root disk/export (symbolically linked to /state/partition1)
1 GBswap
6 GB/
Size Partition Name
![Page 20: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/20.jpg)
20
Rocks installation 6eth0 for private network.
It is recommended that you accept the defaults.
![Page 21: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/21.jpg)
21
Rocks installation 7eth1 for Public network
Set up the networking parameters for connectedto the outside network.
![Page 22: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/22.jpg)
22
Rocks installation 8
Configure the Gateway and DNS.
![Page 23: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/23.jpg)
23
Rocks installation 9
Configure the time
![Page 24: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/24.jpg)
24
Rocks installation 10
Input the root password
![Page 25: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/25.jpg)
25
Rocks installation 11
example screen above,insert the Roll into the drive and select 'Ok'
![Page 26: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/26.jpg)
26
Rocks installation 12
the packages will be installed.
![Page 27: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/27.jpg)
27
Rocks installation 13
• Then the installer will ask for each of the roll CDs you added at the beginning of the frontend installation.
• Put the appropriate roll CD in the drive when prompted and hit 'Ok'.
• After the last roll CD is installed, the machine will reboot.
![Page 28: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/28.jpg)
28
Rocks installation 14
In the First time of logging into the frontend, When the system ask you for pass phrase of SSH,
Essentially! press Enter for pass it.Remember not fill any data!!!
![Page 29: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/29.jpg)
29
Install compute node
• Compute node installation1. Login to the frontend node as root. 2. Run a program which captures compute
node DHCP requests and puts their information into the Rocks MySQLdatabase: • # insert-ethers
• you will see next screen:
![Page 30: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/30.jpg)
30
Install compute node (cont’d)
• Take the Rocks base disc 1 and put it in your first compute node
• If you don't have a CD drive in your compute nodes, you can use PXE (Network Boot).
![Page 31: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/31.jpg)
31
Install compute node (cont’d)• When the frontend
machine receives the DHCP request from the compute node
• will be displayed for a few seconds and then you'll see the following:
![Page 32: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/32.jpg)
32
Install compute node (cont’d)
• Press F1 for exit of insert-ethers • Default name of compute node is compute-X-X• The first digit call cabinet. It same the cluster
group number. • For install another cabinet you can restart the
insert-ethers again and use option –cabinet – # insert-ethers --cabinet=1
• If you use before command you can get compute node in cabinet “compute-1-X”
![Page 33: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/33.jpg)
33
Remove a compute node from the cluster
• Command– # insert-ethers --remove="[your compute node
name]"• Example : remove compute-0-1
– # insert-ethers --remove="compute-0-1"
![Page 34: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/34.jpg)
34
cluster-fork Command.
• cluster-fork is a command for distribute another command to all node in the cluster
• Example– #cluster-fork poweroff
• For an example the poweroff command is distributed to all compute node in cluster. And let few minute all compute node is shatdown
![Page 35: 02 install cluster using npaci rocks](https://reader030.vdocuments.mx/reader030/viewer/2022020206/546f9db7b4af9f260b8b45e9/html5/thumbnails/35.jpg)
The End