isc cloud'13 - hands-on tutorial on “building your cloud for hpc, here & now, in 3...
DESCRIPTION
TRANSCRIPT
![Page 1: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/1.jpg)
ISC CLOUD’13 Heidelberg, Germany, September 23rd, 2013
Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”
1/16 Creative Commons Attribution-NonCommercial-ShareAlike License
An Introduction to Cloud Computing with OpenNebula
Daniel Molina Project Engineers
The research leading to these results has received funding from Comunidad de Madrid through research grant MEDIANET S2009/TIC-1468,
Acknowledgments
![Page 2: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/2.jpg)
2 An Introduction to Cloud Computing with OpenNebula
Agenda An Introduction to Cloud Computing with OpenNebula!
● Infrastructure as a Service ● The OpenNebula Model ● The Anatomy of the Cloud
![Page 3: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/3.jpg)
3 An Introduction to Cloud Computing with OpenNebula
Infrastructure as a Service Types of Cloud Services!
What Who On-demand access to any application
End-user (does not care about hw or sw)
Platform for building and delivering web
applications
Developer (no managing of the underlying hw &
swlayers)
Raw computer infrastructure
System Administrator (complete management of the
computer infrastructure)
Software as a Service
�
Platform as a Service
Infrastructure as a Service
Physical Infrastructure
![Page 4: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/4.jpg)
4 An Introduction to Cloud Computing with OpenNebula
Infrastructure as a Service Types of Cloud Deployments!
• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity
Public Cloud
![Page 5: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/5.jpg)
5 An Introduction to Cloud Computing with OpenNebula
• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity
Public Cloud
A “Public Cloud behind the firewall”
• Simplify internal operations
• Dynamic allocation of resources
• Higher utilization & operational savings
• Security concerns
Private Cloud
Infrastructure as a Service Types of Cloud Deployments!
![Page 6: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/6.jpg)
6 An Introduction to Cloud Computing with OpenNebula
• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity
Public Cloud
A “Public Cloud behind the firewall”
• Simplify internal operations
• Dynamic allocation of resources
• Higher utilization & operational savings
• Security concerns
Private Cloud
• Supplement the capacity of the Private Cloud
• Utility Computing dream made a reality!
Hybrid Cloud
Infrastructure as a Service Types of Cloud Deployments!
![Page 7: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/7.jpg)
7 An Introduction to Cloud Computing with OpenNebula
• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity
Public Cloud
A “Public Cloud behind the firewall”
• Simplify internal operations
• Dynamic allocation of resources
• Higher utilization & operational savings
• Security concerns
Private Cloud
• Suplement the capacity of the Private Cloud
• Utility Computing dream made a reality!
Hybrid Cloud
Infrastructure as a Service Types of Cloud Deployments!
![Page 8: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/8.jpg)
8 An Introduction to Cloud Computing with OpenNebula
Infrastructure as a Service Challenges of IaaS Clouds!
● How do I provision a new VM? Image Management & Context
● Where do I store the disks? Storage
● How do I set up networking for a multitier service? Network & VLANs
● Where do I put my web server VM? Monitoring & Scheduling
● How do I manage any hypervisor? Virtualization
● Who has access to the Cloud’s resources? User & Role Management
● How do I manage my distributed infrastructure? Interfaces & APIs
![Page 9: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/9.jpg)
9 An Introduction to Cloud Computing with OpenNebula
● How do I provision a new VM? Image Management & Context
● Where do I store the disks? Storage
● How do I set up networking for a multitier service? Network & VLANs
● Where do I put my web server VM? Monitoring & Scheduling
● How do I manage any hypervisor? Virtualization
● Who has access to the Cloud’s resources? User & Role Management
● How do I manage my distributed infrastructure? Interfaces & APIs
Uniform management layer that orchestrates multiple technologies
Infrastructure as a Service Challenges of IaaS Clouds!
![Page 10: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/10.jpg)
10 An Introduction to Cloud Computing with OpenNebula
The Anatomy of the Cloud Cloud Architecture - The Internals of the Cloud!
Interfaces, Tools & API • CLI & Sunstone (GUI) • API • Cloud (EC2,OCCI) • Service Management & Catalogs
Compute Hosts • Grouped into logical clusters • Multiple hypervisors • Monitoring
Storage • VM disks (file & block) • Image Distribution • Multiple Backends
Multi-tenancy • AAA Services • Scheduling • Permissions & roles
Network • VLAN • Firewalling • Multiple Technologies
![Page 11: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/11.jpg)
11 An Introduction to Cloud Computing with OpenNebula
The Anatomy of the Cloud Different Perspectives of the Cloud – Demands from the Different Communities!
Cloud Consumer
Cloud Administrator
Cloud Integrator
Cloud Application Developer
![Page 12: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/12.jpg)
12 An Introduction to Cloud Computing with OpenNebula
An Uniform Management Layer!Infrastructure as a Service
![Page 13: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/13.jpg)
13 An Introduction to Cloud Computing with OpenNebula
Story A Project Aimed at Building the Industry Standard Open Cloud Management Tool!
2005 2008 2009 2010 2011 2012
• Develop & innovate • Support the community • Collaborate
Large-scale production deployment: 16,000 VMs
5,000 downloads/month
2014 2013
Research Project
TP v1.0 v1.2 v1.4 v2.0 v2.2 v3.0 v3.2 v3.4 v3.6 v3.8 v4.0 V4.2
![Page 14: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/14.jpg)
14 An Introduction to Cloud Computing with OpenNebula
The OpenNebula Model
● Adaptable: Integration capabilities to fit into any data center
● Enterprise-ready: Upgrade process and commercial support
● No Lock-in: Broad infrastructure and platform independent
● Light: Efficient & simple
● Proven: Rigorously tested, mature and widely used
● Powerful: Advanced features for virtualized
● Scalable: single instance & multi-tier architectures
● Be interoperable! rich set of API's & Interfaces
● Open Source: Apache License v2
An Enterprise-ready Open-source Platform to Manage Cloud Data Centers !
![Page 15: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/15.jpg)
15 An Introduction to Cloud Computing with OpenNebula
The Anatomy of the Cloud OpenNebula Architecture - Infrastructure Agnostic and Highly Customizable!
OpenNebula core
Virtualization Images
Storage Network
Auth
Monitoring
Scheduler
XML-RPC API
OCA (Ruby, Java)
CLI GUI Cloud Servers
DB
Languages
![Page 16: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/16.jpg)
16 An Introduction to Cloud Computing with OpenNebula
The Anatomy of the Cloud Basic OpenNebula Deployment!
• Repository of VM images • Multiple Backends (LVM, Ceph)
Monitoring,Virtualization, Storage and Network
• Provides physical resources for the VMs • Must have a hypervisor installed
![Page 17: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/17.jpg)
17 An Introduction to Cloud Computing with OpenNebula
Private HPC Cloud Case Studies One of Our Main User Communities!
Supercomputing Centers
Research Centers
Distributed Computing Infrastructures
Industry
![Page 18: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/18.jpg)
18 An Introduction to Cloud Computing with OpenNebula
The Private HPC Cloud Use Case OpenNebula as an Infrastructure Tool – Enhanced Capabilities!
Virtual Worker Nodes
LRMS (LSF, PBS, SGE…)
Grid Middleware Acc
ess
Pro
visi
on
Ser
vice
• Common interfaces • Grid integration
• Custom environments • Dynamic elasticity
• Consolidation of WNs • Simplified management • Physical – Virtual WNs • Dynamic capacity partitioning • Faster upgrades
Service/Provisioning Decoupling !
![Page 19: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/19.jpg)
19 An Introduction to Cloud Computing with OpenNebula
The Private HPC Cloud Use Case OpenNebula as an Provisioning Tool – Enhanced Capabilities!
Pilot Jobs, SSH…
IaaS Interface Acc
ess
Pro
visi
on
Ser
vice
• Simple Provisioning Interface • Raw/Appliance VMs
• Dynamic scalable computing • Custom access to capacity • Not only batch workloads • Not only scientific workloads
• Improve utilization • Reduced service management • Cost efficiency
![Page 20: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/20.jpg)
20 An Introduction to Cloud Computing with OpenNebula
We Will Be Happy to Clarify Any Question !Questions?
![Page 21: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/21.jpg)
1/16 Creative Commons Attribution-NonCommercial-ShareAlike License
Installation and Basic Usage
Daniel Molina Project Engineer
The research leading to these results has received funding from Comunidad de Madrid through research grant MEDIANET S2009/TIC-1468,
Acknowledgments
ISC CLOUD’13 Heidelberg, Germany, September 23rd, 2013
Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”
![Page 22: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/22.jpg)
2 Installing and Basic Usage
Agenda Installing and Basic Usage!
● Planning the Installation ● Virtual Lab Configuration ● Basic Usage
● Managing Hosts ● Images, Networks, Templates and VMs ● Managing Users, Quotas and ACLs ● Logging & Debugging ● Configuration Files
● Appendix A - Installation
![Page 23: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/23.jpg)
3 Installing and Basic Usage
A Typical OpenNebula Environment Planning the Installation!
• Repository of VM images • Multiple Backends (LVM, Ceph)
Monitoring,Virtualization, Storage and Network
• Provides physical resources for the VMs • Must have a hypervisor installed
![Page 24: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/24.jpg)
4 Installing and Basic Usage
Required Software Installing!
● Head node ● ssh, ruby ● OpenNebula: oned, mm_sched, sunstone, …
● Worker nodes ● Hypervisor (KVM, Xen or VMWare) ● ssh, ruby (Xen & KVM)
● Optional ● Storage Backends (LVM, iSCSI, Ceph, …) ● Networking systems (VLAN, Open vSwitch, …) ● Ganglia, LDAP, Apache, Nginx
![Page 25: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/25.jpg)
5 Installing and Basic Usage
Virtual Lab Planning the Installation!
NODE 1 NODE 2
![Page 26: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/26.jpg)
6 Installing and Basic Usage
Virtual Lab Installing!
● Start Virtual Box ● File > Import Appliance…
● frontend_node1.ova & node2.ova ● Create a Host-only network in VirtualBox if you have
not created it yet
![Page 27: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/27.jpg)
7 Installing and Basic Usage
Virtual Lab Installing!
● Start frontend_node1 and node2 images ● You can access them from:
1. VirtualBox GUI 2. Console/putty ● frontend_node1 (password centos)
● node2 (password centos)
$ ssh localhost -l root -p 2222
$ ssh localhost -l root -p 2223
![Page 28: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/28.jpg)
8 Installing and Basic Usage
CLI – node1 Basic Usage!
Hands on (node1) ! ● OpenNebula CLI Commands
# su - oneadmin $ one[TAB]
oneuser Manage Users oneimage Manage Images
onegroup Manage Groups onetemplate Manage Templates
oneacl Manage ACLs onevm Manage VMs
onehost Manage Hosts oneacct Accounting Tool
onecluster Manage Clusters onemarket Marketplace Tool
onevnet Manage Networks onedb DB Tool
onedatastore Manage Datastores
![Page 29: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/29.jpg)
9 Installing and Basic Usage
CLI – node1 Basic Usage!
● Get the Sunstone Login information
● Try out sunstone!
http://localhost:9869
# (as oneadmin) $ cat ~/.one/one_auth oneadmin:<password>
![Page 30: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/30.jpg)
10 Installing and Basic Usage
Adding Hosts - Sunstone Basic Usage – Hosts!
Hands on! (Sunstone) ● Create one host in Sunstone: node1
● Virtualization: KVM ● Information: KVM ● Network: dummy ● Cluster: none
● Watch transition INIT ! ON
● Click on the row for more information ● Automatic gathering of monitoring data ● Take a look at the graphs
![Page 31: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/31.jpg)
11 Installing and Basic Usage
Adding Hosts - CLI Basic Usage – Hosts!
Hands on! (CLI) (always as oneadmin in the Frontend – node 1)
$ onehost -help $ onehost create -help $ ssh node2 ls /var/tmp/one $ onehost create node2 -i kvm -v kvm -n dummy $ onehost list $ onehost top # Wait for ON ... and then CTRL-C $ ssh node2 ls /var/tmp/one $ onehost show node2 $ onehost show 1 $ onehost show -x 1
![Page 32: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/32.jpg)
12 Installing and Basic Usage
Adding Images Basic Usage – Images!
Hands on! (Sunstone) ● Create an Image in Sunstone
● Name: tty ● Provide a Path: /var/tmp/tutorial/ttylinux.qcow2.img ● Advanced ! Driver: qcow2 ● Datastore: default ● Create!
● Watch transition LOCKED ! READY ● Ownership and Permissions (ala Unix!), Size, Driver... Hands on! (CLI) $ oneimage list $ oneimage show tty # DO NOT EXECUTE THE FOLLOWING COMMAND $ oneimage create --name tty --driver qcow2 \ --path /var/tmp/tutorial/ttylinux.qcow2.img -d default
![Page 33: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/33.jpg)
13 Installing and Basic Usage
System Datastore Basic Usage – Datastores!Hands on! (Sunstone) ● Inspect each Datastore: ● The system datastore:
● Holds images for running VMs ● The TM_MAD (transfer manager driver) is shared which means:
![Page 34: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/34.jpg)
14 Installing and Basic Usage
Shared Datastore Basic Usage – Datastores!Hands on! (Sunstone) ● The default datastore:
● Holds images ready to be cloned or linked for VMs ● The DS_MAD is fs because our image is a regular file ● The TM_MAD (transfer manager driver) is shared which means:
![Page 35: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/35.jpg)
15 Installing and Basic Usage
Adding Networks Basic Usage – Networks!
Hands on! (Sunstone) ● Create a new Network
● Name: private ● Type: Fixed Network ● IP: 192.168.0.1 -> [ENTER] -> repeat ... -> 192.168.0.4 ● Network Model: default ● Bridge: br1
br1
VM VM
Node 1 eth1
br1
Node 2 eth1
VM VM
![Page 36: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/36.jpg)
16 Installing and Basic Usage
Adding Networks Basic Usage – Networks!
Hands on! (Sunstone) ● Network extended information:
● Lease Management ! Add, Hold and Remove Leases Hands on! (CLI)
$ cat private2.net NAME = private2 TYPE = fixed BRIDGE = br1 LEASES = [ IP = 10.0.0.1 ] LEASES = [ IP = 10.0.0.2 ] $ onevnet create private2 $ onevnet list $ onevnet show private $ onevnet addleases private 192.168.0.105 $ onevnet hold private 192.168.0.105
![Page 37: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/37.jpg)
17 Installing and Basic Usage
Adding Templates Basic Usage – Template!
Hands on! (Sunstone) ● A template is a Virtual Machine definition ready to be instantiated ● It has CPU, Memory, Disks, NIC, Graphical Ports, etc...
● Create a new Template: ● Name: ttylinux ● CPU: 0.1 ● Memory: 64M ● Storage: tty ● Network: private ● Input/Output: VNC ● Random values in Context ! Custom Variables ● Create!
![Page 38: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/38.jpg)
18 Installing and Basic Usage
Adding Templates Basic Usage – Template!
Hands on! (CLI) ● Try the useful --dry option in the CLI
$ onetemplate create --help $ onetemplate create --name ttylinux --cpu 0.1 \
--memory 64 --disk tty --nic private --vnc --dry NAME="ttylinux“ CPU=0.1 MEMORY=64 DISK=[ IMAGE="tty“ ] NIC=[ NETWORK="private“ ] GRAPHICS=[ TYPE="vnc", LISTEN="0.0.0.0" ]
![Page 39: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/39.jpg)
19 Installing and Basic Usage
Instantiating Basic Usage – VMs!
Hands on! (Sunstone) ● Instantiate the template
● Deploy 2 VMs ● Leave the name blank
● Watch the transition PENDING ! RUNNING ● In which host is running each VM?
● vnc (vm1) ! root / password ● ifconfig ! configured using context ● ping the other machine (vm2)
● Migrate / live-migrate (vm2)
![Page 40: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/40.jpg)
20 Installing and Basic Usage
Main VM actions Basic Usage – VMs!
suspend VM state saved. Kept in the host.
power off (--hard) Powers off a VM. Kept in the host.
stop VM state saved. Taken to the system datastore.
undeploy (--hard) Powers off a VM. Taken to the system datastore.
reboot (--hard) Reboots the VM.
delete --recreate Cleans the VM and moves it to PENDING.
shutdown (--hard) Powers off a VM, cleans host and VM is removed from OpenNebula.
delete VM is immediately destroyed regardless of state. Recommended only for oneadmin.
![Page 41: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/41.jpg)
21 Installing and Basic Usage
Other VM actions Basic Usage – VMs!Hands on! (Sunstone) ● VM extended information tab
● Capacity - Resize VM capacity (power off –hard, first halt from vnc) ● Storage ● Network - Attach new nic ● create a new network ! attach nic ! reboot from vnc
● Snapshot ● create a file using VNC ● Take snapshot ● Modify the file ● Revert
● Placement ● Actions - Schedule action ● Template ● Log
![Page 42: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/42.jpg)
22 Installing and Basic Usage
Managing Users Basic Usage – Users!
Hands on! (Sunstone) ● Create new user: testuser / testpass ● Click on new user ! Update Quotas
● Enforce 1 Max VMs ! Add/edit quota ● Other possible options ● limit the use of a Datastore ● limit the use of an Image ● limit the use of a Network
● Apply changes! ● Create new ACL
● We can customize any rule extending the functionality provided by the Unix ownership/group/permissions schema.
![Page 43: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/43.jpg)
23 Installing and Basic Usage
Logs Basic Usage – Logging and Debugging!
● Logs are kept under /var/log/one ● oned.log: all the information related to the oned daemon. Every
request, actions and driver errors will be here. The verbosity is set by DEBUG_LEVEL in /etc/one/oned.conf
● sched.log:has all the information related to the placement of Virtual
Machines. If a VM is not being deployed (kept in PENDING state), this log will explain why.
● <id>.log: the log of each VM. Also accessible through Sunstone.
![Page 44: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/44.jpg)
24 Installing and Basic Usage
oned.conf Configuration !
/etc/one/oned.conf (open this file and take a look!) ● OpenNebula Daemon:
● LOG, PORT, DB ● Monitoring Intervals:
● MANAGER_TIMER, MONITORING_INTERVAL ● Configuration options for VMs:
● VNC_BASE_PORT ● MAC_PREFIX (MAC " IP) ● DEFAULT_DEVICE_PREFIX = "hd“ (or vd, xvd, etc…)
● Drivers: ● IM_MAD, VMM_MAD, TM_MAD, DATASTORE_MAD, HM_MAD,
AUTH_MAD ● Resources:
● DEFAULT_UMASK ● VM_RESTRICTED_ATTR, IMAGE_RESTRICTED_ATTR
![Page 45: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/45.jpg)
25 Installing and Basic Usage
sched.conf Configuration !
/etc/one/sched.conf (open this file and take a look!) ● Scheduler Daemon:
● ONED_PORT, SCHED_INTERVAL, LOG ● Dispatch Options
● MAX_VM, MAX_DISPATCH, MAX_HOST, LIVE_RESCHEDS ● Policy
● DEFAULT_SCHED (packing, striping, load-aware, custom)
![Page 46: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/46.jpg)
26 Installing and Basic Usage
We Will Be Happy to Clarify Any Question !Questions?
![Page 47: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/47.jpg)
27 Installing and Basic Usage
Appendix A
Installation
This is just a reference of what have been done to configure the frontend_node1 and node2 images
![Page 48: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/48.jpg)
28 Installing and Basic Usage
Installation node 1 - Frontend Installing!
● Activate repo and Install Packages
● Add QEMU drivers ● Configure NFS Server
# cp /var/tmp/tutorial/opennebula.repo /etc/yum.repos.d/ # yum clean all # yum install opennebula-server opennebula-sunstone opennebula-node-kvm
# Change VM_MAD type from kvm to qemu
# cat /etc/exports /var/lib/one *(rw,sync,no_subtree_check,root_squash,anonuid=9869,anongid=9869)
![Page 49: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/49.jpg)
29 Installing and Basic Usage
Installation node 1 - Frontend Installing!
● Configure Sunstone
● Start Services
● Quick overview of the CLI
# service nfs start # service libvirtd start # service opennebula start # service opennebula-sunstone start # chkconfig nfs on
# gpasswd -a oneadmin wheel # su - oneadmin $ oneuser show $ oneuser -help
# sed -i 's/127.0.0.1/0.0.0.0/' /etc/one/sunstone-server.conf
![Page 50: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/50.jpg)
30 Installing and Basic Usage
Installation node 2 – Worker Node Installing!
● Activate repo and Install Packages
● Configure Network, Hostname, NFS and sudo
# cp /var/tmp/tutorial/opennebula.repo /etc/yum.repos.d/ # yum clean all # yum install opennebula-node-kvm
# chkconfig NetworkManager off # service NetworkManager stop # echo HOSTNAME=node2 > /etc/sysconfig/network # hostname node2 # sed -i 's/1.1.1.1/1.1.1.2/' /etc/sysconfig/network-scripts/ifcfg-br1 # ifconfig br1 1.1.1.2/24 up # mount –t nfs 1.1.1.1:/var/lib/one /var/lib/one # gpasswd -a oneadmin wheel # service libvirtd start
![Page 51: ISC Cloud'13 - Hands-On Tutorial on “Building Your Cloud for HPC, Here & Now, in 3 Hours!”](https://reader034.vdocuments.mx/reader034/viewer/2022051513/546ca084b4af9f662c8b51b1/html5/thumbnails/51.jpg)
31 Installing and Basic Usage
Configure Password-less SSH Installing!
● OpenNebula needs passwordless ssh access to
all the nodes from all the nodes:
# (as oneadmin) $ ssh-keyscan node1 node2 > ~/.ssh/known_hosts # test it! $ ssh node2 $ exit $ ssh node1 $ exit