niif cloud infrastructure and services - terena · 9/19/2011 · niif cloud infrastructure and...
TRANSCRIPT
![Page 1: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/1.jpg)
NIIF Cloud Infrastructure and Services
TF-MSP MeetingSeptember 19, 2011
Heraklion, Crete, Greece
Szabolcs Székelyi<[email protected]>
![Page 2: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/2.jpg)
Why?
The task of the NREN provider
To provide useful IT services to
academic institutions those are either
not found on the market or at least not
at a reasonable price.
(And the cloud is Such A Thing.)
![Page 3: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/3.jpg)
The problem
● Unconsolidated infrastructure● Static hardware configurations
● Overprovisioning
● Fragmented free capacities
● Waste of hardware resources
● Hardware dependency● Failure sensitivity
● Classical HA is expensive and limited, “new school” HA is immature
● Institutions: lack of possibilities and know-how to provide service reliably and efficiently
![Page 4: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/4.jpg)
Project focus
● Infrastructure as a Service● Full virtualization of the infrastructure
● Virtual machines, virtual networks, disk images, etc.
● Not GIaaS (Grid Infrastructure as a Service)
– Although it's designed with this also in mind
● Solution no software● Integrated storage management
● Special network requirements
● You need servers, storage, and network
![Page 5: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/5.jpg)
Project schedule
● Project launch: February 2010● 1st phase end: December 2010● January 2011 – present: “1.5th“ phase, beta test
● Robustness
– Multipathing
– Distributed filesystem (Ceph)
● Essential features
– (Web-based) GUI
– Access control lists
● Deployment
![Page 6: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/6.jpg)
Features
● Features● Public cloud: authentication & authorization
● Self-service private virtual network management
● Live migration of VMs between sites
● Console access to VMs
● Non-features (yet!)● VM configuration modification (hot-/coldplug)
● Sophisticated image and virtual disk management
● Fine-grained access control system
![Page 7: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/7.jpg)
(Seeds of) Features for the academia
● Dynamic scaling of existing computing resources● Virtual networks
● Self-service
● Virtually L2 connected
● Extensible beyond the cloud
● VM systems● Networks + arrays of VMs
● Deploy “now or never”
– Deterministic worst case job completion time
![Page 8: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/8.jpg)
Entities
● Virtual Machine● Name + CPU + memory + disks + boot device + network interfaces
● Network● Golden image (disk image)
● Always clone, exclusive, read-write
● CD image● Never clone, shared, read-only
● Virtual machine systems● Networks + arrays of VMs
![Page 9: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/9.jpg)
A fundamental assumption
One virtual disk = One iSCSI target
![Page 10: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/10.jpg)
Under the hood
![Page 11: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/11.jpg)
Physical deployment
![Page 12: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/12.jpg)
Dunaújváros
Backend storage (plan)
Sopron
![Page 13: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/13.jpg)
Virtual disk access
MultipathCLVM
iSCSI target
Volume
iSCSI initiator
KVM
iSCSI initiator
CLVMiSCSI target
Virtual machine
iSCSI initiatorMultipath
Multipath
![Page 14: NIIF Cloud Infrastructure and Services - TERENA · 9/19/2011 · NIIF Cloud Infrastructure and Services TF-MSP Meeting September 19, 2011 Heraklion, Crete, Greece Szabolcs Székelyi](https://reader033.vdocuments.mx/reader033/viewer/2022042322/5f0c99217e708231d4363315/html5/thumbnails/14.jpg)
Tasks before release & plans
● Access Control Lists (done)● Distributed storage (done)● GUI (done)● Deployment● Cold-/hotplug support (CPU, memory, disks, NICs, etc.)
● Replace OpenNebula
● IPv6 support● Exploit grid features● Add more features (snapshotting, persistent disks, APIs, etc.)● Modularization
public release