virtualization experience with xen havard ... - cern openlab filecern openlab virtualization...
TRANSCRIPT
![Page 1: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/1.jpg)
02.05.2006
Havard Bjerke
CERN Openlab
Virtualization experience with Xen
![Page 2: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/2.jpg)
Overview
VM technologyOpenlab I
HistoryXen/ia64Deployment in the LCG testbed
Openlab IINew hardwareETICS, SmartfrogVirtualization in batch subsystem
Vision
![Page 3: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/3.jpg)
Virtualization Technologies Hosted
Microsoft Virtualization ServerUsed at CERN for consolidation
Runs MS Windows, Linux (SLC3, SLC4)Nonnegligible CPU overhead: every ~ 3rd cycle wasted
HostedFreeAPI to control VMM and VMs32bit, single CPU only
VMWareHosted: GSX
Nonnegligible CPU overhead
Nonhosted: ESXLimited hardware support
![Page 4: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/4.jpg)
Virtualization Technologies Nonhosted
XenParavirtualization, nonhostedClose to native performanceSupports only paravirtualized OSs unless hardwarevirtualized platform64bit supportSMP supportOpen source, GPL
![Page 5: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/5.jpg)
02.05.2006
Havard Bjerke
CERN Openlab
Openlab I
![Page 6: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/6.jpg)
CPU performance benchmarks (Rune)
CPU: Dual Xeon 2.4 GhzBenchmark: test40forSPECOS: SLC3
![Page 7: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/7.jpg)
Cluster benchmarks (with Rune)
Lower bandwidth and higher latency in guest domains.Aggregate bandwidth of multiple domains scales, but not latency.
![Page 8: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/8.jpg)
Xen/ia64
X86 virtualization unfriendlyNonfaulting privilege sensitive instructions
IA64 a little more friendlyThree nonfaulting privilege sensitive instructionsTagged TLB / Region registers
No need to flush the TLB when switching domainEasier to virtualize physical memory
No more segmentation, real mode, protected modeRedundant hypercalls
EFI – easier to virtualize than BIOS
Optimized paravirtualizationLinux is a moving target > minimize changes in the guest Linux kernelInstead: trap faulting instructions
![Page 9: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/9.jpg)
Physical machine
LCG Deployment
Xen 2.0.7Proof of concept GRIDinaboxComplete LCG 2.6 installation
Computing Element (CE)Storage Element (SE)Worker Node (WN)
![Page 10: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/10.jpg)
Successful deployment in LCG testbedCurrently used in test gridTests passed as good as native nodes
IssuesAutomatic software updates cause /lib/tls to be restoredSupport for 2.4 kernels dropped
Possible applicationsServer consolidation (GRIDinabox)Security (VObox)Customizable environments (Openlab II)Availability, management flexibility (Livemigration)
LCG Deployment
![Page 11: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/11.jpg)
02.05.2006
Havard Bjerke
CERN Openlab
Openlab IIFocused effort with Intel
![Page 12: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/12.jpg)
New Hardware
MontecitoIA64VTiParavirtualization – OK
No support for FPSWA yet
Dempseyx86 EM64TVTxParavirtualization OK
![Page 13: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/13.jpg)
Smartfrog, ETICS
ETICS (Xavier)Testing environment
SmartfrogUtility computingProvide a single configuration file
MemoryHD capacitySoftware configuration...
Deploy a complete site – clean up afterwards
![Page 14: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/14.jpg)
PBSResource scheduling independent from queues
LSFOne queue per VO
BLAHPCommon interface to batch subsystemsLet LSF do scheduling decisions based on time constraints
Virtualization in Batch Subsystems
time: 9hVO: CMS
Queue AVO = CMS
Queue Bt < 10h
?
![Page 15: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/15.jpg)
Virtualization in Batch Subsystems
RequirementsCustomized execution environmentsIsolated execution environmentsDynamic resource management
Three goals over three phases1. Selection of static execution environments2. Dynamic instantiation of execution environments – ondemand3. Dynamic configuration of execution environments – VM factory
![Page 16: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/16.jpg)
Virtualization in Batch Subsystems
Client/CE Routingqueue
Executionqueue
[max 1 job]
Executionqueue
[max 2 jobs]
One-way
WNSLC3WN
SLC4
Two-way
WNSLC3WN
SLC4
1. Static execution environments
![Page 17: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/17.jpg)
Virtualization in Batch Subsystems
Client/CE Routingqueue
Executionqueue
[max 1 job]
Executionqueue
[max 2 jobs]
One-way
Two-way
2. Dynamic instantiation
WNSLC3WN
SLC4
WNSLC3WN
SLC4
![Page 18: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/18.jpg)
Virtualization in Batch Subsystems
Client/CE Routingqueue
Executionqueue
[max 1 job]
Executionqueue
[max 2 jobs]
One-way
Strawberry
Two-way
Vanilla
Chocolate
3. Dynamic configuration
Pistachio
![Page 19: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/19.jpg)
Vision
Close to native performanceWithout hardware support
XenVMWare ESX
With hardware supportMany to come
VM tech agnosticCasatt's XVM
Usersupplied or specified execution environmentsDomain migration
Flexible resource managementHigh availability
![Page 20: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/20.jpg)
Vision
Execution environment characteristicsIsolatedSecure
XenSESVM hardware extensions
Clean
![Page 21: Virtualization experience with Xen Havard ... - CERN openlab fileCERN Openlab Virtualization experience with ... Common interface to batch subsystems Let LSF do scheduling decisions](https://reader030.vdocuments.mx/reader030/viewer/2022040111/5e189cd9c577aa308917c52f/html5/thumbnails/21.jpg)
02.05.2006
Havard Bjerke
CERN Openlab
Questions?Questions?
More info:More info:http://openlab-mu-internal.web.cern.ch/openlab-mu-internal/openlab-II_Projects/http://openlab-mu-internal.web.cern.ch/openlab-mu-internal/openlab-II_Projects/
Platform_Competence_Centre/Virtualization/Virtualization.aspPlatform_Competence_Centre/Virtualization/Virtualization.asp