virtualization technology and directions
Post on 06-Dec-2014
978 Views
Preview:
DESCRIPTION
TRANSCRIPT
1© Copyright 2010 EMC Corporation. All rights reserved.
Virtualization Technology and Directions
David L. Black, Ph.D. Distinguished Engineer
2© Copyright 2010 EMC Corporation. All rights reserved.
EMC makes no representation and undertakes no obligations with regard to product planning information, anticipated product characteristics, performance specifications, or anticipated release dates (collectively, “Roadmap Information”).
Roadmap Information is provided by EMC as an accommodation to the recipient solely for purposes of discussion and without intending to be bound thereby.
Roadmap information is EMC Restricted Confidential and is provided under the terms, conditions and restrictions defined in the EMC Non-Disclosure Agreement in place with your organization.
Roadmap Information Disclaimer
3© Copyright 2010 EMC Corporation. All rights reserved.
Business Challenges
Data growing at 62% annually to 800,000 Petabytes
Mandates to reduce OPEX and CAPEX
Hardware underutilized or overutilized
Reduce power consumption and footprint
Faster response to business changes
In addition – deal with all of this across multiple data centers
Virtualization is not an option, it is a requirement
4© Copyright 2010 EMC Corporation. All rights reserved.
Defining Virtualization
Virtualization provides logical views of physical resources while preserving the usage interfaces for those resources.
Virtualization removes physical resource limits and improves resource utilization.
5© Copyright 2010 EMC Corporation. All rights reserved.
Virtualization Comes in Many Forms
Each application sees its own logical memory, independent of
physical memory
Each application sees its own logical server, independent of physical
servers
Each application sees its own logical storage, independent of physical
storage
Each application sees its own logical network, independent of physical
network
Virtual Memory
Virtual Networks
Virtual Servers
Virtual Storage
Each application sees its own logical network, independent of physical
network
Virtual Networks
Each application sees its own logical storage, independent of physical
storage
Virtual Storage
Each application sees its own logical server, independent of physical
servers
Virtual Servers
6© Copyright 2010 EMC Corporation. All rights reserved.
Virtualization Comes in Many Forms
Each application sees its own logical memory, independent of
physical memory
Virtual Memory
Physical Memory
Swap Space
App
App
AppBenefits of Virtual Memory
Remove physical memory limitsRun multiple applications at once
7© Copyright 2010 EMC Corporation. All rights reserved.
Virtualization Comes in Many Forms
Each application sees its own logical memory, independent of
physical memory
Each application sees its own logical server, independent of physical
servers
Each application sees its own logical storage, independent of physical
disks
Each application sees its own logical network, independent of physical
network
Virtual Memory
Virtual Networks
Virtual Servers
Virtual Storage
Each application sees its own logical storage, independent of physical
storage
Virtual Storage
Each application sees its own logical server, independent of physical
servers
Virtual Servers
Each application sees its own logical memory, independent of
physical memory
Virtual Memory
8© Copyright 2010 EMC Corporation. All rights reserved.
Virtualization Comes in Many Forms
Each application sees its own logical network, independent of physical
network
VLAN TrunkSwitch Switch
Benefits of Virtual Networks
Common network links with access control properties of separate links.Manage logical networks instead of
physical networks.Virtual SANs provide similar benefits
for storage area networks.
Virtual Networks
VLAN B VLAN CVLAN A
9© Copyright 2010 EMC Corporation. All rights reserved.
Switch A Switch B
Virtual Networks Unify Network Traffic
VLANs: different classes of traffic share network – iSCSI, FCoE, NFS, CIFS, web, etc.– Unification: Reduce cables, interfaces, etc.
Limited interaction among traffic classes– Controls (access and QoS) for each traffic class
Servers
FC SAN
Ethernet LAN
iSCSI/FCoEStorage
EthernetFC
FCoE switches
10© Copyright 2010 EMC Corporation. All rights reserved.
Distributed Virtual Networks: Virtualization across Locations
Overlay network extends VLANs over arbitrary network connectivity– Works over any WAN type – dark fiber, MPLS, IP– No network architecture change in datacenter – just add OTV edge devices
Seamless add/ drop of edge nodes w/o reconfiguring other edge notes
Distributed network virtualization– VLANs based on physical network resources across multiple locations
Core
IP A IP B
IP C
West East
South
OTV [Overlay Transport Virtualization] (Cisco)
11© Copyright 2010 EMC Corporation. All rights reserved.
Defining Distributed Virtualization
Distributed Virtualization provides logical views of distributed physical
resources while preserving the usage interfaces for those resources.
Distributed Virtualization removes location barriers and physical resource limits,
improving resource utilization.
12© Copyright 2010 EMC Corporation. All rights reserved.
OTV Use Case
Problem: Primary data center maxed out (space, cooling and power)
Requirement: Seamlessly extend clusters & workload across datacenters
Challenge: Rapidly establish network interconnect between data centers
• No new transport provisioning required (Dark fiber, MPLS, etc)• Eliminate months of re-design effort • Significant operations and provisioning cost savings
Solution: OTV!
Deploy over
existing network 4 configuration
commands per site
No Re‐design
Required
Ethernet Overlay
One Logical Data Center
Automatic Fault
Isolation
Data Center Growth Constraints
13© Copyright 2010 EMC Corporation. All rights reserved.
Virtual Servers
Each application sees its own logical server, independent of physical
servers
Virtual Servers
Flexible Infrastructure
Each application sees its own logical storage, independent of physical
storage.
Virtual Storage
Each application sees its own logical memory, independent of
physical memory
Each application sees its own logical network, independent of physical
network
Virtual Memory
Virtual Networks
Each application sees its own logical memory, independent of
physical memory
Virtual Memory
Each application sees its own logical network, independent of physical
network.
Virtual Networks
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
Server Virtualization
OS
OS OS
Benefits of Virtual Machines
Run multiple apps on a single server. Increase server utilization.
Move applications nondisruptively. .
14© Copyright 2010 EMC Corporation. All rights reserved.
Anatomy of a Virtual Machine
Unmodified Application
Server OS
Virtual Hardware
(X86) Physical Server
Hypervisor
Virtual Machines / Guests
A complete system encapsulated in a set of software files
Virtual Appliance: Virtual Machine stored in one file –
Can be used anywhere
15© Copyright 2010 EMC Corporation. All rights reserved.
Comparison of Virtual Machine Approaches
Hardware Level
Multiple virtual machine abstraction layer locations
High-Level Language
Operating System Level
Virtualization Layer
Application Application
16© Copyright 2010 EMC Corporation. All rights reserved.
Microsoft Hyper-V / Xen Architecture VMware vSphere ArchitectureThin hypervisor, no general-purpose OSI/O subsystem is in hypervisorHypervisor owns resourcesSupport functions: hypervisor processes
Hypervisor extends general purpose OSOS I/O subsystem shared with hypervisorResources shared with primary OSOS support functions extended to hypervisor
Hypervisor Architecture Comparison
17© Copyright 2010 EMC Corporation. All rights reserved.
Windows Server 2008
VSPVSPWindows Kernel
Hyper-V Architecture
Applications
Windows Server 2003, 2008
Windows Kernel VSC
VMBusVMBus
Server Hardware
Windows hypervisor
Parent Partition
Child Partitions
VM ServiceVM Service
WMI ProviderWMI Provider
OSISV / IHV / OEM
Microsoft Hyper-VMicrosoft / XenSource
User Mode
Kernel Mode
Provided by:
Ring -1
Device Drivers
VMBusVMBus
Applications Applications
Non- Hypervisor Aware OS
EmulationEmulation
Xen-Enabled Linux Kernel
Linux VSC Linux VSC
Hypercall AdapterHypercall Adapter
VMBusVMBus
Applications
I/O Virtualization and Optimization
VM Worker Processes
Worker Process = VM “proxy” (management)
18© Copyright 2010 EMC Corporation. All rights reserved.
vSphere ESX Server: I/O Virtualization
Each Virtual Machine has its own virtual I/O interfaces
Network: Virtual NIC with its own MAC address– ESX contains Ethernet switches implemented in software– Actual hardware Ethernet port behaves like a switch port
Network operates transparently
Storage: Virtual disk controller– ESX maps OS volumes (LUNs) to
storage resources– ESX contains a volume manager
and a cluster file system (VMFS) Can use storage from many places
• SAN, iSCSI, internal storage• NAS - Can store volume as a file
Storage operates transparently
19© Copyright 2010 EMC Corporation. All rights reserved.
Pooling of Servers, Storage, and Networking
Server
Virtual Machines
ESXServer
Server Farm
Hypervisor Hypervisor Hypervisor Hypervisor Hypervisor Hypervisor
Virtual Machines / Guests
Enterprise Virtualization
Hypervisor
Network
Storage
Benefits• Partition CPU and
memory across multiple Virtual Machines
• Aggregate hardware resources into unified logical resource pools
• Utilize local or shared storage
Aggregate and share resources across servers
20© Copyright 2010 EMC Corporation. All rights reserved.
VMware vNetwork Distributed Switch
• Aggregated datacenter level virtual networking
• Simplified setup and change
• Easy troubleshooting, monitoring and debugging
• Enables transparent third party management of virtual environments
OSAPP
OSAPP
OSAPP
OSAPP
OSAPP
OSAPP
OSAPP
OSAPP
OSAPP
VMware vSphere™
vNetwork Distributed SwitchvSwitch vSwitch vSwitch
Cisco Nexus 1000V
21© Copyright 2010 EMC Corporation. All rights reserved.
Move Virtual Machines across physical servers – while running
Preserve transactional integrity during movement
Eliminate downtime and provide continuous service
Shift underlying hardware resources dynamically
Balance workloads to optimize computing resources
VMotion
22© Copyright 2010 EMC Corporation. All rights reserved.
• Live migration of virtual machine disk files across storage arrays
– Relocate virtual machine disk files across shared storage live using Storage vMotion
– Complete transaction integrity
– Full GUI administration
– Supports NFS, FC and iSCSI
• Benefits– Zero-downtime migration
– Eases array maintenance
– Refresh to new arrays
– Migrate to different class of storage
– Upgrades, space mgmt
– VM granularity, LUN Independent
Storage VMotion
Zero-downtime migration
23© Copyright 2010 EMC Corporation. All rights reserved.
Evolution of Server Virtualization
Self-Managing Datacenter
Automate
Capacity On Demand
Server Consolidation
Test and Development
Separate Consolidate Aggregate
Computing Clouds On and Off Premise
Liberate
24© Copyright 2010 EMC Corporation. All rights reserved.
Evolution of Server Virtualization
Self-Managing Datacenter
Automate
Capacity On Demand
Server Consolidation
Test and Development
Separate Consolidate Aggregate
Computing Clouds On and Off Premise
Liberate
Hypervisor
Management
Virtual Infrastructure
25© Copyright 2010 EMC Corporation. All rights reserved.
Capacity on Demand: Rapid Provisioning
Without VMware Virtualization
With VMware Virtualization
Determine server spec
Locate or purchase system(s)
Rack and cable system
Install/ config OS
Install/ config application Boot
system
Choose host
system
Choose template
Boot VM
Determine server spec
"We can deploy servers in a pinch. With VirtualCenter, it takes 10 minutes. It's absolutely fantastic to be able to deliver a server and have the applications up, have them tested and then put them in production in a matter of four or five hours."
-- Robert Buchwald, Technical Lead, Systems Assurance Team, Moen
Time for other productive tasks
Timeline
26© Copyright 2010 EMC Corporation. All rights reserved.
Evolution of Server Virtualization
Self-Managing Datacenter
Automate
Capacity On Demand
Server Consolidation
Test and Development
Separate Consolidate Aggregate
Computing Clouds On and Off Premise
Liberate
Hypervisor
Management
Virtual Infrastructure
Automation
27© Copyright 2010 EMC Corporation. All rights reserved.
Resource Optimization: DRS & DPM
Distributed Resource Scheduler – Dynamic balancing of computing resources
across resource pools– Intelligent resource allocation based on
predefined rules
Distributed Power Management– Dynamic optimization of computing resources– Place unneeded servers into standby mode– Common framework, different set of rules
DRS and DPM Customer Impact– Align IT resources with business priorities – Operational simplicity; dramatically increase
administrator productivity– Add hardware dynamically to avoid over-
provisioning to peak load– Reduce power consumption without reducing
service levels
Dynamic and intelligent allocation of hardware resources
Resource Pool
Business Demand
28© Copyright 2010 EMC Corporation. All rights reserved.
Evolution of Server Virtualization
Self-Managing Datacenter
Automate
Capacity On Demand
Server Consolidation
Test and Development
Separate Consolidate Aggregate
Computing Clouds On and Off Premise
Liberate
29© Copyright 2010 EMC Corporation. All rights reserved.
Flexible Infrastructure
Each application sees its own logical storage, independent of physical
storage
Virtual Storage
Each application sees its own logical server, independent of physical
servers
Virtual Servers
Each application sees its own logical memory, independent of
physical memory
Each application sees its own logical network, independent of physical
network
Virtual Memory
Virtual Networks
Each application sees its own logical memory, independent of
physical memory
Virtual Memory
Each application sees its own logical network, independent of physical
network
Virtual Networks
Each application sees its own logical server, independent of physical
servers
Virtual ServersBenefits of Virtual Storage
Nondisruptive data migrations, simplify storage management, and
increase storage utilization
Storage Virtualization:Block Level
Storage Network
IP Network
30© Copyright 2010 EMC Corporation. All rights reserved.
Storage Virtualization: Centralized Aggregation
Inband storage system pools storage resources
– Underlying storage systems hidden from servers
– Extends useful life of storage assets by creating virtualized storage pools
Streamlines storage refreshes, consolidations and migrations within the Data Center
Simplifies multi-array storage allocation, provisioning, and tiering via common management
Storage Pool
Multi-Array Data Center
31© Copyright 2010 EMC Corporation. All rights reserved.
Distributed Federation: Distributed Storage Virtualization
EMC VPLEX TechnologyFederated Information Access: “AccessAnywhere” enables geographic data distribution
Scale Out Cluster Architecture: Start small and grow big with predictable service levels
Distributed Cache Coherency:Load balancing and transparent failover of storage domains within and across Data Centers
VPLEX Metro
EMC and non-EMCarrays
EMC and non-EMCarrays
Access anywhere
32© Copyright 2010 EMC Corporation. All rights reserved.
Distributed MirroringActive-Active Access A A
Aggregation of Storage devices Volume management
Remote AccessDiskless access to non-local storage
AA
Array Failure ProtectionLocal mirroring
Site ASite A Site BSite B
VPLEX MetroVPLEX ClusterVPLEX Cluster
FC
Heterogeneous Geographically
Distributed Storage Non Disruptive Data Mobility
Inter-array migrations
VPLEX System Architecture
33© Copyright 2010 EMC Corporation. All rights reserved.
VPLEX I/O Virtualization Stack
DirectorFE
Cache
Storage View…
Distributed Coherent Cache
Device VirtualizationVirtual Volumes
…BE
…Storage Volumes
Storage volumes represent claimed devices from back-end arrays
The device virtualization layer creates composite devices from storage volumes, providing slicing, striping, concatenation, and mirroring
Caching leverages local and global cache, maintains consistency between all VPLEX directors
Virtual volumes are exported out of front- end ports and exposed to hosts
34© Copyright 2010 EMC Corporation. All rights reserved.
Scale Out Cluster Architecture
Centralized Aggregation Distributed Federation
Add additional appliances or controllers to scale up capacity and/or performance
Independent virtual storage pools (management)
Workloads isolated within each cluster (usually two nodes)
Larger engine cluster scales out performance and/or capacity as needed
Storage resources aggregated into a single virtual storage pool
Workloads dynamically distributed across engines
+ + + + + +
35© Copyright 2010 EMC Corporation. All rights reserved.
Distributed Federation
Scale Out Cluster Architecture: Availability
Single node failure: lose half of storage I/O resources
Performance impact can be significant for active storage pools
Data is unavailable in the event of a dual nodes failure
High availability and predictable performance in the event of a component failure
Failover redistributes workloads across all remaining engines
Add additional engines to increase resiliency
Dual node architecture: Availability in the event of a single node failure
Better predictabilityHigher availabilityMore performance
Centralized Aggregation
+
36© Copyright 2010 EMC Corporation. All rights reserved.
Cache Directory D Cache Directory F Cache Directory HCache Directory B
Distributed Cache Coherency: Write
Cache Directory C Cache Directory E Cache Directory G
Directory based distributed cache coherence efficiently maintains cache state consistency across all Engines
Cache Cache Cache Cache
Engine Cache Coherency DirectoryBlock Address 1 2 3 4 5 6 7 8 9 10 11 12 13 …
Cache A
Cache C
Cache E
Cache G
Engine Cache Coherency DirectoryBlock Address 1 2 3 4 5 6 7 8 9 10 11 12 13 …
Cache A
Cache C
Cache E
Cache G
Cache Directory A
New Write:Block 3
37© Copyright 2010 EMC Corporation. All rights reserved.
Cache Directory D Cache Directory F Cache Directory HCache Directory B
Distributed Cache Coherency: Read
Cache Directory C Cache Directory E Cache Directory G
Directory based distributed cache coherence efficiently maintains cache state consistency across all Engines
Cache Cache Cache Cache
Engine Cache Coherency DirectoryBlock Address 1 2 3 4 5 6 7 8 9 10 11 12 13 …
Cache A
Cache C
Cache E
Cache G
Engine Cache Coherency DirectoryBlock Address 1 2 3 4 5 6 7 8 9 10 11 12 13 …
Cache A
Cache C
Cache E
Cache G
Cache Directory A
Read:Block 3
38© Copyright 2010 EMC Corporation. All rights reserved.
Online Workload Migration
Site ASite A Site BSite B
VPLEX MetroVPLEX ClusterVPLEX Cluster
Heterogeneous
Distributed Storage
VMotion over DistanceHyperV Live Migration
OVM Live Migrator
39© Copyright 2010 EMC Corporation. All rights reserved.
VPLEX Metro Use Case EMC solution
VPLEX Metro
VMware VMotion over distance
Microsoft SQL, SharePoint, SAP, Oracle
Symmetrix VMAX and CLARiiON CX4 to Vblock Type 1
Nondisruptive migrations and relocations to 100 km
Migrate and relocate VMs, applications, and data with support for VMotion over distance
Transparently share and balance resources between data centers
ESX Cluster A ESX Cluster B
Share, access, and relocate data between sites over distance
SynchronousAccess Anywhere
40© Copyright 2010 EMC Corporation. All rights reserved.
Putting it all Together: Unified Virtualization and The Journey to the Private Cloud
41© Copyright 2010 EMC Corporation. All rights reserved.
Key Attributes for Enterprise Virtualization
Scalable, high-performance architecture
– Infrastructure that grows with the business
Supports heterogeneous environments
Continuous availability– No single point of failure– Nondisruptive upgrades
Disaster recovery
Enterprise management– Reduce risk and operational costs
Incremental deployment– Easy physical-to-virtual migration– Deploy as problems and opportunities arise
42© Copyright 2010 EMC Corporation. All rights reserved.
App Provisioning: Selective Virtualization
OS
OS
OS
Install operating systems
Authenticate users or applications
Allocate server resources
Storage Network
IP Network
Set up storage environments (disk, SAN, or NAS)
Configure networks
Allocate storage resources – leading reason for forcing systems offline
Effect
Effect
Effect
Online:
Online:
Online:
Point virtualization technologies can accomplish near-term goals but create long-term problems.
43© Copyright 2010 EMC Corporation. All rights reserved.
App Provisioning: All Resources Virtualized
Install operating systems
Authenticate users or applications
Allocate server resources
Set up storage environments (disk, SAN, or NAS)
Configure networks
Allocate storage resources to and from the available pool
Online:Effect
Online:Effect
Online:Effect
OS
OS
OS
Unified Network
Virtualization of all resources: continuous online operation.
44© Copyright 2010 EMC Corporation. All rights reserved.
A Unified Virtualization Infrastructure
Each application sees its own logical server, independent of physical
servers
Each application sees its own logical storage, independent of physical
disks
Virtual Storage
Virtual Servers
OSOS
OS
Unified Network
Virtual Networks
45© Copyright 2010 EMC Corporation. All rights reserved.
A Unified Virtualization Infrastructure
Consistent models of the entire virtual infrastructureManagement: Enables end-to-end dynamic provisioning, troubleshooting, and optimizationSecurity: Enables transparent consistent security policy application, monitoring and compliance reporting
Managing and Securing Virtualization
Virtual Storage
Virtual Servers
OSOS
OS
Unified Network
Virtual Networks
46© Copyright 2010 EMC Corporation. All rights reserved.
Virtualized Data Center
Internal Cloud
Cloud Computing
External CloudSecurity
Virtualization
Information
Flexible
Dynamic
On-demand
Efficient
Trusted
Control
Reliable
Secure
Journey to the Private Cloud
47© Copyright 2010 EMC Corporation. All rights reserved.
Private Cloud
External Cloud
Virtualized Data Center
Internal Cloud
Cloud Computing
Security
Virtualization
Information
Federation
Journey to the Private Cloud
48© Copyright 2010 EMC Corporation. All rights reserved.
Virtualized Data Center
Security
Virtualization
Information Cloud Computing
Private Cloud
Federation
External CloudInternal Cloud
AppLoads
AppLoads
AppLoads
AppLoads
AppLoads
Virtual Applications
Virtual ClientVirtual ClientVirtual Client
Journey to the Private Cloud
Distributed Virtualization: Foundation for Private Clouds
49© Copyright 2010 EMC Corporation. All rights reserved.
Moving a Virtual Machine over Distance: Distributed Virtualization in Action
VM Movement Requirements1. Preserve Shared Storage Access
Example: VPLEX
2. Preserve Network ConnectivityExample: OTV
3. Move the Virtual MachineExample: VMotion
4. Optimize External Network AccessExample: DNS based route optimizationVery useful, not an absolute requirement
Distributed Virtualization used to meet first three requirements
Site ASite A Site BSite B
Heterogeneous
Distributed Storage
VMotion
1
2
3
44
VPLEX Metro VPLEX
ClusterVPLEX
Cluster
Network A Network B
50© Copyright 2010 EMC Corporation. All rights reserved.
Private Cloud: Mobility Vision
Non-disruptive movement:
1. Any Workload2. Any Where3. Any Time
Reality Check: Can’t repeal the laws of physics– But magic (sufficiently advanced technology) is still possible
Private Cloud
Virtualized Data Center
Cloud Computing
51© Copyright 2010 EMC Corporation. All rights reserved.
Conclusions and Recommendations
Conclusions:– Server, network, and storage virtualization
Virtualization benefits increase with extent of deployment– Virtualization can be distributed
Virtualization benefits extend across multiple locations– Distributed Virtualization: Key enabler of Private Cloud
Enables application mobility among locations
Recommendations:– Virtualization is a strategic decision
Don’t let short-term tactics disrupt your long-term strategy– Pick your partners wisely – virtualization is not a technology you implement
and then remove – it’s around for the long haulTechnology, services, and support
52© Copyright 2010 EMC Corporation. All rights reserved.
Related EMC World Sessions (selected subset)
Server Virtualization– Microsoft Corporation: Microsoft Virtualization - A Technical Look Into Microsoft
Hyper-V and Microsoft Systems Center– Vision Into the Future of Desktop Virtualization (VMware)– vSphere vStorage Technologies
Unified Virtualization: Mobility– Cisco: Workload Mobility across Data Centers with innovations from VMware, Cisco
and EMC – includes Cisco OTV and VMware VMotion across data centers;
Unified Networks (storage)– Converged Data Center: FCoE, iSCSI and the Future of Storage Networking
VPLEX (sessions TBA)
top related