MicrosoftVirtual Academy

Hyper-V High Availability and Live Migration

Symon Perriman Jeff WoolseyTechnical Evangelist Principal Program Manager

Introduction to Hyper-V Jump StartFirst Half Second Half

(01) Introduction to Microsoft Virtualization

(05) Hyper-V Management

(02) Hyper-V Infrastructure (06) Hyper-V High Availability and

Live Migration

(03) Hyper-V Networking (07) Integration with System Center

2012 Virtual Machine Manager

(04) Hyper-V Storage(08) Integration with Other System

Center 2012 Components

** MEAL BREAK **

MicrosoftVirtual Academy

• High Availability Planning• Cluster Deployment• Hyper-V Optimization on a Cluster• Cluster Shared Volumes & Live Migration• Hyper-V Replica

Agenda

High AvailabilityPlanning

Why is HA Important?• Server downtime is inevitable• Servers will go offline due to

• Maintenance• Upgrade • Software or Hardware

• Update• Hotfix, Security Patch

• Disaster• Power Outage• Accident

Complete Redundancy In the BoxDisaster Recovery

• Hyper-V Replica for Asynchronous Replication• CSV 2.0 Integration with Storage Arrays for Synchronous

Replication

Application/Service Failover

• Non-Cluster Aware Apps: Hyper-V App Monitoring• VM Guest Cluster: iSCSI, Fiber Channel• VM Guest Teaming of SR-IOV NICs

I/O Redundancy• Network Load Balancing & Failover via Windows NIC Teaming• Storage Multi-Path IO (MPIO)• Multi-Channel SMB

Physical Node Redundancy

• Live Migration for Planned Downtime• Failover Cluster for Unplanned Downtime

Hardware Fault • Windows Hardware Error Architecture (WHEA)• Reliability, Availability, Serviceability (RAS)

Overview of Failover Clustering

Public

Shared Storage

VMs & Workloads

VMs & Workloads

Host ClusteringAvoids a single point of failure when consolidatingVMs survive host crashes

VMs restarted on another node

Restart VM crashesVM OS restarted on same node

Recover VM hangsVM OS restarted on same node

Zero downtime maintenance & patchingLive migrate VMs to other hosts

Mobility & load distributionLive migrate VMs to different servers to load balance

SAN

Cluster

Guest ClusteringApplication Health MonitoringApp or service within VM crashes or hangs and moves to another VM

Application MobilityApps or services moves to another VM for maintenance or patching of guest OS

Virtualized HBAsiSCSI (2008 R2 & 2012)Fibre Channel (2012)

Combine physical &virtual servers

iSCSI or FC

Cluster

Combining Host & Guest Clustering Best of both worlds for flexibility and protection

VM high availability & mobility between physical nodesApplication & service high availability & mobility between VMs

Increases complexity

CLUSTER CLUSTERiSCSI or FC

Guest Cluster

SAN SAN

Increased Scalability8,000 VMs across 64 nodes1,024 VMs per node

320 logical processors per host64 virtual processors per VM

4 TB of RAM per host1 TB of RAM per VM

64 TB per virtual disk (.vhdx)More storage choicesHyper-V over SMBVirtual Fibre Channel HBA (guest clustering)

. . .

Sca

le u

p

Scale out

..

.

Failover Cluster Deployment

Hyper-V Validation TestsFaster storage validationSelect a specific LUNReplicated storage for multi-siteNew Hyper-V Configuration Tests

Run when Hyper-V role is installedIntegration ComponentsMemory CompatibilityVirtual Switch CompatibilityHyper-V Role EnabledNetwork ConfigurationStorage Configuration

Upgrading Clusters to Windows Server 2012Cluster Migration WizardAutomated export / import of VMsMigrate to CSV disksStorage mappingVirtual network mappingUse the same storage or different storage

Hyper-V Optimization on a Cluster

• Start Order• Node Maintenance• Running Priority

• Pre-emption shuts down lower priority VMs

• No Auto Start• Must be restarted manually

Virtual Machine Priority

High Medium Low

Disable Starting Low Priority VMs

• ‘Auto Start’ setting configures if a VM should be automatically started on failover• Group property• Disabling mark groups as lower priority• Enabled by default

• Disabled VMs needs manual restart to recover after a crash

Also in Windows Server 2008 R2

Keep VMs on Preferred Hosts• ‘Preferred Owners’• VMs will start on preferred host

• ‘Possible Owners’• VMs will start on a possible owner, only if a

preferred owner is not available

• If neither a preferred or possible owner is available, the VM will move to an active node, but not start

Start VMs on Preferred Hosts• ‘Persistent Mode’ will attempt to

place VMs back on the last node they were hosted on during start• Only takes affect when complete cluster is started up• Prevents overloading the first nodes that startup with

large numbers of VMs

• Better VM distribution after cold start

• Enabled by default for VM groups• Option is hidden from GUI in 2012

Keep VMs off the Same Host• AntiAffinityClassNames

• Groups with same AACN try to avoid residing on the same node• Configured by PowerShell directly on the cluster • System Center 2012 VMM has a GUI “Availability Groups”• Enables VM distribution across host nodes for best resource utilization• Scenarios

• Separate similar VMs• Guest cluster nodes• DCs or infrastructure servers

• Separate tenets• For affinity, use preferred owners

CLUSTER

• Enable VM heartbeat setting• Requires Integration Components (ICs)

installed in VM

• Health check for VM OS from host• User-Mode Hangs• System Crashes

VM Health Monitoring

SAN

VM Guest Service MonitoringThe host monitors the guest VMAny application with a serviceUses Service Control Manager

Configurable recovery actionsRestart serviceReboot VMMove VM

Node Drain (Node Maintenance) ModeDrain all VMs off a nodeSupports all cluster roles Role-specific featuresLive migration or quick migration for VMs Uses VM Priority

Suspend-ClusterNodeResume-ClusterNode

Windows Update

• Automated cluster updating• Coordinator serially updates all nodes

• Windows Update Agent (WUA)• Windows Server Update Services (WSUS)• Windows Update

• Workflow1. Scan nodes to find which patches are needed2. Identify node with fewest workloads3. Move workloads or live migration VMs to other nodes4. Call to WUA to patch 5. Verify patch is successful6. Repeat steps 2 – 5 on next node7. Repeat on remaining nodes

Cluster-Aware Updating UpdateCoordinator

So You’re a Building a Cloud…

I have good processes in place, but what other

safeguards can I use to protect my data?

Server Hard Disks Appear on eBayReal Case : A US Power Company

• The Company had processes in place to either physically

destroy drives or scrub them to U.S. DOD standards

• Degaussing

• Overwriting the data with a minimum of three specified patterns

• Data on drives used in servers, contained:

• Proprietary company information such as memos, correspondence

• Customers data (460,000+) & Confidential employee information

According to Gartner about 1/3 companies use outside firms to dispose of PCs & Servers

HIPAA Breach: Stolen Hard Drives• March 2012: Large Medical Provider in Tennessee paying

$1.5 million to the US Dept. Health & Human Services• Theft of 57 hard drives that contained protected health information (ePHI) for over 1 million

individuals

• Secured by:• Security Patrols• Biometric scanner• Keycard scanner• Magnetic locks• Keyed locks

“71% of health care organizations have suffered at least one data breach within the last year” -Study by Veriphyr

Critical Safeguard for the CloudEncrypted cluster volumes

• BitLocker encrypted cluster disks• Support for traditional failover disks

• Support for Cluster Shared Volumes

• Cluster Name Object (CNO) identity used to lock and unlock Clustered volumes

• Enables physical security for deployments outside of secure datacenters• Branch office deployments

• Volume level encryption for compliance requirements

• Negligible (<1%) performance impact

Cluster Shared Volumes & Live Migration

Cluster Shared Volumes (CSV)All cluster nodes can read/write to the CSV volumeLUN ownership by node abstracted from applicationApplications failover without drive ownership changesNo dismounting and remounting of volumesFaster failover times (less downtime)

New CSV Architecture in Windows Server 2012What it delivers Improved interoperability with file system mini-filter drivers

Anti-virus softwareBackup software (No more redirected mode for backups!)

Infrastructure for application consistent distributed backupsIntegrate with new file system features

Support for Offloaded Data Transfer (ODX)Spot-fixing integrated to do online correction

Significant performance improvementsSupports BitLocker encrypted volumesMemory mapped files now supportedNo longer Active Directory dependencies for improved performance and resiliency

Your Thoughts on VM Mobility

• Don’t provide new features that preclude Live Migration.

• I want to be able to securely move any part of a VM anywhere at anytime. No Limits.

• No Downtime Servicing• SAN Upgrades/Migrations

• When VMs migrate, move the historical data with the VM

• Fully Leverage hardware to speed migrations

Improved Live Migration• Live Migration Queuing• Concurrent Live Migrations

Concurrent Live Migrations:

Multiple simultaneous LMs for a given source or target

Live Migration Queuing:In-box tools queue & manage

large numbers of VMs

Entire VM memory copied

Live Migration

May be additional incremental data copies until data on both nodes is essentially identical

Memory content is copied to new

serverLive Migrate

VHD

SAN

Enable-VMMigration, Move-VM

Live MigrationSession state is maintained

No reconnections necessary

Clients stay connected to VM

ARP redirects clients to new nodeOld VM deleted after success VHD

SAN

Client directed to new host

Multiple live migrations can be performed either concurrently or as a queued request

Live Migration with SMBFile Based Storage SolutionStorage is not moved, just the running virtual machineLike live migration in a cluster, without high availability

Requires SMB 3.0

Shared Nothing Live Migration Ability to live migrate a virtual machine with only an Ethernet cableThe VM is mirrored to the destination first over the network and then the VM is migratedLive Migrate in/out clusterLive Migrate between clusters

Storage MigrationMove any part of a running virtual machine with no need to turn it offVHDsConfig filesSnapshots

Perform storage upgrades with no downtimeRespond to I/O bottlenecks with no downtime

Move-VMStorage

Storage Migration ArchitectureHyper-V

VHD Software

Virtual Machine

Source Device Destination DeviceVHD

Storage Migration ArchitectureHyper-V

VHD Software

Virtual Machine

Source Device Destination DeviceVHD VHD

Storage Migration ArchitectureHyper-V

VHD Software

Virtual Machine

Source Device Destination DeviceVHD VHD

Storage Migration ArchitectureHyper-V

VHD Software

Virtual Machine

Source Device Destination DeviceVHD VHD

Storage Migration ArchitectureHyper-V

VHD Software

Virtual Machine

Source Device Destination DeviceVHD

Move-VMStorage "File Server 3" –DestinationStoragePath "K:\File Server 3"

Hyper-V Replica

45

Disaster Recovery Challenges

• Cost

• Complexity

• Inflexibility

• Initial Replication

• Distance Requirements

46

Hyper-V Replica

Disaster recovery scenarios Planned, unplanned, and test failoverPre-configuration for IP settings for primary/remote location

Key featuresRecovery point objective and recovery time objective in minutesSeamless integration with Hyper-V and clusteringAutomatically handles all VM mobility scenarios (e.g. live migration)Supports heterogonous storage between primary and recoveryIntegrates with Volume Shadow Services (VSS) Enable-VMReplication

Set-VMReplicationServer

NASA Image: Hurricane Sandy

Hurricane Sandy: Email from 10/30/12

Good morning;The Hurricane hit our area badly; many downed trees, even on my wife’s car. Flooding and total power cuts were everywhere. We are very grateful that everyone is well.I now want to thank the Microsoft 2012 server team for giving businesses the new replica feature. Two of our clients (both whom cannot be without their IT infrastructure) were flooded entirely, and might take 2 weeks to get back into their businesses. At 7pm last night we failed over their entire domains to the Replica site, and they have been able to continue their daily business with ZERO interruption. “Windows Server 2012 saved their business”.

Hyper-V ReplicaComplements Array Based Replication

Replication Provider

Cost Management Performance

Hyper-VReplica

Microsoft • Flexible Storage Options Available

• Unlimited VM Replication included

• VM Granularity• Open APIs

provide extensibility, interoperability and prevent vendor lock-in

• 5 minutes RPOs• Application Level

Consistency• File Level

Consistency

Storage Based

Replication

NetApp, HP, Fujitsu,IBM, Hitachi,

FalconStor, 3Par, EMC, LSI, Compellent, EqualLogic and

more…

• High end replicating storage

• Additional replication software

• LUN-VM Layout• Coordination

with storage team

• Synchronous Replication

• High Data Volumes

Key Hyper-V Replica TakeawaysEasy to SetupVia wizardOr, via PowerShell

Works with your current hardwareAll you need is two connected servers running Windows Server 2012No Guest Dependencies

©2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Office, Azure, System Center, Dynamics and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

New Live MigrationsStorage live migrationNetwork live migration“Shared nothing” live migrationHyper-V Replica

New Live Migrations

Branch Office

VHD

Storage Live Migration:Moves VHDs from one disk to

another, supports concurrent LMs

Hyper-V Replica:Point-in-time

replication of VHDs for disaster recovery

SAN

VHD

Network Live Migration: Moves VMs across the

network, supports concurrent LMs Network

“Shared Nothing” Live Migration:

Moves VMs & VHDs across the network & SAN, supports concurrent

LMs

Network