Hyper-V Storage

Senthil RajaramSenior PMMicrosoft Corporation

agenda

• Deep Dive - Existing and New Options

• Virtual Storage Stack Improvements

• Example Configurations

Survey:

Top Impediment To Increased Virtualization?

MemoryNetwork Storage

CPU

35 %27 %45 %0 %

Hyper-V Enables Multiple Storage Options At Flexible Price-

Performance Points That Offer Continuously Availability & High

Scalability

Hyper-V & Shared StorageMore Options For Hyper-V Storage Deployments

New for Windows Server 2012

External Storage Arrays

Remote File Servers

Storage Spaces

Clustered PCI RAID

Hyper-V StorageLight Up External Storage Arrays

External Storage Array

LUN

Hyper-V Server

VM

Virtual Fibre ChannelExtends Fibre Channel Into VM’s

High Performance WorkloadsGuest ClusteringExposes SAN Functionality

Utilizes NPIV Functionality

SupportHost: Windows Server 2012

Updated NPIV HBA driver

Guest: >= Windows Server 2008

Live Migration Just Works

vHBA

WWN

NPIV HBA

VM

vHBA

WWN

Virtual Fibre Channel and Live Migration

Live Migrate

Shared Storage

WWPN A: C0:03:FF:78:22:A0:00:14

WWPN B: C0:03:FF:78:22:A0:00:15

WWPN A: C0:03:FF:78:22:A0:00:14

WWPN B: C0:03:FF:78:22:A0:00:15

1. Create A Temporary VM On Destination Hyper-V Server2. Connect Temporary VM’s HBAs To FC Fabric Using WWPN B 3. Verify Temporary VM Has Connectivity To Shared Storage

4. Complete Normal VM Live Migration (copy memory etc..) Limit IO Queue Depth To 1

5. Pause Source VM6. Change Temporary VM To Permanent VM and Start IO7. Logout of FC Fabric and Delete Source VM

Hyper-V Storage

Virtual Fibre Channel

Senthil RajaramSenior PMMicrosoft Corporation

Hyper-V Host

VHD Stack

Increased Storage Efficiency – UnmapUnmap

Storage Informed Of Unused Space

Efficiencies At Virtual LayerAllows Reuse Of Unused Blocks

Efficiencies At Physical LayerVMs Unmap Passed To Hardware

Supported OnVHDX & PassThru DisksVirtual SCSI or Virtual Fibre Channel

VHDX

External Storage Array

VM

Hyper-V Storage

Unmap Integration

Senthil RajaramSenior PMMicrosoft Corporation

Hyper-V Host

VHD Stack

Offloaded Data Transfer (ODX)Traditional Data Copy Model

Server Issues Read Request To SANData Is Read Into MemoryData Is Written From Memory To SAN

ProblemsIncreased CPU & Memory UtilizationIncreased Storage TrafficInefficient For SAN

External Storage Array

LUN1 LUN2

Hyper-V Host

VHD Stack

Offloaded Data Transfer (ODX)

Offload Enabled Data Copy ModelServer Issues Offload Read Request To SANSAN Returns Token Representing RequestServer Issues Write Request To SAN Using TokenSAN Completes Data Copy InternallySAN Confirms Data Was Copied

Reduce Maintenance TimeMerge, Mirror, VHD/VHDX Creation

Increased Workload PerformanceVM’s Are Fully ODX Aware and Enabled

External Storage Array

LUN2LUN1

Toke

n

Toke

n

Hyper-V Storage

ODX Integration

Senthil RajaramSenior PMMicrosoft Corporation

Hyper-V Storage

New Storage Options

SMB File Storage

File Server

Hyper-V Host

Share1

VHDVHD

X

Supports All Existing Scenarios

Enables New ScenariosShared Nothing LMCross-Cluster LM

Requires SMB 3.0

VM VM

VIR304-Building Flexible Hyper-V Env…

VIR306-Hyper-V over SMB

Handling Intermittent Network Failure

Resiliency: Transparently Re-establishes Network Connection

Temporary DisconnectX

Normal Operation1

Connections & Handles Re-establishedApplication Does Not Receive IO Error

3

1X3

Hyper-V Host

File Server

\\FS\Share

Hyper-V Host

File Server

13 1

Handling Permanent Network Failure

Multichannel: Transparently Uses Alternate Network Path

Permanent Disconnect

X

Normal Operation1

Connections & Handles Failover, Application Does Not Receive IO Error

3

X

\\FS\Share

Clustered

File Server

Node B

File Server

Node A

Handling File Server Node Failure

Continuous AvailabilityTransparently Fails Over Share To Different File Server

Failure of File Server,Share Failed Over To New Node

X

Normal Operation1

Connections Re-established,Application Does Not Receive IO Error

3

1

\\FS\Share\\FS\

Share

3

X

Hyper-V Host

ClusteredHyper-V Host A

File Server

Handling Hyper-V Node Failure

Cluster Client Failover (CCF)

VMs communicate identityEnables Quick Recovery

Hyper-V Host Failure, VM Starts On Different Hyper-V Node

X

Normal Operation1

Stale Handles Shot Down, New Handles Opened Without Delay

3

1

\\FS\Share

3

Hyper-V Host B

X

Host based Backup And Restore

Virtual Shadow Service For SMB

No Change in Flow For Backup

File Server

Hyper-V Host

\\FS\S1

VSS Service

Backup

Agent

Remote VSS

Agent

Remote VSS

Provider

VSS Service/ Provider

\\FS\S1~ Snap

Performance

SMB Direct (SMB over RDMA)Minimal CPU utilization for I/O processingHigh Throughput With Low Latency

SMB MultiChannelActive – Active Configuration

Setup & Administration

Management - Hyper-V & SMB PowerShell

Full Permissions On SMB Share & NTFS FoldersHyper-V Host Machine-Accounts VM Administrators

Hyper-V Host

Pool

Storage Spaces

Inbox Solution ProvidesPoolingThin provisioningResiliency

Simple SpaceMirror SpaceParity Space

Space

JBOD

WSV327-Vast Storage Capabilities for Everyone

Space

Hyper-V Host

Clustered

Storage Spaces & Clusters

Cluster Supports SpacesNot For Parity Spaces

Simple Direct IO from all Nodes

Mirrored SpaceCSV Redirection From Non-Owning NodesUse Low Latency Network (10G or RDMA) For Cluster Network

Hyper-V Host

CSVM-

SpaceM-

Space

Shared JBOD SAS

S-Spac

e

S-Space

Clustered PCI RAID

Host Hardware RAID In A Cluster

Resiliency To Node Failure LUN Fails Over

Resiliency To Disk FailureRAID

Hyper-V Host

Hyper-V Host

CSV

Clustered

Shared JBOD SAS

LUN

PCI RAID PCI RAID

WSV310-Cluster-in-a-Box, RDMA, and More

SAS

Hyper-V StorageVirtual Storage Stack Improvements

The New Default Format for Virtual Hard Disks

VHDX

Up To 64 TB

Larger Virtual Disks

MB Alignmen

t

Large Sector

Support

Enhanced Perf

Larger Block Sizes

Internal Log

Enhanced Resiliency

Embed Custom

Metadata

User Defined

Metadata

VHDX Performance - 32KB Random Writes

PassThru Fixed Dynamic Differencing125000

130000

135000

140000

145000

150000

155000

160000Disk VHD VHDX

10%

10%

Queue Depth 16

IOPS

VHDX Performance - 1MB Sequential Writes

PassThru Fixed Dynamic Differencing0

200

400

600

800

1000

1200

1400

1600

1800Disk VHD VHDX

Queue Depth 16

MB/S

25% 25%

Large Sector Support

Advanced Format/Large Sector Disk Types:Physical Media 4K

512eEmulated 512-byte Logical InterfaceRead-Modify-Write ( RMW )

4K Native: Exposes 4K Interface Directly

512B

Hardware

4K

Hardware

4K

4K

Hyper-V Host

Large Sector Support – 512e DisksSub-Optimal Performance For Existing VHDs ~30%

512b structures - Sector Bitmap, Header, Footer Parent LocatorsHardware Read-Modify-Write

Windows Server 2012 New VHDs 4K Aligned - PaddingBetter Performance, Reduced Need For RMW

No Auto Align For Existing VHDs

512e Disk

Hardware

RMW

LegacyVHD

4K AlignedOffset

Unaligned F(Off)+512b

VM

VHD

Aligned F(Off)+4 KB

VHD Performance on 512e

64KB Seq Writes0

1000

2000

3000

4000

5000

6000

7000 Unalinged AlingedRaw

IOPS

6000%

8KB Random Writes0

10

20

30

40

50

60

70

80

90

100 Unalinged AlingedRaw

IOPS

6000%

40%

Hyper-V Host

Large Sector Support – Native 4K Disks

Windows Server 2012 Supports Native 4K Disks

Software Read-Modify- Write

512b Logical Sector Virtual Disk

Performance Penalty For RMW

4K Logical Sector VHDX No Performance Penalty

VHD VHDX

512

4K

SoftwareRMW

VHDX

512

4K4K 4K

Native 4K Disk

VM

Reduce Downtime - Online MetaOperations

Reclaim Deleted Snapshot SpaceOnline Virtual Disk Merge

VM Storage MobilityOnline Virtual Disk Mirror

Quick DeploymentOnline SetParent

Hyper-V Storage Reclaim Deleted Snapshot SpaceQuick VM DeploymentSenthil RajaramSenior PMMicrosoft Corporation

Hyper-V Host

Parent Partitio

n

IO SCALING

VirtualStorage Stack

VM

VMDev

IO Throughput Was Limited By

1 Channel Per VMFixed VP For IO Interrupt Handling256 Queue Depth/SCSI, Shared For All Attached Devices

Windows Server 20121 Channel/16 VPs , Per SCSI256 Queue Depth/Device, Per SCSIIO Interrupt Handling Distributed Amongst VPs

Dev

Hyper-V Storage

Scaling IO

Senthil RajaramSenior PMMicrosoft Corporation

Related Technologies

CSV Read CacheBlock Cache Very Effective For VDI Boot Storm

Inbox De-Duplication EngineBlock Level De-DuplicationVery Effective For VHD Library Server

Not supported For Live VM Virtual Hard Disks

Hyper-V Storage

Example Configurations

SAN Configuration

Hyper-V Server Cluster

Cluster Shared Volume

Shared Virtual Fibre Channel LUN

Hyper-V Server ClusterSAN

Cluster Shared VolumeBlock Storage

Virtual FC

Fibre Channel or iSCSI

Fibre Channel or iSCSI

Block Storage

Virtual FC

Storage Space

Storage Space

Cluster Shared Volume

Cluster Shared Volume

File Share

File Share Configuration With Storage Spaces

Hyper-V Server ClusterHyper-V Server Cluster File Share

Shared SAS JBOD Array(s)

Windows Continuously Available File Servers

Mulit-ChannelSMB

Mulit-ChannelSMB

Hyper-V Server Cluster

Two Server High Availability

Storage Space

Cluster Shared Volume

Shared SAS JBOD Array(s)

Hyper-V Server

Hyper-V Server

Storage Space

Cluster Shared Volume

PCI RAID

Cluster Shared Volume

Shared SAS JBOD Array(s)

Hyper-V Server

Hyper-V Server

PCI RAID

Cluster Shared Volume

Related Content

Breakout Sessions

Session Code

Title

VIR306 Hyper-V over SMB2: Remote File Storage Support in Windows Server 2012 Hyper-V

VIR401 Hyper-V High-Availability & Mobility: Designing Infrastructure for Your Private Cloud

WSV334

Windows Server 2012 File and Storage Services Management

WSV327

Windows Server 2012 Storage Solutions: Vast Storage Capabilities for Everyone

VIR302 Enabling Disaster Recovery for Hyper-V Workloads Using Hyper-V Replica

VIR304 Building Flexible Hyper-V Environments: Hyper-V Live Migration and Live Storage Migration

WSV410

Continuously Available File Server: Under the Hood

Related Content

Hands-on Labs (session codes and titles)

Session Code

Title

VIR13-HOL Configuring Windows Server 2012 Hyper-V to Use Highly Available Storage

VIR21-HOL Configuring Windows Server 2012 Hyper-V Replica

VIR12-HOL Flexible Infrastructure with Windows Server 2012 Hyper-V

WSV-31-HOL Introduction to Storage Spaces in Windows Server 2012

Related Content

Product Demo Stations (demo station title and location)

Find Me Later At…

Location Title

VIR02-TLC Windows Server 2012 Hyper-V

WSV08-TLC Windows Server 2012 Storage

Location Title

VIR02-TLC Windows Server 2012 Hyper-V

SIA, WSV, and VIR Track Resources

Talk to our Experts at the TLC#TEVIR301

DOWNLOAD Windows Server 2012 Release Candidate

microsoft.com/windowsserverHands-On Labs

DOWNLOAD Windows Azure

Windowsazure.com/teched

Resources

Connect. Share. Discuss.

http://europe.msteched.com

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

Evaluations

http://europe.msteched.com/sessions

Submit your evals online

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS

PRESENTATION.