sto2986bu vsan technical deep dive or distribution · 2019-06-27 · swaroop dutta eric knauft...

Swaroop DuttaEric Knauft

STO2986BU

#VMworld #STO2986BU

vSAN TechnicalDeep Dive

VMworld 2017 Content: Not fo

r publication or distri

bution

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

2



bution

VMware vSAN Delivers a Native vSphere Architecture

Runs on any standard x86 server

Pools HDD/SSD into a shared datastore

Delivers enterprise-grade scale and performance

Managed through per-VM storage policies

Deeply integrated with the VMware stack

vSphere vSAN

vSAN DatastoreVMworld 2017 Content: N

ot for publicatio

n or distribution

March 2015

All Flash

64 Node Cluster

2x Hybrid Speed

Sep 2015

Stretched Cluster

Replication: 5min

RPO

2-node ROBO

March 2016

Deduplication

Compression

RAID5/6

Quality of Service

vSAN 6.0 vSAN 6.1 vSAN 6.5

Accelerating Innovation

VSAN 5.5 vSAN 6.2

Nov 2016

iSCSI Support

2-Node Direct

Connect

Large Capacity

Drives



bution

Rapid Pace of Innovation: vSAN 6.6 Biggest Release Ever!20+ New Major vSAN Features

3/2014

v5.5

• Distributed RAID• Per-VM SPBM• Set and change FTT via

policy• In-kernel hyper-

convergence engine• RVC and Observer

3/2015

v6.0

• All-flash architecture• Perf improvements (4x

IOPS)• 64-node support• High density storage

blades• Fault domain awareness• Scalable snapshots and

clones• Disk enclosure

management

8/2015

v6.1

• Windows Failover Clustering

• Oracle RAC support• HW checksum and

encryption• 2-node ROBO mode• UltraDIMM and NVMe

support• Stretch clusters• 5 min RPO (vSphere Rep) • SMP-FT support• Health Check, vROps,

LogInsight

2/2016

v6.2

• IPv6 support• Software checksum• Nearline dedup and

compression on all-flash

• Erasure coding on all-flash

• Qos: IOPS limits• Performance

monitoring service

10/2016

v6.5

• iSCSI• 2-Node direct connect• PowerCLI• Public APIs and SDK• 512e support• All-Flash to all editions

• Native encryption for data-at-rest• Compliance certifications• Resilient management independent of vCenter• Degraded Disk Handling v2.0 (DDHv2)• Smart repairs and enhanced rebalancing• Intelligent rebuilds using partial repairs• Certified file service & data protection solutions• Stretched clusters with local failure protection• Site affinity for stretched clusters• 1-click witness change for Stretched Cluster• vSAN Management Pack for vRealize• Enhanced vSAN SDK and PowerCLI• Simple networking with Unicast • vSAN Cloud Analytics with real-time support

notification and recommendations• vSAN Config Assist with 1-click hardware

lifecycle management• Extended vSAN Health Services• vSAN Easy Install with 1-click fixes• Up to 50% greater IOPS for all-flash with

optimized checksum and dedupe• Support for new next-gen workloads• vSAN for Photon in Photon Platform 1.1• Day 0 support for latest flash technologies• Expanded caching tier choice• Docker Volume Driver 1.1

4/2017

v6.6

© 2017 VMware Inc. All rights reserved. Confidential – Not for Distribution(vSphere 6.5 EP02 Patch)



bution

vSAN 6.6.1

6

Enhanced Operations

✓Partial Rebuilds

✓Smart Repairs

✓Point Fix

✓What-Ifs

✓Resync Throttling

s

All-Flash

Optimizations

✓Support for Intel Xeon

Scalable

✓All-Flash performance

improvements

✓New Platform Support

Management

✓Firmware/driver auto

updates

✓Performance Analytics

✓Analytics-based KB

awareness

Security &

Availability

✓Encryption

✓Local Failure Protection

for Stretched Clusters



bution

Secure Data with vSAN Data-at-Rest Encryption

• Datastore level, data-at-rest encryption for all objects on vSAN Datastore

• Enabled at cluster level, supporting hybrid, all-flash, and stretched clusters

• No need for self encrypting drives (SEDs), reducing cost and complexity

• Works with all vSAN features, including deduplication and compression

• Integrates with KMIP compliant key management technologies, including SafeNet, Hytrust, Thales, Vormetric, etc.

vSphere vSAN

vSAN Datastore



bution

Encryption – Details

8

• Encryption key in memory used to encrypt data and then place in cache tier and destaged to capacity tier

• Data remains deduped and compressed with encryption

• Provisioning of KMS is same for VMcryptand vSAN Encryption

• Workflows factored for host reboots, adding new hosts or changing keys VMworld 2017 Content: N

ot for publicatio

n or distribution

Low Cost Local and Remote Protection for Stretched Clusters

vSphere vSAN

ClusterCluster

5ms RTT, 10GbE

• Redundancy locally andacross sites

• With site failure, vSAN maintains availability with local redundancy in surviving site

• No change in stretched cluster configuration steps

• Optimized site locality logic to minimize I/O traffic across sites

RAID-6

3rd site for

witness

RAID-6

RAID-1



bution

Increase Flexibilitywith Site Affinity for Stretched Clusters

vSphere vSAN

ClusterCluster

• User can specify single site location of VM’s components if site level protection is unnecessary

• Policy driven using SPBM

• Reduces network and storage requirements by running workloads closer to the clients

3rd site for

witness

RAID-6



bution

Stretched Cluster Optimizations

11

vSphere vSAN

ClusterCluster

5ms RTT, 10GbE

RAID-6

3rd site for

witness

RAID-6

RAID-1

Proxy

• Data needs to be sent to multiple replicas on the remote site

• Will consume network bandwidth if not optimized

• vSAN sends copies once to a proxy on the remote site

• Proxy will replicate the copies as many times required locally

• Network bandwidth is conservedVMworld 2017 Content: N

ot for publicatio

n or distribution

Intelligent Rebuilds Using Enhanced Rebalancing

vSphere vSAN

vSAN Datastore

• Allows rebalance even when disks are mostly full by splitting large components to fit in free space

• Improved visibility in rebalancing status in Health Services

• New customizable “throttling” of resync activity using slider bar



bution

Component Splitting and Reporting for Enhanced Rebalancing

R1

C2C1

R1

R0C1

C4C3

• C2 is split into smaller C3 and C4 components

• C3 and C4 can now fit into available space – avoids further resyncs, rebalance

• Health services now shows resyncing components, amount left to resync and components that are resyncingVMworld 2017 Content: N

ot for publicatio

n or distribution

Intelligent Rebuilds Using Partial Repairs

• More resilient repair process

• Repairs as many components as possible even if not enough resources to ensure fullcompliance

• Remaining components will be repaired as soon as enough resources are available

• Works in non-stretched and stretched clusters

Replica

Status: Two host failures

Configured policy: FTT2

Effective compliance: FTT0

Replica Replica WW



bution

Intelligent Rebuilds Using Partial Repairs

• More resilient repair process

• Repairs as many components as possible even if not enough resources to ensure fullcompliance

• Remaining components will be repaired as soon as enough resources are available

• Works in non-stretched and stretched clusters

Status: Partial repair completed

Configured policy: FTT2

Effective compliance: FTT1

Replica Replica Replica ReplicaReplicaW



bution

Intelligent Rebuilds Using Smart, Efficient Repairs

• Two methods for repairs of offline components reappearing after 60 minutes.

• Calculates cost of methods of repair at time host comes back online

• Will choose most efficient method, and cancel other action

• Significant improvement in speed and efficiency of component repairs

R1

C2C1C1

ReplacementComponent(Partially Repaired)

Absent CompComes Back

Which is Faster?



bution

Health Monitoring —Decommissioning Host Improvements

• Conducts a precheck for free space prior to maintenance mode decommissioning

• Dialog and report shown prior to entering maintenance mode

• Decommission check occurs for disk and disk group removals

• Tries smaller components to fit in remaining free space

• Reduced amount of temporary space during decommissioning effort

vSphere vSAN

vSAN Datastore



bution

Health Monitoring —vSAN Degraded Device Handling Enhancements

• Smarter intelligence in detecting impending drive failures

• If replica exists, components on suspect device marked as “absent” with standard repair process

• If last replica, proactive evacuation of components occurs on suspect device

• Any evacuation failures will be shown in UI

vSphere vSAN

vSAN Datastore



bution

New vSAN Cloud AnalyticsDelivers Proactive Guidance

Performance diagnostics to verify expected performance and report anomalies if encountered

• Cloud-based health checks for easy, online known issue detection tied to relevant support notices (KBs)

• New analytics framework results in:

– Identified and relevant issues showing up immediately as health check notifications

– Continuous updates with cloud model—no need to wait for subsequent vSAN releases

• Reduce troubleshooting with prescriptive, environment specific analytics

• All information sent to VMware anonymized

checks/

KBs

VMware Customer Experience Improvement Program

vSAN Cloud Analytics



bution

Cloud-connected Performance Diagnostics

• Provides diagnostics for benchmarking & PoCs

• Specify one of three predefined areas of focus for benchmarks:

– Max IOPS

– Max Throughput

– Min Latency

• Integration into HCIBench

• Output automatically sent to cloud for analysis

• Provides results of analysis in UI

• Detects issues and suggests remediation steps by tying to specific KB articles

NEWvSAN 6.6.1

vSphere vSAN

HCIBench

Analysis

Detect issues

Visible to GSS

Feedback

Site results

Links to KBs

vSAN Cloud Analytics

VMware Customer Experience Improvement Program



bution

vSAN integration with vRealize Operations

• Prebuilt vSAN dashboards with multi-site visibility and analytics

• Fully integrated natively into vRealize Operations 6.6

• Prebuilt dashboards

• Easily customize to expose data you want to see

• Display vSAN and non vSAN metrics together

Aggregate cluster statistics

Cluster specific statistics



bution

VMware Update Manager (VUM) Integration

• Simplifies upgrades and patching by verifying hardware compatibility

• Creates HCL aware baseline recommendations, scanning for critical patches or required drivers

• Will only upgrade to the highest level of HCL compatibility

• Automates VUM baseline creation, scanning and delivery of update packages and ISOs.

NEWvSAN 6.6.1

Custom Baseline

Update to 6.6.1 Update drivers

Update to 6.6.1

Custom Baseline

Update drivers

Remain at 6.2

VUM

HCL Database

Release Catalog

vmware.com

Custom Baseline



bution

.

Intelligent, AutomatedOperations with vSAN Config Assist

• Simplify HCI Management with prescriptive one-click controller firmware and driver upgrades

• HCL aware. Pulls correct OEM firmware and drivers for selected controllers from participating vendors including Dell, Lenovo, Fujitsu, and SuperMicro

• Validate and remediate software configuration settings for vSAN

• Configuration wizards validate vSAN settings and ensure best practice compliance

vSphere vSAN

vSAN DatastoreVMworld 2017 Content: Not fo


bution

vSAN Performance Enhancements

.

• Reduced overhead of checksum

• Improved deduplication and

compression

• Destaging optimizations

• Object Management improvements

• iSCSI for vSAN performance

improvements

• More accurate cache sizing

guidelines

• New vSAN ReadyNode Sizer!

vSphere vSAN

vSAN Datastore



bution

Expand competitive advantage with Day 1 support of latest flash innovations

Simplify new technology adoption without a major forklift upgrade to infrastructure

Lower costs with higher consolidation ratios

© 2017 VMware Inc. All rights reserved. Confidential – Not for Distribution

Scale to Tomorrow with Latest Hardware Innovations

Next-Gen

Servers

Next-Gen Flash

(Intel 3D XPoint

NVMe)

* Source: VMware Internal Analysis based on stated pricing.

• Day 1 support of latest hardware

through industry’s best ecosystem

• Intel Purely Platform

• HPE Apollo and Synergy support

• Support larger caching drive options,

including 1.6TB flash drives

• Lower read latencies with vSAN and

new 3D XPoint NVMe drives from Intel

NEWvSAN 6.6.1



bution

New Apps and Hardware

.

VMware HCI

vSAN Datastore

• New reference architectures available for broader set of use cases

– Intersystems Caché

– Hadoop and Big Data

– XenDesktop/XenApp

– Kubernetes

– MongoDB

• Flexibility and choice with the latest hardware



bution



bution

sto2986bu vsan technical deep dive or distribution · 2019-06-27 · swaroop dutta eric knauft...

Documents