improving app performance and protection for …...#vmworld improving app performance and protection...
TRANSCRIPT
#vmworld
Improving App Performance and Protection for VMware:
NVMe, Cloud and BeyondColin Durocher, Dell EMC
Drew Tonnesen, Dell EMC
HYP3705BUS
#HYP3705BUS
VMworld 2018 Content: Not for publication or distribution
2
Agenda
Introduction to NVMe
Benefits of NVMe on VMware environments
2
Data protection advances for VMware environments• NVMe• Converged• Cloud
VMworld 2018 Content: Not for publication or distribution
3
Introduction to NVMe
VMworld 2018 Content: Not for publication or distribution
4
What is NVM and NVMeI N T R O D U C T I O N T O N V M e
NVM is non-volatile memory media
• NAND-based flash
• Storage Class Memory (SCM) media technologies such as 3D XPointTM
NVMe(Non-Volatile Memory Express)
• A set of standards which define a PCI Express (PCIe) interface used to access data on NVM
• Takes advantage of modern CPUs and SSDs
• Replaces older storage protocols
• NVMe unlocks up to 65536 queues, up to 65536 commands per queue
Standard developed by an open industry consortium
Directed by a 13 company promoter group which includes Dell
Core designobjective to achieve high levels of the following
• Parallelism
• Concurrency
• Scalability
4
VMworld 2018 Content: Not for publication or distribution
5
Conceptualizing NVMeI N T R O D U C T I O N T O N V M e
Concept attribution: J Metz, “The Data Robot Parable”
Flash + SCSI/SAS
Flash: all data blocks available at the same seek time & latency
SCSI /SAS: pick & place robot w/single arm executing 1 command at a time, 1 queue
HDD + SCSI/SAS
Slower Faster
HDD: varying speed conveyer belts carrying data blocks (faster belts = lower seek time & latency)
SCSI / SAS: pick & place robot w/tracked, single arm executing 1 command at a time, 1 queue
Media
Protocol
5
Flash + NVMe
Flash: all data blocks available at the same seek time & latency
NVMe / PCIe: pick & place robot with 1000s of arms, all processing & executing commands simultaneously, over 64K queuesVMworld 2018 Content: Not for publication or distribution
6
Storage technology transitions
HDD 7K, 10K, 15K
M E D I ATransitions
D R I V E I N T E R FAC E
Transitions
H O S T I N T E R FAC E
Transitions
NAND FLASHSLC, MLC, TLC
SCMe.g. 3DXP
PARALLEL SCSI & ATA
FIBRE CHANNEL SAS & SATA NVMe
SCSI FIBRE CHANNEL NVMeoF
6
VMworld 2018 Content: Not for publication or distribution
7
Addresses latency / capacity gap between DRAM and NAND SSDs
S C M F I L L S T H E G A P, N V M E I S T H E P A T H T O G E T T H E R E
10ns 1us 10us1ns 100ns 100us 1ms 10ms
HDDStorage Class
Memory (e.g., 3D XPoint)DRAMProcessor
SRAMAccessLatency
Rel
ativ
e ca
paci
ty
CAPACITY/LATENCY GAP
$$$$ $$$ $$ $ < $ << $
SSD(NAND Flash)
VOLATILE NON-VOLATILENVMe unlocks the power of SCM
7
VMworld 2018 Content: Not for publication or distribution
8 Storage Class Memory*
SASDISK ERA
SAS Protocol
NVMeMODERN ERA
NVMe Protocol
SAS NAND Flash Drives
NVMe NAND Flash Drives
Multi-controller Architecture with Multi-core CPUs
Multi-controller Architecture with Multi-core CPUs
Maximizing the Performance of a Multi-Controller Architecture
N V M E U N L O C K S T H E P O W E R O F N E X T G E N M E D I A
*SCM Drive coming soon8
VMworld 2018 Content: Not for publication or distribution
9
Flash becomes mainstream storage• Flash/SSD lowered cost ($/GB) over time make
AFA mainstream data center solution
• SSDs true potential not exposed because legacy protocols were designed based on older technology single core CPU, slow HDD + fast volatile memory (DRAM)
Emergence of NVMe• NVMe designed from ground to use flash.
Protocol exposes the parallel nature of NAND in SSD to increase performance and lower latency
• Common NVMe protocol & driver allow adoption of NVMe from multiple SSD suppliers and across multiple OS
Emergence of NVMeB U S I N E S S D R I V E R S
9
VMworld 2018 Content: Not for publication or distribution
10
NVMe host connectivity Simplest - an NVMe card in a server, direct access to storage on the server or directly to array
NVMe over Fabric (NVMeoF)
Fabric can be any of the following:• FC (most popular)• Ethernet• RoCE (RDMA over Converged Ethernet)• iWARP• Infiniband• Next Gen Fabrics
3DXP
3DXP SSD SSD SSD SSD SSD SSD
Controller Side Transport Abstraction
Host Side Transport Abstraction
NVMe Host Software
FibreChannel
InfiniBand RoCE Next Gen
FabricsiWARP
APPOS
APPOS
VMworld 2018 Content: Not for publication or distribution
11
Why NVMe over Fabric
PCIe Connections
NVMe SSDs
I M P L E M E N TAT I O NThin encapsulation, no translationUses existing Fibre Channel (32Gb/s) and co-exists with FC SCSI
U S E C A S E SIO parallelization and low latencyInvestment protection and increased scale
B E N E F I T SEnd to end performance optimizationEnabler for high performance shared storage
NVMeFC Fabric
NVMe HBA NVMe HBA
NVMe Array Controller
11
VMworld 2018 Content: Not for publication or distribution
12
NVMe
NVMe over Fabric
NVMe over Fabric SWITCH
SERVER
PowerMax
*Coming early 2019
M U LT I - C O N T R O L L E R
E N D T O E N D N V M e• NVMe over Fabric Ready*• NVMe based drives (dual ported)
• NVMe based DAE
I N D U S T R Y S TA N D A R D T E C H N O L O G Y
Future Proof NVMeD E L L E M C P O W E R M A X
12
Flash SCM*
VMworld 2018 Content: Not for publication or distribution
13 Slide credit: Intel and NVM ExpressSource: Storage Technologies Group, Intel. Comparisons between memory technologies based on in-market product specifications and internal Intel specifications.
Late
ncy
E N T E R P R I S E S T O R A G E S T A T E O F T H E A R T - 2 0 0 8
SERVER
FIBER CHANNEL
HOST
STORAGE NETWORK
VMAX1 / 2
Engine
Back End
Disk Shelf
SASHDD + SAS
Drive Latency Controller Latency(i.e. SAS HBA)
Software Latency
Flash SCM*HDDKEYVMworld 2018 Content: Not for publication or distribution
14
Late
ncy
Slide credit: Intel and NVM ExpressSource: Storage Technologies Group, Intel. Comparisons between memory technologies based on in-market product specifications and internal Intel specifications.
HDD + SAS
E N T E R P R I S E S T O R A G E S T A T E O F T H E A R T – 2 0 1 2
SERVER
FIBER CHANNEL
HOST
STORAGE NETWORK
VMAX3 / VMAX
All FlashV-Brick
Back End
Disk Shelf
SASNAND + SAS
Drive Latency Controller Latency(i.e. SAS HBA)
Software Latency
Flash SCM*HDDKEYVMworld 2018 Content: Not for publication or distribution
15
Late
ncy
Slide credit: Intel and NVM ExpressSource: Storage Technologies Group, Intel. Comparisons between memory technologies based on in-market product specifications and internal Intel specifications.
HDD + SAS
E N T E R P R I S E S T O R A G E S T A T E O F T H E A R T - 2 0 1 8
SERVER
FIBER CHANNEL
HOST
STORAGE NETWORK
POWERMAX
P-Brick
Back End
Disk Shelf
NVMeNAND + SAS
Drive Latency Controller Latency(i.e. SAS HBA)
Software Latency
NAND+ NVMe BE
Flash SCM*HDDKEYVMworld 2018 Content: Not for publication or distribution
16
Late
ncy
Slide credit: Intel and NVM ExpressSource: Storage Technologies Group, Intel. Comparisons between memory technologies based on in-market product specifications and internal Intel specifications.
HDD + SAS
E N T E R P R I S E S T O R A G E S T A T E O F T H E A R T – 2 0 1 9 +
SERVER
NVMeoF
HOST
STORAGE NETWORK
POWERMAX/SCM
P-Brick
Back End
Disk Shelf
NVMeNAND + SAS
Drive Latency Controller Latency(i.e. SAS HBA)
Software Latency
NAND+ NVMe BE
SCM+ NVMeEnd to end
Flash SCM*HDDKEYVMworld 2018 Content: Not for publication or distribution
17
R A N D O M R E A D S : P O W E R M A X 8 0 0 0 V S . V M A X 9 5 0 Fm
s R
espo
nse
Tim
e
IOs/sec
VMAX 950F
PowerMax 8000
50%More RRH IOPs!
8KRandom Read Hit
ONEEngine 950F
ONEBrick PowerMax 8000
VMworld 2018 Content: Not for publication or distribution
18
D S S W O R K L O A D : P O W E R M A X 8 0 0 0 V S . V M A X 9 5 0 Fm
s R
espo
nse
Tim
e
IOs/sec
VMAX 950F
PowerMax 8000
25%More Throughput
ONEEngine 950F
ONEBrick PowerMax 8000
128KDSS
VMworld 2018 Content: Not for publication or distribution
19
NVMe VMware benefits
19
v S A NNVMe controllers
available
V I R T U A L V O L U M E S
H I G H E R V M D E N S I T YConsolidation
V I R T U A L I Z E D D A T A B A S E S
B A C K U P & R E C O V E R Y
VMworld 2018 Content: Not for publication or distribution
20
• Highly virtualized environments requiring high IOPS and low latency
• Large Oracle / SAP deployments• Real time data processing and analytics
– Factory control / SCADA systems– Data warehousing– High end trading applications– Oil and Gas
• Large scale web services• Less applicable
– Cache friendly workloads (higher % of read hit / write hit)– Workloads which don’t tax backend storage such as
Microsoft Exchange
Where NVMe makes sense
20
Real-time analytics
Big Data
Machine Learning
VMworld 2018 Content: Not for publication or distribution
21
A D V A N C E S I N D A T A P R O T E C T I O N T O M A K E Y O U R L I F E E A S I E R
NVMe and converged
VMworld 2018 Content: Not for publication or distribution
22
C H A L L E N G E S R E Q U I R E M E N T S
Cloud extensibilityIncrease in data volumes, users, apps
Do more with less
Simplicity for quick time-to-value
Low cost-to-protect
Efficient cloud enablement
High performance
State of data protection today
VMworld 2018 Content: Not for publication or distribution
23
Higher performanceN V M E T M A N D D A T A P R O T E C T I O N
23
Instant Access and Restore of Virtual Machines
Fasterwith NVMeTM
flash
Use of backup storage appliance
for test dev
VM VM VM VM VM VM VM VM
VM VM VM VM VM VM VM VM
Spinoff VMs directly in backup storage
Backup Storage with NVMe Flash
VMworld 2018 Content: Not for publication or distribution
24
CloudDR + LTR
Search & analytics2
Backup servers & storage
NVMeflash
System management
Backup software
Days Hours
2U and 10x1 faster to deploy
Easy to deploy & upgrade
Simplicity in a Converged SolutionI N T E G R A T E D D A T A P R O T E C T I O N A P P L I A N C E D P 4 4 0 0
Highest density 2U
24TB–96TB +192TB withwithout additional HW
24
Simpler to deploy
Easier to manage
Lower total cost to protect
VMworld 2018 Content: Not for publication or distribution
25
Up to
2Xfaster backups1
Boosted application-direct
protection
NVMe flash for instant access
& restore
Powered by 14G PowerEdge Server
Power is Performance & Efficiency I N T E G R A T E D D A T A P R O T E C T I O N A P P L I A N C E D P 4 4 0 0
ESG Lab Review Additional information
Source-side deduplication
Up to
98%less bandwidth required2
7Xmore backup streams1
55:1Avg dedup3
25
VMworld 2018 Content: Not for publication or distribution
26
I N T R O D U C I N G
@ Lowest cost-to-protect.1
Guaranteed.2
26
Ideal for mid-size organizations and remote/back office environments1Dell EMC internal analysis using publically available competitive pricing, May 2018. Lowest cost-to-protect is based on $ per logical GB. Actual cost will vary.23 year satisfaction guarantee, hardware investment protection, clear price framework and up to 55:1 data protection deduplication guarantee under the Dell EMC Future Loyalty Program
Integrated Data Protection Appliance DP4400 Simply Powerful.
VMworld 2018 Content: Not for publication or distribution
27
A D V A N C E S I N D A T A P R O T E C T I O N T O M A K E Y O U R L I F E E A S I E R
What about Cloud
VMworld 2018 Content: Not for publication or distribution
28
DatabasesApplications Files
Public/Private/Hybrid/
DPaaS
LTR to Cloud DR to Cloud Protect in CloudBackup to Cloud
Policy
EVOLUTION OF DATA PROTECTION TO THE CLOUD
Data Protection to Cloud
Clients
VMs
S3/https Clients
VMs
S3/httpsS3/https
Current StateC O M P L E X I T Y
Multiple data siloesMultiple solutions/management consolesMultiple vendors/support organizations
VMworld 2018 Content: Not for publication or distribution
29
DatabasesApplications Files
Public/Private/Hybrid/
DPaaS
Policy
Ideal StateS I M P L I C I T Y
Single solution that can span data protection from on-premises, direct to cloud, and workloads in the cloudIntegrated and optimized for in-cloud data protectionOne vendor and support organization
Transformed Data Protection
Clients
VMs
S3/https Clients
VMs
S3/httpsS3/https
LTR to Cloud DR to Cloud Protect in CloudBackup to Cloud
SINGLE MANAGEMENT INTERFACE
VMworld 2018 Content: Not for publication or distribution
30
Long-term retention
Transform through the Cloud D E L L E M C D A T A P R O T E C T I O N
U P T O 192 TB w i t h C l o u d T i e r
VMware Cloud on AWSBackup/Long Term Retention Disaster Recovery In Cloud Workloads
EC2S3 Objects
+ +
Support for all phases of your journey to the cloud
VMworld 2018 Content: Not for publication or distribution
31
• DD
VMware Cloud on AWS
vSphere integrated
Amazon S3 cost optimized
- plus -
Up to 96 TB withDD VE
Deduplication
Solution• Enterprise-grade data protection
for hybrid cloud workloads
• Increased resiliency for VMware workloads running on AWS cloud
Benefits• Integration with on-premises data protection
simplifies administration
• Best-in-class deduplication lowers cloud consumption costs
• Deep management tool integration automates operations
• Dell EMC Data Protection Bundle (DP Software + DD VE) makes it easy to add on to your VMware Cloud subscription
1 s tData protection solution for VMware Cloud on AWS
VM VM VM VM VM VM VM VM
VMware Cloud on AWSD E L L E M C D A T A P R O T E C T I O N
VMworld 2018 Content: Not for publication or distribution
32
EC2 on demandS3 Objects
+VM
+
AWS as DR SiteOn-Premises Production
Application consistent recovery to the cloudC L O U D D I S A S T E R R E C O V E R Y
Simple to operate • Existing on-prem UI
• Direct in-cloud access
Advanced Capabilities• Eliminate DR Data center costs
• Application recovery to the cloud
• Deduplication to the cloud
• Up to 96 TB
Orchestrated DR • Test and failover to AWS
• Failback on-premises
• Recovery in minutes
• Multiple VMs DR PlansVMworld 2018 Content: Not for publication or distribution
33
Simple to operate • Existing on-prem UI
• Direct in-cloud access
• Recover to VMware Cloud on AWS
Efficient with End-to-End Orchestration
Minimal cloud cost & footprint• Protect directly to S3
• Eliminate DR data center costs
• Deduplication to the cloud
• Up to 96 TB
Orchestrated DR • Recover to VMware Cloud on
AWS
• Recovery in minutes
• Multiple VMs DR Plans
VM
+
EC2 on demandS3 Objects
VMC on demand
VMware Cloud on AWS as DR SiteProtect to S3, Recover to VMware Cloud on AWS
On-Premises Production
Extend your DR to VMware Cloud on AWSN E W – C L O U D D R T O V M W A R E C L O U D O N A W S
VMworld 2018 Content: Not for publication or distribution
34
On Premises• Optimized for virtual environments
• Provides application consistent backup
• Reduces backup time and network load
• Variable-length deduplication
• Daily full backups and one-step image recovery
In Cloud• Reduce backup storage 10 to 30x
• Reduce network traffic by up to 98%
• Reduce backup times by up to 50%
• Incremental forever backups
• Instant access for VM recovery
Software and Data Domain Efficient, reliable and low cost backup
D E L L E M C D A T A P R O T E C T I O N
+ +
VMworld 2018 Content: Not for publication or distribution
35
In Cloud Data ProtectionG R O W T H O F D A T A P R O T E C T I O N A S A S E R V I C E ( D P A A S )
27%CAGR growth rate*
Backup & recovery 58%
Disaster/site recovery 44%
24 x 7 support 44%
Mobile services40%
Archiving 40%
The market isAC C E L E R AT I N G
24%2018 year-over-year growth rate est*
*Technavio market research global backup as a service 2018-2022Source: IDC’s Cloud and AI Adoption Survey, January 2018, N=400, Percent of Sample
Top managed services
VMworld 2018 Content: Not for publication or distribution
36
R e f r e s h e d
vCloud Director Data Protection Extension
Seamless Integration• End-users can manage Data Protection for
their virtual datacenters directly from the vCD Tenant Portal, without the need to login to a separate interface
Cost effective• Industry leading deduplication minimizes
backup storage costs for service providers Performance and scale• A scale-out architecture provides unparalleled
levels of service performance
Simple, self-service data protection through an integrated tenant portal UI
VMworld 2018 Content: Not for publication or distribution
37
vCloud Director Organization
vCloud Director Data Protection extensionM U L T I - T E N A N T / M U L T I - T I E R D A T A P R O T E C T I O N S E R V I C E
CLOUD ADMINDefine policy templates, publish to tenant catalogsConfigure granular quotas on protected capacity
Tenant repository assignmentConfigure backup replication
TENANT ADMINApply Policies from catalog to vApps / VMs
In-place restore of vApps or VMsRe-directed restore of vApps or VMs
Self-service file-level recoveryMonitor Backups
vDC-Iowa
vDC-Ohio
AceIndustry
vApp 2Exchange
vApp N
VM 3
VM N
VM 1Client Access Svr
VM 2DB Available Group Svr
Virtual Data Center Services
VirtualData Center
VirtualData Center
VMworld 2018 Content: Not for publication or distribution
38
Seamlessly integrated tenant portal UI
Data Protection Service tab for embedded Data Protection(extension of vCD Client UI)
VMworld 2018 Content: Not for publication or distribution
39
Seamlessly integrated tenant portal UI
vApp Restore Workflows• Restore to new• Restore to original
VM Restore Workflows• Restore to new• Restore to original• File-level restore
VMworld 2018 Content: Not for publication or distribution
40
Power is Built For VMwareD E L L E M C D A T A P R O T E C T I O N
Comprehensive Data Protection Integration with
vSphereWeb Client
vSpherevCenter
vRealizeLog Insight
vRealizeAutomation
vCloudDirector
vRealizeOperations Manager
Protect more VMs Simple, cost effective to scale to more VMs Faster backups and recoveries
VMware Cloud on AWS
VMworld 2018 Content: Not for publication or distribution
PLEASE FILL OUTYOUR SURVEY.Take a survey and enter a drawingfor a VMware company store gift card.
#vmworld #HYP3705BUS
VMworld 2018 Content: Not for publication or distribution
THANK YOU!
#vmworld #HYP3705BUS
VMworld 2018 Content: Not for publication or distribution