software defined storage - aventri...outlook: software defined storage sds is the key to the “next...
TRANSCRIPT
2 2
2
Software Defined Storage
The New Storage Platform
Anil Vasudeva President & Chief Analyst
IMEX Research
3 3
IT Industry Journey - Roadmap
Integrate Physical Infrast./Blades to meet CAPSIMS ®IMEX Cost, Availability, Performance, Scalability, Inter-operability, Manageability & Security
Integration/Consolidation
Standard IT Infrastructure- Volume Economics HW/Syst SW
(Servers, Storage, Networking Devices, System Software (OS, MW & Data Mgmt. SW)
Standardization
Cloudization On-Premises > Private Clouds > Public Clouds DC to Cloud-Aware Infrast. & Apps. Cascade migration to SPs/Public Clouds.
Virtualization Pools Resources. Provisions, Optimizes, Monitors Shuffles Resources to optimize Delivery of various Business Services
Automatically Maintains Application SLAs (Self-Configuration, Self-Healing©IMEX, Self-Acctg. Charges etc.)
Automation
IT Industry Roadmap by IMEX Research
Analytics – BI
Predictive Analytics - Unstructured Data From Dashboards Visualization to Prediction Engines using Big Data.
3 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Enterprise VZ Data Center On-Premise Cloud
Home Networks
Web 2.0
Social Ntwks. Facebook,
Twitter, YouTube… Cable/DSL…
Cellular
Wireless
Internet ISP
Core Optical
Edge ISP
ISP
ISP
ISP
ISP
Supplier/Partner
s
Remote/Branch Office
Public CloudCenter©
Servers VPN IaaS, PaaS
SaaS
Vertical
Clouds
ISP
Tier-3
Data Base
Servers
Tier-2 Apps
Management Directory Security Policy
Middleware Platform
Switches: Layer 4-7,
Layer 2, 10GbE, FC Stg
Caching, Proxy,
FW, SSL, IDS, DNS,
LB, Web Servers
Application Servers
HA, File/Print, ERP,
SCM, CRM Servers
Database Servers,
Middleware, Data
Mgmt
Tier-1
Edge Apps
FC/IPSANs
ScaleOut NAS
Data Centers & Cloud Infrastructure
4 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
H O S T
RA I D SOF TWARE
D
D I SK CONTROLLER
H O S T
High Availability RAID-1
Cost RAID-5
Performance RAID-3
JBOD
D
D I SK CONTROLLER
RAID – First SW Defined Storage 1988
5
© 2010-13 IMEX Research, Copying prohibited. All rights reserved.
RAID Arrays Software Creates Specific Storage Capabilities (High Availability, Performance or Cost)
Sources: Vasudeva, Anil “A Case for Disk Arrays” Presented at LAN Conference, Santa Clara, CA Aug 1988 Patterson D., Katz R, Gibson G “ A case for Redundant Array of Inexpensive Disks (RAID) UC Berkeley 1988
Virtualization led Workload Consolidation provides >20x Savings in RE, Pwr., HA
Multiple VMs create I/O Blender Effect
Virtualized Server Penetration
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
2011 2012 2013 2014 2015 2016
Virtualized Servers Penetration
WW Spending on Servers
Time
Provisioning
Hardware SAN
Network
Power & Cooling
DC Real Estate Disaster Recovery
Downtime
Co
st o
ver
3 y
ears
995 Pre-Virtualization (VZ) Servers 78 VZ Servers
VZ SW & Support
Virtualization: TCO Savings
Power/Cooling & Data Management & Bottlenecks in Physical Servers sharing Memory
50% of all servers in 2011 growing to 85% by 2016
Virtualization: Impact on IT Infrastructure
6 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
NextGen Applications Exploding
7
0
50
100
150
200
250
2013 2014 2015 2016 2017
# A
pp
licat
ion
s (#
K)
Applications Growth 2013-17
14 % growth
70 % growth
Traditional Applications NexGen Cloud Applications
© 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Traditional Applications
NextGen Cloud Apps
8 8
Data
: IM
EX
Researc
h &
Panasas
HPC &
Commercial Bioinformatics
& Healthcare
Entertainment-
Social Netwks
B-Intelligence
Big Data Productivity/
VDI
8
Apps leveraging ITaaS using SDDC
© 2010-13 IMEX Research, Copying prohibited. All rights reserved. © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
*IOPS for a required response time ( ms) *=(#Channels*Latency-1)
(RAID - 0, 3)
500 100
MB/sec 10 1 50 5
Data
Warehousing
OLAP
Business
Intelligence (RAID - 1, 5, 6)
IOP
S*
(*L
ate
nc
y-1
)
Web 2.0 Audio
Video
Scientific Computing
Imaging
HPC
TP
HPC
10K
100 K
1K
100
10
1000 K OLTP
eCommerce
Transaction
Processing
Workloads need Infrastructure Optimized for Cost, Availability, Performance …
Workloads: Key to Infrastructure Architecture
9 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
10
Srvrs
Storage Ntwk
SW
Srvcs
$-
$5
$10
$15
$20
$25
2011 2012 2013 2014 2015 2016
Re
v $
B
Big Data Market Syst .& Services
Big Data Analytics: Next IT Frontier
10 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Application’s SLA dictates the Resources Required to meet specific
requirements of Availability, Performance, Cost, Security, Manageability etc.
Platform Tools & Services / APIs
Operating Systems
Cloud Computing Public Cloud Service
Providers
Private Cloud
Enterprise
App SLA
Applications/Software as a Service
PaaS
IaaS
SaaS
Virtualization
Resources (Servers, Storage, Networks)
App SLA
App SLA
App SLA
App SLA
Man
ag
em
en
t
Hybrid
Cloud
Workloads/SLA Optimized Systems
11 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Need: A New Storage Architecture 1 Key Tenets of Virtualization (VZ)
Resources Utilization Costs
Uti
lizat
ion
63%
15%
Physical Servers
Virtual Servers
Compute & Networking
Storage Underperforms in VM Environments • Very Random, Write intensive I/Os from some
VMs get blended with Sequential, Read Heavy I/Os from other VMs resulting in: o Degraded Storage Performance by 30-50%
• Legacy Soln: Larger, more expensive storage configs created to meet needed IOPs o Storage Capacity wastage
• Other Effects o Poor Thin Provisioning & Snapshots/Cloning o Inefficient VM Management
2 Storage Performance Issues in VZ The VM I/O Blender – A key Culprit
3 Solution: Storage Defined Storage Improves Perf., Mgmt, Cost/Provisioning,Snaps
• Create a storage abstraction layer o Do for Storage like Hypervisor for Compute
Virtualizes Storage for Optimum Mgmt. • Unlock the Performance & Wasted Capacity of
Existing Storage by provisioning Storage as fast as VMS can be created o Improves storage performance by 10x o Improves Thin Provisioning & Snapshots o Reduces capacity consumption up to 90%
• Provide a VM-Centric Management paradigm o VM-Centric Management
• Integrate Seamlessly into existing Hypervisor
Hypervisor
Storage Hypervisor
VM 1
vDisk
VM 2
vDisk
VM 3
vDisk
VM n
vDisk
Storage Pool
Storage Hypervisor: Key to SDS
Storage Hypervisor Characteristics Improves Perf., Mgmt, Cost/Provisioning,Snaps
• Software Solution that deploys in each Host • Improves Storage Performance by up to 10x • Reduces Capacity Cosumption by up to 90% • Instantly provisions high performance Storage • Provides VM-Centric Mgmt. for Ease-of-use
Hypervisor
vDisk vDisk vDisk
VM n VM 2 VM 1 Virtual Storage
Appliance
Writes
vLogs Reads
Optimized de-staging
vSpace
Storage Hypervisor Architecture
• Removes Random Write I/Os to remove storage IO inefficiencies from Hypervisor
• Thin- Provisions vDisks to Outperform VMDKs to cut storage costs in half
• Enable CDP making fast and scalable High Performance Snapshots/Cloning
• Provides Instant Provisioning of High Performance Storage
• Provides transparent VMDK level Mgmt. • Lowers VDI Costs/desktop by 50%
New Role of IT: ITaaS
14
Virtual Workspace Manages Access to Services, Applications and Data for Any Device
Hybrid Cloud Seamlessly Extends Data Center to Public Cloud
Software-Defined Data Center Virtualizes the Entire Data Center
Management & Automation
Storage & Availability Compute Network & Security
© 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Software Defined Data Center Positioning IT for the Mobile-Cloud Era
15 © 2010-13 IMEX Research, Copying prohibited. All rights reserved. © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Positioning IT for the Mobile-Cloud Era
Virtualization Platform Has • Inherent knowledge of Requirements of Application • Global View of Infrastructure • Is Hardware agnostic
Converged Storage Pools
VM App OS
VM App OS
VM App OS
VM App OS
Virtualization Platform vSphere / Hyper-V / Xen / KVM/…
Virtualization Opens New Opportunities
16 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Hypervisor
IaaS
VM
App OS
VM
App OS
VM
App OS
VM
App OS
Infrastructure Control & Policy
17 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Proprietary
Software Defined Storage: Bringing Operational Mode of Compute to Storage
18 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
VAAI, VASA ,Storage v-Motion, Storage DRS..
VM Storage Policy
• Capacity • Performance • Availability
VM VM VM VM VM VM
SDS – VM Driven Data Services
19
De-Dupe
Replication
Encryption
Snapshots
Compression
Caching
Back Up
© 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Block Storage File Storage Object Storage
Control Plane
Data Plane
vSphere vSAN/vVols
vCenter Opns.Mgr.
Scale Out
NAS Storage High End Storage Mid-Range
Storage Open Storage
1
2
1
2
vCloud Automation Center
SDS-Control Plane Manages & Automates
20 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
vCloud
Block Storage File Storage Object Storage
Control Plane
Data Plane
Scale Out
NAS Storage High End
Storage
Mid-Range
Storage OpenStack
Storage
REST APIs REST APIs
Infrastructure & Application Software Vendors
SDS is a Programmable Platform
21 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM VM VM
VM
vSAN: Storage Hypervisor
22 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
VM VM VM VM VM VM VM VM
VM
Self-Tuning Dynamic Storage for VMs
23 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
VM Storage Policies Built in Advance
24
VM
VM Storage Policy
• Capacity • Performance • Availability
© 2010-13 IMEX Research, Copying prohibited. All rights reserved.
vDataStore Capabilities visible to vCenter vDataStore Capabilities visible to vCenter
25
1. At the time vSAN Cluster is created, the capabilities available in vSAN Datastores are read and automatically sent to vCenter
2. vCenter looks at these capabilities available in Datastores and sets VM Storage Policies
3. VM Storage Policies then have the Requirements of the Application running on the VM (Requirements such as Availability, Performance and Provisioning etc.)
© 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Storage Hypervisor (vSAN) Overview
26
Storage designed for
VMs
50% Lower TCO
Dynamic, Fast & Resilient
• Automated Storage Management via VM Storage Policies derived from Application Requirements
• Integrated with Hypervisor & Managed in vCenter
• SLA Requirements per VM managed by Intelligent Data Placement
• Instant Storage Provisioning • Built-In Resiliency/Protection
from HW failures • Dynamic Scalability to Grow from
TB to PB
© 2010-13 IMEX Research, Copying prohibited. All rights reserved.
From vCenter to vStores
27
VM
VM
VM
VM
VM
VM
VM
vCenter
© 2010-13 IMEX Research, Copying prohibited. All rights reserved.
ITaaS Cloud Model using SDDC
28 © 2010-13 IMEX Research, Copying prohibited. All rights reserved.
Outlook: Software Defined Storage
SDS is the key to the “Next Big Thing in ITaaS” Built-In strong features for Virtualized Data Centers & Cloud Federation
SDS Features • Services Based Infrastructure to provide Automation, Unifies
Control and Efficiency • Provisioning via Policies and Workload-aware service Levels to
match specific requirements by each individual Applications • Utilizes Open Standards and Interfaces based resilient,
commodity Data Storage deployable on any platform of choice • Covers full spectrum of block, file and object storage • Cost effective and highly automated • Highly Scalable (Capacity, Throughput, Performance)
30 30
30
Software Defined Storage
The New Storage Platform
Anil Vasudeva President & Chief Analyst
IMEX Research