snia gsi training day1 part1 training... · vendor differences 6/23/13 20 . snia emeraldtm training...
TRANSCRIPT
![Page 1: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/1.jpg)
PRESENTATION TITLE GOES HERE Enterprise Storage
Leah Schoeb, Vice Chair, SNIA Technical Council
SNIA EmeraldTM Training
SNIA Emerald Power Efficiency Measurement Specification,
for use in EPA ENERGY STAR®
June 24-27, 2013
![Page 2: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/2.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 2
Day 1 of this course presents an overview of storage technology, efficiency, and performance.
Day 1 Course Overview
![Page 3: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/3.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 3
! Who should attend? ! Information Technology professionals ! Engineers ! Consultants
! Objectives – what you will learn ! Basics of enterprise storage technology ! What are the initiatives for optimizing the data center ! Current efficiency technologies used in storage ! Understand Storage Performance basics ! IO Generation tools are not all created equal
Course Information
![Page 4: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/4.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 4
Agenda
! Enterprise storage overview ! Break ! Lab Tour ! Enterprise storage efficiency ! Enterprise Storage Performance and load
generation ! Q&A
![Page 5: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/5.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 5
! Storage is more than a device ! In general, we think of a box ! We look at the device attributes
! Capacity ! Performance (speeds and feeds)
! It’s really about storing and retrieving information with integrity, availability, data protection, cost
! Need a strategy and efficiency to address how we deal with information
What is a Storage?
5
Storage
Servers
% of IT Hardware Spend
60%
40%
Source: IBM
![Page 6: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/6.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 6
BLOCK VS. FILE VS. OBJECT
Storage Technology
![Page 7: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/7.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 7
Block, File, and Object
! File I/O vs. Block I/O vs. Object I/O ! Applications can do block I/O or file system I/O or object I/O ! File systems turn file I/O into block I/O ! Block I/O goes to specific device and reads or writes a block
from/to that device ! Linear address space of blocks ! May do multiple blocks in single operation ! Typically fixed length blocks
! File I/O is represented by a file with file name and some offset into the file
! Read or writes data in the file ! Some number of bytes involved in the operation
! Object I/O is storing data as objects with new control/metadata information
7
![Page 8: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/8.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 8
Storage Access
8
![Page 9: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/9.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 9
Block I/O
! Application writes data block
! Block goes to HBA and over storage interface
! Storage controller receives block
! Data written to device as data block
6/23/13 9
![Page 10: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/10.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 10
Tape I/O
! Backup application writes data block to tape driver
! Block converted to tape image and goes to HBA and over storage interface
! Tape controller receives tape block
! Data written to tape as tape image block
6/23/13 10
![Page 11: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/11.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 11
Tape Library I/O
! Backup application writes data
! Block converted and tape volume identified
! Tape library receives tape block and volume information
! Data written to selected tape as tape image block
6/23/13 11
![Page 12: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/12.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 12
Virtual Tape I/O
! Block converted to tape image
! Tape image written to disk controller
! Depending on controls, VTL reads tape image from disk and writes to tape library
! A few products can go direct to tape
6/23/13 12
![Page 13: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/13.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 13
Block I/O vs. File I/O
13
![Page 14: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/14.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 14
File I/O
! Application writes data block to a mounted file system
! Block goes to HBA and over storage interface
! Storage controller receives block
! Data written to device as data block
! Many Protocols
6/23/13 14
![Page 15: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/15.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 15
File I/O - NAS
! Application writes file data to mounted file system
! File redirected over network
! NAS / File server takes file and converts to block I/O
! Data written to device as data block
6/23/13 15
![Page 16: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/16.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 16
Object I/O
! Application writes object information
! Object file system creates attributes and sends object to HBA / NIC
! Storage controller receives object
! Data written to device as data block
6/23/13 16
![Page 17: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/17.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 17
SCALE OUT VS SCALE UP
Storage Technology
![Page 18: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/18.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 18
Scale Out vs. Scale Up
18
Scale UP Scale OUT
![Page 19: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/19.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 19
Scale Out Storage: NAS
! Implemented using distributed file system usually ! Clustered hardware
! Global namespace across nodes
! Key implementation points ! Linkage between nodes – InfiniBand, Ethernet:10Gb
! I/O balancing between nodes
! Capacity balancing between nodes
! Coherency – across distance
! Switching requirements
6/23/13 19
![Page 20: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/20.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 20
Scale Out Storage: Block Storage
! Two approaches used
! Multiple controller cards to common backend storage device pools ! Backplane connected typically
! Normally associated with high-end enterprise systems
! Federation of separate controller nodes (included with NAS systems in some cases as integrated unified storage) ! Complexities in cache coherency and I/O routing
! Vendor differences
6/23/13 20
![Page 21: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/21.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 21
REPLICATION
Storage Technology
![Page 22: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/22.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 22
Why Replicate Data?
! Migrate data at same or different location ! New technology or added capacity ! Consolidations ! Mergers ! Workload balancing
! Application testing ! Data exchange for warehousing / mining ! Business continuance, Disaster Recovery, Data
Protection ! Motivated by:
! Business economics ! RPO and RTO ! Legal requirements
22
![Page 23: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/23.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 23
Replication Technologies
! Point-in-Time Copy – Snapshot / Flashcopy ! Space efficient copy – only changed data ! Variations in storage system implementations
! Remote replication ! Synchronous – continuous transfer of all data changed,
operations wait until transfer completes ! Asynchronous – data sent but operation continues without
waiting for transfer completion ! Asynchronous periodic – data sent periodically, most often is
incremental snapshot
23
![Page 24: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/24.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 24
Types of Point-in-Time Copy
! Snapshot ! Copy-on-write - only changed data is copied ! Redirect-on-write – writes to new location ! Various implementations use pointer manipulations, side
files, or dynamically allocated space from storage pool
! Cloning ! Makes a complete copy of data ! Clone may be continuous or split and later resynced
! Variations are differentiation points for vendors
24
![Page 25: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/25.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 25
Remote Copy Approaches
! Synchronous ! Storage system-based or through fabric appliance ! Data must be stored at remote site before application can resume
! Significant impact on performance limits distance ! Application stops if I/O can’t complete
! May stall application
! Asynchronous ! Initially host software based, but system based is now available ! Application continues before data is stored on remote site ! Delayed write represents a window of “risk” ! continuous or periodic transmission of data
! Multi-hop or cascading ! Combination of synchronous and asynchronous with intermediate storage
system
6/23/13 25
![Page 26: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/26.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 26
ARCHIVE
Storage Technology
![Page 27: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/27.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 27
Archiving Definition
! Different than backup ! One time operation ! Protection is done at time of archiving
! Multiple copies are made
! Indexing for searching done at time of archive ! File or object based element – not a transformation by
backup software ! Backup does a restore, Archive does a retrieve
![Page 28: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/28.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 28
Archiving Benefits
! Economic – efficiency improvements ! Reduction in primary capacity demand
! Continuing economic benefit
! Reduced amount of data for regular backups ! Fewer operational expenses for data protection ! Reduction in backup capacity demand
! Reduced capacity-based licensing charges for software and data management services
! Reduction in power/space/cooling based on different type of archival storage
![Page 29: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/29.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 29
Archiving Overview
Archive System
Data moved
based on criteria
Active Archive Removable
Media
Primary Storage
Archiving Application
HSM, ECM, PACS, Email, System utilities
Deep Archive
![Page 30: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/30.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 30
VIRTUALIZATION
Storage Technology
![Page 31: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/31.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 31
IO Performance Needs Monitoring at Every Level
Application Guest OS
Hypervisor
Physical Server
Connectivity
Storage
Application Level App Specific Perf tools/stats
Guest OS CPU Utilization, Memory Utilization, I/O
Latency
Virtualization Level Performance Metrics /Charts
Limits, Shares, Virtualization Contention
Physical Server Level
CPU and Memory Saturation, Power Saving
Connectivity Level
Network/FC Switches and data paths Packet loss, Bandwidth Utilization
Storage Level
SAN or NAS Devices Utilization, Latency, Throughput
![Page 32: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/32.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 32
Server Virtualization Impact on Storage
! Increased workload demand
! Over 80% of storage related performance problems stem from misconfigured storage hardware
! Tendency to over provision storage
! Mixed workloads
I/O Bo'leneck
Hypervisor
![Page 33: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/33.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 33
VMware vSphere Storage APIs – VAAI
! VMware APIs for Array Integration - VAAI ! Full copy — Enables the storage system to make full copies of
data within the storage system without having the ESX host read and write the data.
! Hardware-assisted locking — Provides an alternative means to protect the metadata for VMFS cluster file systems
! Block zeroing — Enables storage systems to zero out a large number of blocks to speed provisioning of virtual machines.
! Thin Provisioning support – ! TP-STUN – error code to report out of space for thin volumes ! UNMAP – zero page reclaim to maintain “thinness”
! NAS support ! Full file system clone – uses NAS system to make copies ! Reserve space – creation of thick virtual disk on NAS ! Native snapshot support
4.1
5.0
![Page 34: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/34.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 34
VAAI Performance Affects VMFS directs storage to move data directly • Much less time
§ Up to 95% reduction
• Dramatic reduction in load on: § Servers § Network § Storage
![Page 35: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/35.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 35
VMware vSphere APIs for Storage Awareness - VASA
! Administrator can see capabilities of storage system ! Allows creation of VM Storage Profiles for Profile Driven
Storage ! API for storage systems to communicate their
capabilities to vSphere ! RAID protection ! Thin provisioned LUN ! Deduplication capability ! Tiered storage capability ! Capacity ! Storage health
! Vendor plugins – Storage Providers
![Page 36: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/36.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 36
Microsoft Hyper-V over SMB 3
§ SMB Persistence ! Ability to create a continuously available persistence file share
without changes to a way a file is opened § SMB Scale-Out
! In a cluster configuration this new ability shows a share in all nodes of a cluster.
! Active/Active configuration makes it possible to scale file server clusters (not to be combined with other features)
! Cluster Shared Volumes (CSV) - A volume that shows on every cluster node simultaneously so all nodes can access the volume
! Dynamic Network Name (DNN) - Single name to connect ! Less IP addresses needed for the cluster
§ SMB Encryption ! No PKI or certificates required ! Accelerated Encryption – optimized their algorithm
![Page 37: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/37.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 37
Microsoft Hyper-V over SMB 3
§ SMB Multichannel ! Transparent Failover for network paths - Allows for an SMB
client to continue working when there is a failure in a SMB file server cluster node.
! Interface Arrival - Mulit-channel will re-establish connections automatically
! Link-local - These are special IP address that are assigned automatically when there are no manual IP addresses configured or no DHCP server is found on the network
§ SMB Direct ! Discovery over TCP/IP and Fail back to TCP/IP, shift from TCP/
IP to RDMA ! the ability to use RDMA network interfaces, high bandwidth, low
latency
![Page 38: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/38.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 38
Microsoft Hyper-V over SMB 3
§ Volume Shadowcopy Services (VSS) for SMB File Share
! Same model as block VSS ! Stream snapshots from file server - creates application
consistent snapshots of data volumes. § Server Manager
! SMB file shares can be created with a set of wizards § SMB PowerShell
! Used to manage a significant number of file shares ! Automatically checks the cluster type based on disk type ! Combined view of the cluster with all nodes
![Page 39: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/39.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 39
Storage Map
Software Installs as Virtual Appliance
(presents as NFS Datastore)
VM1
Hypervisor (ESX/ESXi)
Intent Log • Optimized Reads • Central VSA Cache
Logging architecture • Intent Log may be SSD
(host or storage resident) • Write Immediately Acknowledged by VM
• Sequential Write I/O
VM2 VM(n) vDisk vDisk
Server Host
vDisk: VMDK / VHD vDisk
Backing capacity provided by 3rd party
storage
Primary
Storage
VSA – Virtual Storage Appliance
VSA
Block Storage Capacity (RAID)
Write Cached Reads
![Page 40: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/40.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 40
Storage Technology on the Horizon
![Page 41: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/41.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 41
Big Data and Data Analytics Overview
! Big data ! Storage for large amounts of
data
! Data Analytics ! Analytics against very large
amounts of data
! Usually from machine-to-machine data ! Called pervasive computing
! So, what does this mean for storage and IT?
41
![Page 42: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/42.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 42
Why IT Should be Concerned
! Distributed computing for analytics (Hadoop, for example) is moving from science experiment to mission-critical
! As this happens, data encompassed by these applications becomes the responsibility of people who worry about: ! Security ! Data protection/disaster recovery/business continuance ! Data governance and compliance ! Digital records management and archiving
42
![Page 43: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/43.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 43
NODE 1
NODE 2
NODE 3
NODE n
DAS DAS DAS DAS
1 2 3 4 5 6 7 8
B8GMR3 Link
Active
Link
Active
Link
Active
ConsolePwr
Active
Link
Active
DAS
Network Layer
Compute Layer
Storage Layer
Distributed, Shared-Nothing Architectures for Big Data Analytics
43
CONTROL
![Page 44: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/44.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 44
Storage-As-A-Service
![Page 45: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/45.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 45
Software Defined Storage
![Page 46: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/46.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 46
Technology Summary
! Storage is critical to a business ! Having a storage strategy can mean real economic savings ! Potential to impact the corporation without adequate plans and
procedures
! Technology changes quickly ! Need to plan for changes ! Represent opportunities
! Costs ! Competitive advantage
6/23/13 46
![Page 47: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/47.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 47
Technology Summary
! Storage needs to be dealt with on an economic value basis ! Factor in elements of availability, administration costs,
acquisition cost, facility cost, energy cost. etc. ! Decisions based on economics
! Vendor offerings ! Long-term implications
6/23/13 47
![Page 48: SNIA GSI Training Day1 Part1 Training... · Vendor differences 6/23/13 20 . SNIA EmeraldTM Training ~ June 24-27, 2013 21 ... Allows creation of VM Storage Profiles for Profile Driven](https://reader033.vdocuments.mx/reader033/viewer/2022052801/5f13399b96884569f677a874/html5/thumbnails/48.jpg)
SNIA EmeraldTM Training ~ June 24-27, 2013 www.sniaemerald.com 48
Thank You
Leah Schoeb [email protected]
Twitter:@vLeahSchoeb