ds8700 easy tier webinar june 22 2010 final

DS8700 Easy Tier© 2010 IBM Corporation
© 2010 IBM Corporation
Workload Optimization Tools
Very good $/Gbyte, but slow access performance
Access performance is slow – 150-200 Ops/Sec
Processor capabilities are out-stripping disk drive and RAID controller performance
(rotational speed and IOPS)
As a result, servers and storage systems become more unbalanced between CPU/controller capability and storage performance
Clients add more drive spindles to improve performance
Reduced Energy Use
Heat
Solid State as internal storage for the Server
Edge and DMZ servers outside corporate firewall
Fast re-boot
Save up to 1500 Watts per server rack (84 servers) with IBM BladeCenter
SSD as a slower non-volatile store (NVS) cache
Offers performance acceleration of all I/O, or designated I/O
Managed using cache algorithms
For OLTP, ERP and other high requirements for IOPS
Can be used for business analytics
SSD
HDD
SSD
SSD
HDD
Semiconductor (NAND flash)
3.5”, 2.5”, 1.8”
SATA, FC, SAS, PCI-E
Flash technology improvements allowing for use in enterprise storage and server deployments
Other Storage Class Memory technologies in the wings
Greater than 5 year lifetime
New Tier-0 drives for high priority, time-sensitive applications
Americas Advanced Technical Skills (ATS)
High read-to-write ratio; low cache hit ratio
High I/O rates; likely to be large data objects
For example, Oracle, DB2, Exchange and SQL Databases
SSD is practical for high access density data
Average access density today is less than 600 I/O per TB
High access density typically over 1,800 I/O per TB
Mission-critical applications
Applications that short stroke 15K HDDs
Used for applications where disks are the bottleneck
Sequential access data can remain on disks
All other data stays on HDD
$/IOP makes sense with SSD. $/MB does not make sense with SSD
Solid State Drive technology remains more expensive than HDD
HDD and SSD technologies will coexist in hybrid configurations for several years
During this transition, use SSDs for data which can benefit most from the new technology
Without sub-volume optimization tools, clients have been over-provisioning the resource
Hot data not often static
Administrators spend too much time regularly monitoring, reporting, and tuning tiers
Inefficient use of an expensive asset is difficult to justify
Result: Many clients feel they can’t afford solid state storage yet
Storage hardware based tool
Performance analytics identify both open and z/OS sub-volume hotspots
Automated data relocation function to dynamically move hot and cold extents across drive tiers
Traditional OS based tools
Enhanced System Monitoring Facility records
SAS® tooling available for free download
DMCzOS SMF record analysis for candidates + TDMF and zDMF for data movement
System P
Migration: SVC storage pools
TPC Intelligent Performance Optimization - hotspot function builds scripts for SVC data movement
System I
Data collection: Collection Services, Performance Explorer
Migration: ASP Balancer, DB2 Preferred Media Support, ASP dedicated to SSD
IBM Novus Intelligent Storage Service Catalogue
Storage Enterprise Request Planner (SERP)
DS8000 Logical Configuration and Virtualization
An array site is a collection of 8 drives of the same type spread across both internal fabrics(loops) on the DS8000
An array is formed when the drives in an array site are formed into a RAID group (RAID5/6/10) and potentially a spare is assigned
A rank is created when an array is formatted for either CKD or FB
Ranks are divided into extents which are either 1GB (FB) or 1113 cylinders (CKD)
An extent pool is a collection of ranks all of which are managed by the same DS8000 server (0/1)
Volumes are created from one or more extents from a single extent pool
A LSS/LCU is a collection of volumes and has relevance mostly for copy services and CKD
6+P+S 146GB
6+P+S 146GB
Easy Tier functionality
Smart data placement
Two data relocation functions that enable smart data placement to optimize SSD deployments with minimal cost
Automatically migrate sub-volume data to right tier
Manually migrate full volumes non-disruptively
Storage Tier Advisor tool provides guidance for existing client workloads
No requirement for SSDs for monitoring and analysis
Simplicity, flexibility, economy
Automatic Mode
Requires use of a merged extent pool
Manual Mode
CLI/GUI setup and management
Storage Tier Advisor Tool (advisor tool) for I/O analysis and projected benefit
DS8700 Hardware feature
Easy Tier is a no charge feature available with Release 5.1
Supported by all server platforms with no additional software
Manual Mode (Volume Level) and Automatic Mode (Extent Level)
SSD Rank Pools
Merged Pool
(SSD/FC or SSD/SATA)
Automatic extent level data relocation enabled in a Merged Extent Pool
Manual Mode
Dynamically relocates a logical volume’s extents
Hot extents relocated to SSD Arrays
Cold extents relocated from SSD to FC/SATA Arrays
Extent level relocation requires mixed technologies in a merged extent pool
SSD + Enterprise FC
Logical Volume
Easy Tier – Automatic Mode Operation
Monitors stage/destage activity on each extent to determine the data ‘temperature’
Can be set to monitor all volumes or merged extent pool volumes (default)
Develops an extent migration plan for optimal data placement every 24 hours of I/O statistics
Read/write, random/sequential, large/small transfer size all collected as input to developing the migration plan
Temperature generated is based on cumulative average latency time
Migrates extents within an extent pool according to plan over 24 hour period
A limited number of extents are chosen for migration every 5 minutes
Monitors whether rank workload exceeds rank performance capability
Rank, Device Adapter and cluster level thresholds
Extent pool configuration options
Create new extent pool with SSD + HDD ranks
Merge existing SSD and existing HDD extent pool
Add SSD rank to existing HDD extent pool
Add HDD rank to existing SSD extent pool if no space efficient capacity (virtual capacity or repository) configured in the extent pool
Logical volume configuration options
Migrate standard logical volumes between homogeneous and mixed technology extent pool
Merge existing homogeneous extent pool with existing logical volumes with another extent pool to create a mixed technology extent pool
Easy Tier – Automatic Mode User Interfaces
Design point is for customer to not normally need or use any controls to manage Automatic Mode
Easy Tier Automatic Mode
Easy Tier Automatic Mode monitoring
Disable / managed volumes / all volumes
Ignores workload activity in plan generation statistics while disabled
Managed volumes is normal setting and monitors workload on volumes in managed pools if the Easy Tier LIC feature is enabled
All volumes causes all logical volumes to be monitored (with or without LIC feature)
Can be used with analysis tools prior to ordering and enabling the LIC feature
Can be used to analyze logical volumes in homogeneous extent pools as candidates for mixed technology pool
Storage Tier Advisor Tool (advisor tool)
Generate reports on extent monitoring and obtain SSD capacity planning recommendations
Easy Tier – Manual Mode
Easy Tier Manual Mode allows a user to perform the following actions:
Volume Migration
Allows existing data to be restriped over an extent pool once new capacity is added
User can change a logical volume’s storage technology by dynamically relocating between extent pools
Different RAID format, drive size/type
Extent Pool Merge
User can merge two existing extent pools without moving data
Consolidate extent pools with equivalent disks
Merge extent pools with to create a mixed technology extent pool for Automatic Mode
Solid State Disk
Enterprise Disk
Change disk class
Change RAID type
Change disk RPM
automatic mode
Volume migration
Migration pre-allocates target extents in target extent pool, releases each source extent when migrated
Any number of volumes can be requested to migrate
Processes a limited number of volumes concurrently
Actively migrates a number extents per CEC concurrently
Overheads comparable to FlashCopy with background copy
Extent Pool merge
Changes source logical volumes extent pool to target extent pool
Deletes source extent pool if complete prior actions
Migrate Volume (Target Extent Pool, Extent Allocation Method)
Can specify current extent pool for target extent pool
Can keep the current Extent Allocation Method or change
Pause/Resume Volume Migration
Pause stops initiation of any new extent migrations on a volume
Resume continues migration
Cancel Volume Migration
Nullifies volume migration if it has not started
Stops volume migration if it has started. Can request migrate volume to source or target extent pool to retry
Merge Extent Pool (Source Extent Pool, Target Extent Pool)
Deletes source extent pool if merge is successful
DS8700 R5.1
Automatic Mode and Volume migration supported on standard logical volumes
Space efficient volumes are not Easy Tier managed
Can reside in an extent pool managed by Automatic Mode
Volume migration is not supported on space efficient volumes
Migrate data between extent pools on the same storage image (0-0 / 1-1)
Copy services considerations
Easy Tier optimization of data on the primary system is not reflected at the secondary
Can merge any two extent pools except:
Both must be same extent type (CKD or Fixed Block)
Both must be within the same storage image
At most, one of two extent pools can have a space efficient repository
At most, one of one of two extent pools can have virtual capacity
Not allowed if one extent pool is homogeneous with SSD disks and additionally has space efficient repository or virtual capacity configured
Not supported on encryption capable storage facilities
No encryption capability on SSD drives
Implementation Characteristics
Extent size is 1 GB on FB, Mod 1 on CKD
Plan Generation Window is 24 hours
Some workloads may not benefit significantly from Automatic Mode
Hot spots are small in size and uniformly distributed across extents such that all extents exhibit equal temperatures
Hot spots vary over time such that they are uniformly distributed given a large enough monitoring period
Critical workload to be performance optimized is intermixed with other workloads that result in a non-optimal extent placement
May be able to turn off monitoring in time windows where non-critical workloads are affecting statistics in an undesirable (e.g. batch windows, off-shift or weekend workloads, month-end processing, etc.)
Consult Easy Tier performance white paper for additional information
Tools for SSD
Easy Tier Tools
Disk Magic
Release 5.1 and later
The advisor tool runs as a Windows application
Model current disk subsystem to a DS8700 using Easy Tier
Both Open and z Systems
Model is based on Tucson performance observations with various benchmarks
IBM z FLASHDA Tool
Input is SMF record type 42 subtype 6 and type 70 through 78
Tool uses SAS
Analysis will identify datasets and volumes that are good candidates for placement on SSD
Analyze the workload to determine the benefits of SSD
Report ranks best SSD candidates by job name
Modeling is at the volume level
z/OS
Disk Magic can estimate which volumes are good SSD candidates and migrate those volumes to SSD
Or use the result of the FLASHDA analysis
Open System
Feature is Megapack
# of SSD Ranks
all: monitor all volumes on the DS8700
automode: monitor only volumes that reside on the hybrid pools
none: monitoring is turned off
SF75XX101ESS01_heat.data: server 0 data
SF75XX101ESS11_heat.data: server 1 data
Process monitor data
c:\stat\stat -o c:\stat\output c:\et\SF75XX101ESS01_heat.data c:\et\SF75XX101ESS11_heat.data
c:\stat is the folder where the advisor tool resides
c:\stat\output is the folder where the output will be placed
Input data must have “_heat” in the name
Advisor Tool Report
System Summary Report
No data allocated/migrated to SSD yet
Random I/O is 8% of total I/O
These are random I/Os that need to access the DDM in the rank
Random read hit I/O are not included in this data
Predicted performance improvement
(old_latency – projected_latency) / (old_latency)
Random read hit is not included
I/Os included:
Random read miss
Sequential read I/Os
Even though the read hit ratio may be close to 100%
Random & sequential write I/Os
Advisor Tool Report
Predicted performance improvement
Estimated 0% to 16%
Estimated that it will still take 7 more hours to migrate the hot extents
96 x 1TB SATA (RAID-10), 16x146 GB SSD (RAID-5)
256 GB cache, 12 FC paths on 6 x 4Gb Host Adapters
SPC-1 workload generator ran on a P770 (AIX 6.1.3.0) with 12 FC ports on 11 Host Bus Adapters (8 Gbps HBAs but running at 4 Gbps)
Measurements included an extended SPC-1 "warmup" of 21 hours to demonstrate the effect of Easy Tier data migration
Complete published DS8000 SPC-1 details are available
Configuration for DB2 OLTP Brokerage Test
DS8700 with R5.1 licensed internal code
HDD Configuration: RAID-5, 128 x 300GB/15K HDDs; 8 3TB volumes were allocated for database, Temp files and Data Generation 8x50GB volumes are allocated to log files.
SSD Configuration: RAID-5, 16 or 32 x 146GB SSDs
DB2 Configuration: DB2 9.7 FP1, 4 Instances, 4 DBs at 2TB each, 4 Buffer Pools at 54GB each.
Server Configuration: P770 (AIX 6.1.3.0) , 8 Eight Core P7 (3GHz), 256 GB Memory, 16 4Gb FC Ports.
LUN Queue Depth set to 20 for “typical” I/O intensity and 256 for “peak” I/O intensity
“Typical” I/O Intensity (QD 20)
“Peak” I/O Intensity (QD 256)
DS8000 Easy Tier Summary
Easy Tier is a DS8000 feature that supports the dynamic relocation of data using the following methods:
Automatic Mode
Manual Mode
Easy Tier is a no charge feature available with DS8700 and Release 5.1
Supported on all host attachments with no additional host-based software
Easy Tier will help customers utilize large capacity drives
Reduces administrative effort and costs by automating data placement
New tooling enables clients to see exactly how much their existing workloads can benefit from how many SSDs
Helps align storage capacity purchases with performance and cost requirements
0
10
20
30
40
50
60
70
80
90
100
0
10000
20000
30000
40000
50000
60000
0:002:004:006:008:0010:0012:0014:0016:0018:00
Time
Improves RT in range
At Queue Depth 20

ds8700 easy tier webinar june 22 2010 final

Documents