hitachi unified storage and hitachi nas platform performance optimization with flash acceleration

26
Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration © Hitachi Data Systems Corporation 2013. All Rights Reser Nick Jarvis Director, File, Content and Cloud Solutions August 14, 2013

Upload: hitachi-data-systems

Post on 18-Nov-2014

1.902 views

Category:

Technology


2 download

DESCRIPTION

Hitachi Unified Storage VM (HUS VM) and Hitachi Virtual Storage Platform (VSP) flash technology helps increase performance and decrease total disk quantity and while lowering power, cooling and space costs. Attend this WebTech to learn more about how to optimize Hitachi Unified Storage and Hitachi NAS Platform performance using flash acceleration, SSD storage, and other technologies.

TRANSCRIPT

Page 1: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

11

Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

© Hitachi Data Systems Corporation 2013. All Rights Reserved.

Nick JarvisDirector, File, Content and Cloud SolutionsAugust 14, 2013

Page 2: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

2

Hitachi Unified Storage (HUS) VM and Hitachi Virtual Storage Platform (VSP) flash technology helps increase performance and decrease total disk quantity while lowering power, cooling, and space costs. Attend this WebTech to learn more about how to optimize Hitachi Unified Storage and Hitachi NAS Platform (HNAS) performance using flash acceleration, SSD storage, and other technologies

By attending this webcast, you’ll learn how to

Increase HUS and HNAS performance by using flash technology

Identify key technologies and products needed to achieve optimum results

Locate and tune key parameters necessary for performance optimization

HITACHI UNIFIED STORAGE AND HITACHI NAS PLATFORM PERFORMANCE OPTIMIZATION WITH FLASH ACCELERATION

WEBTECH EDUCATIONAL SERIES

Page 3: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

3

UPCOMING WEBTECHS

Maximize IT WebTechs‒ Comprehensive and Simplified Management for VMware vSphere

Environments – Now, Even Better!, September 11, 9 a.m. PT, 12 p.m. ET

‒ Easily Deploy Microsoft® Private Cloud and Microsoft SQL Server® 2012 Data Warehouse on Hitachi Converged Solutions, September 25, 9 a.m. PT, 12 p.m. ET

Check www.hds.com/webtech for Links to the recording, the presentation, and Q&A (available next week) Schedule and registration for upcoming WebTech sessions Questions will be posted in the HDS Community

- http://community.hds.com/groups/webtech

Page 4: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

44

Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

© Hitachi Data Systems Corporation 2013. All Rights Reserved.

Nick JarvisDirector, File, Content and Cloud SolutionsAugust 14, 2013

Page 5: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

5

Drivers for High-Performance Storage

Page 6: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

6

FLASH USE CASES

SUPPORTS APPLICATIONS THAT REQUIRE “RANDOM” WORKLOADS

File Shares(unstructured)

SQL Server Database

File System

Analytics Apps(Unix/Linux)

Oracle Database (Red Hat/OVM)

VMware/VDI environments

OCFS/GFSVMFSGPFS/GFS HDFS/JFFSCSV/NTFSNFS/CIFS

All of the above applications generate high random read/write IO and require low latency.

Match use cases to flash implementations to deliver on performance promises at lowest possible overall system cost

Page 7: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

7

WHY ARE RANDOM IOPS WORKLOADS CRITICAL?

I/O workloads are either random (many concurrent accesses to relatively small blocks of data) or streaming (sequential data transfers)

Historically, random access has been associated with transactional workloads, which often represent an enterprise’s most critical IT operations

Adoption of “scale-out” architectures with networked storage − drivers for scale-out include server and desktop virtualization, database consolidation, complex analytics, and data warehousing

Even workloads that appear to be sequential from an individual application’s point of view actually become random as they interact with other workloads using advanced disk array capabilities like de-clustered RAID, thin provisioning, and automatic storage tiering

Page 8: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

8

FUNDAMENTAL STORAGE PERFORMANCE CHANGES AVAILABLE

A single Hitachi Accelerated Flash storage module can deliver 500X more IOPS than a

single high-performance disk drive

Yesterday’s High Performance Today’s High Performance

Page 9: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

9

APPROXIMATE PER-DEVICE PERFORMANCE POTENTIAL

A PARADIGM SHIFT IN PERFORMANCE

Traditional Disk Drives Solid State Capacity

Capacity Drives

PerformanceDrives

CommoditySSD

Hitachi Accelerated Flash

storage

IOPS 80 200 20,000 100,000

Resp.Time(milliseconds)

6 2 0.2 0.2

Page 10: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

10

Unique and patented Hitachi technology

High-bandwidth, multi-core architecture allows high density and predictable performance

Industry improvements regarding‒ Enterprise durability with

cost-effective capacity‒ Highest device density‒ 5X device IOPS to SSD

HITACHI ACCELERATED FLASH STORAGE

HITACHI INNOVATION: FLASH CAPACITY

CPU and Flash Management Engine

Block/Page Mapping

Wear Leveling Data Refresh

Performance Manager

Contiguous Block Write Avoidance

Endurance Manager

100+ Related Patents

Granted or Pending

Page 11: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

11

FLEXIBILITY FOR APPLICATIONS

Adopting an “ALL-IN-ONE” enterprise storage platform provides

Hitachi flash acceleration ‒ Firmware that has been re-engineered to increase scalability for host I/O processing on

exiting VSP and HUS VM

‒ Can also be implemented without the need of SSD or Hitachi Accelerated Flash; however, adding either of these will provide performance improvements

Hitachi Accelerated Flash (HAF)‒ The HDS flash memory controller (HAF) is a multi-core, high-bandwidth architecture that

uses block and page mapping, wear leveling, an endurance manager, and inline write compression that results in up to 94% write reduction

‒ Hitachi custom designed and built

Hitachi Dynamic Tiering (HDT) hybrid storage‒ Utilize automated sub-LUN dynamic tiering for pooling storage resources for application

host access‒ Thin provisioning capability for efficient storage utilization and better performance

Storage virtualization‒ Virtualize up to 100+ external storage arrays and obtain the benefits of preserving existing

assets, migration, and/or consolidation for management

Page 12: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

12

30+ fundamental software changes to turbo-charge performance with flash‒ New “express” I/O processing ‒ Higher internal thread count support‒ Improved wide striping capability

Significant performance impacts‒ Up to 65% reduction in response time‒ Up to 2X Hitachi Dynamic Provisioning

(HDP) scalability

Nondisruptive installation and transparent to current applications

SOFTWARE REENGINEERING TO EXPLOIT FLASH CAPABILITIES

HITACHI INNOVATION: FLASH ACCELERATION

Hitachi Storage

HUS VM and VSP Optimized

for FlashToday

Page 13: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

13

ENTERPRISE

Flash Acceleration Software

Hitachi Accelerated Flash

Hybrid Storage Tiering

HYBRID ARRAY | INTELLIGENT CACHING | TEIRING

HITACHI FLASH SOLUTIONS PORTFOLIO

* Only random performance is improved by flash acceleration; sequential performance is unaffected

Data management and protection Storage tiering for HAF, SSD, SAS, NL-SAS (Hitachi Dynamic Tiering) Management with Hitachi Command

Suite

Scale Flash acceleration improves

HDP wide stripping scalability with hard drives up to 25%

HAF flash enclosure <76.8TB capacity

SSD <102TB, SAS <1.8PB, NL-SAS <3.7PB

Performance HAF flash <1,000,000 random I/O,

<1ms latency with high consistency

*Flash acceleration 49% to 61% increased random I/O throughput

Page 14: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

14

ENTERPRISE | MIDRANGE

Flash Acceleration Software

Hitachi Accelerated Flash

Hybrid Storage Tiering

HYBRID AND ALL FLASH ARRAY | CACHING | TIERING Performance HAF flash <500,000 random I/O,

<1ms latency with high consistency

*Flash acceleration 49% to 61% increase random I/O throughput

HITACHI FLASH SOLUTIONS PORTFOLIO

* Only random performance is improved by flash acceleration. Sequential performance is unaffected.

Scale Flash acceleration improves HDP wide

stripping scalability with hard drives up to 25%

HAF flash enclosure <19.2TB capacity SSD <51TB, SAS <900TB, NL-SAS

<3.4PB

Data management and protection Storage tiering for HAF, SSD, SAS,

NL-SAS (Hitachi Dynamic Tiering) Management with Hitachi

Command Suite

Page 15: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

15

Hitachi flash acceleration

software

Hitachi Command

Suite

Up to 154TB flash storage

Hitachi Accelerated

Flash

Unified and virtualized capacity

500,000 IOPS, <1ms

response

HUS VM ALL FLASH:NO-COMPROMISE ALL-FLASH STORAGE

More flexible than all-flash

systems

Best flash form factor

and durability

Best storage optimization

for flash

Page 16: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

16

Virtualize and flash-enable current Hitachi and 3rd-party storage

Boost performance of multiple applications and platforms (including mainframe)

Economic savings from efficient data mobility over tiers with Hitachi Dynamic Tiering and Tiered Storage Manager‒ Automate tiering of data‒ Pin critical workloads in flash

ADVANCED VSP FLASH OPTIONS CONTINUE ENTERPRISE LEADERSHIP

HITACHI VIRTUAL STORAGE PLATFORM:FLASH-ACCELERATED, ENTERPRISE-READY

1 Million IOPS~200K more than EMC 40K

3X ScalabilityWithout a forced box-swap

Page 17: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

17

HITACHI NAS FAMILY COMPARISON

Unified StorageDedicated storageEasy to deploy and manageUtilize dynamic tieringFile deduplication

HUS 110 HUS 130 HUS 150 HUS VM HNAS 4060

HNAS 4080-4100

Availability Symmetric HA Symmetric HA Symmetric HA Symmetric HA Clustered Failover

Clustered Failover

Number of Nodes 1 to 4 1 to 4 1 to 4 1 to 4 1 to 2 1 to 4

ConnectivityNFS,SMB,iSCSI,Fibre Channel

NFS,SMB,iSCSI,Fibre Channel

NFS,SMB,iSCSI,Fibre Channel

NFS,SMB,iSCSI,Fibre Channel

NFS,SMB,iSCSI,Fibre Channel

NFS,SMB,iSCSI,Fibre Channel

Storage HUS 110 HUS 130 HUS 150 HUS VM AMS and/or VSP

AMS and/or VSP

Maximum IP storage capacity 360TB raw 756TB raw 2.88PB raw 3.4PB raw 8PB usable 16PB usable

FM = File Module

Page 18: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

18

File

Sys

tem

HNAS – STANDARD FILE SYSTEM

SASUser Data

Meta Data

Traditional file system approach Mixed IO on the same media

All or nothing footprint

One type of disk for all types of I/O

Page 19: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

19

HNAS – TIERED FILE SYSTEMO

ptim

ized

Fi

le S

yste

m

FLASH/ SSD / SAS

SAS/NL-SAS

User Data

Meta Data

Optimized file system approach Mixed IO placed on most

effective and cost effective storage platform

Best TCO for workflow performance

Provides cost efficiency with equal performance by using fewer or lower cost disks Can be deployed with or without SSD drives

New installation with no degradation in I/O performance Performance benefits depend on application

Improved spindle efficiency (achieve performance target with less storage)

Metadata intensive operation (e.g. backup, replication or data migration)

Large Files (VMware, Oracle, etc..)

Page 20: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

20

HNAS – CLUSTER READ CACHINGC

lust

er

Wid

e R

ead

Cac

he

FLASH/SSD/SAS

Cluster wide read cache Accelerate read intensive I/O

at scale

Cluster wide

NFS v3 environments

Read Caches Enabled

4 x Bandwidth

Read Caching

Copy1 Copy3

Copy2

Copy4

Copy

Slow

User Data

Meta Data

Page 21: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

21

HNAS – LEVERAGING HDT FLASH

Optimized back-end storage ‒ Driven by HUS, HUS-VM and/or

VSP

‒ Economic savings from efficient data mobility over tiers with Hitachi Dynamic Tiering, Tiered Storage Manager

‒ Automate tiering of data

‒ Pin critical workloads in flash

HD

T

User Data

FLASH/SSD

TIER 1 DISK

TIER 2 DISK

Page 22: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

22

3rd-largest GSM operator in Europe; 34.7 million subscribers

FLASH + VIRTUALIZATION AT TURKCELL

Page 23: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

23

Drivers for High-Performance Storage

Page 24: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

2424

QUESTIONS AND DISCUSSION

Page 25: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

25

UPCOMING WEBTECHS

Maximize IT WebTechs‒ Comprehensive and Simplified Management for VMware vSphere

Environments – Now, Even Better!, September 11, 9 a.m. PT, 12 p.m. ET

‒ Easily Deploy Microsoft® Private Cloud and Microsoft SQL Server® 2012 Data Warehouse on Hitachi Converged Solutions, September 25, 9 a.m. PT, 12 p.m. ET

Check www.hds.com/webtech for Links to the recording, the presentation, and Q&A (available next week) Schedule and registration for upcoming WebTech sessions Questions will be posted in the HDS Community

- http://community.hds.com/groups/webtech

Page 26: Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

2626

THANK YOU