dell emc unity all-flash: flash technology deep dive … · 3d tlc flash drives •intelligent wear...

Dell EMC Unity All-Flash: Flash Technology Deep Dive

Nick Principe Performance Engineering Midrange & Entry Solutions Group

© Copyright 2017 Dell Inc. 2

Optimized for All-Flash Performance & Simplicity

What’s New with Dell EMC Unity

4 new Broadwell based All-Flash models New 80 drive 3U enclosure 4X file power with 256TB file system Compression for file AppSync integration, snapshots & thin

clones for iCDM Dynamic Pools

Up to 40% more cores; 2X the memory

650F

550F

450F

350F


Dell EMC Unity All Flash: Flash Technology Deep Dive

3D TLC Flash Drives Compression

Intelligent Wear Leveling Host I/O Limits

Dynamic Pools Replication

Capacity

Reliability

Data Protection

Hardware and Endurance • 3D TLC Flash Drives • Intelligent Wear Leveling

Efficiency and Affordability • Dynamic Pools • Compression • Host I/O Limits • Replication

Hardware and Endurance 3D TLC Flash Drives

Intelligent Wear Leveling


3D TLC Flash Drives

• As of Dell EMC Unity OE 4.1, we offer three high capacity 3D TLC Flash Drive choices for Dell EMC Unity All-Flash arrays

• These drives can be mixed with other Flash types in a pool

– Sparing rules still apply separately for each SAS Flash drive type

SAS Flash 4


Intelligent Wear Leveling and Monitoring

• Intelligent Wear Leveling in Dell EMC Unity OE 4.1 and above

• Monitors flash wear level

• Enables mixing of different flash types within a pool

• Unisphere flash wear alerts

• CloudIQ’s “flash fuel gauge” for flash wear monitoring

• Proactive copy from drives prior to wearing out

Wear Level Monitoring Intelligent Wear Leveling


Wear Level Monitoring

• Unisphere generates user-visible wear alerts at 180, 90, and 30 days before predicted end of life – Proactive Copy operations are automatically initiated at 30 days

remaining to a spare drive


Wear Level Monitoring

• CloudIQ analytics provide a “Flash Fuel Gauge” for your flash drives indicating remaining endurance – Indicates endurance remaining in 20% steps – Indicates days remaining until predicted end of life starting at 180

days


CloudIQ: Monitor, Manage, & Service Dell EMC Unity & SC Series Storage

Analyze and identify storage issues faster, simpler, accurately

Proactive Monitoring

Centrally monitor performance,

capacity, system, configuration,

and data protection.

View details about CPU Utilization, Compliance, RPOs, Storage Pools, LUNs, File Systems, and more.

Predictive Analytics

Identify and predict potential issues

before they occur in the environment.

Plan and optimize for capacity trending and performance.

Proactive Health Score

Present comprehensive

health scores for Dell EMC Unity &

SC Series storage.

Get practical remediation to issues based on best practices and risk management.


Intelligent Wear Leveling and Monitoring

• Dell EMC Unity tracks, monitors, and predicts:

– Flash drive end-of-life – Expected wear level for drive

age – Current wear level of flash drive

• Remember: a worn-out flash drive is covered under warranty!

Driv

e W

ear

Time

End of LifeExpected WearActual Wear



• Flash drives already have internal wear leveling algorithms

• Dell EMC Unity adds another layer of wear leveling in the storage array

• All space allocation decisions now automatically take into account wear level


= Space Allocation



• Dell EMC Unity avoids allocating new slices from a flash resource if it is wearing faster than expected

– Drive wear is checked about once a week Intelligent Wear

Leveling

= Space Allocation



• Dell EMC Unity avoids allocating new slices from a flash resource if it is wearing faster than expected

– Drive wear is checked about once a week

• After some time, wear levels reduce to expected level for age of drive

– Write activity is reduced by system › Less wear

– Drive continues to age with few writes


= Space Allocation

Several Days Later

Efficiency and Affordability Dynamic Pools

Compression

Host I/O Limits

Replication


Dynamic Pools: Introduction

New Default Pool Technology Available in OE 4.2 on Dell EMC Unity All-Flash Models

Dynamic Pools

Easier Expansion of

Pools

Easier Storage Pool

Planning Reduced

Flash Wear Faster

Rebuilds

Distributed Sparing Across Many Drives Parallel Rebuild Process

I/O Spread Across All Drives No Dedicated Hot Spares

No Specific Drive Multiples Required Still Choose Your RAID Type

Expand by One or More Drives Expand by Capacity Required


Dynamic Pools: Architecture 25

6MB

25

6MB

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B Traditional Storage Pool

Private LUN

RAID Group

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

Private LUN

RAID Group

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

Dynamic Pools change the relationship between a

pool’s private RAID Groups and its Flash Drives


Private RAID Groups

Private LUNs

Traditional Storage Pool

Dynamic Pools: Architecture

Flash Drives

Drive Extents

RAID Extents

DP Private RAID Groups

Private LUNs

Dynamic Storage Pool Similar Look-and-Feel Easier to Manage

256MB Slices 1 per RG

Now Made of RAID Extents

New! Made of Drive Extents

New! A Portion of a Flash Drive

Now Utilized More Efficiently


Flash Drives

RAID Extents


Private LUNs

Dynamic Storage Pool

Dynamic Pools: Architecture 400GB 800GB

DE: 1 DE: 2 DE: 3 DE: 4 DE: 5 DE: 6

… DE: n

DE: 1 DE: 2 DE: 3 DE: 4 DE: 5 DE: 6 DE: 7 DE: 8 DE: 9

DE: 10 DE: 11 DE: 12 DE: 13 DE: 14

… DE: 2n

• A drive extent is a portion of a drive

• Each drive within a Dynamic Pool is partitioned into drive extents

– Drive extent size is consistent across all drives of the same type within the system

• The number of extents created per drive depends on its size

• A drive extent can either contain: – A single position of a RAID Extent – Spare space

Drive Extents


Dynamic Pools: Architecture • RAID Extents – RAID 5 (4+1) – Example

D1 DE 1 D1 DE 2 D1 DE 3 D1 DE 4 D1 DE 5 D1 DE 6

… Spare


… Spare


… Spare


… Spare


… Spare


… Spare

D1 DE 1 D2 DE 1 D3 DE 1 D4 DE 1 D5 DE 1 D6 DE 1 D1 DE 2 D2 DE 2 D3 DE 2 D4 DE 2 D5 DE 2 D6 DE 2 D1 DE 3 D2 DE 3 D3 DE 3

RAID Extent 1

D6 DE 1 D1 DE 2 RAID Extent 2 D2 DE 2 D3 DE 2 D4 DE 2

D5 DE 2 D6 DE 2 RAID Extent 3 D1 DE 3 D2 DE 3 D3 DE 3

*Note: This configuration is only an example and may not reflect the actual algorithm

D1 DE 1 D1 DE 2 D1 DE 3

D2 DE 1 D2 DE 2 D2 DE 3

D3 DE 1 D3 DE 2 D3 DE 3

D4 DE 1 D4 DE 2

D5 DE 1 D5 DE 2

D6 DE 1 D6 DE 2


Flash Drives

Drive Extents


Private LUNs

Dynamic Storage Pool


• A RAID extent is a collection of drive extents

• The number of Drive Extents in a RAID Extent is determined by – RAID type (RAID 5, RAID 6, or RAID 1/0)

– RAID width (4+1, 4+2, 1+1, etc.)

• Effectively a stripe width + parity: 5 drive extents for a RAID 5 (4+1) RAID extent

• A RAID extent will never have more than one drive extent from the same drive

D1 DE 1 D2 DE 2

RAID Extent: RAID 5 (4+1)

D3 DE 2 D4 DE 2 D5 DE 2

1 2 3 4 P

RAID Extents




RAID Group 1

• Dynamic Pool Private LUN and RAID Group – Example

RAID Extent

1

RAID Extent

2

RAID Extent

3

RAID Extent

4

RAID Extent

5

RAID Extent

6

RAID Extent

7

RAID Extent

8

Private LUN


DP RAID Group 1 (RAID 5 4+1) RE 1

RE2

RE3

RE4

RE5

RE6

RE7

RE8

Dynamic Pools: Architecture 25

6MB

25

6MB

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B Dynamic Storage Pool

Private LUN

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

Private LUN

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

256M

B

User LUN

DP RAID Group 2 (RAID 5 4+1) RE 1

RE2

RE3

RE4

RE5

RE6

RE7

RE8

DE1 DE2 DE3

DE1 DE2 DE3

DE1 DE2 DE3

DE1 DE2 DE3

DE1 DE2 DE3

DE1 DE2 DE3

DE1 DE2 DE3



Dynamic Pools: Adding A Single Drive

RG1_RE2 RG1_RE3 RG1_RE4 RG1_RE5 RG1_RE7

… Spare

RG1_RE1

RG1_RE3 RG1_RE4 RG1_RE6 RG1_RE7

… Spare

RG1_RE1 RG1_RE2

RG1_RE5 RG1_RE6 RG1_RE7

… Spare


RG1_RE6 RG1_RE7

… Spare


RG1_RE7 …

Spare

RG1_RE2 RG1_RE3 RG1_RE4 RG1_RE5 RG1_RE6 RG1_RE8

… Spare


RG1_RE6 … …

1. Expand the Pool by a single drive

2. Rebalance drive extents within the Pool RG1_RE1

RG1_RE2 RG1_RE3

RG1_RE5 RG1_RE6

RG3_RE1 RG3_RE1

RG3_RE1 RG3_RE1

RG3_RE1 RG3_RE2

*Note2: This configuration is only an example and may not reflect the actual algorithm *Note1: Not all RAID extents are shown


Dynamic Pools: Proactive Copy / Rebuild

*Note2: This configuration is only an example and may not reflect the actual algorithm


Spare Spare


Spare Spare

RG1_RE2


Spare Spare


RG1_RE6 RG1_RE7

Spare Spare


RG1_RE7 Spare Spare

RG1_RE1 RG1_RE2 RG1_RE3 RG1_RE4 RG1_RE5 RG1_RE6 RG1_RE8

Spare Spare


Spare Spare

1. A drive is identified for proactive copy or rebuild

2. Spare space is identified and drive extents are copied or rebuilt RG1_RE1

RG1_RE2 RG1_RE3

RG1_RE5 RG1_RE6

RG3_RE1 RG3_RE1

RG3_RE1 RG3_RE1

RG3_RE1 RG3_RE2

RG1_RE1

RG1_RE1 RG1_RE1


RG1_RE7

*Note1: Not all RAID extents are shown

RG1_RE2 RG3_RE1


Compression

Host I/O Limits

Replication


Dell EMC Unity Compression: Introduction

Unified Compression for Block and File with Dell EMC Unity OE 4.2

Unified Compression

Inline Space Savings

No Additional License

Required

Compression is Included with Base System License for Dell EMC Unity OE 4.1 and up

Writes Logged and Held in Cache Data Written to Flash Only Once

Lower TCO of Your Storage Solution Improve Utilization of Flash Capacity


Unified Compression: Architecture

• Life of an I/O (Host Perspective) – Host write – Data saved in cache – Host acknowledged

• Compression does not change this process

– Compression is inline between cache and drives

– Not between host write and acknowledgement

Empty Page

Dirty Page

System Cache

Acknowledgement

Host write


Dell EMC Unity Compression: Architecture

• After an acknowledged write – Data is aggregated and sorted – Compression attempted with LZ

algorithm – If compression savings are

sufficient, compressed data replaces existing data in cache

System Cache

Host write Dirty Page

Compression

Compressed Page

Empty Page

Sorting/Aggregation


Dell EMC Unity Compression: Considerations

• No additional license required – included in the Dell EMC Unity OE license – Only supported on physical Dell EMC Unity hardware and only on All Flash Pools

• Compression takes advantage of thinly provisioned storage resources – Supported on Thin LUNs, File Systems, VMware VMFS Datastores, and VMware NFS

Datastores – File Systems and VMware NFS Datastores must have been created with OE 4.2

• Storage resources supporting compression may have compression: – Enabled at any time

› Any existing data will remain uncompressed unless re-written

– Disabled at any time › Any existing data will remain compressed unless re-written

• Compression utilizes Dell EMC Unity CPU cycles to achieve compression


Compression

Host I/O Limits

Replication


Dell EMC Unity Host I/O Limits: Introduction

Policy-Based Host I/O Limits for LUNs, Snapshots, VMFS Datastores, and VVols

Dell EMC Unity Host I/O Limits

Multiple Limit Types

Density-Based Limits VVol Support I/O Limit

Exceptions

Pause / Resume Individual Policies Add I/O Burst Exceptions

Both Block and File VVols Can Now Have Host I/O Limits Applied

Limit Max IOPS and/or MB/s per GB Same Language as Public Cloud

Limit by Maximum IOPS or MB/s Ability to Limit by both IOPS and MB/s

4.1 4.1 4.2


Dell EMC Unity Host I/O Limits: Considerations Flash Drive Capacity

Drives in a Storage Pool

Using Dynamic Pools

• Desire to use as few storage pools as possible

• Workload isolation substitute – Use Host I/O Limits to limit noisy

neighbors – Multiple classes of workloads can share

a pool

• Budget available performance between different tenants

– Density-based host I/O limits provide familiar and consistent service levels

– Allow I/O burst exceptions via policy


Compression

Host I/O Limits

Replication


Replication: All-Flash Considerations

All-Flash Considerations

Replication

Compression-Independent Replication

Hybrid / VSA Destination

OK

Destination May Have Different Configuration or Features Must Have Sufficient Resources to Maintain Desired RPO

Compression May Be Enabled on Destination Data on Destination Recompressed if Enabled and Supported

Data Transmitted Uncompressed Data on Source Remains Compressed


Dell EMC Services Driving the rapid adoption and optimization of your digital technologies

CONSULTING

Harness the power of business urgency with help from our consultants

DEPLOYMENT

Accelerate technology adoption with expert deployment designed for you

MANAGED SERVICES

Gain efficiencies with our hosted cloud, managed applications, storage, archiving, and back-up

TRAINING

Develop and retain valuable IT talent through continuous learning

IT PROVEN

Learn how to invest from extreme users such as Dell IT

SUPPORT

Maximize productivity with expert support backed by proactive, predictive tools

Booth #347


Related Sessions for SC and Dell EMC Unity Series Session Title Day/Time Dell EMC Unity & SC Series: Midrange Storage Portfolio Overview Mon @ 12:00 PM + Wed @ 01:30 PM CloudIQ: Cloud-Based Storage Analytics for Dell EMC Unity and SC Series Mon @ 04:30 PM + Wed @ 08:30 AM Dell EMC Unity All-Flash: What’s New Tue @ 03:00 PM + Wed @ 01:30 PM Dell EMC Unity: Architectural Overview Mon @ 01:30 PM + Thu @ 08:30 AM Dell EMC Unity: Best Practices For Best Performance Wed @ 08:30 AM + Thu @ 10:00 AM Dell EMC Unity: Performance Analysis Deep Dive Wed @ 03:00 PM + Thu @ 01:00 PM Dell EMC Unity: Next Generation NAS & File Capabilities Mon @ 03:00 PM + Thu @ 11:30 AM Dell EMC Unity: Data Protection & Copy Management Options Mon @ 08:30 AM + Wed @ 12:00 PM Dell EMC Unity: Virtualization & Cloud Integration Mon @ 12:00 PM Dell EMC Unity: Migration From VNX Tue @ 08:30 AM Dell EMC Unity: Using Dell EMC UnityVSA In Converged Environments Mon @ 08:30 AM Dell EMC Unity All Flash: Flash Technology Deep Dive Mon @ 08:30 AM + Thu @ 01:00 PM SC Series: What's New Mon @ 04:30 PM + Tue @ 03:00 PM SC Series: Architectural Overview Mon @ 01:30 PM + Tue @ 03:00 PM SC Series: Performance Best Practices Mon @ 04:30 PM + Thu. @ 01:00 PM SC Series: Affordable Data Mobility & Business Continuity With Multi-Array Federation Mon @ 08:30 AM + Thu @ 01:00 PM SC Series: Virtualization & Ecosystem Integrations Wed @ 03:00 PM + Thu @ 08:30 AM


Hands on Labs for SC and Dell EMC Unity Series Self-Paced Day/Time

Dell EMC Unity CloudIQ – Event Correlation & Analytics

Monday: 8:30AM – 9:00PM

Tuesday: 7:00AM – 5:30PM

Wednesday: 7:00AM – 5:00PM

Thursday: 7:00AM – 2:00PM

Dell EMC Unity – Simplified Storage Management & Administration

Dell EMC Unity – VMware vSphere Integration

Dell EMC Unity – Configuring Snapshots & Replication

SC Series: Introduction to SC Series and Dell Storage Manager

Guided Day/Time

Dell EMC Unity CloudIQ – Event Correlation & Analytics (Registration required and limited availability)

Tuesday: 1:30PM – 2:30PM

Thursday: 8:30AM – 9:30AM


Thank You for Attending

PLEASE TAKE A MOMENT TO • Visit the Storage & Data Protection Booth • Tweet: @DellEMCStorage

A STAR IS BORN • Shoot an in-room 10 second reference video

(where applicable)

Talk with us in the booth about the:

Modern Infrastructure Assessment &

Storage Efficiency Guarantee

SITES TO BE SEEN • Efficiency Guarantee: dellemc.com/4to1guarantee • CloudIQ: dellemc.com/cloudiq • All-Flash Storage: dellemc.com/all-flash

http://www.dellemc.com/4to1guarantee

http://www.dellemc.com/cloudiq

http://www.dellemc.com/all-flash

Questions?


WANT TO WIN A LEVITATING DEATH STAR SPEAKER?

• Follow @DellEMCStorage while at Dell EMC World

• 2 Winners will be chosen daily from

Monday May 8 through Thursday May 11 • All winners will be notified through

Twitter Direct Message

NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/

dell emc unity all-flash: flash technology deep dive … · 3d tlc flash drives •intelligent wear...

Documents