netapp 10th tf-storage meeting - terena...netapp @ 10th tf-storage meeting wojciech janusz, netapp...

Netapp @

10th TF-Storage Meeting

Wojciech Janusz, Netapp Poland Bogusz Błaszkiewicz, Netapp Poland

Ljubljana, 2012.02.20

Agenda

Data Ontap Cluster-Mode

pNFS

E-Series

2 NetApp Confidential - Internal Use Only

FAS Market Share Trend – Revenue

NetApp Confidential – Limited Use

NetApp 13.8%

EMC 29.4%

Dell 8.8%

IBM 12.1% HP 10.7%

FAS equals the combined NAS and SAN markets

Source: IDC, Dec 2010

432TB 144 Drives

408TB 136 Drives

4,320TB 1,440 Drives

6TB Flash Cache


8TB Flash Cache

1,800TB 600 Drives

1TB Flash Cache


3TB Flash Cache 2,880TB 960 Drives

2TB Flash Cache 720TB

240 Drives 512GB

Flash Cache

New Entry Systems Added to Line

Truly unified Most efficient Extremely flexible

4

FAS/V3210

FAS2040

FAS/V6240

FAS/V6280

FAS/V3240

FAS/V6210

FAS/V3270

FAS2240

Unified Storage Architecture

5

Ontap 8.1

Cluster-mode

NAS and SAN Familiar Ethernet and

FC infrastructures No special client or host code

FAS/V62x0, FAS60x0, FAS/V32x0, FAS31x0 FAS3070, FAS3040,

FAS2040*

SATA, SAS, FC, and SSD storage

Third-party arrays with V-Series

Flash Cache

Data ONTAP 8.1 Cluster-Mode System


Multiprotocol Access (NFS/CIFS/FC/iSCSI/FCoE)

Virtualized Storage and Network

Data ONTAP® 8.1 Cluster-Mode System

FC SAS SATA SSD

Third-Party Arrays with V-Series NetApp® Storage

FC or SATA SAS

Namespace is unchanged as volumes move

No client code

Easy to manage

Easy to change

Seamlessly scales to many petabytes

Access using a single NFS mount or CIFS share

B A2

A3 A1

B1 B2

A

R C A4

Single NFS mount/CIFS share

Data ONTAP 8 Cluster-Mode Global Namespace


A B

A1 A2 A3

B1 B2

R

C

A4

VS1

Data ONTAP 8.1 Cluster-Mode Virtual Server


Logical, flexible, secure resource pool for a NAS namespace and LUNs

All data access is through a Vserver, which supports one or more protocols

Includes FlexVol® volumes, LUNs, and logical network interfaces (LIFs)

Minimum of one Vserver required: can support 100s

SAN hosts/NAS clients

Integrated Shared Architecture

Logical Interfaces

FlexVol volumes Vserver

LIF2 LIF1 HA

VS2

Data ONTAP 8.1 Cluster-Mode Multi-Tenancy



HA

LIF2 LIF3 LIF4 LIF2 LIF1 LIF1

Workload Isolation

VS1

Vservers enable multiple storage domains sharing a common resource pool

Maintain logical separation – A Vserver defines a domain for

volumes, LIFs, and access protocols

Secure, delegated administration

100s of Vservers supported

HA

HA

Data ONTAP 8.1 Cluster-Mode Cluster Expansion



Transparent Operational Flexibility

LIF2 LIF1 LIF3 LIF4

VS1

Nondisruptively grow and redistribute resources

Vserver adjusts as the cluster is seamlessly expanded

Mix and match controllers

Mix and match drive types − SATA, SAS, FC, SSD

Third-party arrays with V-Series

Hosts 1000s of volumes

PB-sized namespace

HA

Cluster-Mode Transparent Volume Move


B

C A2

A3 C1 A1

B1 B2

A

R

C2

LUN

LUN LUN

A B C

A1 A2

A3 B1 B2

C1

R

LUN LUN

Uninterrupted Access Continuous data access by

clients and hosts

Uses Snapshot™ technology to copy data to a new aggregate

in the background

Nondisruptively move volumes between ANY aggregates anywhere in the cluster

Storage space savings, mirror relationships, and

Snapshot copies are unchanged

NFS / CIFS / iSCSI /FC / FCoE

HA HA

Cluster-Mode: On-Demand Flexibility


The Results Seamlessly add capacity Rebalance resources Rapidly deploy new system

The Challenges “Disk full” errors Over-provisioning in anticipation of future

capacity needs Managing access to new storage

The Benefits Nondisruptive volume movement is

transparent to clients and hosts Namespace and LUN mapping unchanged Shared storage infrastructure

A1

C1 LUN

LUN

B2

A B

A1

A3

R C LUN

B1 C1 LUN

LUN

A A2

Cluster-Mode: Operational Efficiency


The Results Virtualized tiered services

Integrated unified system

Match business priorities

The Challenges Changing workload demands Critical projects need appropriate resources

The Benefits Nondisruptive volume movement is

transparent to clients and hosts Mix controllers and disk types in the same

cluster On-demand mobility for critical projects Adapt resources to meet business demand

Higher Performance Storage

Lower Cost Storage

C1 LUN

LUN

B2

A B A1

A3

R C LUN

A2 B1

Cluster-Mode: Operational Lifecycle


The Results ZERO downtime ZERO processing interruptions ZERO client changes

The Challenges Upgrade an entire storage system 24x7 operation during move

The Execution Identify affected volumes and LUNs Nondisruptively move volumes Perform technology refresh Power up node and rejoin cluster Move volumes back to new node Repeat

B2

A B

A1 A3

R C LUN

A2

B1 C1 LUN

LUN

“Always-On” Infrastructure

Cluster-Mode Networking Overview


SAN / NAS

Mgmt

Cluster Interconnect 10GbE

HA HA

Data ONTAP® Cluster-Mode

16

pNFS

Massively Scalable NAS Platform One Namespace or Many, Classes of Service

Heterogeneous cluster – Mix of controller types in single

cluster per workload needs

– Entry, midrange, and high-end platforms

– Native and third-party storage (FAS, V-Series)

– Multiprotocol

Tiered storage – Match data to disk price/

performance

– Manage multiple tiers in the same namespace or many

– Examples

Reference data

DR mirror destination

Scalable archives

17

B C A2

A3 C1

C2

Projects

A B C

A1 A2 A3 B1 B2 C1 C2 C3

A1 B1

High-Speed Storage (Highest Performance Across All Workloads)

High-Capacity Storage (Lower $/GB)

B2 C3

Personality Semantics

Authentication Identification Permissions

Transport Caching

Data Locality

Stateful

Supports UNIX & WINDOWS

Strong (Kerberos)

Stringbased ([email protected])

WINDOWS like access

TCP Only

File Delegations

Referrals

NFSv4

Stateless

UNIX Only

Weak(AUTH_SYS)

32 bit UID/GID

UNIX based

UDP & TCP

Ad-hoc

No Remote Access

NFSv3

Stateful

Supports UNIX & WINDOWS

Strong (Kerberos)

Stringbased ([email protected])

More WINDOWS friendly

TCP Only

Files & Directory Delegations*

Referrals

NFSv4.1

Comparison of NFSv3, NFSv4 and NFSv4.1

18 NetApp Confidential - Limited Use

NFSv4.1 • Is a minor release

of NFSv4 • Does not modify any NFSv4

features • Is only in DOT8.1 c-mode • Bug fixes • Supports pNFS • Supports sessions

and trunking

8

pNFS

pNFS Protocol − Minor version of NFSv4.1 − Transparent to applications Storage Access Protocol − files (NFSv4.1) − blocks (FC, iSCSI, FCoE) − objects (OSD2) Control Protocol − Outside of the

pNFS standard

User Applications

NFSv4.1

Generic pNFS layout

File layout

OSD layout

Block layout

SUN RPC iSCS

I

SCSI

TCP FCP RDMA

pNFS Protocol

Control Protocol

Metadata Server Data Servers

Client

Storage Access Protocol

NetApp Confidential - Limited Use

Regular NFS Vs. pNFS

pNFS with Data Ontap 8.1

9

Meta-data, Control, Data use the same path

NFS

Single Stack NFS, Meta-Data, Data , Locks

NFS Client Meta-Data Path Data Path

N-Blade NFS pNFS

Control Path

N-Blade NFS pNFS

D-Blade Meta-Data, Data Locks

D-Blade Meta-Data, Data Locks

pNFS Client

pNFS Client

pNFS Client

NetApp Confidential - Limited Use

NFSv4.1 Sessions RHEL 6.0/ RHEL 6.1 SLES 11 SP1 (Untested)

Important fixes missing pNFS Files

RHEL 6.2 (File support Only) – kernel 2.6.40 SLES 11 SP 2* (Files & objects)

pNFS Files and Objects Fedora 16 (Linux-3.0)

* Internal testing of RHEL Early Access bits under way

Client NFSv4.1 and pNFS in Linux Distributions

21

NetApp Sets Record NFS Performance

NetApp® delivers better performance and efficiency than Isilon 35% more IOPS 40% faster response time 50% less disks 80% fewer controller nodes

22

Leading Performance

FAS6240 24-node cluster with Data ONTAP® 8.1 SPECsfs2008 NFS benchmark

For more information, visit http://www.spec.org/sfs2008/results/. SPEC® and SPECsfs2008® are trademarks of the Standard Performance Evaluation Corp.

http://www.spec.org/sfs2008/results/�

23

E-Series

Big Data Market Requirements


Distributed compute farms with standard software

Simpler systems, faster to deploy

Optimized balance between compute & storage

Reliable data (metadata)

Very high streaming bandwidth

Dense configurations - GB/s/Rack Unit

Large data sets (containers)

Simpler system configurations

Boundaryless containers (10’s PBs) Simple access to dynamic

datasets New access

technology(CDMI) with legacy application interfaces

Highly efficient, self-managing systems

E-Series Controllers

25 NetApp Confidential – Limited Use

5400 2600 Host/SAN connectivity • (4) 40Gb IB • (8) 8Gb FC • (16) 8Gb FC

Host/SAN connectivity • (8) 6Gb SAS • (8) 8Gb FC and (4) SAS • (8) 1Gb iSCSI and (4) SAS • (4) 10Gb iSCSI and (4) SAS

Drive channels / types / max • (2) 6Gb SAS ports • SSD/SAS/SED/NL-SAS • Up to 384 drives

Drive channels / types / max • (2) 6Gb SAS ports • SSD/SAS/SED/NL-SAS • Up to 192 drives

Enclosures • (60) drive DE6600 • (24) drive DE5600 • (12) drive DE1600

Enclosures • (60) drive DE6600 • (24) drive DE5600 • (12) drive DE1600

Cache • 12 / 24 / 48 GB

Cache • 2 / 4 GB

Performance • 6,000 MB/s – disk reads • 3,100 MB/s – CME disk writes • 900,000 IOPS – cache reads • 350,000 IOPS – SSD reads • 150,000 IOPS – disk reads

Performance • 4,000 MB/s – disk reads • 1,200 MB/s – CME disk writes • 200,000 IOPS – cache reads • 84,000 IOPS – SSD reads • 65,000 IOPS – disk reads

Dual-controller systems

E-series disk shelves

DE5600 2U / 24 / 2.5”

– SAS, SAS SSD drives

DE1600 – 2U / 12 / 3.5”

– SAS, SAS SSD

DE6600 – 4U / 60 / 3.5”

– FC, SAS, SATA, SAS SSD

NetApp Confidential - Internal Use Only

5400 + DE6600 5400 + DE5600 2600 + DE1600 5460 2612 5424

Any controller to ANY enclosure

Insert 2 E-Series Controller(s) into enclosure to create 1 storage system (RBOD)

Creating Storage Systems

27 NetApp Confidential – Limited Use

E Series Power

• 1.8PB in 1 rack

• High density 4U /60 • up to 60GB/s reads • 400,000 IOPs from disks

NetApp Confidential - Internal Use Only

HaDoop


StorageGRID® E-Series Building Blocks


E2600/5400 + DE6600 120/180TB Array

E2600 + DE1660 24TB Arrays

2 x Control Nodes 2 x Storage Nodes

2 x Gateway Nodes 2 x Storage Nodes

StorageGRID Software on Generic x86 Servers

FC attached, 1 adapter per SN

NetApp and StorNext

Designed for NetApp E-Series storage

– High performance

– High capacity

– Highly reliable foundation

StorNext File System – Heterogeneous data sharing across Fibre Channel

SAN clients Mac, Win, Linux, UNIX

– Simultaneously serve LAN clients with StorNext LAN Gateway & LAN clients

StorNext Storage Manager (Optional)

– Intelligent archiving

– Data always stored on most cost-effective storage tier

31

NetApp Full Motion Video Solution

StorNext Metadata Controller

StorNext SAN Clients

StorNext LAN Clients

LAN

NetApp E5460 Stack

SAN

FC

FC

Long-term Archive

NetApp Auto Support

32 NetApp Confidential - Limited Use

Correlate disk latency (hot) with disk type – 24 billion records – 4 weeks to run query – After Hadoop implementation -> 10.5 hours

Bug detection through pattern matching – 240 billion records – Too large to run – After Hadoop implementation = 18 hours

Phone home data representing information about the status NetApp storage controllers

netapp 10th tf-storage meeting - terena...netapp @ 10th tf-storage meeting wojciech janusz, netapp...

Documents