netapp usergroup product update v0.2

Marc Hofstetter, Christian Volkmer, Patric Schallmo, Bojan

Jovanovic

NetAppProduct Update2012.03

1

2

Hardware

V-Series: Supported with Enterprise Storage Arrays from Major Vendors

NetApp Unified Storage SystemsFAS and V-Series

368 TB136 drives

720 TB240 drives

1800 TB600 drives

1TB Flash Cache

2880 TB960 drives

2TBFlash Cache

3600 TB1200 drives

3TB Flash Cache

4320 TB1440 drives

6TBFlash Cache

4320 TB1440 drives

16TBFlash Cache

FAS/V6280

FAS/V6240

FAS/V6210

FAS/V3270

FAS/V3240

FAS/V3210

FAS2040

3

FAS2240

432 TB144 drives

New

NetApp Shelf Alignment

� DS4243– Supports 3.5” form factor

– SATA 7.2k, SAS 15k and SSD

– 3Gb/sec SAS architecture

– Alternate Control Path (ACP)

� DS2246– Supports 2.5” form factor

– SAS 10k (450GB/600GB)

– 6Gb/sec SAS architecture

– Alternate Control Path (ACP)

8

13

MetroCluster mitSAS/SATA

MetroCluster with SAS Shelves

� DS4243 and DS2246

shelves are

supported

– Both SAS and SATA

drives can be

configured

� Available for stretch

and fabric

MetroCluster

� Requires DOT8.1

14

SAS

FC

Site A Site B

FibreBridge Stack

15

10 Shelves Maximum per FibreBridge Stack

SAS Disks SATA Disks SSD

DS4243 YES YES, BSAS NO

DS2246 YES N/A NO

DS4243(SAS disks)

DS4243(SATA disks)

DS2246

DS4243(SAS disks)

SAME YES NO

DS4243(SATA disks)

YES SAME NO

DS2246 NO NO SAME

NetApp Confidential – Limited Use

Shelf Combinations in FibreBridge Stack

16

ONTAP

Evolution of ONTAP

Scale-up (7-Mode)Upgrade to bigger and

bigger boxes

Scale-out (C-Mode)Scale controllers horizontally

Distribute data across more controllers

Distribute clients across interfaces

Cluster

17

ONTAP Versions in Switzerland

18

ONTAP Version ASUP sending Controllers

< 7.2 200+

7.3 1’850+

8.0 750+

8.1RC 80+

TOTAL ~2880 on ASUP - 68%

(Total ~4200 Systems)

as of March 2012

Data ONTAP 7.3 Status

� Data ONTAP 7.3

– 7.3.6 is currently recommended

– 7.3.7 targeted for March/April

19

Data ONTAP 8.x Status

� Data ONTAP 8.0.x

– 8.0.3 is currently recommended

– 8.0.4 targeted for June/July

� Data ONTAP 8.1

– RC3 available

– GD is targeted for May/June

� Data ONTAP 8.1.1

– RC1 targeted for this spring

20

New Features in ONTAP 8.0

� Complete new “chassis”

� Larger Aggregates (64bit)

� Performance

� Larger Dedupe Vols

� Takeover/Giveback Scalability

� VSim

21

*DOT8.0 was released in March 2010

New Features in ONTAP 8.0.1

� Maintenance Release

� Inline software compression (PVR)

� SMB2.0

� Data Motion for Volumes

� vStorage API (VAAI)

� Functional parity with 7.3 releases

22

*DOT8.0.1 was released in January 2011

New Features in ONTAP 8.0.2

� Maintenance Release

� 1TB FlashCache

� 3TB SATA Drives

� Quad Port 1Gb/s PCIe

23

*DOT8.0 was released in June 2011

Systems Support Matrix

Platform 7.3 8.0 8.1

FAS9x0/R200 ✔ ✗✗✗✗ ✗✗✗✗

FAS2x0 ✔ ✗✗✗✗ ✗✗✗✗

FAS2020/2050 ✔ ✗✗✗✗ ✗✗✗✗

FAS2040 ✔ ✔ ✔

FAS2240 ✗✗✗✗ ✗✗✗✗ ✔

FAS3020/3050 ✔ ✗✗✗✗ ✗✗✗✗

FAS3040/3070 ✔ ✔ ✔

FAS31x0 ✔ ✔ ✔

FAS32x0 ✗✗✗✗ ✔ 8.0.1+ ✔

FAS60x0 ✔ ✔ ✔

FAS62x0 ✗✗✗✗ ✔ 8.0.1+ ✔

24

https://now.netapp.com/NOW/knowledge/docs/hardware/NetApp/syscfg/

25

What is new inDOT 8.1

32-bit to 64-bit Aggregate Conversion

� Data ONTAP 8.1 supports 32-bit aggregate expansion– Data in-place – no data copying or migration

– Volumes online – reads, writes and other

operations continue

– Short, small performance impact –

it’s a background activity

26

How to trigger expansion to 64bit?

� aggr1 (size 13TB)– Admin decides to add 10 1TB disks

– Since the addition of the disks will cause the aggregate to go

over 16TB, the admin will be advised to run the following steps

� Trigger expansion

27

filer> aggr add aggr1 10Warning: By adding these disks, the aggregate's siz e will be too

large to revert to Data ONTAP 7.3. To proceed with this operation, and upgrade the agg regate from

32-bit format to 64-bit format, follow these steps: 1. Run the "aggr add" command with the "-64bit-upgr ade check"

option to determine whether there is enough free sp ace for the 64-bit upgrade

2. Resolve any space issues identified by the "-64b it-upgrade check" option

3. Run the "aggr add" command with the "-64bit-upgr ade normal" option to add the disks and trigger 64-bit upgrade on the aggregate

How to trigger expansion to 64bit?

� Add disks to trigger the expansion

28

filer> aggr add aggr1 -64bit-upgrade normal 10

Addition of 10 disks to the aggregate has completed.

The 64-bit upgrade scanner has started running on aggregate aggr1.

The 64-bit upgrade scanner has started running on volume vol1.

System Manager 2.0 support

29

Home Directory Workload:

Average Latency (ms)

0

1

2

3

4

5

6

1 2 3 4 5 6 7 8 9

Latency (ms)

Data Points (20 min interval)

Baseline:sys_avg_latency

64-bit expansion:sys_avg_latency

Initial short spike in latency

30

Expansion process starts

TR-3978: In-Place Expansion of 32-Bit Aggregates to 64-Bit Overview and Best Practices

Data ONTAP

8.0.x

Data ONTAP

8.1

FAS or V-Series

Model

Aggregate &

Volume Limit

Aggregate

Limit

Largest

Volume

6280, 6240

6080, 6070100 TiB 162 TiB 100 TiB

6210 70 TiB 162 TiB 70 TiB

6040, 6030

3270, 317070 TiB 105 TiB 70 TiB

3240, 3160 50 TiB 90 TiB 50 TiB

3210, 3140 50 TiB 75 TiB 50 TiB

3070, 3040 50 TiB 50 TiB 44.7 TiB

2240 Not supported 60 TiB 53.7 TiB

2040 30 TiB 50 TiB 30 TiB

64-bit Aggregate and Volume Size Limits

31

� 8.1 maximum

volume sizes

are the same

with and

without dedupe

�Existing

volumes using

dedupe can be

expanded

beyond 16TB

Deduplication Volume Size Limits

32

Data ONTAP

8.0.x

Data ONTAP

8.1

FAS or V-Series

Model

Aggregate &

Volume Limit

Largest

Volume

6280, 6240

6080, 6070100 TiB 100 TiB

6210 70 TiB 70 TiB

6040, 6030

3270, 317070 TiB 70 TiB

3240, 3160 50 TiB 50 TiB

3210, 3140 50 TiB 50 TiB

3070, 3040 50 TiB 44.7 TiB

2240 Not supported 53.7 TiB

2040 30 TiB 30 TiB

More Deduplication Updates

� License has been removed

� Deduplication performance is

higher in many cases

� Dedupe integration with Volume

SnapMirror is better

� Hourly checkpoints enable more

granular restart points

33

Data Compression Overview

� Generally available with Data ONTAP 8.1:

7-Mode and Cluster-Mode

� Space savings

– For data that doesn’t

deduplicate well, or

– In addition to what

deduplication can provide

34

Data Compression Overview continued

� Supported on 64-bit aggregates only

� No license required

� Data ONTAP 8.1 enhancements include

– Performance improvements

– No volume size limits

– New technical documentation

35

Compression and Deduplication

36

Typical storage savings by application

0%

10%

20%

30%

40%

50%

60%

70%

80%

File Services Virtualization Oracle OLTP Oracle DW Exchange2007

Exchange2010

Software Dev Geoseismic

Compression Only Dedupe Only Dedupe + Compression

P

P

P

P = primary storage use cases

Space Savings Estimation Tool via Partner/NetApp available

PP

P

PP

Compression and Deduplication

Characteristic Compression Deduplication

When it is done Inline or post-process Post-process only

Scope of process

Replaces repeating

patterns within a 32KB

chunk of a file or LUN

Removes duplicate

4KB blocks within a

volume

Performance impactWhen compressing

and reading

Typically only when

deduplicating

37

Brief Comparison

TR-3958: NetApp Data Compression and Deduplication Deployment and Implementation Guide: Data ONTAP 8.1 Operating in 7-Mode

FlexClone for File and LUN Enhancements

� Creating clones from Snapshot copies

� 125x more logical references to a 4KB block

� Immediate read/write access to new clones

38

Flexclone Single File Clone Demo

39

http://www.youtube.com/watch?v=w5qS9UGHpsQ

Storage HW Acceleration / Offload

� VAAI (VMware)

� VMware clones use NetApp clones

� Unified SAN/SMB Copy Offload (Microsoft)

� File copies will be NetApp clones

40

http://virtualstorageguy.com/2011/09/20/microsoft-announces-smb-2-2-and-nas-support-for-hyper-v-3-0-in-windows-8/

Other Items of Note

� 8.1 7-Mode supports IPv6 and SnapLock

� System Manager 2.0 is the device manager GUI

� Snapshot reserve default values have changed

– New volume reserve default is 5% (previously 20%)

– Aggregate reserve default is 0% unless SyncMirror is enabled

� Nondisruptive upgrade from Data ONTAP 7.3.2

41

Volume SnapMirror Interoperability Matrix

42

Destination Volume

Data ONTAP 7.3.x 8.0.x 8.1

Aggregate

Type32-bit 32-bit 64-bit 32-bit 64-bit

Source Volume

7.3.x 32-bit Yes Yes No ✔ ✔

8.0.x

32-bit No Yes No ✔ ✔

64-bit No No Yes ✔ ✔

8.1

32-bit No No No ✔ ✔

64-bit No No No ✔ ✔

43

OFFTAP

File Systems and Partitions

� Aligning the partition aligns the file system

� File systems need to use a block size

that is an even multiple of 4096 bytes

– NTFS, EXT, VMFS

44

Partial I/O

� I/Os smaller than the physical block

� Generated by specific applications

– Database transaction logs

� May appear as unaligned I/O

� Not performance impacting

when sequential

45

Heuristic Checks (ONTAP)

� Data ONTAP counters

– lun show -v

– lun alignment show

– stats show lun

– nfsstat -d

� Partition table analysis

for susceptible

configurations

46

Alignment Heuristic on LUNs

� Automated calculations based on I/O patterns

� Reset internal counters – lun stats -z

*> lun show -v /vol/luns/my_windows_lun

/vol/luns/my_windows_lun 1.0g (1077511680) (r/w, online, mapped)

Serial#: C4dAFJfXW5Fp

Share: none

Space Reservation: enabled

Multiprotocol Type: windows

Maps: sanboot-b9rtp8=1

Occupied Size: 432.7m (453726208)

Creation Time: Fri Sep 30 09:04:50 EDT 2011

Alignment: misaligned

47

Alignment Heuristic on Volumes (NFS)

� Automated calculations based on I/O patterns

f31> nfsstat –d

<snip>

Files Causing Misaligned IO's

[Counter=46925], Filename=infra/WinVC/WinVC-flat.vmdk

[Counter=32001], Filename=infra/WinDSView/WinDSView-flat.vmdk

[Counter=39], Filename=infra/vsc4/vsc4-flat.vmdk

[Counter=9831], Filename=infra/RHEL54x64/RHEL54x64-flat.vmdk

[Counter=728], Filename=infra/VC41/vc41-flat.vmdk

[Counter=314400], Filename=infra/vCenter/vCenter-flat.vmdk

48

TR3747: Best Practices for File System Alignment in Virtual Environments

SystemManager

50

System Manager 2.1 (Spring/Summer)

51

SnapDrive & SMSQL

52

53

54

VSC 4.0

55

NetApp Virtual Storage ConsoleDetecting and fixing Misalignment

� Online detection and correction

� Periodic detection scanning of VMDKs

� Scheduler for automating migrations

� VSC 4.0 – Spring 2012

– VMDKs in VMFS datastores

– VMDKs in NFS datastores*

56

*requires ONTAP 8.1.1

The NetApp VSC 4.0 release provides

the following:

� NFS Local Path Affinity for the VSC Monitoring and

Host Configuration sub plug-in

� Installation of NetApp NFS NAAI plugin.

� New Optimization and Migration plugin within VSC to

address alignment issues (online alignment). MBR

align tools will still be packaged with VSC 4.0 for

offline alignment

� Storage controller user credentials sharing between

Prov and Cloning, Monitoring and Host Configuration

and Optimization and Alignment capabilities. Backup

and Recovery will not share user credentials in this

release.

57

58

59

60

C-Mode

NetApp Terminology

HA

HA PairEquals 2-nodes. HA interconnect for heart beat and recording of storage logs

Node A single storage controller running

one instance of Data ONTAP

� Highly available

– Hardware/software resilience

– Online software updates

Evolution of Data ONTAP

Unified StorageSAN hosts / NAS Clients

HA

Access Protocols

Storage

� Symmetrical two-node pair

– Data storage for SAN hosts and NAS clients

– Fixed / assigned to controllers

– Scale-up - bigger controllers

� Core storage capabilities

– RAID-DP®

– Storage efficiency

– Integrated data

Data ONTAP 8.1 Cluster-Mode

� Virtualizes storage and data access

� Flexible data management and presentation

� Transparent migrationof data andnetwork resources

Virtualizes Storage and Network

Interconnect

Access Protocols

Storage

HA

SAN hosts / NAS Clients

VS1

Data ONTAP 8.1 Cluster-Mode

� Logical, flexible, secure resource pool for a NAS namespace and LUNs

� All data access is througha Vserver

� Includes FlexVolvolumes, LUNs, andlogical networkinterfaces (LIFs)

Logical Interfaces

FlexVol volumes

Vserver

LIF2 LIF1

SAN hosts / NAS Clients

HA

Virtual Server

Integrated Shared Architecture

HA

Data ONTAP 8.1 Cluster-Mode

SAN hosts/NAS clients

LIF2 LIF1

HA

LIF3LIF4

� Consolidated management

� Access to any data

from anywhere

� Nondisruptive operations

� Dynamic flexibility

� Virtualized “tiered services”VS2

LIF2 LIF1

VS1

� Integrated data protection

and efficiency

Architectural Benefits

Data ONTAP 8.1 Cluster-ModeNondisruptive Operations

Volume MoveLIF Migrate andLoad Balancing

High Availability(SFO / LIF failover)

NondisruptiveUpgrades

66

Nondisruptive Operations

67

ONTAP 8.1: Cluster-Mode Focus Area

Ready for these workloadsT

Windows File Services

Exchange

SharePoint

SQL Server

Hyper-V

VMware

Oracle

IBM ClearCase

Siemens PLM

Tand these customers

• Enterprises seeking scalable,

shared IT solutions for nonstop

operations

• New customers and new

installations at existing

accounts

• Cluster-Mode and GX

customers looking to upgrade