ibm spectrum nas overview · scale out nfs and smb scale out data store scale out file system scale...

�© Copyright IBM Corporation 2018.

Accelerate with IBM Storage:

IBM Spectrum NAS Overview

Apr 12, 2018

Ash Mate

Norman Bogard

Chris Vollmar

John Sing

�Washington Systems Center - Storage

�© Copyright IBM Corporation 2018 Accelerate with IBM Storage.

Accelerate with IBM Storage Webinars

The Free IBM Storage Technical Webinar Series Continues in 2018...

Washington Systems Center – Storage experts cover a variety of technical topics.

Audience: Clients who have or are considering acquiring IBM Storage solutions. Business Partners and IBMersare also welcome.

To automatically receive announcements of upcoming Accelerate with IBM Storage webinars, Clients, Business

Partners and IBMers are welcome to send an email request to [email protected].

Located in the Accelerate with IBM Storage Blog: https://www.ibm.com/developerworks/mydeveloperworks/blogs/accelerate/?lang=en

Also, check out the WSC YouTube Channel here:

2018 Webinars:January 9 – DS8880 Easy TierJanuary 17 – Start 2018 Fast! What's New for Spectrum Scale V5 and ESSFebruary 8 - VersaStack - Solutions For Fast DeploymentsFebruary 16 - TS7700 R4.1 Phase 2 GUI with Live DemoFebruary 22 - DS8880 Transparent Cloud Tiering Live DemoMarch 7 - Spectrum Storage Management, Control, Insights, Foundation; what’s the difference?March 15 - IBM FlashSystem A9000/R and SVC Configuration Best PracticesMarch 27 - IBM FlashSystem A9000/R Technical UpdateApril 12 - Introducing Spectrum NAS - The Newest Member in the Spectrum Storage FamilyApril 26 - TS7700 Grid Configuration Changes -- Joins, Merges and Removals

Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e19126fb94d657fcf347b5a70c7e08ce2May 8 - DS8880 Technical Update

Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e5a4a631f2c718b34c9c3ec4e0f508672

https://www.youtube.com/playlist?list=PLSdmGMn4Aud-gKUBCR8K0kscCiF6E6ZYD&disable_polymer=true

Questions about this webinar? Interested in follow-up?

Send email to:

Dennis [email protected]

IBM Washington Systems Center

IBM Storage & SDI

Topic Speaker

Spectrum NAS Product Announcement John Sing

Spectrum NAS Architecture Overview Ash Mate

Spectrum NAS Features & Functions Christopher Vollmar

Spectrum NAS Functions demo Norman Bogard

Additional Resources Ash Mate

Conclusion & Next Steps John Sing

End

Agenda

3

IBM Storage & SDI

IBM Spectrum NAS Product

Announcement

John Sing

IBM Storage & SDI

• NEW! Addition to the Spectrum Software Defined Storage Portfolio

• Designed for modernizing your general purpose NAS workloads toward software defined storage

• Simple, easy to deploy and manage

• Native support of the latest specifications for NFS and SMB

• Software only offering - runs on storage rich commodity servers (x86)

Introducing IBM Spectrum NAS

IBM Storage & SDI

• IBM Spectrum™ NAS is a software-defined storage solution

that offers agility and management simplicity for network-attached storage (NAS) workloads

• It helps reduce capital expenditure by working with industry-

standard x86 servers to form high-performance, scale-out

storage clusters

• It includes:� Protocol support (NFS, SMB)

� Scale-out file system

� Embedded operating system

� Intuitive Management GUI

• Spectrum NAS GA: March 20, 2018

IBM Spectrum NAS

6

IBM Storage & SDIDriven by Data: Modernize and Transform

MODERNIZE

Optimize and drive efficiencies, while continuing to deliver high levels of service delivery

SAVE HERE INVEST HERE

TRANSFORM

Deliver and operate new scale out NAS infrastructure to support new Cognitive and agile workloads

Traditional NAS Software Defined NASGeneral Purpose File

IBM Storage & SDI

The NAS segment is 20+ years old, and enterprises depend on standard file protocolsHowever, enterprises are looking to lower the cost of storing file data in order to invest in new workloads

1. Simple to deploy and administer

• Deploy on bare-metal servers or VMs in 30 mins

• Robust and Self balancing

2. Lower cost

• Run on Commodity x86 servers

• Tailor for efficiency, performance, and protection

3. Scale-out file storage that grows with you

• Linear scale of performance and capacity

• Upgrade without downtime

4. Enterprise NAS features you need

• Native NFS and SMB protocols

• Rich NAS functions

Easy to manage software-defined file storage for the enterprise

IBM Spectrum NASScalable software-defined file storage for enterprise IT

IBM Storage & SDIIBM File and Object offerings based on Workloads and Key Requirements

The right offering for the right workloads

IBM

OfferingSpectrum Scale & ESS Spectrum NAS Cloud Object Storage

WorkloadsTraditional

HPC

Big Data

analytics,

Technical

computing,

ML/DL

High

speed

backup &

restore

File serving

for Virtual

Machines

Home

Directories /

General

purpose file

serving

NAS for

Microsoft

Apps

Archive,

Content

Repository &

distribution

Native Object

Applications

Key

req’ments

High Performance;

supports billions of files

Simple and Native File Protocols

(no open source code)

Multi-site and Native Object

Storage

IBM Storage & SDIEasy to Use and Manage

Management Tool Management Tool Management Tool

Unconfigured servers + Spectrum NAS software

Name the servers

Connect to a network

Run server wizards Run cluster wizard

Setup is complete

IBM Storage & SDI

Architecture Overview

Ash Mate

IBM Storage & SDISpectrum NAS IS/IS NOT

Spectrum NAS

IS... IS NOT…

NAS (NFS & SMB File Protocols) Unified File, Object, Block

SW only Appliance

Scale-out A pair of HA controllers

Based on storage rich servers Based on external storage

SDS-NAS Traditional NAS

On-Premise Cloud

Native NFS/SMB Open Source (Samba/Ganesha)

Symmetric architecture Asymmetric architecture

IBM Storage & SDI

Spectrum NAS Traditional NAS

Software Defined – Commodity Hardware Customized Hardware Appliance

Software-defined storage cost effectiveness Traditional cost levels

Rolling, in-service upgrades Fork-lift upgrades

Flexible, agile, on-demand scale out Rigid, controller-based, hardware specific

models

Easier to deploy, configure, manage,

upgrade, and scale

Traditional methods for configure, manage &

upgrade

Scale out in discreet increments Add a whole array at a time, to expand

Low cost commodity enterprise servers,

exploit fast moving technology upgrades

Hardware vendor lock-in

Spectrum NAS vs. Traditional NAS

13

IBM Storage & SDI

Synchronous & Asynchronous Replication for DR

Robust File System Feature set

IBM Storage & SDI

• Significant compatibility with primary file protocol specifications

• Support for NFSv3, NFSv4.0, NFSv4.1 and pNFS

• SMB is critical for Microsoft application environments

• Many software defined NAS and file gateways use Samba for SMB

• Open source SMB is lacking full

coverage of SMB standard (46%)

Strong Support for Standard SMB and NFS

IBM Storage & SDI

Each node is an industry standard storage rich server with CPU, RAM, NIC, HDD/SSD, NVMe SSD Cache and SAS HBA

Node 1 Node 2 Node 3 Node 4 5 . . n

Linear Scale-Out

Tig

htl

y I

nte

gra

ted

sin

gle

so

ftw

are

sta

ck

10, 40 or 100GbE private network

True Scale-Out� Symmetric Architecture: Every node has

identical role

� No hot spots or bottlenecks

� Files served from cache on any node

� No JBODs or any external storage

� Min 4 nodes to form cluster

� Data store runs erasure coding &

responsible for load balancing

� Self healing cluster survives node failures

� Scalable to 100’s of nodes

Scale Out NFS and SMB

Scale Out Data Store

Scale Out File System

Scale Out Non-Volatile Cache

Spectrum NAS is architected from ground up for cloud-scale

IBM Storage & SDINative protocols, easy to use, self-healing and linear scaling

IBM Storage & SDIDeployment Model

18

• 4 servers to start; simply add node(s) to scale capacity

and performance

4 nodes for protection against 2 drive failures,

5 nodes for protection against 2 complete node failures

• Add new tier with new hardware up to 5 tiers

Start each tier with 4 nodes

• Every node has identical role; no bottleneck or hotspots

• Self healing cluster survives node or drive failures

• Non-disruptive upgrades & capacity expansion

IBM Storage & SDIProviding the Full Software Stack

NO

3PPSOFTWARE

NO

OPENSOURCE

IBM Storage & SDI

All protocols implemented in C/C++

Protocols tightly integrated with the virtual

file system layer

Own implementation of RPC server for

higher efficiency

High focus on minimizing memory

allocations

Protocols

IBM Storage & SDIScale-out Storage

IBM Storage & SDI

• Support for cache mirroring

• Cache partners are selected at file level

• Supports write cache for a file on single

server

• Supports read cache for a file on

multiple servers

• Destage after a configurable time

Spectrum NAS Write Operation – Cache Sync

22

IBM Storage & SDI

File encoding: 2+1 Extent (object) size: 1 GB

File 1Size2 GB

Obj1ASize1 GB

Obj1BSize1 GB

Slice 1A1

Size500 MB

Slice 1B1

Size500 MB

Slice 1A2

Size500 MB

Slice 1B2

Size500 MB

Slice 1A3

Size500 MB

Slice 1B3

Size500 MB

Slice x

128 KB + chk sum

128 KB + chk sum

128 KB + chk sum

128 KB + chk sum

128 KB + chk sum

File Encoding

IBM Storage & SDI

No 1-to-1 mapping of

nodes

Data placed based on:

• Free space in node

• Geographical position

• Current work load

• Tier policies

• Random

How is data distributed within cluster

IBM Storage & SDIVirtual IP

IBM Storage & SDI

Configuration 1: 8 nodes

2x Intel(R) Xeon(R) 6 core CPU E5645 @ 2.40GHz, 96 GB

RAM (6x16GB DIMMs)

1x800 GB SATA SSD for cache

10x1TB SAS/SATA HDD for data

1x 10Gb port for mgmt , 1x 10Gb port for private , 1x 10Gb port for public


2x Intel(R) Xeon(R) 6 core CPU E5645 @ 2.40GHz, 96 GB RAM (6x16GB DIMMs)




What does IBM recommend?Tested Configurations


2x Intel(R) Xeon(R) 6 core CPU E5645 @

2.40GHz, 96 GB RAM (6x16GB DIMMs)





2x Intel(R) Xeon(R) 4 core CPU E5620 @ 2.40GHz, 64 GB RAM (8x8GB DIMMs)




NVMe

NVMe

NVMe

NVMe

IBM Storage & SDI

Capacity OptimizedCapacity OptimizedCapacity OptimizedCapacity Optimized Performance Performance Performance Performance

OptimizedOptimizedOptimizedOptimized

All FlashAll FlashAll FlashAll Flash

CPU 1x Intel Xeon E5-2620v4

8cores

2x Intel Xeon E5-2620v4

8cores

2x Intel Xeon E5-2620v4 8cores

RAM 64GB RAM DDR4; 128GB RAM DDR4; 128GB RAM DDR4;

Storage 12x3.5” (6TB or 10TB) 24x2.5” SAS 10K 24 x Intel 1200GB SATA SSD

Cache(R/W) 1xIntel® P3700/P4800

400GB NVMe

2x Intel P3700/P4800

400GB NVMe

3 x Intel® P4800X 375GB NVMe

HBA Broadcom SAS 3008 IT-mode (HBA)

NIC Intel® X520 2x10GbE NIC SFP+ Intel® X520 2x10GbE NIC SFP+ 2 x Mellanox ConnectX-4 25/100GbE

All Configurations require 2 switches: 1 for client connections, 1 for intra-cluster communication

Spectrum NAS can run on any x86 storage rich server but the Items in purple must be the same family model/vendor as listed above

(See following page)

Recommended Node Configurations

IBM Storage & SDI

NVMe

1. Prefer two smaller cards over one big card

2. “Enterprise" grade NMVe (not "desktop" grade)

3. Endurance (DWPD) - 5 or above (close to 10 preferred)

(Good experience w/ Intel Optane)

HBA

1. As long as it is based on LSI based

2. All disk drives are classified as 6 Gb or better

NIC

1. Any Mellanox card is fine

2. 10 Gb or better

3. Support IGMP multicast

(There have been reported performance issues with Intel 710 Gigabit Ethernet cards)

Hardware Compatibility for Spectrum NAS

28

IBM Storage & SDI

IBM Spectrum NAS Features

Christopher Vollmar

IBM Storage & SDIManagement Tools

30

• GUI• Out of band

• Windows installable

• Services available• Real-time performance

• Configuration

• Health

• Logging

• Alerts

• REST API• Supports administration of file shares,

users, groups, ACLs, policies and manual snapshots

• Any node in the cluster is capable of responding to API requests

IBM Storage & SDIFile Share Properties

Properties

• NFS

• SMB

• Capacity

• Encryption Status

• Ability to update Properties ‘on the fly’

IBM Storage & SDI

Core Folder Characteristics are retained under ‘Properties’

• SnapShots

• Folder Coding

• Capacity

• Number of Files

• Tier

Folder Properties

IBM Storage & SDI

• File policy is an optional feature to automatically apply actions to selected files in a folder

• Policy filters include• File type, age

• Policies apply to: • Erasure encoding level, media tier, data encryption, retention and

WORM

• New files created will inherit established policies

• Previously created files will have policies applied by a background, low priority task

File Policies

IBM Storage & SDI

Data Durability in ‘2 Dimensions’• Leverage File Coding to create policies in the same

folder and apply at the

• File Folder level

• File Policy Level

• Create a file share with a File Coding based on initial Data Durability requirements – eg 3 Copies

• Add a policy based on ‘Data Durability’ of file types placed in the file share

File Policies and Erasure Coding

IBM Storage & SDI

Ability to have different performance tiers in same cluster

• Nodes with similar media capabilities are grouped into the same tier

• Five tiers available

File policies are defined for files at the Folder level

• Tiers based on attributes filename and age

Tiering

IBM Storage & SDI

Ability to create snapshots at the file level, within a folder

• Automatically scheduled snapshots• Can be configured so that one is made hourly, daily, weekly or manually

• Up to 253 snapshots for each folder

• Target snapshots are copies that have read-only access

• Leverage copy-on-write capability

• After a file share has been configured, it can be accessed from Windows or Linux using SMB and NFS

Snapshots

IBM Storage & SDI

Capacity limit that restricts the use of storage

• Space set at the file system, folder or sub-folder

• Limit is specified in number of GB, TB or PB and will then

apply for all users with access to the folder

Quota Management

IBM Storage & SDI

Data at rest encryption• AES 256 bit XTS

• File system, folder, file level

• One key for each file system

• Internal key management

Encryption

IBM Storage & SDI

Retention period can be set • To retain files for a specific time period

based on either;

• Accessed time frame

• Modified time frame

• Can be used to remove file types or patterns to enable file screening

eg – Remove file types 1 day after being

saved

Retention

IBM Storage & SDI

Files can be set read-only

• Users cannot edit or delete WORM protected files

• Administrator can delete WORM protected data

Spectrum NAS – WORM

IBM Storage & SDI

Metro Cluster (Synchronous Replication ) High-availability cluster for mission-critical data and applications

Writes written synchronously to two clusters

Established while Adding Nodes to ClusterBoth sides should be same size

Promoting a site to primary can be done from the GUI.

Replication – Metro Cluster

IBM Storage & SDI

Hybrid Cloud (Asynchronous Replication)

• Snapshot based

• Continually replicate differential snapshots

Provides a unified view of the file system between the

local network and the second cluster

• Permits a common view of the file system that spans both clusters

Replication – Hybrid Cloud

IBM Cloud available as a target site

Leverage IBM Cloud Bare Metal servers** as an alternate to customer premise or MSP

IBM Storage & SDI

• Allows multiple, separate domains and file systems spanning over one single storage cluster

• Each domain and file system are separated, using their own IP addresses for access, authentication mechanisms and set of protocols

• Provides CPU, infrastructure and storage capacity to be utilized for all the domains combined

Spectrum NAS - Multitenancy

IBM Storage & SDI

IBM Spectrum NAS Demonstration

Norman Bogard

IBM Storage & SDI

1. Simplicity of deployment and administration� Node installation (https://www.youtube.com/watch?v=K0DVB0JTEQ8)

� File System Creation & NFS, SMB shares

(https://www.youtube.com/watch?v=Xl1y-zwtWS4&t=86s)

2. Enterprise NAS Features � File Policies – Quota, Snapshots, Erasure Coding, Tiering

3. Scale out file storage that grows with you � Node addition

� Rolling Upgrades

Spectrum NAS Demonstration

45

IBM Storage & SDI

GUI

Out of band

Windows installable

Services availableReal-time performance

Configuration

Health

Logging

Alerts

REST APISupports administration of file shares, users, groups, ACLs, policies and manual snapshots

Any node in the cluster is capable of responding to API requests

Spectrum NAS – Features through the GUI

IBM Storage & SDI

Install Spectrum NAS software on Linux node

Install NAS management on Windows machine, import license

Discover un-configured nodes over management network

Configure nodes into a cluster using NAS management software

Spectrum NAS – Node Installation

47

IBM Storage & SDI

Wizard for file system creation

Configure hostname & public IP

Configure SMB & NFS protocols

Spectrum NAS – File System Creation

48

IBM Storage & SDI

Select un-configured nodes to add into a cluster

Wizard will walk user through the configuration for node addition

Spectrum NAS – Node Addition

49

IBM Storage & SDI

Spectrum NAS supports rolling upgrades of software on the nodes in the cluster without downtime

The update is performed in sequence, one node at a time to maintain resiliency level

Spectrum NAS – Rolling Upgrades

50

IBM Storage & SDI

File and Object Solutions

Design Studio Tool

Ash Mate

IBM Storage & SDIFile and Object Solutions Design Studio� Interactive tool for you and your IBM and Business Partner for sizing

� Unified questions to help determine what IBM solution fits best

� One common tool for IBM Spectrum NAS, Spectrum Scale/Elastic Storage Server, and

IBM Cloud Object Storage

� IBM Design Thinking approach to working with you, our clients

� Available now for IBMers, available end of April with IBM Business Partners

� Link: https://ibm.biz/FOSDesignStudio

IBM Storage & SDIFOS Design Studio Workflow

53

IBM Storage & SDI

Dashboard: Answer a few questions, responses used by the tool to automatically select product and solution template

Template: View all details pre-populated, answer more questions about

requirements, contacts, sites. Select options in order to complete template

Design: Solution design is shown based on the inputs, including cautions and items need to be addressed

Report: Generate a report summarizing requirements, solution design, any considerations, warnings or errors

FOS Design Studio Workflow

54

IBM Storage & SDI

• Spectrum NAS Demo videos on YouTube:• https://www.youtube.com/playlist?list=PLS7mekU2kxDpHZFHWXDEcrzD6RuubzhdO

• Data sheet: • https://www-01.ibm.com/common/ssi/cgi-bin/ssialias?htmlfid=51012651USEN&

• Product Documentation:• https://www.ibm.com/support/knowledgecenter/en/SSKLNK_1.7.0/spectrumnas170_welco

me.html

• Analyst white paper: • https://www-01.ibm.com/common/ssi/cgi-bin/ssialias?htmlfid=69013169USEN

Additional Resources

IBM Storage & SDI

Conclusion: Next Steps

John Sing

IBM Storage & SDI

• Get more information on Spectrum NAS• IBM Spectrum NAS YouTube:

� https://www.youtube.com/watch?v=oA55y2Mv7c0&list=PLS7mekU2kxDpHZFHWXDEcrzD6RuubzhdO

• IBM Spectrum NAS Knowledge Center: � https://www.ibm.com/support/knowledgecenter/en/SSKLNK_1.7.0/spectrumnas170_welcome.html

• Contact your IBM Account Exec / Business Partner for more information and to arrange a demonstration

• IBM Client Demo Center: http://ibm.biz/ClientDemoCenter

• Sign up for a free 60-day Spectrum NAS software trial• https://www.ibm.com/us-en/marketplace/spectrum-nas

• Sign up for future IBM Washington Systems Center webinars:• Accelerate with IBM Storage blog on IBM Developerworks:

https://www.ibm.com/developerworks/mydeveloperworks/blogs/accelerate/?lang=en

Next Steps

57

Questions about this webinar? Interested in follow-up?

Send email to:

Dennis [email protected]

IBM Washington Systems Center

Special Thanks

Christopher Maestas, Global Solution Architect, Software Defined and Flash Solutions

Ash Mate, Sr. Solutions Architect, Spectrum Storage

Norman Bogard, Sr. IT Specialist, Spectrum Storage

Christopher Vollmar, Storage Client Technical Architect - IBM Certified Consulting

Franck Malterre, Certified Specialist, Software Defined Infrastructure

Dennis Robertson, Accelerate with IBM Storage Lead

ibm.com/storage

Thank You.

IBM Storage & SDI

ibm spectrum nas overview · scale out nfs and smb scale out data store scale out file system scale...

Documents