emc isilon technical deep dive workshop

37
1 © Copyright 2015 EMC Corporation. All rights reserved. EMC ISILON SCALE-OUT NAS EMC Emerging Technologies Division © Copyright 2015 EMC Corporation. All rights reserved.

Upload: solarisyougood

Post on 15-Apr-2017

887 views

Category:

Technology


3 download

TRANSCRIPT

Page 1: Emc isilon technical deep dive workshop

1© Copyright 2015 EMC Corporation. All rights reserved.

EMC ISILON SCALE-OUT NAS

EMC Emerging Technologies Division

© Copyright 2015 EMC Corporation. All rights reserved.

Page 2: Emc isilon technical deep dive workshop

2© Copyright 2015 EMC Corporation. All rights reserved.

Student Guide & Workshop & Internal Training & Confidential Update Dailyhttps://goo.gl/VVmVZ0cp-hadoop-isilon http://ouo.io/cLlAV

isd620-isilon_as_tsm_backup_target_-_radtke http://ouo.io/H9mJ1k

isd518-archive_solutions_with_emc_isilon_01oct2013 http://ouo.io/BDbu1e

isd590-archive-solutions-isilon-sourceone http://ouo.io/BLnvD

isd762-emc-2015-media-and-entertainment-sales-deck http://ouo.io/5ysV6S

EMC Isilon Overview http://ouo.io/pTmyri

Isilon Scale-Out Storage for Big Data http://ouo.io/iebI3P

Presentation - iSilon Transform Your Business http://ouo.io/DXrvg9Presentation - EMC Isilon Big Data Storage and Hadoop Analytics http://ouo.io/TQnQJ3

Page 3: Emc isilon technical deep dive workshop

3© Copyright 2015 EMC Corporation. All rights reserved.

Agenda

Isilon Hardware and Software Overview

EMC Isilon Market Leadership

Key Trends with File and Unstructured Data

Summary

Advantages of Isilon Scale-Out NAS

Page 4: Emc isilon technical deep dive workshop

4© Copyright 2015 EMC Corporation. All rights reserved.

EMC Isilon Market LeadershipSetting the standard for scale-out NAS

6,000+CUSTOMERS

SCALE-OUTMARKET LEADER

Page 5: Emc isilon technical deep dive workshop

5© Copyright 2015 EMC Corporation. All rights reserved.

Unstructured Data Growth

Source: IDC 5

2015

71 EBTotal Capacity Shipped, Worldwide % of Unstructured Data

75%78%

80%

2016

106 EB2017

133 EB

Page 6: Emc isilon technical deep dive workshop

6© Copyright 2015 EMC Corporation. All rights reserved.

NAS

SAN CLOUD

TAPE

DAS

OBJECT

6

NEXT-GEN WORKLOADSTRADITIONAL WORKLOADS

HPC

Backup/Archive

Analytics

Mobile

File Shares

Cloud Apps

Page 7: Emc isilon technical deep dive workshop

7© Copyright 2015 EMC Corporation. All rights reserved.

TAPE

NAS DAS

CLOUDSAN

OBJECT

Isilon Data LakeFoundation

7

NEXT-GEN WORKLOADSTRADITIONAL WORKLOADS

HPC

Backup/Archive

Analytics

Mobile

File Shares

Cloud Apps

Page 8: Emc isilon technical deep dive workshop

8© Copyright 2015 EMC Corporation. All rights reserved.

Next-Gen Access Methods

FILE

FILE

8

HPC

Backup/Archive

Analytics

Mobile

File Shares

Cloud Apps

Page 9: Emc isilon technical deep dive workshop

9© Copyright 2015 EMC Corporation. All rights reserved.

Enterprise-Grade Features

DATA PROTECTION

DATA SECURITY PERFORMANCE MANAGEMENT

9

Isilon Data LakeFoundation

DATA MANAGEMENT

Page 10: Emc isilon technical deep dive workshop

10© Copyright 2015 EMC Corporation. All rights reserved.

Isilon Data Lake Foundation AdvantagesEliminate inefficient islands of storage

Simplify management and reduce costs

Enable better information sharing

Increase data protection and security

Accelerate data analytics to gain new insight

Support data-driven decision making

1

2

3

4

5

6

Page 11: Emc isilon technical deep dive workshop

11© Copyright 2015 EMC Corporation. All rights reserved.

EMC Isilon Scale-Out NAS ArchitectureClients and Applications

RESTful APIGET PUT POST DELETE

Gig-e10 Gig-eNetwork

OneFS Operating EnvironmentMulti-Protocol Client/Application

Layer Ethernet Layer

Protocols

SMBNFS

FTPHTTP

HDFSfor

Hadoop

RESTfor

Object

Intra-cluster Communication

Page 12: Emc isilon technical deep dive workshop

12© Copyright 2015 EMC Corporation. All rights reserved.

Isilon OneFS Operating System

Single Volume/ File System

UnmatchedEfficiency

Simplicity &Ease of Use

LinearScalability

EasyGrowth

HighPerformance

12

Page 13: Emc isilon technical deep dive workshop

13© Copyright 2015 EMC Corporation. All rights reserved.

Comprehensive Enterprise SoftwareDATA PROTECTION

SmartPoolsPolicy-based Automated Tiering

SmartDedupeData Deduplication to reduce storage requirements and costs without impacting performance

SmartQuotas Quota Management And Thin Provisioning

InsightIQPerformance Monitoring And Reporting To Manage Storage Resources

SnapshotIQFast, Efficient Data Backup And Recovery

SyncIQ Fast And Flexible Asynchronous Replication For Disaster Recovery Protection

SmartConnect Policy-based Client Failover With Load Balancing

SmartLockPolicy-based WORM Data Protection

DATA MANAGEMENT

Page 14: Emc isilon technical deep dive workshop

14© Copyright 2015 EMC Corporation. All rights reserved.

EMC Isilon Scale-out NAS Product Family

Linear Scaling Of Performance And Capacity

High Transactional Platform

High Throughput Platform

Nearline Storage Platform

S-Series

X-Series

Capacity

Perfo

rman

ce

NL-Series

High DensityPlatform

HD-Series

Page 15: Emc isilon technical deep dive workshop

15© Copyright 2015 EMC Corporation. All rights reserved.

PLATFORM FEATURES2x Increase IOPS/node

3.75 Million IOPS/cluster

Intel Ivy Bridge six-core processors

KEY BENEFITS

50% lower $/IOP & TCO• Flexible configuration and deployment• Ideal for large-scale transactional file workloads

Isilon S210 High Transactional Platform

Page 16: Emc isilon technical deep dive workshop

16© Copyright 2015 EMC Corporation. All rights reserved.

PLATFORM FEATURES4U chassis with density of 32 TB to 144 TB per nodeCombines HDD and SSD Flash

200 GBPS aggregate throughput per clusterIntel Ivy Bridge eight-core processors

KEY BENEFITS

33% lower $/MBPS & TCO• Ideal balance of high capacity & performance• Versatility for wide range of use cases including

analytics, content streaming and home directories

Isilon X410 High Throughput Platform

Page 17: Emc isilon technical deep dive workshop

17© Copyright 2015 EMC Corporation. All rights reserved.

PLATFORM FEATURES4U chassis with 35 to 36 HDDs including new 6 TB HDD option

Density: 36 TB to 210 TB/node Data at Rest Encryption option

KEY BENEFITS• Highly efficient unstructured data storage that scales

from 100 TB to 30 PB in a single cluster• Reduce data center costs – power, cooling and floor

space with new 6 TB HDD option• Ideal for nearline storage, archiving and DR

Isilon NL400 Nearline Storage Platform

Page 18: Emc isilon technical deep dive workshop

18© Copyright 2015 EMC Corporation. All rights reserved.

PLATFORM FEATURES

2.5X Increase in cluster capacity to 50 PB354 TB per node and 3.2 PB per rack

Pre-Racked Configuration Options

KEY BENEFITSMassive scalability for unstructured data consolidation and storage

50% lower operational expensesIdeal for deep archiving, DR & Data Lake Foundation

NEW HD400 High Density Platform

Page 19: Emc isilon technical deep dive workshop

19© Copyright 2015 EMC Corporation. All rights reserved.

Up to 37 TB

Up to 20 PB

Up to 1 PB

Hard Drive

SmartFlash

DRAM Node 1 Node 2 Node 3 Node 4

Isilon SmartFlashFirst and Only Globally Coherent Scale-Out Flash-as-Cache

Up to 37 TB

PLATFORM FEATURES• Globally coherent flash cache• Scale to 1PB flash cache in a single cluster• Simple, self-optimizing performance & flash utilization

KEY BENEFITS30X more flash cache — up to 1PB vs. 37TB DRAM• 1/5th of cost per GB compared to DRAM• Ideal for high performance computing (HPC)

applications such as rendering, CAD and software design

Page 20: Emc isilon technical deep dive workshop

20© Copyright 2015 EMC Corporation. All rights reserved.

Isilon scales from 16TB to 50PBin a single file system, single volume cluster Under 60 seconds to

scale with no downtime

Massively Scalable More scalable than traditional storage systems

Page 21: Emc isilon technical deep dive workshop

21© Copyright 2015 EMC Corporation. All rights reserved.

Isilon Simplicity and Ease of UseSingle volume and file system Directories and files striped across

cluster nodes

Automation NO manual intervention NO reconfiguration NO server or client mount point or

application changes NO data migrations NO RAID

SING

LE V

OLUM

E

Page 22: Emc isilon technical deep dive workshop

22© Copyright 2015 EMC Corporation. All rights reserved.

Gain New Levels of Efficiency Isilon AutoBalance

• AutoBalance automatically moves content to new storage nodes

• Eliminates “hot spots”• Enables unmatched storage capacity

utilization of more than 80%EMPTY

EMPTY

EMPTY

EMPTY

EMPTY

FULL

FULL

FULL

FULL

BALANCED

BALANCED

BALANCED

BALANCED

BALANCED AUTOBALANCEAutomated data balancing across nodes reduces costs, complexity, and risks for scaling storage

Page 23: Emc isilon technical deep dive workshop

23© Copyright 2015 EMC Corporation. All rights reserved.

Optimize with Automated Tiering

Single point of management• Single file system/single volume• Multiple performance tiers

Automatic data movement• Policy-based tiering management• Transparent reallocation• NO application changes

Optimize storage resources • Automatically match storage resources

with data requirements • Eliminate data migration

Isilon SmartPools

S-SeriesPerformance

HD-SeriesHigh Density

X-SeriesThroughput

Reduced Costs

NL-SeriesNearline

Perf

orm

ance

Capacity

Page 24: Emc isilon technical deep dive workshop

24© Copyright 2015 EMC Corporation. All rights reserved.

Unmatched Data Protection and AvailabilityHighly resilient, clustered architecture

100%

100%

100%

100%

100%

100%

100%

100%

FAILED

FAILED

With N+2, N+3, and N+4 protection, data is 100% available

if multiple drives or nodes fail

With N+1 protection,data is 100% available even if a single drive or node fails

And with Isilon, the more nodes in the cluster, the faster drive rebuild time

Page 25: Emc isilon technical deep dive workshop

25© Copyright 2015 EMC Corporation. All rights reserved.

Enterprise Data Protection OptionsFast, easy backup and disaster recovery

WAN/LAN

Isilon NL-Series Cluster

Isilon S-Series and X-Series Cluster Disk-to-disk backup

Remote archive and DR

Efficient snapshots with SnapshotIQ

Data replication with SyncIQ

Push-button simple failover/failback

Page 26: Emc isilon technical deep dive workshop

26© Copyright 2015 EMC Corporation. All rights reserved.

Isilon Security and Compliance Options

LEGAL

IT

ACCOUNTING

MARKETING

Roles-based access control (RBAC)

Access Zones for secure isolation

WORM Data Protection

File System Auditing

Data at Rest Encryption (DARE) with Self-Encrypting Drives (SEDs)

Page 27: Emc isilon technical deep dive workshop

27© Copyright 2015 EMC Corporation. All rights reserved.

The Isilon Advantage for Hadoop

In-place analytics • Native integration speeds time to insight

Enterprise data protection• Fast snapshots, backup, and data recovery• Simple, efficient data replication for disaster recovery

Lower costs• Eliminates the need for dedicated Hadoop infrastructure • Much more efficient than DAS-based approach

Increase flexibility• Simultaneous support for any Apache-compliant Hadoop distribution• Ambari integration for management, monitoring, and provisioning

Scale-out storage with native Hadoop integration

Page 28: Emc isilon technical deep dive workshop

28© Copyright 2015 EMC Corporation. All rights reserved.

PLATFORM FEATURESIndustry standard object storage capabilityPetabyte scaleVersatile Data Lake Foundation for unstructured data and object storage

KEY BENEFITSSimultaneous File, Object and Hadoop accessRun next-generation Swift-based apps unchangedReduce risk on proven platform

NEW OpenStack Swift for Object Storage

Page 29: Emc isilon technical deep dive workshop

29© Copyright 2015 EMC Corporation. All rights reserved.

Isilon Scale-Out NASSimple to manage Single file system, single volume, global namespace

Massively scalable Scales from 16 TB to over 50 PB in a single cluster

Unmatched efficiencyOver 80% storage utilization, automated tiering and SmartDedupe

Enterprise data protectionEfficient backup and disaster recovery, and N+1 thru N+4 redundancy

Robust security and compliance options• RBAC, Access Zones, WORM data security, File System Auditing• Data At Rest Encryption with SEDs

Operational flexibility• Multi-protocol support including NFS, SMB, HTTP, FTP and HDFS• Syncplicity support for mobile computing• Object and Cloud computing including OpenStack Swift

Page 30: Emc isilon technical deep dive workshop
Page 31: Emc isilon technical deep dive workshop

APPENDIXPlease use select additional slides from

Appendix as appropriate to customize the main deck

Please delete this slide and any unused Appendix slides prior to presentation

Page 32: Emc isilon technical deep dive workshop

32© Copyright 2015 EMC Corporation. All rights reserved.

Isilon in Financial ServicesConsolidate Scale-Out Home Directories, File Shares and Next Gen Workflows

Mobility Cloud

Big Data

ANALYTICS

SECURE SYNC-n-SHARE SOCIAL MEDIA

Page 33: Emc isilon technical deep dive workshop

33© Copyright 2015 EMC Corporation. All rights reserved.

Isilon in HealthcarePartners Certifications Shared Workloads

Mobility Future DiagnosticsClinical NGS & Digital Pathology

Analytics

Page 34: Emc isilon technical deep dive workshop

34© Copyright 2015 EMC Corporation. All rights reserved.

Isilon in Life ScienceHome Directories & Active Archives

Mobility Cloud

Analytics

Page 35: Emc isilon technical deep dive workshop

35© Copyright 2015 EMC Corporation. All rights reserved.

Isilon in Media & EntertainmentM&E Alliance Partners Industries & Workflows

Mobility Cloud

Analytics

Page 36: Emc isilon technical deep dive workshop

36© Copyright 2015 EMC Corporation. All rights reserved.

Isilon in Oil & GasScale-Out Seismic™

Petrel Snapshot Plug-in Brazil Research & Development Center

Validated

Keeping track of each version for every project with a “save as”

Focus: Upstream Interpretation & Modeling

Shared

Downstream

Upstream

Seismic Processing

Interpretation & Modeling

Reservoir Simulation Automating Seismic Data Management

TechnologyPark

$100M Investment

50 Big Data Scientists

Faster Time to Discovery

Page 37: Emc isilon technical deep dive workshop

37© Copyright 2015 EMC Corporation. All rights reserved.

Isilon in Video SurveillancePartners Certifications Simplifying Storage Management

ISILON = SINGLE VOLUME UP TO 50 PB

Customer Segments Leveraging Isilon for Video Surveillance

Proven Solution

Analytics

Configuration Guidelines, Best Practices Performance Profiles

Interoperability & Testing Lab