emc ecs 2 technical deep dive workshop

1© Copyright 2015 EMC Corporation. All rights reserved.

ELASTIC CLOUD STORAGE 2.0ASD PRODUCT MANAGEMENT


• Student Guide & Workshop & Internal Training & Confidential Update Daily• https://goo.gl/VVmVZ0


UNSTRUCTURED DATA GROWTH

Total Capacity Shipped, Worldwide Unstructured Data

80%

106 EB 133 EB71 EB2015 2016 2017

75%78%

Source: March 2014, IDC Structured vs. Unstructured Data, The balance of power continues to shift


SCALE-OUT OBJECT MARKET

2014 2015 2016 2017 2018

$-

$0.2

$0.4

$0.6

$0.8

$1.0

$1.2

$0.4 $0.5

$0.7

$0.9

$1.1

Source: IDC Worldwide File and Object Based Storage 2014–2018 Forecast, Oct. 2014

Revenue (in $B)

4© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.

28% CAGR


MODERN APPS ARE DRIVING CHANGEREQUIRE A DIFFERENT ARCHITECTURE/NEW CAPABILITIES

Multi-tenantUniversal Access/Geo-DistributedExtremely Scalable “Cloud-like” Attributes


CHANGE CREATES CHALLENGE

MANAGING DATA GROWTHPrivate Cloud

PublicCloud

HybridCloud

CLOUD STRATEGY

GAIN INSIGHTS FROM DATA


Hyper Scale - Sales Out to Billions of Objects

“Public Cloud-Like” – Secure Access, Anytime, Anywhere

Comprehensive Multi-Tenant Management

Active/Active Geo-Distributed Architecture

Multiple Protocol Support – REST and HDFS Ready

Compelling Economics –Appliance or SW Only (DIY)

ECS HYPERSCALE CLOUD STORAGE


ECS USE CASESCloud

Modern/ AppsGlobal Content

Repository ArchiveAnalytics

Global Namespace

Internet of ThingsSensor data

SITE 1 SITE 2 SITE 3


ECS USE CASES UPDATE

10EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY

GLOBAL CONTENT REPOSITORYON-PREMISE UNSTRUCTURED STORAGE PLATFORM

PROBLEM• Can’t cost-effectively manage or scale storage to

support explosive growth in unstructured content• Traditional storage not suited for new Web, mobile

and cloud applications• Difficult and costly to manage data lifecycle and

retention policies across archive silos and sites

SOLUTIONEMC ECS Appliance (Object and HDFS)

VALUE• Reduce complexity and cost–one globally

accessible, geo-efficient archive that serves multiple applications and content types at lower cost than public cloud

• Anywhere data access – All data globally accessible by Web, mobile and cloud apps

• Enterprise-grade data protection – Efficient geo-protection and policy-based retention for basic compliance and governance

https://accesspoint.yourcompany.com

U.K.L.A.Memphis

Applications Tiering, Archiving, Backup


MODERN APPLICATION PLATFORMEFFICIENT GEO-CAPABLE STORAGE & ANYWHERE ACCESS


U.K.L.A.Memphis

PROBLEM• Traditional storage architecture not optimized for

multi-site, mobile access to content• Writing to multiple file systems and proprietary

APIs complicates development• Can’t access or process large data sets


VALUE• Anywhere access - Provides anywhere access to

geo-replicated content• Simpler, faster development - Supports

multiple industry standard APIs/protocols and anywhere access with strong consistency

• Unmatched access and efficiency - Geo-protection, active-active architecture optimizes both access and storage efficiency for Big Data – large and small files


GEO-SCALE BIG DATA ANALYTICSEFFICIENT GEO-SCALE STORAGE & GLOBAL BIG DATA ANALYTICS


U.K.L.A.New York

ANALYTICS

PROBLEM• Large (and growing) data volumes lead to

exponential storage costs• Traditional Hadoop replication leads to

unmanageable DC footprint with data growth• Always have to move data to the analytics cluster


VALUE• Cost Efficient Storage – ECS is 65% cheaper

than even public cloud • HDFS Archive – ECS brings state of the art

patented technology to provide highly dense storage for Hadoop

• Global Analytics –Bring analytics to geo-distributed data and archives


PROBLEM• Unstructured data growth - Reclaim costly Tier 1 storage • Current solutions aren’t scalable or cost efficient• Instant access to cold-stored data is required • “No Public Cloud” policy - Data needs to be on-premises


VALUECosts less than public cloud - Provides on-premises security

U.K.L.A.Memphis

LAN/

WAN

Video

UnstructuredData

Sensory Data

Images

COLD ARCHIVECOST EFFECTIVE LONG TERM RETENTION


PROBLEM• Need cost effective solution to store hue amounts of

unstructured data generated by IOT and sensors• “No Public Cloud” policy - Data needs to be on-premises• Data collection via modern cloud applications requires

compatibility with APIS’s like S3 and OpenStack• Analytics workflow is slow, expensive and complicated using

Hadoop direct attach or public cloud storage


VALUE• ECS cost per GB is less than public clouds• ECS provides high availability with on-premises security• ECS is compatible with S3, OpenStack, and other popular API’s• ECS is HDFS compatible and enables a streamlined Hadoop

workflow for “data in place” analytics

‘IOT’ CLOUD STORAGE PLATFORM‘INTERNET OF THINGS’ – SENSORY & TELEMETRY DATA COLLECTION


UPCOMING ECS INTEGRATIONS


ISILON CLOUDPOOLSSMART TIERING TO OBJECT STORES

Key Features

Benefits

Stub to Cloud of choice Extending SmartPools workflow to

CloudPools Ability to send encrypted data to the

cloud Compression for efficient transport Simple policy based management

Combine file & object store benefits Use stubs to optimize local storage

space, with offsite archive protection Seamless placement and availability

of data per policy One Accessible namespace

SmartPools -> CloudPools

Clients

SMB | NFS | REST| HDFS | SWIFT

OneFS

Service Provider

PublicCloud

ECS


EMC CLOUDBOOST LONG TERM RETENTION TO THE CLOUD

LAN LAN/WANCloudBoostappliance

DesktopsLaptops

Files NAS/NDMP

VMware &Hyper-V Databases

Email Applications

DB

ROBO

Protected by NetWorker, Avamar, NetBackup

Key Features

Benefits

Long-term retention to ECS for NetWorker, Avamar, NetBackup

Inline variable de-duplication and compression

Data encrypted in-flight and at rest Cloud choice: private/public clouds Appliance cache for ROBO Capacity of up to 6PB logical per

appliance Central management via a cloud

portal

Lower storage cost per TB Efficiency: Reduced network and

storage consumption Lower risk, operational overhead

than tape. Airtight security

18© Copyright 2015 EMC Corporation. All rights reserved.© Copyright 2015 EMC Corporation. All rights reserved.

ECS FREE downloadNew MonitoringDiagnostics

Better Multi-Site Performance/Availability


Quota Management Lock/unlock user/bucket

capabilities Retention Management Replication policy across tenants

and buckets

Operational management efficiency Support for short and long term data

retention

Enterprise FeaturesFEATURES

KEY BENEFITS


Improved failover scheme, Handling of Temporary Outages

Data is now shipped as it is written

Quick recovery from network outages Access to data even in the event of a

temporary outage Improved RPO granularity

Higher AvailabilityFEATURES

KEY BENEFITS


Geo Caching

Better Multi-site Performance Reduced latency

FEATURES

KEY BENEFITS

Better Multi-Site Performance


Improved tenant/bucket views Comprehensive capacity

reporting/graphs Real-time Metering for tenants and

buckets

Increased visibility, determine capacity across various metrics

Effectively monitor usage across your enterprise

Monitoring FEATURES

KEY BENEFITS


New storage and replication metrics Drill down trend charts, usage reports See performance/system health Flexible access GUI or API

Simplified managementComprehensive metering and reporting

Diagnostics FEATURES

KEY BENEFITS


Self Contained /controller-less design Easy, single command install

Improved User Experience Rapid Deployment

Simplified Deployment FEATURES

KEY BENEFITS


FREE ECS SOFTWARE 2.0• Free Unlimited capacity

• Free Unlimited time

• Go from application prototype to production faster

• Container-ized download available on github.com/emcecs/

• Community driven support


ECS ECOSYSTEMEnterprise Information

Archiving

Enterprise Content Management

Analytics

Cloud Gateways

Migration

Sync & Share

CLOUD BOOST


Analytics

Protocols CAS


ECS IN ACTIONAnalytics: Data in Place Analysis RequiredECS created a multi-protocol data lake that is geo-distributed and can accept huge volumes of data from a variety of sources

Analytics - Ability to add dense storage without more computeECS scales compute and storage independently to ensure that the data in the HDFS archive is accessible to analytics applications

Modern Applications: Multi protocol object supportECS delivers multi protocol object support to offer customized tax software services using S3 and Swift

Global Content Repository – Massive Scale RequiredECS is being used to Digitize 40 million pages, and deliver the content to anyone, anywhere on any device

Tensor Company LTD

*NDA Only – Not public references

emc ecs 2 technical deep dive workshop

Technology