emc vipr and ecs: a lap around software-defined services · hus vm netapp fas emc scaleio emc vnx...

1© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.

EMC ViPR and ECS: A Lap Around Software-Defined Services

EMC Forum 2014

Magnus [email protected]: @swevmBlog: purevirtual.eu


Session Agenda

• Market Dynamics

• EMC ViPR Overview

• What’s New in ViPR Controller

• What’s New in ViPR Data Services

• Additional Resources


HYPERSCALE AND BIG DATA APPLICATIONS10X More Data, Accessible 24x7x365


Mobile Cloud Big Data Social

MOBILE DEVICES

BILLIONSOF USERS

MILLIONSOF APPS

LAN/Internet Client/Server

PC

HUNDREDS OF MILLIONS OF USERS

TENS OF THOUSANDSOF APPS

Source: IDC, 2013

ECS Appliance ECS Appliance


Commodity Hardware

New & Basic Workloads

ECS AppliancesProtect Current Investments

Performance & Mission-Critical Workloads

ViPR: SOFTWARE-DEFINED STORAGE

ViPRServices

Provisioning Self-Service ReportingAutomationViPRController

EMC Non-EMCArray

Support via OpenStack


Simple, Open and Extensible ArchitecturePROVIDES UNMATCHED FLEXIBILITY & CHOICE

Automate Storage Best Practices:Orchestrates repetitive and complex tasks

100% Open & Extensible Using ViPR REST API & Java SDK

Works with EMC & Non-EMC Storage Platforms: Isilon, VMAX, VNX, XtremIO, ScaleIO, HDS, & IBM plus many others

Works with Data Protection Technologies: RecoverPoint, VPLEX, and SRDF

Works with Commodity Platforms

Integrated with Cloud Stacks: VMware, Openstack Swift and Microsoft Hyper-V

ViPRController

ApplicationAdmin

SELF–SERVICE UI

Create a Bock Volume

Snapshot a Volume

Restore from Snapshot

Mount a Volume to Host

Multi-tenant, Multi-Site Self-Service Catalog

HIGH LOWMEDIUM

EMC Non-EMCvia

OpenStack


ViPR Controller Use Cases

Storage Automation Storage-as-a-Service

Multi-tenancy Metering

Self-service access to all

storage

Universal API & Protocol support

< 60 seconds

Storage discovery and

ingestion

5 ClicksAutomated storage

provisioning

63%Average reduction

in provisioning times

VNX IsilonXtrem-IO

3rd PartyVMAX

Commodity Platforms

Simplify


ViPR 2.0 & 2.1 – ENHANCEMENTS

Controller

• Commodity Platform Support

• Geo-Distributed Data Center Support

• Enhanced Native Array Support(XtremIO, Vplex+RP)

• Expanded 3rd Party Array Support via OpenStack

• Data Protection Technology Enhancements

• Federal Compliance


EXPANDED ARRAY SUPPORT

CONTROLLER

ORACLEZFS

NetAppE-Series

Solidfire

IBMXIV

IBMSVC

IBMDS8000

Native Integration

EMC Isilon

EMCVMAX

HitachiVSP

(Block)

HitachiHUS VM

NetAppFAS

EMCScaleIO

EMC VNX

EMCVBLOCK

HP 3PARHP

Left-HandDell

Equal-Logic

XtremIO


Enhanced Data Protection Functionality

• Operational Recovery of VPLEX Virtual Volumes

• SNAPs for VPLEX volumes

• Automate high availability –reduce to 5 clicks

Active Failure Domain Active Failure Domain

San Francisco San Jose

VMAX VMAX

VPLEX Metro

Passive Failure Domain

Las Vegas

VMAX


COMPLIANCE FEATURES FOR SECURE ENVIRONMENTS

• IPv6 and Dual Stack Support

– All communication to ViPR, ViPR to underlying systems and within ViPR

• Security Hardening Scans

• Compliance Certifications

– Common Criteria

– FIPS 140-2 Compliance

– Section 508 Compliant GUI

– Smaller footprint


GEO-DISTRIBUTED DATA CENTER MANAGEMENT

• Single Sign-on across Geo

• Global tenants and projects

• Reporting across ViPR instances

• Scale

Multiple ViPR Controller Deployment

Tenant 1000sVolumes 1,000,000 / ViPRFile systems 400,000 / ViPR#operations/hr 500


NEW DATA MANAGEMENT REQUIREMENTS

Documents (XLS, PPT, DOC)

Relational Databases

Rich Media (PDF, JPG, Video,

Streaming)

Sensor Data (GPS, measurements)

Unstructured Content

(Web Server Logs)

Content Repositories

Host Based Storage

Effortless ScaleUniversal Protocol Support Highly Efficient Geo-Storage

Analytics


ViPR 2.0 & 2.1 – ENHANCEMENTS

Services

• Geo-replication and geo-distribution

• ViPR Block – enabled by ScaleIO• Data services on commodity

hardware• ViPR CAS Support for Centera

workloads


Geo-Replicated Data ProtectionProtection against local and global failures

• Handles local hardware and full data center failures– Disk, Node, Rack, Data Center are failure

domains

• Local hardware failure recovery requires no WAN traffic

• New Hybrid encoding approach enables low storage overhead

Site 1

Site 3

Site 2


Active-Active Read/Write ArchitectureAnywhere access to content

• Single global namespace across data centers

• Strong consistency across data centers

• Optimized for minimal WAN round trips by sensing access patterns across data centers on individual entities

https://accesspoint.yourcompany.com


Data AccessCompatibility with common industry APIs

• Simultaneous access to underlying data through multiple interfaces– Object, HDFS , File (Future)

• HDFS compatible with Cloudera, Hortonworks, Pivotal etc.

• Support for S3, Swift, Atmos and Centera CAS APIs object

• Extensions to APIs– Byte-Range updates, Atomic appends, Rich ACLs etc.

HDFS


Data Services on Commodity Hardware

VIRTUAL ARRAY

CommodityCommodity Commodity

• Running on top commodity white boxes

• End to end commodity H/W bootstrap, setup, rolling upgrades, and configuration management.

…


ComplianceCompliance archiving and long-term retention

• Enabled at object or bucket level

• Time-based retention enforcement

• Immutability and checksum

• Platform lockdown

• Privileged delete

• SEC 17a-4f & HIPAA


Software-Defined Storage – ViPR Block

ViPR BLOCK (enabled by SCALEIO)

ViPR Block delivered by Scale IO

Managed by ViPR controller similar to other ViPR data services

Can create virtual pools of storage with varying performance tiers

Scales from 3 to 1000’s of nodes


Flexible Form Factors


WEB-SCALE

Exabyte+

Self-Service

Elastic

COMPLETE ANY DATA CENTER

Enterprise

ServiceProvider

THE WORLDS FIRST COMMERCIALLY AVAILABLE

COMPLETE WEB-SCALE STORAGE INFRASTRUCTURE FOR YOUR DATA CENTER


ECS Appliance Configurations

Commodity HW (Intel x86, Ethernet, SAS)

Object and HDFS Configurations @ GA

– Small = 360TB

– Medium = 1.4PB

– Large = 2.9PB

Mixed Configurations @ GA

– Small = 360TB (Object, HDFS) & 120TB (Block)

– Medium = 1.4PB (Object, HDFS) and 240TB (Block)

Racks can be clustered to scale to 100’s of PBs


The bigger picture, ITaaS – USE CASEIT-as-a-Service

Multi TenancyMulti Cloud

OrderingData Protection

SecuritySelf-Service Admin

Apps not OPSSpeed & Agility

Scalable

MeteringCost control

External Clouds


Join the ViPR Community…Learn | Try | Develop | Collaborate

Explore how-to videos, helpful guides, and training

Download ViPR FREE with no time limit – for non-production use

Access SDKs, FAQs, forums, technical documentation, sample apps, and more

Ask the experts, talk to peers, share ideas and experiences

www.emc.com/viprcommunity

https://legacyemail.emc.com/owa/redir.aspx?C=-STYAge7REC3Xj6TUoyyuU-iVfkQONFI7TBcvGyjnHu5EFMoajrYQBDGerCY24EMRfR0isGkP-s.&URL=http://www.emc.com/viprcommunity


VIPR Controller Starter Pack

50TB ViPR Controller

3 Year Maintenance

40 Hour Professional Services

All For$10,000*

* Limited time offer! Please talk to your EMC Account Rep today for details!


The bigger picture, ITaaS – USE CASE

Network-as-a-Service

Multi TenancyVLAN

Metering

Security policies

Load BalancerFirewall

PerformanceLAN & WAN

Compute-as-a-Service

EncapsulatedOS Images

StandardizationEncapsulation

Scalability vMotion

DRSVirtual

Network

Universal API & Protocol support & Metering

http://willis.maps.arcgis.com/apps/OnePane/basicviewer/index.html?appid=9cab42f2a53b4eeb8aa7ac1ce4920ac7

http://willis.maps.arcgis.com/apps/OnePane/basicviewer/index.html?appid=9cab42f2a53b4eeb8aa7ac1ce4920ac7