netapp industry keynote - flash memory summit - aug2015

24
Keynote 11 Data Center Evolution: Hyperscale vs. Enterprise Architectures Val Bercovici Cloud and Big Data Czar NetApp, Inc. @valb00 2015 Santa Clara, California

Upload: val-bercovici

Post on 13-Jan-2017

2.389 views

Category:

Software


5 download

TRANSCRIPT

Page 1: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Keynote  11Data  Center  Evolution:Hyperscale  vs.  Enterprise  ArchitecturesVal  BercoviciCloud  and  Big  Data  CzarNetApp,  Inc.

@valb00

2015Santa  Clara,  California

Page 2: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Science  (Fiction?)

2 ©  2015  NetApp,  Inc.  All  rights  reserved.  

Exponential  Growth  of  Computing20th  Through  21st  Centuries

URL: http://www.singularity.com/charts/page70.html

Page 3: NetApp Industry Keynote - Flash Memory Summit - Aug2015

3

Analytics

Competitive  advantage463%

Cloud

of  CIOs  indicate  that  cloud  is  one  of  their  Top  5  priorities3

60%

Social

productivity  increase125%

Mobile

of  the  world’s  population  have  a  mobile  device2

75%©  2015  NetApp,  Inc.  All  rights  reserved.

SSOCIAL

MMOBILE

AANALYTICS

CCLOUD

Page 4: NetApp Industry Keynote - Flash Memory Summit - Aug2015

NoSQLNewSQL

OLTP Enterprise Hyperscale Emerging

Application

Data  Model

BlockFile

Key-­Value  Store

Columnar,Document,Graph

Streaming,Resource  Mgmt

at  Scale

Evolving  Application  Architecture  Landscape

4 ©  2015  NetApp,  Inc.  All  rights  reserved.  

Page 5: NetApp Industry Keynote - Flash Memory Summit - Aug2015

©  2015  NetApp,  Inc.  All  rights  reserved.

Product  CatalogDocument  Store

Financial  Transactions

Relational  StoreShopping  CartKV  Session  Store

AnalyticsColumn  Store

Product  ImagesObject  Store

User  SessionsKV  Store

Personalized  Recommendations  Graph  Store

Sample  Polyglot  App

5

Page 6: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Unintended  Consequences

6

Data  Management  Ramifications

Supply  Chain  Trends

SMAC

©  2015  NetApp,  Inc.  All  rights  reserved.  

SSOCIAL

MMOBILE

AANALYTICS

CCLOUD

Page 7: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Economics  Driving  Polarization  of  Storage

7Access  Latency

$$$

SLCeMLC

MLCTLC

SCM

Solid  State95%  R  /  5%  W

Cloud

Archive

HDD1%  R  /  99%  W

DRAM

TAPE

EntDrive

Performance Capacity

©  2015  NetApp,  Inc.  All  rights  reserved.  

Google  Quarterly  Spend $3.5BYearly  Spend $14B

All?Yearly  Spend $50B<

3D

Page 8: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Storage  Intelligence  1.0

Storage  Intelligence  

1.0

T10 T13

“NetApp  selected  Samsung  solid-­state  drives to  bring  enterprise-­grade  performance  and  capacity to  a  customer  base  that  also  expects  the  cost  effectiveness of  V-­NAND  TLC  flash. The  combination  of  NetApp  Clustered  Data  ONTAP  software  value  with  Samsung  hardware  component  expertise  has  helped  the  NetApp  All  Flash  FAS  array  become  the  fastest  growing  product  in  NetApp  history.”

– Lee  Caswell,  VPProduct  and  Solutions  Marketing

NetApp,  Inc.©  2015  NetApp,  Inc.  All  rights  reserved.  8

Page 9: NetApp Industry Keynote - Flash Memory Summit - Aug2015

New  Memory  /  Storage  Tiers

©  2015  NetApp,  Inc.  All  rights  reserved.  9

Page 10: NetApp Industry Keynote - Flash Memory Summit - Aug2015

NVM/Persistent  Memory  Programming  Model  – pmem.io

10

Hardware

Kernel

User

NVM  Driver

Optimized  Applications

Naming  Layer

Open  NVM  Kernel  API

NVM  Management NVM  User-­space  API

NVM  Hardware

Block  Layer

Middleware  (e.g.  JVM)

Raw  Access

File  Access

File  File  or  Raw  Access

Management  Applications  

(GUI,  CLI,  CIM)

File  System

File  Access

NVM  Customer  Kernel  Modules

Control  Path

Data  Path

Standard  Access   NVM  Regions  Exposed  as  Files NVM    API

©  2015  NetApp,  Inc.  All  rights  reserved.  

Page 11: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Management  in  the  SCM  Data  Path:  Latency  Rules

11

NFS/Block/LRSE

AFF  ClusterServer-­side  

Persistence  Store Server

Application

Data  Model

SCM  DriverOperating  System

HypervisorServer-­side  Persistence  Store

Server

Application

Data  Model

SCM  DriverOperating  System

Hypervisor

Server

Application

Data  Model

SCM  DriverOperating  System

Hypervisor

Server

Application

Data  Model

SCM  DriverOperating  System

HypervisorServer-­side  Persistence  Store Server-­side  Persistence  Store

OnCommand.Next

©  2015  NetApp,  Inc.  All  rights  reserved.  

Page 12: NetApp Industry Keynote - Flash Memory Summit - Aug2015

New  Data  Center  Storage  Stack  Circa  2020

12

XaaS

DataNode

DataNode

DataNode

DataNode

DataNode

ComputeNode

ComputeNode

ComputeNode

ComputeNode

ComputeNode

Distributed/Parallel  Processing

Host  CacheSoftware

Memßà Mem RDMA  (iWARP/RoCE) SCM

Independent  Scaling

1  μsec

Shared  Storage  (POSIX  +  Object)

Data  Globally  Managed  by  

Federated/Shared  Storage

Persistence/Intelligent  Caching  Layer

©  2015  NetApp,  Inc.  All  rights  reserved.  

Page 13: NetApp Industry Keynote - Flash Memory Summit - Aug2015

2015Santa  Clara,  California

Waterfall  “Lean  Cloud” (Enterprise  &  Hyperscale)Lifecycle  ComparisonsApp/Container  lifecycle  placement  tomaximize  hybrid  cloud  economics  

Page 14: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Summary:  Cloud  Landscape  Since  1/1/2012

The  BVP   Cloud  IndexBessemer  Venture   PartnersAugust   2015

14

Source:  Gartner,  July  2013Note:  Estimates  per  2013.  Cloud  includes  SaaS,  PaaS and  IaaS.  Overall  IT  includes  worldwide  spend  in  Data  Center  Systems,  Enterprise  Software  and  IT  Services.

Page 15: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Cost  of  Cloud  Price  Index  Specification  Over  Timen  =  Market  Weighted  Average  of  70%  of  Market

Cloud  Price  Index,   451   Research,   July  16,   2015

©  2015  NetApp,  Inc.  All  rights  reserved.  15

Page 16: NetApp Industry Keynote - Flash Memory Summit - Aug2015

LoB  Tech  Spend

2014Enterprise  Technology  Spend  Ratios  

16

IT  Budget

66%

2008

Run

20%Grow

©  2015  NetApp,  Inc.  All  rights  reserved.  

14%Transform

Page 17: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Tech  Spend  à Mapped  to  Project  Lifecycles

Transform14%

Grow20%

Run66%

17 ©  2015  NetApp,  Inc.  All  rights  reserved.  

Page 18: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Application  Lifecycles

Dev/TestLab

Deploy/ScaleNew  Infrastructure

MaintainLegacy  Infrastructure  

18 ©  2015  NetApp,  Inc.  All  rights  reserved.  

Page 19: NetApp Industry Keynote - Flash Memory Summit - Aug2015

19

Amazon  Web  Services  IaaS  (Storage)  Deployments:  Analysis  and  Insight  IDC  #255387April  2015  

Page 20: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Economics  of  a  Hybrid  Cloud  Ecosystem

HyperscaleAWS,  Azure,GCE,  Aliyun

(M)SPVerizon,  T-­Systems,Telstra,  HP,  Rackspace

Hosting/On-­PremiseGoDaddy,  Dreamhost

20

LowerProductionCosts

Burst  forPeak

Workloads

HostStatic

Workloads©  2015  NetApp,  Inc.  All  rights  reserved.  

Page 21: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Scale-­Up Scale-­Out In-­Memory

New  Resource  Managers  and  Control  Points

21 ©  2015  NetApp,  Inc.  All  rights  reserved.  

ConvergedHCI  /  RSA

Redis /  TachyonSpark  /  FlinkSwift  /  Riak

HDFS  /  CEPH

OpenStack  /  Mesos  /  YARN  /  Kubernetes

StoragePersistence

Infrastructure

Management

Page 22: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Architecture  Biases:  Today

22

Hyperscale

(M)SPHosting/On-­Premise

©  2015  NetApp,  Inc.  All  rights  reserved.  

Scale-­Up Scale-­OutScale-­Up

StoragePersistence

Infrastructure

Management

Scale-­Out

Page 23: NetApp Industry Keynote - Flash Memory Summit - Aug2015

Architecture  Biases:  Tomorrow

23

Hyperscale

(M)SPHosting/On-­Premise

©  2015  NetApp,  Inc.  All  rights  reserved.  

In-­Memory

Scale-­Up

Scale-­Out

StoragePersistence

Infrastructure

Management

Scale-­UpScale-­Up

Page 24: NetApp Industry Keynote - Flash Memory Summit - Aug2015

2015Santa  Clara,  California

Thank  You