nato ist symposium 2013

83
Patrick Chanezon Director Enterprise Evangelism Microsoft [email protected] @chanezon NATO IST Symposium, May 2013 Cloud is such stuff as dreams are made on Sunday, May 12, 13

Upload: patrick-chanezon

Post on 01-Sep-2014

2.413 views

Category:

Technology


0 download

DESCRIPTION

Overview of the Cloud stack: infrastructure, platforms, software, development

TRANSCRIPT

Page 1: NATO IST Symposium 2013

Patrick ChanezonDirector Enterprise [email protected]@chanezon NATO IST Symposium, May 2013

Cloud is such stuff as dreams are made on

Sunday, May 12, 13

Page 2: NATO IST Symposium 2013

French

Polyglot

Server Side

San Francisco

Developer Relations

@chanezon

Sunday, May 12, 13

Page 3: NATO IST Symposium 2013

P@ & Military Software

Sunday, May 12, 13

Page 4: NATO IST Symposium 2013

Dreams Of my childhood

4

Sunday, May 12, 13

Page 5: NATO IST Symposium 2013

Accelerando / Singularity, in a Galaxy far far away

§ Even if we automate ourselves out of a job every 10 years

§ ...I don’t think the singularity is near!

5

Sunday, May 12, 13

Page 6: NATO IST Symposium 2013

Moore's Law is for Hardware Only

§ Does not apply to software

§ Productivity gains not keeping up with hardware and bandwidth

§ Writing software is hard, painful, and still very much a craft

6

Sunday, May 12, 13

Page 7: NATO IST Symposium 2013

Moore's Law’s free lunch is over

§ Herb Sutter, Welcome to the Junglehttp://herbsutter.com/welcome-to-the-jungle/

7

Sunday, May 12, 13

Page 8: NATO IST Symposium 2013

Predictions

“The future is already here — it's just not very evenly distributed” William Gibson

8

Sunday, May 12, 13

Page 9: NATO IST Symposium 2013

Architecture Changes: 60’s Mainframe

Sunday, May 12, 13

Page 10: NATO IST Symposium 2013

Architecture Changes: 80’s Client-Server

Sunday, May 12, 13

Page 11: NATO IST Symposium 2013

Architecture Changes: 90’s Web

Sunday, May 12, 13

Page 12: NATO IST Symposium 2013

Architecture Changes: 2010’s Cloud, HTML5, Mobile

Sunday, May 12, 13

Page 13: NATO IST Symposium 2013

Back to Client Server: Groovy Baby!

13

Sunday, May 12, 13

Page 14: NATO IST Symposium 2013

What is Cloud Computing?

14

Cloud According to my daughter Eliette

Sunday, May 12, 13

Page 15: NATO IST Symposium 2013

Cloud Stack - Classic Pyramid

15

Platform As A Service

Infrastructure As A Service

SoftwareAs A Service

Sunday, May 12, 13

Page 16: NATO IST Symposium 2013

Cloud Stack - By Number

16

Platform As A Service

InfrastructureAs A Service

SoftwareAs A Service

Sunday, May 12, 13

Page 17: NATO IST Symposium 2013

Cloud Stack - By Value

17

InfrastructureAs A Service

SoftwareAs A Service

Platform As A Service

Sunday, May 12, 13

Page 18: NATO IST Symposium 2013

Cloud Stack - Neutral

18

Platform As A Service

Infrastructure As A Service

SoftwareAs A Service

Sunday, May 12, 13

Page 19: NATO IST Symposium 2013

Crossing the Chasm

§ Build the whole product

§ Cloud getting mainstream: Apple iCloud

§ Opportunities and risks

§ Ecosystems, various platforms

19

Picture from Wikimedia Foundation http://en.wikipedia.org/wiki/File:Technology-Adoption-Lifecycle.png

Sunday, May 12, 13

Page 20: NATO IST Symposium 2013

Cloud Stack - History

§ What does cloud mean, 4 main angles• Software 1994 Netscape

• Infrastructure 2002 Amazon AWS

• Platform 2008 Google

• Development now!

20

§ Industrialization of hardware and software infrastructurelike electricity beginning of 20th century

§ But software development itself is moving towards craftmanship

Sunday, May 12, 13

Page 21: NATO IST Symposium 2013

Cloud started at Consumer websites solving their needs

• Google, Amazon, Yahoo, Facebook, Twitter

• Large Data Sets

• Storage Capacity growing faster than Moore’s Law

• Fast Networks

• Horizontal -> Vertical scalability

• Open Source Software

• Virtualization

• Cloud is a productization of these infrastructures

• Public Clouds Services: Google, Amazon

• Open Source Software: Hadoop, Eucalyptus, Ubuntu, Cloud Foundry

Sunday, May 12, 13

Page 22: NATO IST Symposium 2013

Google research papers: good predictor of where BigData is going

• Horizontal scalability 2004: Map/Reduce (Hadoop)

• NoSQL 2006: Bigtable (Mongo, Cassandra, HBase, Riak)

• Real Time analytics 2010: Dremel, BigQuery (Impala)

• Horizontally Scalable SQL 2012: Spanner/ Amazon Redshift

Sunday, May 12, 13

Page 23: NATO IST Symposium 2013

23

Infrastructure

Sunday, May 12, 13

Page 24: NATO IST Symposium 2013

IaaS/Virtualization getting mainstream

§ AWS, Azure, Google, Joyent, Rackspace,...

§ Open Source projects: OpenStack,CloudStack, Eucalyptus

§ Automation: Chef, Juju

§ Standardization?

§ Inside the Firewall, Virtualization: VMware, Microsoft HyperV, Xen, KVM

§ 50% of workloads are virtualized

§ Easy to provision, manage instance...BUT

§ Still need to manage backups, software stacks, monitor, upgrades

§ Devops: cultural movement, dev and ops working hand in hand, sharing tools and processes

24

Sunday, May 12, 13

Page 25: NATO IST Symposium 2013

With Infrastructure, you still need to build your own platform

§ Need to build a distributed platform on top of you infrastructure

§ Story of the AWS meltdown from last summer• http://blog.reddit.com/2011/03/why-reddit-was-down-for-6-of-last-24.html

• http://www.readwriteweb.com/cloud/2010/12/chaos-monkey-how-netflix-uses.php

• http://news.ycombinator.com/item?id=2477296

• http://stu.mp/2011/04/the-cloud-is-not-a-silver-bullet.html

§ Twilio, Smugmug, SimpleGeo survived it because they built their own distributed platform on top of IaaS

§ Enterprise customers want to consider Infrastructure like CDNs• Multi Cloud usage

• Based on Open Source de facto standards, or full standards whenever that happens

25

Sunday, May 12, 13

Page 26: NATO IST Symposium 2013

26

Platforms

Sunday, May 12, 13

Page 27: NATO IST Symposium 2013

Platforms

§ Raise the Unit of currency to be application & services instead of infrastructure

§ Google App Engine, Microsoft Windows Azure, Cloud Foundry, SalesForce Heroku, Stax (Cloudbees), Amazon elastic beanstalk, Red Hat OpenShift, AppFog

§ Single or a few languages, services

§ Start of Multi language Polyglot platforms

§ Enabler for Agile Developers -> Create Business value faster

§ Lack of standards: risk, vendor lock-in

§ Enterprise needs:•Control, customizability

•Private/Hybrid Cloud: Azure/Windows Server, Cloud Foundry Bosh, Red Hat Openshift

•Avoid lock-in27

Sunday, May 12, 13

Page 28: NATO IST Symposium 2013

Agile Development Processes

Sunday, May 12, 13

Page 29: NATO IST Symposium 2013

Agility as a survival skill

§ Consumer software is becoming like fashion•Phone apps, social apps, short lifetime, fast lifecycles

•Ab testing

§ Clay shirky situational apps

§ Kent Beck, Usenix 2011 Talk, “Software G-Forces”change in software process when frequency grows

§ Cloud Platforms enables an Agile culture, driver for innovation•Scalability is built in the platforms

•Can iterate faster

•Focus on design

§ Cloud Platforms lets developers focus on driving business value

29

Sunday, May 12, 13

Page 30: NATO IST Symposium 2013

Cloud Foundry: The Open PaaS

30

Clou

d Pr

ovide

r Int

erfa

ce

Application Service Private Clouds

PublicCloud

MicroCloud

Data Services

Other Services

Msg Services

vFabric Postgres

vFabric RabbitMQTM

• Open Source: Apache 2 Licensed

• multi language/frameworks

• multi services

• multi cloud

Sunday, May 12, 13

Page 31: NATO IST Symposium 2013

Windows Azure

flexible open solid

Sunday, May 12, 13

Page 32: NATO IST Symposium 2013

Sunday, May 12, 13

Page 33: NATO IST Symposium 2013

Global Footprin

Sunday, May 12, 13

Page 34: NATO IST Symposium 2013

Sunday, May 12, 13

Page 35: NATO IST Symposium 2013

ß Windows Server and Linux

Sunday, May 12, 13

Page 36: NATO IST Symposium 2013

ß Windows Server and Linux

ß Flexible Workload Support

Sunday, May 12, 13

Page 37: NATO IST Symposium 2013

Virtual Machinesß Windows Server and

Linuxß Flexible Workload

Supportß Virtual Private Networking

Sunday, May 12, 13

Page 38: NATO IST Symposium 2013

virtual machine portability

Sunday, May 12, 13

Page 39: NATO IST Symposium 2013

Sunday, May 12, 13

Page 40: NATO IST Symposium 2013

Windows Azure

Your Data Center

Sunday, May 12, 13

Page 41: NATO IST Symposium 2013

Windows Azure

Your Data Center

Sunday, May 12, 13

Page 42: NATO IST Symposium 2013

Windows Azure

Your Data Center

Sunday, May 12, 13

Page 43: NATO IST Symposium 2013

Your Data Center

Windows Azure

Sunday, May 12, 13

Page 44: NATO IST Symposium 2013

Your Data Center

Windows Azure Other Service Providers

Sunday, May 12, 13

Page 45: NATO IST Symposium 2013

Your Data Center

Windows Azure Other Service Providers

Sunday, May 12, 13

Page 46: NATO IST Symposium 2013

Your Data Center

Windows Azure

Sunday, May 12, 13

Page 47: NATO IST Symposium 2013

Your Data Center

Windows Azure Other Service Providers

Sunday, May 12, 13

Page 48: NATO IST Symposium 2013

Your Data Center

Windows Azure Other Service Providers

no lock-inSunday, May 12, 13

Page 49: NATO IST Symposium 2013

Sunday, May 12, 13

Page 50: NATO IST Symposium 2013

ß Build with ASP.NET, Node.js or PHP

Sunday, May 12, 13

Page 51: NATO IST Symposium 2013

ß Build with ASP.NET, Node.js or PHP

ß Deploy in seconds with FTP, Git or TFS

Sunday, May 12, 13

Page 52: NATO IST Symposium 2013

Web Sites ß Build with ASP.NET,

Node.js or PHPß Deploy in seconds with

FTP, Git or TFS ß Start for free, scale up as

your traffic grows

Sunday, May 12, 13

Page 53: NATO IST Symposium 2013

Sunday, May 12, 13

Page 54: NATO IST Symposium 2013

ß Easily build cloud back-ends

Sunday, May 12, 13

Page 55: NATO IST Symposium 2013

ß Easily build cloud back-endsß Data, identity, push

notifications, background jobs

Sunday, May 12, 13

Page 56: NATO IST Symposium 2013

Mobile Servicesß Easily build cloud back-endsß Data, identity, push

notifications, background jobsß Windows 8, Windows Phone,

iOS, Android, HTML5

Sunday, May 12, 13

Page 57: NATO IST Symposium 2013

Sunday, May 12, 13

Page 58: NATO IST Symposium 2013

Data ID  Services

Sunday, May 12, 13

Page 59: NATO IST Symposium 2013

Data ID  Services

Sunday, May 12, 13

Page 60: NATO IST Symposium 2013

Data ID  Services

Custom Script(s)<//>

Sunday, May 12, 13

Page 61: NATO IST Symposium 2013

Data ID  Services

Custom Script(s)<//>

Sunday, May 12, 13

Page 62: NATO IST Symposium 2013

Sunday, May 12, 13

Page 63: NATO IST Symposium 2013

ß Build infinitely scalable apps and services

Sunday, May 12, 13

Page 64: NATO IST Symposium 2013

ß Build infinitely scalable apps and services

ß Support rich multi-tier architectures

Sunday, May 12, 13

Page 65: NATO IST Symposium 2013

Cloud Servicesß Build infinitely scalable

apps and servicesß Support rich multi-tier

architecturesß Automated application

management

Sunday, May 12, 13

Page 66: NATO IST Symposium 2013

Multiple Services

storagebig data

caching

CDN

database

identity

media

messaging

networking

trafficcloud

services

Sunday, May 12, 13

Page 67: NATO IST Symposium 2013

Multiple Services

storagebig data

caching

CDN

database

identity

media

messaging

networking

trafficcloud

services

Sunday, May 12, 13

Page 68: NATO IST Symposium 2013

Multiple Languages

à http://www.windowsazure.com/en-us/develop/overview/

Sunday, May 12, 13

Page 69: NATO IST Symposium 2013

open source

à http://github.com/windowsazure

Sunday, May 12, 13

Page 70: NATO IST Symposium 2013

Software: Apps Marketplaces

45

VMware Horizon App Manager

Sunday, May 12, 13

Page 71: NATO IST Symposium 2013

BigData Platforms: Hadoop

§ Apache Hadoop, open source version of Google MapReduce, GFS...

§ Cloudera, many others, space heating up

§ EMC, HortonWorks distros

§ Google Bigquery

§ Be your own bitch, today, Cloudera distro

46

Sunday, May 12, 13

Page 72: NATO IST Symposium 2013

Services

§ Services

§ Apis, apigee, mashery

§ Telephony, Twilio

§ Geo

§ Social

§ Visualization

47

Sunday, May 12, 13

Page 73: NATO IST Symposium 2013

Development

§ Final frontier, happening now

§ Not whole product yet

§ Source: Google code, Github

§ Dev: Cloud9, Exo, Orion

§ Higher level case tools, Wavemaker, Orangescape, Runmyprocess

§ Build: Jenkins, Cloudbees, OpenShift

§ Test: feature of cloud platforms

§ Community Stackoverflow, Github

48

Sunday, May 12, 13

Page 74: NATO IST Symposium 2013

49

Lessons for Developers

Sunday, May 12, 13

Page 75: NATO IST Symposium 2013

Predictions

§ Software is becoming like fashion, design rules

§ Welcome to Babel, use the best tool for the job, embrace multiple language & heterogeneity

§ Our jobs will change, build yourself out of your current job

§ Sysadmin jobs will morph to hybrid cloud admins

§ Many opportunities open when you embrace change

50

Sunday, May 12, 13

Page 76: NATO IST Symposium 2013

Things to Forget

§ First normal form

§ Waterfall model

§ Single server deployment

§ Single language skill

51

Sunday, May 12, 13

Page 77: NATO IST Symposium 2013

Things to Learn

• Agile, API Design

• UI Design, Javacript, HTML5, CSS3

• A/B Testing

• Open Source, Open Standards

• Architecture, Distributed Computing (CAP theorem, 8 fallacies)

• Cloud Platforms and APIs

• Multiple types of languages (imperative, object, functional, logic)

• Learn to live in a box (embrace platform limitations) to think outside the box

52

Sunday, May 12, 13

Page 78: NATO IST Symposium 2013

What it means for you

§ Build On the shoulders of giants

§ Take risks, to innovate

§ Learn everyday, try different things

§ learn an api or framework / month

§ Learn a language / year

§ Be fast and agile

§ Make money

§ Social and app stores

53

Sunday, May 12, 13

Page 79: NATO IST Symposium 2013

Such stuff as dreams are made on

§ Like a kid on a candy store: there's never been a better time to be a software developer!

§ Welcome to the Cloud: embrace change and reinvent yourselves

§ “The future is already there, not evenly distributed” Gibson

§ We Developers, invent the future today

54

Sunday, May 12, 13

Page 80: NATO IST Symposium 2013

Thank You!@WindowsAzure

@chanezon

Website : www.windowsazure.com/

t

t

Sunday, May 12, 13

Page 81: NATO IST Symposium 2013

Books / Articles

§ Nick Carr, The Big Switch

§ Eric Raymond, The Art of Unix Programming

§ Weinberg, Psychology of Computer Programming

§ Wes python book

§ Mark html5 book

§ Kent Beck XP

§ Hunt, Thomas, The Pragmatic Programmer

§ Ade Oshineye, Apprenticeship Patterns

§ Matt Cutt's Ignite Talk IO 2011, Trying different things

§ Josh Bloch talk about api design

§ Larry and Sergey, Anatomy of a Search Engine

§ Rob Pike, The Practice of Programming

56

Sunday, May 12, 13

Page 82: NATO IST Symposium 2013

Papers / Talks

§ Simon Wardley, Oscon 09 “Cloud - Why IT Matters”

§ Tim O’Reilly article on internet os

§ Peter Deutsch’s 8 Fallacies of Distributed Computing

§ Brewer’s CAP Theorem

§ Gregor Hohpe’s Starbucks Does Not Use Two-Phase Commit

§ Herb Sutter, Welcome to the Junglehttp://herbsutter.com/welcome-to-the-jungle/

§ Stuff I tag http://www.delicious.com/chanezon/

§ More specifically http://www.delicious.com/chanezon/cloudfoundry

§ My previous Talks http://www.slideshare.net/chanezon

§ My list of favorite books http://www.chanezon.com/pat/soft_books.html

57

Sunday, May 12, 13

Page 83: NATO IST Symposium 2013

Acknowledgement

§ Drawings from my daughters Eliette

58

Sunday, May 12, 13