the enterprise cloud

90
Mark Masterson | http://jroller.com/MasterMark The Enterprise Cloud

Upload: mark-masterson

Post on 01-Sep-2014

2.658 views

Category:

Technology


3 download

DESCRIPTION

Presentation given on April 21st, 2009 for the first CloudSlam conference (http://cloudslam09.com/)

TRANSCRIPT

Page 1: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

The Enterprise Cloud

Page 2: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Agenda

Page 3: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

What’s an “enterprise”?

Page 4: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Page 5: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Page 6: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

$$$

Page 7: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

What makes an enterprise uncool is also what defines it

Page 8: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

What’s “the Cloud”?

Page 9: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

(The Cloud >= (The Net = all things via Internet protocols >= (The Web

= all things via HTTP)))

Page 10: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

But the emerging consensus seems to be that “cloud” = “a unit of

elastically usable resources accessible over a computer

network”

Page 11: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Cloud computing”, then, is a style of architecture that exploits such a

“cloud”

Page 12: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Making use of the Cloud is an architectural and engineering

challenge.

Page 13: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Architecture is about making design choices. Engineering is about knowing your materials.

Page 14: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

So what are the architectural choices? What are the materials?

Page 15: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://rationalsecurity.typepad.com/blog/2009/01/cloud-computing-taxonomy-ontology-please-review.html

http://cloudcomputing.sys-con.com/node/811519

http://www.collab-ogce.org/gce08/images/7/76/LamiaYouseff.pdf

SADIST-PIMP

SPI (SaaS, Paas, IaaS)

Page 16: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://www.mindmeister.com/maps/show_public/15936058

Page 17: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

But wait! Once that’s sorted, you have to consider contextual

dimensions…

Page 18: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://cloudforum.googlegroups.com/web/Metaverse+Decomposition.pdf

The Radeztsky Cube

Page 19: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://cloudforum.googlegroups.com/web/Metaverse+Decomposition.pdf

Page 20: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

SaaS

PaaS

IaaS

SPI Model

Page 21: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Agenda

Page 22: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://twitter.com/gblnetwkr

Page 23: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://twitter.com/gblnetwkrhttp://en.wikipedia.org/wiki/Consumerization

Page 24: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Four sources of pressure driving change: a perfect storm

Consumerization- Massive scale services- Tech smart consumers

Collaboration- Moving from vertical

integration to horizontal, networked biz model

Computing Anywhere- Rising demand for mobility to support faster response to customers

Corporate IT challenges- OPEX, CAPEX, DC

power, space, business responsiveness

Le Cloud

Page 25: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Agenda

Page 26: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Physical” perimeter

Physical data centre

Outside world

Secure “gateway” (DMZ, firewall, etc.)

Authentication + Authorization (Active Directory, LDAP, etc.)

Page 27: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Physical” perimeter

Data centre cloud (VMware)

Physical data centre

Virtual servers

Outside world

Page 28: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Physical” perimeter

Cloud Provider (EC2)Data centre cloud (VMware)

Physical data centre

Virtual servers

Outside world

Page 29: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Physical” perimeter

“Virtual" perimeter

Cloud Provider (EC2)Data centre cloud (VMware)

Physical data centre

Virtual servers

Encrypted VLAN link

Virtual switch / router / messaging broker

Outside world

Page 30: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

If your needs / budget require or can accommodate it, consider RAIC

Page 31: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Redundant Array of Independent Cloud providers

http://www.jroller.com/MasterMark/entry/raic_pronounce_it_rake_please

Page 32: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Physical” perimeter

“Virtual” perimeter

Cloud Provider (EC2)Data centre cloud (VMware)

Physical data centre

Encrypted VLAN link

Cloud Provider (Flexiscale)

Virtual servers

Outside world

Page 33: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Physical” perimeter

“Virtual” perimeter

Cloud Provider (EC2)Data centre cloud (VMware)

Physical data centre Cloud Provider (SFDC)

Cloud Provider (Mosso)

Outside world

Page 34: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Cloud Provider (Mosso)

Cloud Provider (EC2)

Cloud Provider (Flexiscale)

“Physical” perimeter

“Virtual” perimeter

Data centre cloud (VMware)

Physical data centre

Outside world

Marketplace / Broker / Orchestratror

Page 35: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Note that this is not about, and never will be about, eliminating

the internal data centre

Page 36: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Cloud Provider (Mosso)

Cloud Provider (EC2)

Cloud Provider (Flexiscale)

“Physical” perimeter

“Virtual” perimeter

Data centre cloud (VMware)

Physical data centre

Outside world

Marketplace / Broker / Orchestratror

Page 37: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Agenda

Page 38: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Things to worry about” sub-agenda

Page 39: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Since we worked out, sometime in the early ‘90s, what the

architecture of a “client / server” system design looked like…

Page 40: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

There's been a general consensus about a sort of a canonical

architecture for so-called “N-tier systems”

Page 41: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Presentation

Service Facáde

Application Logic

Data Persistence

Page 42: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

What does the Cloud do to that?

Page 43: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

In a nutshell: efficient horizontal scalability

Page 44: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

And that means parallelism

Page 45: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Parallelism has significant consequences

Page 46: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

It leads one to try to avoid stateful interactions

Page 47: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

To prefer asynchronous communications (messages)…

Page 48: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

One finds oneself on the front lines of the REST War ™ – the battle of

the RESTafarians vs. the established IT Universe

http://www.dehora.net/journal/2008/07/25/patterns-of-web-architecture/http://www.dehora.net/journal/2008/08/15/rest-as-an-engineering-discipline/

http://www.infoq.com/articles/webber-rest-workflow/http://roy.gbiv.com/untangled/2008/rest-apis-must-be-hypertext-driven/http://www.redmonk.com/jgovernor/2009/02/12/the-rest-of-the-cloud/

http://delicious.com/mastermark/rest/

Page 49: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

And it forces one to think strange things about optimal patterns of

storing and accessing data

Page 50: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Like sharding one’s data to meet resource demands

http://highscalability.com/unorthodox-approach-database-design-coming-shard/

Page 51: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Questions like “is two-phase commit a feature? Or a bug?”

begin to seem important

Page 52: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

New terms, like CAP, Paxos and BASE creep into conversations about “eventual consistency”

http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.1495http://en.wikipedia.org/wiki/Paxos_algorithmhttp://queue.acm.org/detail.cfm?id=1394128

http://www.allthingsdistributed.com/2008/12/eventually_consistent.html

Page 53: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

This was happening anyway, driven by the clash of Web architecture with the established IT universe

Page 54: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Cloud computing’s possibilities are accelerating the process

Page 55: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

In particular, we will need to address decomposition of our

systems in two dimensions: app logic, and data

Page 56: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

There is an emerging consensus about what the consequences of

all this are for app logic (and overall system design)

Page 57: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“The canonical cloud architecture that has evolved revolves around

dynamically scalable CPUs consuming asynchronous,

persistently queued events.”

http://highscalability.com/canonical-cloud-architecture

Page 58: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://developer.amazonwebservices.com/connect/entry.jspa?externalID=1632&categoryID=102

Page 59: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

•Use scalable ingredients•Eg. Hadoop on EC2

•Keep ingredients loosely coupled•All communication via persistent messaging

•Assume constant failure•Design things to persist state, restart from last known good, and continue their own tasks even if all around them fail•Consider things like re-tries with exponential back-off•Build IN redundancy

•Learn about things like the POSA Blackboard pattern, tuplespaces, and Map / Reduce

Page 60: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://www.amazon.com/How-Write-Parallel-Programs-Course/dp/026203171X/http://www.lindaspaces.com/book/

Read this book!

Page 61: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

The impact on data design is much harder to articulate

Page 62: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Essentially, we optimize for the worst case, in typical current

system designs

Page 63: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“What’s the most strict, stringent requirement we have to fulfill?”

OK, make the entire system meet it. Store all data in that bucket.

Page 64: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

This is very inefficient

Page 65: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Moving forward, we will have to think about how to slice and dice

our data for more efficiency

Page 66: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

What data is subject to which rules? What impact does that have on what needs to be stored where,

in what fashion?

Page 67: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

The goal will become: store the right data, in the optimal place.

Page 68: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Things to worry about” sub-agenda

Page 69: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

You will likely run into the following problems:

Page 70: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

1) Static, manual processes to provision and manage VMs will probably not scale to demand.

Page 71: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

You will find yourself wanting to archive (versioned) VMs, ensure VMs have specific attributes, and otherwise maintain governance.

Page 72: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

But you will also need a way to maintain the “self-service” factor,

or risk torpedoing a significant part of the value proposition of the

Cloud.

Page 73: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Again, there are tools available and emerging that can address some of

these needs…

Page 74: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

CohesiveFT ElsaticServer, rPath, Vmware, Enomalism, Elastra,

3Tera, many others

Page 75: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

These tools have widely divergent solutions to these problems – choosing one involves many

tradeoffs

Page 76: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

2) Static, manual configuration and management of your network and

security infrastructure will probably not scale with demand.

Page 77: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

There are tools on the market, available now and emerging, to

meet this demand.

Page 78: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

CohesiveFT VPN-Cubed, Cloudswitch, the next version of Cassatt, whatever vCloud and/or

Cisco’s “the InterCloud” turn out to be, etc.

Page 79: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

But wait! You forgot security!

Page 80: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Things to worry about” sub-agenda

Page 81: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Physical” perimeter

“Virtual" perimeter

Cloud Provider (EC2)Data centre cloud (VMware)

Physical data centre

Virtual servers

Encrypted VLAN link

Virtual switch / router / messaging broker

Outside world

Page 82: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

“Things to worry about” sub-agenda

Page 83: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://www.flickr.com/photos/peterpearson/347124844/

Page 84: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://www.flickr.com/photos/paszczak000/2564969200/

Page 85: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://en.wikipedia.org/wiki/Kurt_Gödel

LOL!

Page 86: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://www.flickr.com/photos/rachels_secret/220269351/

Page 87: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Page 88: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

http://www.flickr.com/photos/euthman/2989437967/in/set-72057594114099781/

Page 89: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Get the slides:http://www.slideshare.net/mastermark/

Page 90: The Enterprise Cloud

Mark Masterson | http://jroller.com/MasterMark

Join the conversation:http://groups.google.com/group/cloud-computing/

http://groups.google.com/group/cloudforumhttp://tech.groups.yahoo.com/group/cloudcomputing-tech/

… and please come talk to us, as well …http://twitter.com/mastermark

http://www.jroller.com/MasterMark/

Thanks!