rethinking cloud computing

8/8/2019 Rethinking Cloud Computing

1/47

http://www.coordguru.com

Woohyun Kim

The creator of open source Coord

(http://www.coordguru.com)

2010-12-02


2/47


3/47


GaiKai


4/47


Cloud Skepticism

AbhishekVerma, Saurabh Nangia


5/47


Buzz or Realistic?

No less influentialthan e-business

(Gartner, 2008)

Cloud computing achieves

a quicker return oninvestment

(Lindsay Armstrong ofsalesforce.com, Dec 2008)

Economic downturn, the

appeal of that costadvantage will be greatly

magnified"

(IDC, 2008)

Revolution, the biggest upheaval since theinvention of the PC in the 1970s [] ITdepartments will have little left to do once the bulk of

business computing shifts [] into the cloud

(Nicholas Carr, 2008)

Not only is it faster and more

flexible, it is cheaper. [] theemergence of cloud models

radically alters the costbenefit decision

(FT Mar 6, 2009)

The economics are compelling, with businessapplications made three to five times cheaper and

consumer applications five to 10 timescheaper

(Merrill Lynch, May, 2008)


6/47


Just Put Them Into The Cloud


7/47


Blind Men and An Eliphant


8/47


Cloud computing is simply a buzzwordused to repackage grid computingand utility computing, both of which

have existed for decades.

whatis.comDefinition of Cloud Computing

8


9/47


What is it? What is it? ... Is it- 'Oh, I am goingto access data on a server on the Internet.'

That is cloud computing?

The interesting thing about cloud computing is

that weve redefined cloud computing to

include everything that we already do.

Larry EllisonDuring Oracles Analyst Day

From http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/ 9
http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/


10/47


.. cloud computing was simply a trap aimed at

forcing more people to buy into locked,proprietary systems that would cost them

more and more over time.

"It's stupidity. It's worse than stupidity: it's a

marketing hype campaign"

Richard StallmanGNU founder

From http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/ 10
http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/http://blogs.wsj.com/biztech/2008/09/25/larry-ellisons-brilliant-anti-cloud-computing-rant/


11/47


Cloud Illusion of Reliability

Amazons cloud outages receive a lot of exposure

July 20, 2008 Failure due to stranded zombies, lasts 5 hours

Feb 15, 2008 Authentication overload leads to two-hour service outage

October 2007 Service failure lasts two days

October 2006 Security breach where users could see other users data

and their current SLAs dont match those of enterprises*

Amazon EC2 99.95% Amazon S3 99.9%

Many enterprise (necessarily or unnecessarily) set their

SLAs uptimes at 99.99% or higher, which cloudproviders have not yet been prepared to match


12/47


Introduction


13/47


What is Cloud Computing?

Definitions of Cloud Computing

More details are on http://jameskaskade.com/?p=594

Wikipedia n/a Cloud computing is Internet- (cloud-) based development and use of computertechnology (computing). In concept, it is a paradigm shift whereby details areabstracted from the users who no longer need knowledge of, expertise in, or controlover the technology infrastructure in the cloud that supports them. It typicallyinvolves the provision of dynamically scalable and often virtualized resources as aservice over the Internet.

Gartner Thomas Bittman Cloud Computing: a style of computing where scalable and elastic IT-enabledcapabilities are delivered as a service to external customers using Internettechnologies.

AMR Research Bruce Richardson,

and esle

Cloud computing is the next-generation of software as a service, in which a

complete software environment is licensed as a subscription from a software vendorand low-cost, secure, and dependable IT hardware infrastructure is rented from autility-computing provider on demand. (omitted)

THINKstrategies Jeff Kaplan A set of web-based tools and services which permit users to acquire computingresources and development capabilities to build or support applications, or performspecific IT functions on a pay-as-you-go basis.

EnterpriseStrategy Group

Mark Bowker,Steve Duplessie

Cloud computing is nothing more than a service model where business workloadsare deployed, transparently executed internally or somewhere on the Internet, andbusinesses only pay for what they consume. (omitted)

IDC Frank Gens Cloud Computing: an emerging IT development, deployment and deliverymodel, enabling real-time delivery of products, services and solutions over theInternet (i.e., enabling cloud services)

The 451 Group Dan Kusnetzky,Rachel Chalmers,and else

Cloud computing describes a service model that combines a general organizingprinciple for IT delivery, infrastructure components, an architectural approach and aneconomic model basically, a confluence of grid computing, virtualization, utilitycomputing, hosting and software as a service (SaaS).

Forrester/JupiterResearch

James Staten A standardized IT capability (services, software, or infrastructure) delivered viaInternet technologies in a pay-per-use, self-service way.


14/47


Squeezing the Definitions

A computing environment to elastically provide virtualized resources as a

service over the Internet in a pay-as-you-go manner

elastically: enable to avoid under-utilization(idle servers) and over-

utilization(blue screen)

virtualized: enable to put whatever end user wants to use into the cloud,and access in anytime, anywhere, any devices

pay-as-you-go: enable a new ecosystem for end user, service provider, and

vendors

What the $#@! is Cloud Computing


15/47


Computing Evolution

Mainframe

Nearly all mainframes had the ability to run multiple operating systems, andthereby operate not as a single computer but as a number of virtualmachines

Grid

The wave of Grid occurred in the 1990s with a way to solve big problems suchas protein folding, financial modeling, earthquake simulation, and climate/weather

modeling. The main use of Grid is applying the resources of manycomputers in a network to a single problem at the same time.

Utility

Computing


16/47


Computing Evolution (contd)

Cluster

Clusters are loosely coupled commodity servers usually deployed toimprove performance and/or availabilityover that of a single computer (e.g.mainframe, MPP, or SMP server), and also significantly more cost-effective

than single computers of comparable speed or availability

VirtualizationA virtual machine (VM) is a software implementation of a physical machine. The

virtual machines allow the sharing of the underlying physical machineresources between different virtual machines, each running its own

operating system

Utility

Computing


17/47


Computing Revolution


18/47


Trend and Prospect


19/47


Gartner Top 10 Strategic Technologies

Stolen from http://www.flickr.com/photos/mobian/3426349990/


20/47


Gartner Hype Cycle

2008Cloud Computing


21/47


Amazon EC2(August 2006)

Amazon S3(March 2006)

Google App Engine(April 2008)

Microsoft Azure(Oct 2008)

Recent Trends

Cloud Computing is NOT a brand-new revolution

GFS

MapReduce

BigTable

Hadoop


22/47


Hubspan Cloud Survey 2010

Companies of all sizes are moving to the cloud and consider cloud solutionsstrategic

More than 60% stated that moving to the cloud for applications,infrastructure, integration and other solutions is a strategic direction for theirorganization and department. And accordingly, they are implementing SaaS,PaaS, IaaS and other cloud-based solutions.


23/47


Hubspan Cloud Survey 2010 (contd)


24/47


Who Is Currently Using Cloud Computing?

0% 10% 20% 30% 40% 50% 60%

Developers

ISVs

SaaS providers

Other PaaS

Soho

SMB

Mid Tier enterprise

Enterprise

Other


25/47


What Does Cloud Computing Currently Offers?

0% 10% 20% 30% 40% 50% 60% 70% 80%

On-demand storage

File Storage

Utility computing

Platform as a service

Virtualized desktop support

SaaS applications

Application Development

Disaster recovery

Batch Computing Jobs

Billing Databases

Internet Application Hosting

Log Processing

Remote Storage

Test & Dev

Other


26/47


What is Cloud Computing Used For?


27/47


Prospects for Cloud Computing

Large enterprises are building their own private clouds

Large enterprises will become part-time cloud-computing vendors Small-sized to medium-sized businesses as well as large enterprises will be run on the

cloud

Coding & development skills will take a back seat to project management, quality

assurance testing, business analysis, and other high-level abstraction thinking

IT departments will shrink as users go directly to the cloud for IT resources

Cloud computing providers will support information security as if banks secure money

The browser will be all the desktop software you need

Game services will be one of the most interesting applications of Cloud Computing

Cloud Optimization and Grid Delivery will be an interesting business part to reducetotal cost


28/47


Benefits of Cloud Computing


29/47


Changes in the Cloud


30/47


Amazons Challenge and Paradigm Shift


31/47


Success Cases in AmazonSmugMug(http://www.smugmug.com/) an online photo storage application that stores more than half a petabyte of data on S3

estimates cost savings on service and storage to be close to $1 million

37Signals(http://37signals.com/)

maker of popular online project-management software Basecamp, uses S3 for storageneeds.

New York Times(http://www.nytimes.com) use EC2 to process terabytes of archival data using hundreds of EC2 instances within 36

hours

Animoto(http://animoto.com/) an online presentation video generator that needs gobs of computing power for video

processing

recently successfully withstood a surge in Web traffic that would kill most companiessystems by scaling up their processing power quickly using EC2 with RightScale

Animoto ramped from 25,000 users to 250,000 users in three days, signing up

20,000 new users per hour at peak

Using RightScale, EC2 instances automatically scaled out 40 to 4000 at that time

For more detail, refer to http://blog.rightscale.com/2008/04/23/animoto-facebook-scale-up/
http://www.smugmug.com/http://www.smugmug.com/http://www.smugmug.com/


32/47


Success Cases in Cloud Computing (contd)

AmazonS3

Joyent

AmazonEC2

RightScale

3Tera

GoogleApps

refered from http://www.johnmwillis.com/other/top-10-entperises-in-the-cloud/
http://www.nytimes.com/http://www.powerset.com/


33/47


Powerset had a great idea, Natural Language Search

It should index millions of pages of data and content

They knew that this would require a massively large datacenter andextensive computing power CPUs, terminal switches, cable, racks, datacenters, hosting, power,

maintenance, staffs

But they needed to keep infrastructure costs at a minimum

33

Start-up Company: Powerset

By using Amazon EC2, Powerset is able to match theinfrastructure of large scale search companies on a

startup budget.- Barney Pell, Founder and CEO of Powerset

Amazon EC2 is a complete game-changer. EC2 andAmazon Web Services make it easy for start-ups to builda complete infrastructure without having to spend much

on capital .- Paul Hammann

h // d
http://www.powerset.com/http://www.powerset.com/http://www.powerset.com/http://www.powerset.com/


34/47


Powerset had a great idea, Natural Language Search

It should index millions of pages of data and content

They knew that this would require a massively large datacenter andextensive computing power CPUs, terminal switches, cable, racks, datacenters, hosting, power,

maintenance, staffs

But they needed to keep infrastructure costs at a minimum

34

Start-up Company: Powerset

By using Amazon EC2, Powerset is able to match theinfrastructure of large scale search companies on a

startup budget.- Barney Pell, Founder and CEO of Powerset

Amazon EC2 is a complete game-changer. EC2 andAmazon Web Services make it easy for start-ups to builda complete infrastructure without having to spend much

on capital .- Paul Hammann

$100 millions

htt :// d
http://www.powerset.com/http://www.powerset.com/


35/47


The New York Times is a 150-year old company, and serves the largestnewspaper Website, NYTimes.com

1 billion page views per month 20+ million monthly unique visitors

They tried to convert TIFF images to PDFs TIFF images(405,000), Articles(3.3 million) in SGML PNG images(810,000) XML files(405,000) mapping articles to TIFFs JavaScript files(405,000)

35

Temporary & Data-intensive : The New York Times

I got access to a few more machines and churned through all11 million articles in just under 24 hours using 100 EC2

instances, and generated another 1.5TB of data to store in S3.It just costs $3000.- Derek Gottfrid

I had was this: upload 4TB of source data into S3, write somecode that would run on numerous EC2 instances to read thesource data, create PDFs, and store the results back into S3.

S3 would then be used to serve the PDFs to the generalpublic.- Derek Gottfrid

htt :// d


36/47


The New York Times is a 150-year old company, and serves the largestnewspaper Website, NYTimes.com

1 billion page views per month 20+ million monthly unique visitors

They tried to convert TIFF images to PDFs TIFF images(405,000), Articles(3.3 million) in SGML PNG images(810,000) XML files(405,000) mapping articles to TIFFs JavaScript files(405,000)

36

I got access to a few more machines and churned through all11 million articles in just under 24 hours using 100 EC2

instances, and generated another 1.5TB of data to store in S3.It just costs $3000.

I had was this: upload 4TB of source data into S3, write somecode that would run on numerous EC2 instances to read thesource data, create PDFs, and store the results back into S3.

S3 would then be used to serve the PDFs to the generalpublic.

Temporary & Data-intensive : The New York Times

http://www coordguru com


37/47


37

Benefits of Cloud Computing

Time to Market

Proof of Concept

Scalability

Reliability

Availability

Startup Cost(Capex/Opex)

Complexity

Business Risk

Business Risk



38/47


38

Benefits of Cloud Computing (contd)



39/47


Cloud Computing Players



40/47


Cloud Wars

Stolen from http://markusklems.wordpress.com/2008/07/05/merill-in-the-cloud/

Merrill Lynch recently issues a research note

The Cloud Wars: $100+ billion at stake (07 May 2008). The analysts write that by 2011 the volume of cloud computing market opportunity would amount

to $160bn, including $95bn in business and productivity apps (email, office, CRM, etc.) and $65bn

in online advertising.



41/47


Promising Cloud ProvidersPlayer Level Type Status Provider Description

3TeraCloud

DisruptorServer Provider Backbone

3Tera host solutions and provides software for other host providers.Founded in 2004, and provides AppLogic system since 2006AppLogic is a turnkey system that converts arrays of servers intovirtualized resource pools such as virtual machines, firewalls, VPNs,load balancers, and storage

AkamaiCloudLook-alike

Server(CDN)Non-Provider

Software-based

Akamai provides a content delivery network solution that improvesthe edge performance application experience by moving cloudapplications closer to target users.Akamai was founded in 1998, and provides a global computinginfrastructure for Internet content and application delivery.By mirroring contents, faster delivery and smoother transmission ofstreaming media can be provided.

AmazonCloudHost

Server,Storage,Database

Provider Backbone

Since 2006, Amazon has been providing cloud technologies suchas EC2 and S3

S3(Simple Storage Service) - $0.15 per-GB per-month EC2(Elastic Compute Cloud) - $0.10 ~ $0.80 per-instanceper-hour(1-Core x86 Server ~ 8-Core x86_64 Server) SimpleDB - $1.50 per-GB per-month

EnkiCloudGuest

ServerNon-Provider

3Tera

3Tera AppLogic-based cloud hosting and cloud-enabling services.Enki offers fast and reliable virtual private data centers on a utility-like billing model and full IT operations services.Enki automatically scale customers virtual private datacenters in

response to CPU loading based on 3Tera AppLogic.



42/47

http //www.coordguru.com


JoyentCloud

HostServer Provider Backbone

Cloud computing platform built on OpenSolaris and JoyentAccelerators (virtual servers)Since 2004, Joyent had delivered web application hostinginfrastructure as a service, and now evolving into providing all thecloud stacks: such as Joyent Cloud, Cloud Control, Smart Platform

LayeredTechnologies

CloudGest

Server Provider 3Tera

3Tera AppLogic-based cloud utility computing platformLayered Tech was founded in 2004, and provides manageddedicated hosting, on-demand grid/virtualization computing, andWeb services

Rackspace CloudHost

Server,Storage

Provider AmazonEC2

Cloud offering focused on hosting dynamic Web sitesRackspaces is one of the worlds largest hosting companies

Cloud Sites : $100 per-month with automatic load-

balancing, clustering, and redundant storage built-in in 5min. Cloud Files : $0.15 per-GB with unlimited storage, $0.22per-GB with Akamai-style content delivery Cloud Server : on-demand virtual machine service

Salesforce.com

Cloud

Look-alike=> CloudHost

Application Provider Force.com

Extendable cloud platform for Web-based applicationsSalesforce.com was founded in 1999, and is one of the pioneers ofthe SaaS model of distributing business software, which used in 16different languagesIn 2008, gross revenue is $1 billion, and currently has 55,500

customers and over 1.5 million usersBest known for CRM(Customer Relationship Management)

Sales, Service& Support, Partner RelationshipManagement, Marketing, Content, Ideas and Analytics

Provide Force.com as PaaS where external developers create add-on apps that integrate into the main Salesforce apps and arehosted on salesforce.coms infra



43/47

p // g


TerremarkCloudLook-alike

ServerNon-Provider

Backbone Cloud offering housed within Terremark co-location facilities

EnomalyECP/ElasticDrive

CloudGuest

Server,Storage

Non-Provider

AmazonEC2

Enomaly offers the "Enomaly Elastic Computing Platform" or"Enomaly ECP" - which it describes as being "the answer for serviceproviders that want to leverage the power, flexibility, andcompelling economics of cloud computing."The aim of ECP is to empower carriers, xSPs and enterprise end-user organizations to deliver infrastructure-on-demand services totheir customers and stakeholders.

RightScale CloudDisruptor Server Provider AmazonEC2

RightScale offers a fully automated cloud management platformthat enables organizations "to easily deploy and manage businesscritical applications across multiple clouds with complete control

and portability."The RightScale Cloud Management Platform is delivered assoftware-as-a-service (SaaS) and is available in a range of editions,froma free Developer Edition to Enterprise Editions.

EnstratusCloudDisruptor

Server ProviderVariousPlatforms

Arguably the #2 cloud management player next to RightScale,enStratus seeks to to deliver security and reliability for what itterms "confidence in the cloud."Describing itself as "the leading cloud management platform forenterprise applications," the company is based in Minneapolis,Minnesota and claims to enable "up to six 9s availability for

Amazon Web Services, Rackspace, ReliaCloud and WindowsAzure" through a patent-pending security architecture and anintelligent auto recovery engine.



44/47


CloudStackCloudDisruptor

Server Provider Backbone

Cloud.com is a pioneer of next generation cloud computingsolutions that enable simple and cost effective deployment,management, and configuration of cloud computing environments,regardless of where they are deployed. Extending beyondindividual virtual machine images running on commodity hardware,Cloud.com provides a turnkey cloud infrastructure software stackfor delivering virtual datacenters as a service delivering all of theessential components used to build, deploy, and manage multi-tierand multi-tenant cloud applications in a simple to install softwarepackage.

ElastraCloudGuest

Server ProviderAmazonEC2

Styling itself as a provider of "Elastic Computing," Elastra offers to"design, deploy & manage database and application infrastructure

in the Cloud in minutes - all with the click of a button." Dedicatedto providing companies building applications with a way toradically innovate the way they develop their products and deliverthem on IT infrastructure, Elastra's aim is to help a company"unlock the value of cloud computing by using virtualizedhardware environments with cloud-provisioned database andinfrastructure software that are easily configurable and do notrequire scripting, respond elastically to changing load and aredelivered in the cloud with meter-based pricing."

Nimbus

Nimbus is an open source toolkit "that allows you to turn your

cluster into an Infrastructure-as-a-Service (IaaS) cloud." It predatesAmazon EC2 though that wire protocol is now supported - in factas of the latest release in July 2010 there are three interfaces:Amazon EC2 WSDLs, Amazon EC2 Query API and Grid communityWSRF. The project defines its mission as being "to evolve theinfrastructure with emphasis on the needs of science" - 'CloudComputing for Science' is its motto - but many non-scientific usecases are supported as well.



45/47


Nimbula

Headquartered in Menlo Park, California with a development teamin South Africa, Nimbula calims to deliver "a new class of cloudinfrastructure and services system that...combines the flexibility,scalability and operational efficiencies of the public cloud with thecontrol, security and trust of todays most advanced data centers."One of the interesting aspects of this company is that it wasfounded by the team that developed Amazon EC2 - the motherand father of all public cloud services.



46/47

Anatomy of Cloud Computing Technologies



47/47

Thank you.

rethinking cloud computing

Documents