benefits of grid computing in the cloud

© 2007 RightScale Inc.—All rights reserved. RightScale Company Confidential

1 © 2009 RightScale Inc.—All rights reserved. RightScale Company Confidential

1

Best Practices in the

Cloud:

Grid Computing



2

Your Panel Today

Presenting• Thorsten von Eicken – Founder, CTO• Josh Fraser – VP, Business

Development• David Welch – Sr. Sales Engineer

Q&A• Matthew Small – Sr. Account Manager



3

Welcome Grid Applications & the Cloud RightGrid Architecture Live Demo Use Cases Q&A – Getting Started

Please use chat to ask questions anytime!

Agenda



4

AUTOMATIONARCHITECTUREAUTOMATIONARCHITECTURE

CLOUD-READYSOLUITIONS

CLOUD-READYSOLUITIONS

EXPERTISE& SUPPORTEXPERTISE

& SUPPORT

EXPERTISE

RIGHTSCRIPTS

MYSQL MGR

WEB SITE

GRID

Cloud ApplicationsCloud Applications

AWS USAWS EUAWS USAWS EU FlexiScaleFlexiScale RackspaceRackspace GoGridGoGrid Other

CloudsOther Clouds

Righ

tSca

leCloud Management Platform



5

Grid Apps – Back-end Jobs • Front-end web app

– “Complete” web site– Simple submit/retrieve site

• Back-end grid– Processes jobs “submitted”

via web site– Results “retrieved” via web site– Job queue invisible to end user– Grow/shrink workers to

maintain SLA

• Typical example:– Multi-media processing/transcoding

Web tier

Grid tier

Users



6

Grid Apps – Back-end Jobs • Cloud effects

– Grow/shrink workers to maintain SLA

– Design, configure, manage all tiersin homogeneous infrastructure

– Communicate and share across tiers (database, storage, aux servers, …)

– Clone entire architecturefor dev & test

Web tier

Grid tier

Users



7

• Job submission– Upload/submit– Complex priority

scheduler

• Cloud effects– Variable number of

nodes• extend peak• improve utilization

– On-demand vs. queue• Personal grids• Real-time grids

Grid Apps – Queued Batch

time

nodes



8

• Standard design pattern:1. Produce/upload data2. Queue work3. Worker array4. Queue results5. Consume/download results

RightGrid Architecture

8



9

RightGrid Architecture

Amazon S3Simple Storage Service

Amazon SQSSimple Queue Service

Amazon EC2Elastic Compute Cloud

web/appserver

userworkstation

JobProducer

InputQueue

ResultQueue

GridWorkers

JobConsumer

web/appserver

userworkstation



10

RightGrid Demo

EC2server

JobProducer

InputQueue

ResultQueue

GridWorkers

JobConsumer

userworkstation

1000 images1000 work items

1..100 servers 1000 watermarked images1000 result items



11

• Standard worker server design pattern:– Loop over items and do work– Pull data descriptor in SQS, data in

S3–Work …– Push data data into S3, descriptor

into SQS– Audit audit record, log files

RightGrid Worker

11



12 12

RightGrid Worker

RightGrid Worker Server

yourcode

local disk

Input(S3)

workqueue

pre-work

post-work

Results(S3)

resultqueue

logs

auditqueue



13

• “Hello world” worker script

• Worker array with 1 worker running

• Coordinator server submitting “Hello” units

• SQS queues

RightGrid 1-click set-up



14

• Pharmaceutical – Protein Analysis– Executed 2.5 million compound comparisons– Estimated one week of processing on internal servers– Completed in a half day on 100 instances

• Insurance – Fraud Detection – Multiple years of records processed for fraudulent or duplicate claims– Estimated at weeks or months internally, or $M cap-ex– Reduced to days and hours on the cloud

• Web 2.0 – Media Transcoding– From images and music, transcode and render video on demand– Produce high production videos within minutes instead of hours

Grid Use Cases Today



15

Why the Cloud for Grid Apps?

In-house Grid

• Invest for peak• Queue model• Web/batch isolation• Black-box jobs• Complex charge-

back

Cloud Grid

• Access “unlimited” resources

• On-demand model• Easy web+batch mix• Transparent resource

access• Simple cost equationNeutral cost equation

1000 Jobs10 Machines

100 Elapsed Hours

1000 Jobs100 Machines

10 Elapsed Hours

same worksame cost



16

RightGrid Benefits

• Standard proven architecture

• Worker framework ready to go

• Management thru RightScale interface

Save Time, Improve Visibility



17

Contact a RightScale representative for a live demonstration of RightGrid: [email protected] (866) 720 – 0208

Register for our next webinar and access live recordings of past webinars at:

RightScale.com/webinars

Q&A - Getting Started

Thank you for listening!

mailto:[email protected]



18

Best Practices in the

Cloud:

Grid Computing

benefits of grid computing in the cloud

Technology