SOA 16: Computing in the Cloud – Is it in your future?

Dr. Sheldon BorkinGus Björklund

Vice Presidents, Technology

I've looked at clouds from both sides nowFrom up and down and still somehowIt's cloud's illusions I recallI really don't know clouds at all

- Joni Mitchell

© 2008 Progress Software Corporation2 SOA 16: Computing in the Cloud – Is it in your future?

Agenda

What is cloud computing? Examples Advantages and potential issues OpenEdge® in the Amazon cloud Lessons-learned Conclusions

Computing in the Clouds – Is it in your future?

© 2008 Progress Software Corporation3 SOA 16: Computing in the Cloud – Is it in your future?

Clouds - the next evolution of hosting

© 2008 Progress Software Corporation4 SOA 16: Computing in the Cloud – Is it in your future? Users

The services clouds

Compute Services•Virtual machine grid•Application grid•Points-of-presence

Storage / Database•Relational•Storage blobs•Entity/object

Common Services•Provisioning•Authentication/Authorization•Metering/billing•Self-service UI•APIs

Application / Business Services•Enterprise or ISV•Business logic•User interface

Messaging/Integration•Queuing•Service bus•Cloud-to-cloud, or cloud to on-premise

Service Providers

Application Development•As-a-service• + (Eclipse)• + (Visual Studio)

Application Platform•Virtual machine•Language platform•App. framework

© 2008 Progress Software Corporation5 SOA 16: Computing in the Cloud – Is it in your future?

Service Providers

As a Service/Application Provider

You are providing an application accessible over the web

You buy your hosting as services You optionally buy additional services You don’t know where your servers are located You don’t have to speak to a human to provision

a new server or install a new application

© 2008 Progress Software Corporation6 SOA 16: Computing in the Cloud – Is it in your future?

Amazon Web ServicesInfrastructure-as-a-Service

Infrastructure Services• EC2 – Elastic Computing Cloud

• S3 – Simple Storage Service

• SQS – Simple Queue Service

• SimpleDB

Billing and Payment Services• Amazon DevPay

• Flexible Payment Service

aws.amazon.com

© 2008 Progress Software Corporation7 SOA 16: Computing in the Cloud – Is it in your future?

Google App EngineApplication Platform-as-a-Service

code.google.com/appengine/

Python language only (for now) Persistent storage (GQL) Automatic scaling and load balancing APIs for authenticating users and sending

email using Google Accounts Local development environment that

simulates Google App Engine on your computer

Preview release

© 2008 Progress Software Corporation8 SOA 16: Computing in the Cloud – Is it in your future?

Force.comApplication Framework-as-a-Service

salesforce.com/developer

Use with or withoutSalesforce.com CRM

Application development anddelivery – emphasis onpoint-and-click GUI

Customizable data object service (SOQL) Apex language and JavaScript for UI Visualforce tools for UI and mashups Web services API

© 2008 Progress Software Corporation9 SOA 16: Computing in the Cloud – Is it in your future?

Advantages and potential issues

Advantages• Pay just for what you use – generally low cost• Easy self-serve scale-up/scale-down• Global reach• Focus on application, not infrastructure

Potential issues• Service level commitments vary widely – most on the

weak side• Limited control at hardware & network level• Limited hand-holding

© 2008 Progress Software Corporation10 SOA 16: Computing in the Cloud – Is it in your future?

In theory, there is no difference between theory and practice. But in practice, there is.

Jan L. A. van de Snepscheut

© 2008 Progress Software Corporation11 SOA 16: Computing in the Cloud – Is it in your future?

RunningOpenEdge onAmazon EC2

© 2008 Progress Software Corporation12 SOA 16: Computing in the Cloud – Is it in your future?

What isAmazon EC2

© 2008 Progress Software Corporation13 SOA 16: Computing in the Cloud – Is it in your future?

AMI (vm) sizes

AMI Size Horsepower4 Memory Disk slices0 I/O Perf.

small1 1 cu 1.7 GB 1 x 150 GB Low

large2 4 cu 7.5 GB 2 x 420 GB High

extra large2 8 cu 15 GB 4 x 420 GB High

hi-cpu med1 5 cu 1.7 GB 1 x 340 GB Med

hi-cpu x-lg2 20 cu 7 GB 4 x 420 GB High

0: and a 10 GB root partition1: 32 bit processor2: 64-bit processor4: Amazon measures horsepower in “compute units”

1 cu = 1 x 1.2 GHz 2007 Opteron equivalent

© 2008 Progress Software Corporation14 SOA 16: Computing in the Cloud – Is it in your future?

Amazon Compute Units vs Observed

SizeCompute Units

Virtualcores

Observed CPU

small 1 cu 1 x 1 cu 2 x 2.6 GHz

large 4 cu 2 x 2 cu 2 x 2.0 GHz

extra large 8 cu 4 x 2 cu 8 x 2.4 GHz

hi-cpu med 5 cu 2 x 2.5 cu 2 x 2.3 GHz

hi-cpu x-lg 20 cu 8 x 2.5 cu 8 x 2.3 GHz

1 cu = 1 x 1.2 GHz 2007 Opteron equivalent

© 2008 Progress Software Corporation15 SOA 16: Computing in the Cloud – Is it in your future?

What does EC2 Cost?

Virtual MachineSize

Price(per hour)

Small $ 0.10

Large $ 0.40

Extra large $ 0.80

Hi-cpu medium $ 0.20

Hi-cpu extra large $ 0.80

© 2008 Progress Software Corporation16 SOA 16: Computing in the Cloud – Is it in your future?

What isAmazon S3

© 2008 Progress Software Corporation17 SOA 16: Computing in the Cloud – Is it in your future?

Europe: $ 0.18 per GB-monthUS: $ 0.15 per GB-month

What Does S3 Cost?

© 2008 Progress Software Corporation18 SOA 16: Computing in the Cloud – Is it in your future?

Other Amazon Web Services

SimpleDB Simple Queue Services Premium Support Mechanical Turk

© 2008 Progress Software Corporation19 SOA 16: Computing in the Cloud – Is it in your future?

To Get Started

Create your Amazon Web Services account and then• Sign up for Amazon S3• Sign up for Amazon EC2• Download command line tools

– Needs Java™ 1.5• Create a certificate• Generate public/private keys

Start a virtual machine Log in via ssh

© 2008 Progress Software Corporation20 SOA 16: Computing in the Cloud – Is it in your future?

Instructions

http://docs.amazonwebservices.com/

AWSEC2/2008-02-01/GettingStartedGuide/

http://developer.amazonwebservices.com

© 2008 Progress Software Corporation21 SOA 16: Computing in the Cloud – Is it in your future?

Sign Up For AWS

© 2008 Progress Software Corporation22 SOA 16: Computing in the Cloud – Is it in your future?

Get Identifiers

© 2008 Progress Software Corporation23 SOA 16: Computing in the Cloud – Is it in your future?

Sign Up For S3

© 2008 Progress Software Corporation24 SOA 16: Computing in the Cloud – Is it in your future?

Sign Up For EC2

© 2008 Progress Software Corporation25 SOA 16: Computing in the Cloud – Is it in your future?

Generating A Keypair

© 2008 Progress Software Corporation26 SOA 16: Computing in the Cloud – Is it in your future?

Firefox EC2 Plugin

© 2008 Progress Software Corporation27 SOA 16: Computing in the Cloud – Is it in your future?

Start an EC2 VM

© 2008 Progress Software Corporation28 SOA 16: Computing in the Cloud – Is it in your future?

Log in to your EC2 VM

© 2008 Progress Software Corporation29 SOA 16: Computing in the Cloud – Is it in your future?

Loading stuff into your EC2 VM (AMI)

create a directory to copy into (e.g. /home/gus)

scp -i id_rsa-gsg-keypair dlclin32.tar.bz2 \root@ec2-67-202-43-207.compute-1.amazonaws.com:\/home/gus

create a /home/dlc directory, unpack tarball into it

set DLC var, add $DLC/bin to PATH

create mount points and mount additional disk slicesif needed (e.g. /dev/sdc, /dev/sdd, /dev/sde)

© 2008 Progress Software Corporation30 SOA 16: Computing in the Cloud – Is it in your future?

Demonstration !(screenshots of)

© 2008 Progress Software Corporation31 SOA 16: Computing in the Cloud – Is it in your future?

Logged in to your EC 2VM

© 2008 Progress Software Corporation32 SOA 16: Computing in the Cloud – Is it in your future?

Linux /proc/version

© 2008 Progress Software Corporation33 SOA 16: Computing in the Cloud – Is it in your future?

/proc/cpuinfo

© 2008 Progress Software Corporation34 SOA 16: Computing in the Cloud – Is it in your future?

/proc/meminfo

© 2008 Progress Software Corporation35 SOA 16: Computing in the Cloud – Is it in your future?

for each customer

© 2008 Progress Software Corporation36 SOA 16: Computing in the Cloud – Is it in your future?

It’s alive

© 2008 Progress Software Corporation37 SOA 16: Computing in the Cloud – Is it in your future?

Where Are We In The Cloud Anyway ???

youare

here

theVM ishere

www.opte.org/maps

© 2008 Progress Software Corporation38 SOA 16: Computing in the Cloud – Is it in your future?

Running The ATM Database Benchmarkon EC2

Simulated ATM withdrawal/deposit transaction• 3 updates, 1 create

150 4GL transaction generators• no think time, self-serving mode

Database tables• 80,000,000 accounts

• 80,000 Tellers

• 8,000 branches

• 1 history record per transaction

What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. - Norbert Weiner

© 2008 Progress Software Corporation39 SOA 16: Computing in the Cloud – Is it in your future?

ATM Database (physical)

Total size 12 gigabytes (data)

Data extent size 2,000,000 (2 GB)

Data extent count 6

Data block size 4096 bytes

Rows per block 64

Data Areas 1 Type II

Data cluster size 512 blocks (2 megabytes)

© 2008 Progress Software Corporation40 SOA 16: Computing in the Cloud – Is it in your future?

ATM Database (other info)

Account table data 9.2 gigabytes

Branch table data 922 kilobytes

Teller table data 9.3 megabytes

Indexes 691 megabytes

RM blocks 2,588,252

Index blocks 181,334

Free blocks 142,464

© 2008 Progress Software Corporation41 SOA 16: Computing in the Cloud – Is it in your future?

Standard ATM Workload Configuration

Data block size: 4096 BI cluster size: 16384 BI blocksize: 16 Server options:

– -n 200 -L 10240– -B 64000– -spin 50000– -bibufs 32

Page writers: 4 BI writer: yes AI writer: no, ai not activated ! Transaction generators: 150

© 2008 Progress Software Corporation42 SOA 16: Computing in the Cloud – Is it in your future?

© 2008 Progress Software Corporation43 SOA 16: Computing in the Cloud – Is it in your future?

Creating the database

~ 12 gigabyte database Data extents and

bi log all on one disk 4 loaders

Build time 198 minutes

Index rebuild 20 minutes

Small VM

© 2008 Progress Software Corporation44 SOA 16: Computing in the Cloud – Is it in your future?

Creating the database

~ 12 gigabyte database Data extents on 4 disks,

bi log on 5th disk 2 loaders

Build time 68 minutes

Index rebuild 9 minutes

High-cpu, extra large VM

© 2008 Progress Software Corporation45 SOA 16: Computing in the Cloud – Is it in your future?

ATM Performance Results(the standard workload)

81 254 380 872

© 2008 Progress Software Corporation46 SOA 16: Computing in the Cloud – Is it in your future?

ATM Performance Results(the standard workload)

experiment EC2 small EC2 large EC2 high-cpu extra-large

2006 Secret Bunker

tps 81 254 380 872

disks 1 3 5 6

EC2 cu’s 1 4 20 6.6 est.

cpu count 2 2 8 4

cpu speed 2.6 GHz 2.0 GHz 2.3 GHz 2.0 GHz

cpu width 32 bit 64 bit 64 bit 32 bit

memory 1.7 GB 7.5 GB 15 GB 6 GB

cu = “compute unit”, 1 x 1.2 GHz Opteron equivalent

© 2008 Progress Software Corporation47 SOA 16: Computing in the Cloud – Is it in your future?

Customising your VM Image

Use scp to copy your stuff to it Put things where you want them Make sure everything works edit /etc/rc if you want

Take out the trash !!!

© 2008 Progress Software Corporation48 SOA 16: Computing in the Cloud – Is it in your future?

Saving Your Customised VM Image

Use scp to copy your certificate to /mnt• S3 data are signed and encrypted

Save your current VM image to S3• ec2-bundle-vol

• ec2-upload-image

Later, you useec2-run-instances

to start it up.

© 2008 Progress Software Corporation49 SOA 16: Computing in the Cloud – Is it in your future?

Shutting Down Your AMI

© 2008 Progress Software Corporation50 SOA 16: Computing in the Cloud – Is it in your future?

“I don’t kill my own chicken for Sunday dinner anymore.

Why should I provision my own server?”

BigJimmy’s blog

© 2008 Progress Software Corporation51 SOA 16: Computing in the Cloud – Is it in your future?

So What’sWrong withEC2

© 2008 Progress Software Corporation52 SOA 16: Computing in the Cloud – Is it in your future?

EC2 Limitations

Performance not as good as very big “real” machines• But still decent

Performance varies somewhat day-to-day Single AMI is I/O bandwidth limited Single AMI limited to at most 5 disks EC2 disk storage is volatile

• Must do backups to S3 or elsewhere S3 requires SOAP (gross !) or REST Sadly, EC2 not yet supported by Progress !!!

Good stuff, but:

© 2008 Progress Software Corporation53 SOA 16: Computing in the Cloud – Is it in your future?

AWS: When REALITY is not enough!

Cheap Easy Performant Flexible

Try it! You’ll like it!

Advantages:

© 2008 Progress Software Corporation54 SOA 16: Computing in the Cloud – Is it in your future?

Avez Vousdes QuestionsReferences:

aws.amazon.com

developer.amazonwebservices.com

docs.amazonwebservices.com