leveraging amazon's elastic block store

© 2007 RightScale Inc.—All rights reserved. RightScale Company Confidential

1

Leveraging Amazon’s Elastic Block Store (EBS)


2

Your Panel Today• Michael Crandell – CEO• Thorsten von Eicken – CTO• Josh Fraser – VP Business

Development


3

Welcome to RightScale Why does EBS matter? EBS features & demo Use-cases RightScale Support for EBS Q&A – Getting Started

Please use chat to ask questions anytime!

Agenda


4

EC2EC2 S3S3 SQSSQS SimpleDBSimpleDB EBSEBS

AUTOMATEDMANAGEMENTAUTOMATED

MANAGEMENTCOMPONENT

LIBRARIESCOMPONENT

LIBRARIESEXPERTISE

& SUPPORTEXPERTISE

& SUPPORT

Cloud Management PlatformEXPERTISE

RIGHTSCRIPTS

MYSQL MGR

WEB SITE

GRID

Cloud ApplicationsCloud Applications

Righ

tSca

le


5

Why Elastic Block Store Matters

Scalable Web Architecture“EC2 Classic”

Traditional Architecture“EC2 + EBS”

SAN

srv

srvsrv srv

srv

srv

srv

srvsrvsrv

srv• Many identical servers• Scalable, replicatable• Service-oriented architecture• Distributed storage system

• Centrally managed storage• Built-in redundancy• Snapshot backup


6

Use-Cases Enabled by EBS• Large Persistent Datasets

– Too large for server-local storage /“too small” for distributed storage

– Traditional applications, relational databases– Large read-only datasets replicated to many

servers

• Virtual Appliance Servers– Single server with reliable persistent store– Easy backup, replication, upgrade– Simple, economical approach


7

Intro to EBS Volumes

• Create volume: 1GB – 1TB size• Attach to any instance

in same availability zone• Pay $0.10/GB per month

+ $0.10 / million I/O ops• Snapshot backup a volume to S3• Create new volume from snapshot


8

Quick Demo


9

Snapshots• Point-in-time

snapshot• Written to S3

– (Not to bucket!)

• Incremental backup• Restore to new volume

– Instantaneous (lazy restore)

Server 1

Server 2

Amazon S3

Vol 1

Vol 2

Server 3 Server 4

Vol 3 Vol 4

snap 2snap 1


10

Incremental Snapshots

• Table of Contents vs. Data Blocks• “Space used” difficult to gauge• Frequent snapshots: minimal cost

delete snap 2


11

Keeping Safe• Freeze data while snapshotting

– XFS filesystem has freeze command

• Volumes are fragile in transit!– Unmounting can leave data in flight– Mounting mistake will be destructive

• Use snapshots for safety!– Always snapshot after unmount– Create fresh volume from snapshot,

mount that, retry in case of problem


12

Running MySQL with EBS

1.Snapshot master2.Create slave volume3.Attach slave volume4.Start replicating


13

Database Fail-Over

MySQLmaster

MySQLslave

AppServer 1

AppServer 2

AppServer 3

AmazonS3

snapshots& exports

replication

EBSvol

EBSvol


14

Database Fail-Over

MySQLmaster

MySQLslave

AppServer 1

AppServer 2

AppServer 3

MySQLslavereplicationmaster

1.Promote slave to master

2.Fail-over app servers

3.Launch new slave

4.Init from snapshot

5.Start replication

Always roll forward!AmazonS3

snapshots& exports

EBSvol

EBSvol

EBSvol

create fromsnapshot


15

Zone 2Zone 1

Multi-Zone Deployment

MySQLmaster

MySQLslave

App Srvr

AmazonS3

LB1 LB2

App Srvr App Srvr

IP1 IP2

EBS EBS


16

Customer 3Customer 2Customer 1

Virtual Appliances enabled by EBS

• Server + volume per customer• “Step and repeat”• Flexibility in sizing• RightScale “sub-accounts” to entitle,

manage, support and aggregate

Srvr 1

data

Srvr 2

data

Srvr 3(XL)

data

Customer 4

Srvr 2

data


17

Clouds surpass traditional hosting• Multiple server sizes: ½ core to 8

cores• Disk Volumes with snapshots• Reassign IPs / VIPs• Multiple failure zones• Soon: multiple geographies

• Automation tying it all together


18

RightScale Support for EBS• EBS management via the RightScale

Dashboard• Volumes, snapshots, nickname, history,

audit entries …• Auto-mount volume at boot time• Lineage of volumes and related snapshots• Server templates & scripts using EBS• Scheduled snapshots w/o AWS credentials


19

Read Thorsten’s blog at:Blog.RightScale.com

Sign up for a free developer account (includes support for EBS): RightScale.com/FreeTrial

Follow one of our EBS TutorialsWiki.RightScale.com

Contact a RightScale representative for a live demonstration or to request presentation slides at: [email protected] (866) 720 – 0208

Q&A - Getting Started

Thank you for listening!


20

Thank you for listening!

leveraging amazon's elastic block store

Technology

ebs server

ebs ebs management

ebs volumes

ebs snapshot master

ebs qagetting

ebs tutorials

ebs matter

ebs large persistent