aws webcast - amazon rds - running low admin high performance databases in the cloud

©2013, Amazon Web Services LLC or its affiliates. All rights reserved.

Amazon RDS

Shakil Langha ([email protected]) Business Development Manager

Running Low Admin High Performance Databases in the Cloud

mailto:[email protected]


What is AWS?

Compute Storage

AWS Global Infrastructure

Database

Application Services

Deployment & Administration

Networking


Amazon DynamoDB Fast, Predictable, Highly-Scalable NoSQL Data Store

Amazon RDS Managed Relational Database Service for

MySQL, Oracle and SQL Server

Amazon ElastiCache In-Memory Caching Service

Amazon Redshift Fast, Powerful, Fully Managed, Petabyte-Scale

Data Warehouse Service

Compute Storage

AWS Global Infrastructure

Database

Application Services

Deployment & Administration

Networking

AWS Database Services

Scalable High Performance Application Storage in the Cloud


backup & recovery, data load & unload

performance tuning 25% 40%

5% 5%

scripting & coding security planning

install, upgrade, patch and migrate

documentation, licensing & training

Why Managed Databases?

differentiated effort increases the uniqueness

of an application


Amazon RDS RDS is a fully managed relational database service that is simple to deploy, easy to scale, reliable and cost-effective

Ease of Deployment and Patching

Push Button Scalability

Choice of DB Engines and Application Compatibility

Automated Backups and Disaster Recovery

User Snapshots and Cloning

Monitoring and Automatic Host Replacement


Case Study: Samsung saved $34M

Problem

Needed to reduce IT costs and were looking to create a more flexible IT environment

Solution

AWS and RDS services. With every request, the application authenticates devices, delivers apps and content, and pushes notifications.

Business Benefits

Saved $34M in hardware and maintenance expenses, 85% less than running on-premises


Problem

Outgrew existing IT environment

Solution

AWS’s elasticity made it easy to respond to demand peaks and saved money during off peak times

Business Benefits

Scaled to handle 10 million visitors per day

Reduced time-to-market and dev time

Case Study: Gumi serves millions of users


Challenges

Time to Market – Faster release cycles

Cost – Millions of users, Seasonal peaks

Reliability – Fast, Always ON

Solution

Use Amazon EC2, RDS, CloudFormation

Multiple Availability Zones (by default)

Business Benefits

Uptime greater than 99.9%

Hands free recovery using Amazon RDS

Monthly to weekly release cycles

Case Study: Intuit Live Community


Flipboard Serves Billions of Pages With RDS

Challenges

6 months to deploy a real-time, socially relevant magazine

5 million users, 2 billion page flips per month

Allow frequent changes system and user requirements

Solution

Amazon EC2, RDS, ElastiCache

Multiple Availability Zones

Business Benefits

High performance, reliable, proven DB technology

Better Response time (Milliseconds) and uptime

Complex queries on user and relevancy data


Low Admin


Key Features • Manageability

• Rapid deployment with pre-configured parameters • Patch Management • Monitoring and Metrics

• Availability and Data Durability • Automated Backups and Point-In-Time-Recovery • DB Snapshots • Automatic Host Replacement (Single-AZ) • Multi-AZ deployments

• Scalability • Push-Button Scaling (Storage, Memory and Compute) • Read Replicas


Rapid deployment via Web Console


Backups and Recovery • DB Snapshots

• User-driven snapshots of database • Kept until explicitly deleted

• Automated Backups • Nightly system snapshots + transaction backup • Enables point-in-time restore to any point in retention period, up to the last 5 minutes • Max retention period = 35 days


Push Button Scaling

• Scale nodes vertically up or down • M1.small (1 virtual core, 1.7GB) • M2.4XLarge (8 virtual cores, 64GB)

• Scale out nodes horizontally • Shard based on data or workload characteristics

• Scale Storage vertically without incurring downtime


High Availability: Multi-AZ Deployments

• Enterprise-grade fault tolerance solution for production databases

• With a few clicks, Amazon RDS creates and synchronously maintains a standby in a different Availability Zone

• Automatic failover in case of: • Loss of availability in primary AZ • Loss of connectivity to primary • Host or storage failure on primary • Vertical Scaling • Software patching


Do It Yourself MySQL replication

Potentially ~100+ Manual steps

Set up primary and standby instances

Set up identical volumes

Create synchronous replication

Create and manage DNS entries

Detect instance failure conditions

Detect network failure conditions

Detect storage failure conditions

Decide when to fail-over….

Re-establish primary secondary connections.

Amazon RDS Multi-AZ

HA with a mouse click

Creating High Availability Databases


Horizontal Scaling with Read Replicas • Add Read Replicas

• Horizontal scaling of read heavy workloads • Offload reporting

• Keep in mind • Asynchronous, native tech • Single threaded and brittle • Currently available for MySQL

• Overcoming challenges • RDS makes it easy to re-create if fallen behind • Deploy a proxy to round robin requests


Amazon RDS Read Replica

Read Replica with a mouse click

Do It Yourself MySQL Read Replica

~30+ manual steps

Creating a Read Replica


High Performance


High Performance RDS


• Able to run applications on AWS without changing the existing technology

stack or user interface

• Test confirmed that utilizing Amazon RDS for Oracle Database and Amazon

RDS Provisioned IOPS reduced processing time from 96 to 24 hours

• Estimates a 50% cost savings over a three-year period

The Story Business Benefit

• Australian consulting firm that provides software development services to the energy,

telecommunications, finance and retail industries

• Enterprise clients found the Oracle-based applications costly to run on an on-premises

infrastructure

• Shine wanted to run the applications as a cloud-based service but had to port a large, ten-

year-old Oracle Database

• Using Amazon RDS for Oracle Database, Amazon RDS Provisioned IOPS, Amazon EC2,

Amazon VPC, and Multi-AZ

“We leveraged Amazon RDS Provisioned IOPS to decrease processing time for our Oracle applications from 96 to 24 hours.”

- Adam Kierce, Principal and Co-Founder


Provisioned IOPS: Details Provision up to 3TB and 30,000 IOPS

Provisioning more than max per engine reduces latency

Convert from Standard to Provisioned IOPS storage

Scale storage and IOPS independently on-line

Engine Max IOPS for m2.4xlarge

Oracle (3TB) 25,000

MySQL (3TB) 12,500

SQL Server (1TB) 10,000


Parameters of RDS Performance

Instance Size CPU Memory Bandwidth P-IOPS Optimized

Provisioned IOPS I/O Performance

Allocated Storage # of Storage Volumes


Amazon RDS Configuration

Improve Availability

Increase Throughput

Reduce Latency

Push-Button Scaling

Multi AZ

Read Replicas

Provisioned IOPS

Read Replicas Push-Button Scaling Provisioned IOPS

Region

Multi-AZ

Availability zone Availability zone

RDS for Production Workloads


Data Migration


Migrating to RDS

Advanced Migrations

Incremental Loads

3rd Party Tools

Basic Migrations

Export/Import

Bulk Load

Not Supported

Restore from backup


Basic Migration

On Premises AWS


RDS Basic Migration

MySQL

mysqldump

mysqlimport

Oracle

Data Pump

SQL*Loader

SQL Server

Gen./Publish Scripts

Bulk Copy

Advantages • Simple • Ideal for initial load • Can be used for small

or large datasets

Disadvantages • Requires downtime


Advanced Migration

On Premise

Dump Copy Backup

AWS

Apply Delta Changes

DB

T1 T1 T2 T2


RDS Advanced Migration

MySQL

mysqlbinlog

Tungsten Replicator

Oracle

Mview replication

GoldenGate

Dbvisit

SQL Server

Linked Servers

SSIS

Advantages • Incremental loads • Inbound replication • Minimizes downtime

Disadvantages • Complex


Post-migration Steps

• Turn on Backups • Turn on Multi-AZ • Create Read Replicas • Tighten down security • Notifications via CloudWatch, DBEvents


• RDS Home Page: https://aws.amazon.com/rds/ • RDS FAQs: http://aws.amazon.com/rds/faqs/ • RDS Webinars: https://aws.amazon.com/resources/databaseservices/webinars/ • RDS MySQL Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/MySQL.Procedural.Importing.html • RDS SQL Server Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/SQLServer.Procedural.Importing.html • RDS Oracle Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Oracle.Procedural.Importing.html

More Information

https://aws.amazon.com/rds/

https://aws.amazon.com/rds/

http://aws.amazon.com/rds/faqs/

http://aws.amazon.com/rds/faqs/

https://aws.amazon.com/resources/databaseservices/webinars/

https://aws.amazon.com/resources/databaseservices/webinars/

http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/MySQL.Procedural.Importing.html

http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/MySQL.Procedural.Importing.html

http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/SQLServer.Procedural.Importing.html

http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Oracle.Procedural.Importing.html

http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Oracle.Procedural.Importing.html


Questions?

aws webcast - amazon rds - running low admin high performance databases in the cloud

Documents