aws webcast - aws 101 - journey to the aws cloud: introduction to aws

What is AWS?

Simone Brunozzi – Senior Technology Evangelist @simon

AWS Mission

Enable businesses and developers to use web services* to build scalable,

sophisticated applications.

*What people now call “the cloud”

Powering the Most Popular Internet Businesses

Trusted by Enterprises

Each day AWS adds the equivalent server

capacity to power Amazon when it was a

global, $5.2B enterprise

$5.2B retail business

7,800 employees

A whole lot of servers

2003

Innovation on behalf of our customers:

158 new features and services in 11months of 2012

Utility computing

Compute

Storage

Security Scaling

Database

Networking Monitoring

Messaging

Workflow

DNS

Load Balancing

Backup CDN

On demand Pay as you go

Uniform Available

Utility computing

On a global footprint

Region

US-WEST (N. California) EU-WEST (Ireland)

ASIA PAC (Tokyo)

ASIA PAC (Singapore)

US-WEST (Oregon)

SOUTH AMERICA (Sao Paulo)

US-EAST (Virginia)

GOV CLOUD

ASIA PAC (Sydney)

Availability Zone


Edge Locations

Dallas(2)

St.Louis

Miami

Jacksonville Los Angeles (2)

Palo Alto

Seattle

Ashburn(2)

Newark

New York (2)

Dublin

London(2)

Amsterdam

Stockholm

Frankfurt(2)

Paris(2)

Singapore(2)

Hong Kong

Tokyo

Sao Paulo

South Bend

San Jose

Osaka Milan

Sydney


At the end of a web service

ec2-run-instances ami-b232d0db

--instance-count 3

--availability-zone eu-west-1a

--instance-type m1.small


--instance-count 5

--availability-zone eu-west-1c

--instance-type m1.medium


--instance-count 2

--availability-zone us-east-1b

--instance-type m1.xlarge


--instance-count 2

--availability-zone us-east-1d

--instance-type m1.xlarge



elb-create-lb myLoadBalancer

as-create-auto-scaling-group MyGroup

--launch-configuration MyConfig

--availability-zones eu-west-1c

--min-size 2

--max-size 200

ec2-authorize default -p 80

and rich console services

Why are customers adopting cloud computing?


Variable expense Replace capital expenditure with variable expense


Variable expense

On-premise

vs $0 to get started Pay as you go

Replace capital expenditure with variable expense

Capital investment & physical installation


Variable expense Replace capital expenditure with variable expense

Source IDC Whitepaper, sponsored by Amazon, “The Business Value of Amazon Web Services

Accelerates Over Time.” July 2012

Average of 400 servers replaced per customer

Economies of scale Lower variable expense than companies can achieve

themselves



themselves


Saved $34m on SmartHub application

10’s of millions of $ saved with first 12 apps

migrated to AWS

50% reduction in analytics

costs


themselves


$3.01M

$0.90M

Source IDC Whitepaper, sponsored by Amazon, “The Business Value of Amazon Web Services

Accelerates Over Time.” July 2012

70% lower 5 year TCO per app

On-premise AWS


themselves


Reduced Prices

More Customers

More AWS Usage

More Infra-structure

Economies of Scale

Lower Costs


Elastic capacity No need to guess capacity requirements and over-provision


Actual demand

Predicted demand

Customer dissatisfaction

Waste

Demand

Time




Elastic capacity

Demand

Time


Speed and agility Infrastructure in minutes not weeks



“We reduced application

deployment times from 2 months to 3

days.”

“Time to deploy from went weeks

to hours.”

“We can double server capacity in

20 seconds”



Add New Dev Environment

Add New Production Environment

Add New Environment in Japan

Add 1,000 Servers

Remove 1,000 servers

Number of Instances 1,000

Instance Type M3 Extra Large

Availability Zone US-West-2b

Launch

aws.amazon.com/managementconsole

Infrastructure in Minutes Old World: Infrastructure in Weeks



Experiment Often

Fail quickly at a

low cost

More Innovation

$00’s Experiment

Infrequently

Failure is

expensive

Less Innovation

“On-premise”


Focus on business Not undifferentiated heavy IT lifting


Focus on business Not undifferentiated heavy IT lifting

We take care of…

Data centers

Power

Cooling

Cabling

Networking

Racks

Servers

Storage

Labour

…so you don’t have to…

Buy and install new hardware

Set up and configure new

software

Build new data centers


Global Reach Go global in minutes and reach a global audience


Global Reach Go global in minutes and reach a global audience

Application

Elasticity

Sunday Monday Tuesday Wednesday Thursday Friday Saturday

Typical weekly traffic to Amazon.com

November traffic to Amazon.com

November

November traffic to Amazon.com Provisioned capacity

November

November traffic to Amazon.com 76%

24%

Provisioned capacity

November

November 10th 2010 Turned off last physical web server of

Amazon.com

November 10th 2010 Turned off last physical web server of

Amazon.com

October 31st 2011 Turned off last web servers supporting

European business

November traffic to Amazon.com

November

Num

ber

of E

C2 I

nsta

nces

4/12/2008 4/14/2008 4/15/2008 4/16/2008 4/18/2008 4/19/2008 4/20/2008 4/17/2008 4/13/2008

40 servers to 5000 in 3 days

EC2 scaled to peak of 5000 instances

“Techcrunched”

Launch of Facebook modification

Steady state of ~40 instances

AWS Services

Compute Storage

AWS Global Infrastructure

Database

App Services

Deployment & Administration

Networking

Reference Model

Regions An independent collection of AWS resources in a

defined geography

A solid foundation for meeting location-dependent

privacy and compliance requirements

Global infrastructure

Compute Storage


Database

App Services


Networking

Availability Zones Designed as independent failure zones

Physically separated within a typical metropolitan

region


Compute Storage


Database

App Services


Networking

Edge Locations To deliver content to end users with lower latency

A global network of edge locations

Supports global DNS infrastructure (Route53) and

Cloud Front CDN


Compute Storage


Database

App Services


Networking

Direct Connect Dedicated connection between your IT infrastructure

and the AWS datacenters

Extend your network infrastructure and VLANs into

AWS

Networking

Compute Storage


Database

App Services


Networking

VPN Connection A Hardware VPN connection connects amazon

environment to your datacenter

Internet Protocol security (IPSec) VPN connection

Commonly used hardware supported

Internet

Networking

Compute Storage


Database

App Services


Networking

Virtual Private Cloud Private, isolated section of the AWS Cloud

Launch resources in a virtual network that you define

complete control over your virtual networking environment

Internet

Networking

Compute Storage


Database

App Services


Networking

Route 53 Highly available and scalable Domain Name System

Extremely reliable and cost effective

Feature Details

Global Supported from AWS global edge locations for fast and reliable domain name resolution

Scalable Automatically scales based upon query volumes

Latency based routing

Supports resolution of endpoints based upon latency, enabling multi-region application delivery

Integrated Integrates with other AWS services allowing Route 53 to front load balancers, S3 and EC2

Secure Integrates with IAM giving fine grained control over DNS record access

Networking

Compute Storage


Database

App Services


Networking

Vertical Scaling

From $0.02/hr

Elastic Compute Cloud (EC2) Basic unit of compute capacity

Range of CPU, memory & local disk options

13 Instance types available, from micro to cluster compute

Feature Details

Flexible Run windows or Linux distributions

Scalable Wide range of instance types from micro to cluster compute

Machine Images Configurations can be saved as machine images (AMIs) from which new instances can be created

Full control Full root or administrator rights

Secure Full firewall control via Security Groups

Monitoring Publishes metrics to Cloud Watch

Inexpensive On-demand, Reserved and Spot instance types

VM Import/Export Import and export VM images to transfer configurations in and out of EC2

Compute

Compute Storage


Database

App Services


Networking

GNM measures the savings from using AWS in terms of reduced lead times.

“It takes … less than 10 minutes to set up a new

instance in Amazon EC2 and perhaps another 20 minutes to connect to the infrastructure and build the

server type, for a total lead time of half an hour. This compares to a possible three weeks for hardware to be delivered and installed plus additional time for budget

approval.” Mike Bracken GNM’s Director of Technology Development,

Compute

Vertical Scaling

From $0.02/hr

Compute Storage


Database

App Services


Networking

Auto-scaling Automatic re-sizing of compute clusters based upon demand

Trigger auto-scaling policy

Feature Details

Control Define minimum and maximum instance pool sizes and when scaling and cool down occurs

Integrated to CloudWatch

Use metrics gathered by CloudWatch to drive scaling

Instance types Run auto scaling for on-demand instances and spot. Compatible with VPC

as-create-auto-scaling-group MyGroup

--launch-configuration MyConfig

--availability-zones eu-west-1a

--min-size 4

--max-size 200

Compute

Compute Storage


Database

App Services


Networking

Elastic Load Balancing Create highly scalable applications

Distribute load across EC2 instances in multiple

availability zones

Feature Details

Auto-scaling Automatically scales to handle request volume

Available Load balance across instances in multiple availability zones

Health checks Automatically checks health of instances and takes them in or out of service

Session stickiness Route requests to the same instance

Secure sockets layer Supports SSL offload from web and application servers with flexible cipher support

Monitoring Publishes metrics to Cloud Watch

Compute

Compute Storage


Database

App Services


Networking

S3 - Durable storage, any object 99.999999999% durability of objects

Unlimited storage of objects of any type

Up to 5TB size per object

Feature Details

Flexible object store Buckets act like drives, folder structures within

Access control Granular control over object permissions

Server-side encryption 256bit AES encryption of objects

Multi-part uploads Improved throughput & control

Object versioning Archive old objects and version new ones

Object expiry Automatically remove old objects

Access logging Full audit log of bucket/object actions

Web content hosting Serve content as web site with built in page handling

Notifications Receive notifications on key events

Import/Export Physical device import/export service

Storage

Compute Storage


Database

App Services


Networking

“Spotify needed a storage solution that could scale very quickly without incurring

long lead times for upgrades. This led us to cloud storage, and in that market, Amazon Simple Storage Service (Amazon S3) is the

most mature large-scale product.

Amazon S3 gives us confidence in our ability to expand storage quickly while also

providing high data durability.”

Emil Fredriksson, Operations Director

Elastic Block Store High performance block storage device

1GB to 1TB in size

Mount as drives to instances

Feature Details

High performance file system

Mount EBS as drives and format as required

Flexible size Volumes from 1GB to 1TB in size

Secure Private to your instances

Performance Use provisioned IOPS to get desired level of IO performance

Available Replicated within an Availability Zone

Backups Volumes can be snapshotted for point in time restore

Monitoring Detailed metrics captured via Cloud Watch

Storage

Compute Storage


Database

App Services


Networking

Glacier Low-cost storage service

Secure and durable storage for backup and archive

For data that is infrequently accessed

Feature Details

Low cost $0.01/GB/month with no up-front capital commitments

Durable Same 99.999999999% durability as S3

Flexible Store any amount of data on-demand. Eliminate the need for capacity planning

Secure Leverage AWS’ robust security platform. Control access to your data.

API REST-based API to send and receive data

Import/Export Optionally use portable storage devices to import/export mass data

Vault inventory Index for real-time view of the contents of the vault

Storage

Compute Storage


Database

App Services


Networking

Relational Database Service Database-as-a-Service

No need to install or manage database instances

Scalable and fault tolerant configurations

Feature Details

Platform support Create MySQL, SQL Server and Oracle RDBMS

Preconfigured Get started instantly with sensible default settings

Automated patching Keep your database platform up to date automatically

Backups Automatic backups and point in time recovery and full DB backups

Provisioned IOPS Specify IO throughput depending on requirements

Failover Automated failover to slave hosts in event of a failure

Replication Easily create read-replicas of your data and seamlessly replicate data across availability zones

Database

Compute Storage


Database

App Services


Networking

Amazon Relational Database Service (Amazon RDS) databases stores forum threads, site content, and project configuration data. High availability Multi-AZ database deployment to handle live game metadata and user-generated content. Enterprise-grade fault tolerance for protecting customer data. By managing time-consuming database administration tasks, Amazon RDS allows SEGA to focus on business critical applications.

Database

Compute Storage


Database

App Services


Networking

DynamoDB Provisioned throughput NoSQL database

Fast, predictable performance

Fully distributed, fault tolerant architecture

Feature Details

Provisioned throughput Dial up or down provisioned read/write capacity

Predictable performance

Average single digit millisecond latencies from SSD backed infrastructure

Strong consistency Be sure you are reading the most up to date values

Fault tolerant Data replicated across availability zones

Monitoring Integrated to Cloud Watch

Secure Integrates with AWS Identity and Access Management (IAM)

Elastic MapReduce Integrates with Elastic MapReduce for complex analytics on large datasets

Database

Compute Storage


Database

App Services


Networking

Amazon SQS

Processing

task/processing trigger

Processing results

Amazon SQS Reliable, highly scalable, queue service

for storing messages as they travel

between instances

Feature Details

Reliable Messages stored redundantly across multiple availability zones

Simple Simple APIs to send and receive messages

Scalable Unlimited number of messages

Secure Authentication of queues to ensure controlled access

Application Services

Compute Storage


Database

App Services


Networking

Task A

Task B

(Auto-scaling)

Task C

2

3

1

Feature Details

Process state Maintain application state across complex workflows in a reliable and available manner

Tracking Tracks executions and log process for audit purposes

Consistency Ensures processing tasks are executed and duplicity of events does not occur

Simple Simple Decider and Task programming model for rapid integration

Simple Workflow Reliably coordinate processing steps across

applications

Integrate AWS and non-AWS resources

Manage distributed state in complex

systems


Compute Storage


Database

App Services


Networking

Cloud Search Elastic search engine based upon

Amazon A9 search engine

Fully managed service with sophisticated

feature set

Scales automatically

Document Server

Results

Search Server

Feature Details

Auto-scaling Automatically scales based upon request volumes and data volumes

High performance In memory operation means consistently low latency for search results

Sophisticated features Support for faceting, stemming, synonyms, stop words and custom rank expressions

Low cost Elastic service, pay for what you use


Compute Storage


Database

App Services


Networking

CloudFront World-wide content distribution network

Easily distribute content to end users with low latency,

high data transfer speeds, and no commitments.

Feature Details

Fast Multiple world-wide edge locations to serve content as close to your users as possible

Integrated with other services

Works seamlessly with S3 and EC2 origin servers

Dynamic content Supports static and dynamic content from origin servers

Streaming Supports rtmp from S3 and includes support for live streaming from Adobe FMS and Microsoft Media Server

London

Paris

NY

Served from S3

/images/*

3

Served from EC2

*.php

2

Single CNAME

www.mysite.com

1


Compute Storage


Database

App Services


Networking

Elastic MapReduce Managed, elastic Hadoop cluster

Integrates with S3 & DynamoDB

Leverage Hive & Pig analytics scripts

Integrates with instance types such as spot


Feature Details

Scalable Use as many or as few compute instances running Hadoop as you want. Modify the number of instances while your job flow is running

Integrated with other services

Works seamlessly with S3 as origin and output. Integrates with DynamoDB

Comprehensive Supports languages such as Hive and Pig for defining analytics, and allows complex definitions in Cascading, Java, Ruby, Perl, Python, PHP, R, or C++

Cost effective Works with Spot instance types

Monitoring Monitor job flows from with the management console

Compute Storage


Database

App Services


Networking

Elastic Beanstalk One-click deployment from Eclipse, Visual Studio and Git

Rapid deployment of applications

All AWS resources automatically created

Feature Details

Platform support Containers for Java, .NET and PHP

Resource creation Creates load balancer, instances, auto scaling and monitoring automatically

Monitoring & Logs Integrated with Cloud Watch and consolidates server logs

Versioning Manage versions of applications and easily rollback deployments

Notifications Receive alerts on key events

Full resource access Access all underlying AWS resources as necessary

Deployment & Admin

Compute Storage


Database

App Services


Networking

Cloud Formation Automate creation of ‘stacks’ in a repeatable way

Scripting framework for AWS resource creation

Feature Details

Platform support Support for AWS resources from EC2 to IAM

Resource creation Creates AWS resources behind the scenes and reports on progress

Declarative Specify stacks in JSON format and source control your environments

Customizable Drive stack creation with parameters

Deployment & Admin

Compute Storage


Database

App Services


Networking

Identity & Access Management Granular control of user rights with AWS

Automated granting of EC2 service rights

Software Developer Kits Comprehensive support of programming models for using

AWS services

Deployment & Admin

Compute Storage


Database

App Services


Networking

+ others Simple Email Service

Simple Notification Service ElastiCache CloudWatch

Storage Gateway AWS OpsWorks

…

Introducing Amazon Redshift

Data Warehousing the AWS Way

Easily and rapidly analyze

petabytes of data

1/10 the cost of traditional data

warehouses

Automated deployment &

administration

Compatible with popular BI tools

Internal Testing: At Least 10X Faster for a Fraction of the Cost

2 billion row data set & 6 most complex

queries 32 nodes, 4.2 TB of RAM, 1.6 PB of disk

Several million dollars

Two 16 TB / 128 GB RAM nodes

$3.65 / hour

Amazon Redshift

Our Test

On-premises retail data warehouse

AWS Data Pipeline

AWS Data PipelineYour Analytics

Orchestration service for data-driven workflows

Create automated and scheduled data flows

Pre-integrated with AWS data sources

Easily connect with 3rd party & on-premises sources

Your analysis

NEW! Amazon Elastic Transcoder

#1 enterprise question Is the cloud secure for my apps and data?

Security is Our #1 Priority

People &

Procedures

Network

Security

Physical

Security

Platform

Security

ITAR

FIPS 140-2

MPAA ISO 27001

SOC 2 ISAE 3402 PCI DSS

HIPAA

FISMA Moderate

Many Customers’ Security Posture Improves In

the Cloud

“The improved computer security

includes, but is not limited to,

greater protection against

network attacks and real time

detection of system tampering.”

Earl E. Devaney, Chairman

Recovery.gov

“You basically turn yourself into a

polymorphic surface to which the

attack guy has a much tougher

time getting at. That, ultimately, is

the real key advantage to drive

security and make things much

better for us across the board.”

Gus Hunt, CTO

Central Intelligence Agency

#2 enterprise question How does the cloud work with my existing

on-premise investments?

What’s a Hybrid Cloud?

Corporate Data

Center

Corporate Data

Center

Extending your data center

Corporate Data

Center

With integrated resources

Our “Hybrid” Focus: Tools to Support Hybrid IT

Architectures

Private network connections

Integration with existing management tools

Workload migrations

Integration with existing identity & access control systems

Summary


Variable expense

Replace capital

expenditure with variable

expense

Economies of scale

Lower variable expense

than companies can

achieve themselves

Elastic capacity

No need to guess

capacity requirements

and over-provision

Speed and agility

Infrastructure in minutes

not weeks

Focus on business

Not undifferentiated

heavy IT lifting

Global Reach

Go global in minutes and

reach a global audience

aws.amazon.com

aws webcast - aws 101 - journey to the aws cloud: introduction to aws

Technology

cloud computing

instancetype m1

capacity requirements

variable expenseonpremisevs

availabilityzone euwest

instances amib232d0db

availabilityzones euwest

web serviceec2