aws compute services state of the union (cpn202) | aws re:invent 2013

38
© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. Amazon EC2 “State of the Union" Peter DeSantis, VP, AWS Compute Services November 14, 2013

Upload: amazon-web-services

Post on 12-Jan-2015

785 views

Category:

Technology


5 download

DESCRIPTION

In this session, Peter De Santis, VP of Compute Services will provide an overview of the key priorities for Amazon Elastic Compute Cloud (Amazon EC2). In this session, you will hear about some of the most innovative ways in which customers are using Amazon EC2, learn more about key capabilities launched over the past year, and gain insights into the near term roadmap and priorities.

TRANSCRIPT

Page 1: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

Amazon EC2 “State of the Union"

Peter DeSantis, VP, AWS Compute Services

November 14, 2013

Page 2: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Seven years ago …

Page 3: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

http://aws.typepad.com/aws/2006/08/amazon_ec2_beta.html

Page 4: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Amazon EC2 – Seven years ago

• Single instance family and size – m1.small (1 vCPU, 1.7 GiB RAM, 160 GB storage)

• Linux only

• On Demand pricing only

• No AWS Management Console

• No EBS

• No Elastic IPs

• No VPC

• No Auto Scaling

• No load balancing

Amazon EC2

Page 5: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Since then

• Many new families and sizes – M1, M2, C1, M3, CC1, CC2, CG1, G2, CR1, HS1, HI1, T1

• Reserved Instances and Spot Instances

• Windows (and Enterprise Linux)

• Auto Scaling

• VPC

• Elastic IPs

• Performance, security, manageability, and

scalability improvements

Elastic

Load

Balancing

Management

Console

Page 6: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Amazon EC2 is designed to help you …

Simplify and automate dev, test

and production operations

Scale as required

Improve resiliency

Run applications securely

Run any application

Reduce your costs

Page 7: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

How do we achieve these goals?

Simplify with Automation APIs for everything Scale

Spin up and down as needed

Save costs with Spot pricing

Automatically respond to demand Improve Resilience

Multiple regions & Availability Zones

Auto Scaling, Elastic Load Balancing, etc. automates

AMI copy runs across regions

Page 8: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

How do we achieve these goals?

Run securely VPC

Resource-based permissions

Run Any Application Multiple instance types/sizes

Many AMIs and operating systems

Lower Costs Pay for what you use

Turn CapEx into Opex

Reserved Instances

Spot Instances

Page 9: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Collects operational and

performance metrics for 15

AWS services.

Get stats, graphs, email

alerts, and Amazon SQS or

http notifications. Amazon CloudWatch

Page 10: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Amazon CloudWatch – Improved Metrics Browsing

Search through all of your CloudWatch

metrics in seconds

Page 11: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Elastic Load Balancing

Elastic Load Balancing

Automatically distributes incoming

traffic across EC2 instances (within one AZ or multiple AZs)

Detects EC2 health, and routes

traffic appropriately

Manages availability and scalability

as a service

Page 12: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Elastic Load Balancing

Amazon Route 53 health checks Use Route 53’s health checking and DNS failover

features for applications running behind a load balancer

Increased redundancy and availability

Cross-zone load balancing Improved application availability across AZs

Page 13: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Amazon VPC

Egress filtering on security groups

Changing SG membership on the fly on running instances

Multiple IPs per instance

Multiple network interfaces per instances

Private IPs only

Many other new features are VPC only

Page 14: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Virtual Private Clouds for Everyone • The power of Amazon VPC and

the simplicity of Amazon EC2

• New customers in most regions launch instances into a default VPC

• Default VPC – One default subnet per Availability

Zone

– A default route table, preconfigured to send traffic from the default subnets to the Internet

– An Internet gateway to allow traffic to flow to and from the Internet

Page 15: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Resource-level Permissions

• Control which users are allowed to take specific actions, e.g., run, stop, reboot, on which specific resources

• Can use specific resource IDs or use tags to control access

• Coming soon: ability to tag on run

• Enforced at the API level

• Work with any IAM principal type – Use these permissions in combination with identity federation tokens, MFA-

protected access, and all of the other tools that IAM provides.

Page 16: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

New Instances and Instance Features

• New instances give you access to the latest

technologies, e.g. Intel Xeon E5 (Ivy Bridge) and

the latest graphics capabilities

• Continue to drive up performance, improving

price-performance, and enabling new use cases

Page 17: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

In the past 18 months

• HI1 instances – 120,000 random read IOPS on SSDs

• M3 instances – Next generation general purpose instances

• HS1 instances – 48 TB of storage per instance for petabyte scale data warehouses and Hadoop clusters

• CR1 instances – 244 GiB of memory and Intel Xeon E5 2670 (Sandy Bridge) CPUs for memory-intensive computing

• EBS-optimized instances – Dedicated network throughput to Amazon EBS for high storage performance

Page 18: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Just announced: G2 instances

• First Amazon EC2 instance that supports graphics

• Targeted towards remote graphics, application streaming, and scientific computing

• Specifications (g2.2xlarge instances) – 1 NVIDIA GK104 GPU (Kepler)

– 2.6 GHz Intel Xeon E5-2670 (Sandy Bridge) CPU

– 8 vCPUs, 15 GiB of RAM

– 60GB SSD storage

– EBS-Optimized up to 1Gbps

– 64-bit, HVM Only

Page 19: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Customer Demo

• Medical Imaging product from Calgary Scientific

- Resolution MD

Page 20: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Just announced: C3 instances

• Next generation compute-optimized instances

• Deliver fast compute power - 2.8 GHz Intel Xeon

E5-2680v2 (Ivy Bridge) processors

• SSD-based instance storage

• Enhanced Networking – More on this later

Page 21: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

C3 Instance Specifications

Page 22: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Top 500 Result • Cores: 26,496 (1656 instances)

• 484.18 tflops

• ~81% efficiency

• #56 in June Top500

• Cost: $3,974.40 per hour

• June Top500 fastest Ethernet based x86 cluster

• #49 in June Top500

• 42,848 cores (60% more cores)

• 545.5 tflops (13% more performance)

• ~51% efficiency

Page 23: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Not just for huge clusters

• Cores: 8192 (512 instances)

• 163.9 tflops

• Cost: $1228.8 per hour

This cluster would have been in the top 250

clusters in the June Top500.

Page 24: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Coming soon: I2 instances

• Next generation High I/O instances

• More instance sizes

• More IOPS – 350,000+ random read IOPS (4k)

– 320,000+ random write IOPS (4k)

• More memory

• Enhanced networking

Page 25: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

I2 Instance Specifications

Page 26: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Enhanced networking

• Currently supported on C3 and I2 instances

• Requires HVM and VPC

• Enables very high PPS performance, lower

latency, and low jitter networking

Page 27: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Improved PPS performance

cc2.8xlarge c3.8xlarge c3.8xlarge (enhanced)

Page 28: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Low jitter network performance

0

20

40

60

80

100

120

140

160

180

200

220

240

260

280

Latency(microseconds)

P50

P90

P99.9

P100

Page 29: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Reserved Instance Fundamentals

Save up to 65% off on-demand prices

Pay upfront to secure discounts over the term of the

Reserved Instance

Reserved Instance Purchase Parameters 1 or 3 year terms

Light, medium or heavy utilization

Ideal for Securing savings for predictable workloads

Capacity reservations to assure capacity is available for you when you need it

Page 30: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Improving Reserved Instance Flexibility

Page 31: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Amazon EC2 Usage Reports (Coming Soon)

• Two new interactive reports which provide visibility

into historical EC2 instance usage and spending.

Filter, group and scope data as needed. – Instance Usage Report – hourly, daily or monthly grain usage and

cost data for EC2 instances which can be easily filtered and

grouped on availability zone, instance type, consolidated billing

account, purchase option and others.

– Reserved Instance Utilization Report – Contains the calculation

of hourly and total cost, savings vs. on demand, and average

utilization for already purchased Reserved Instances.

Page 32: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Instance Usage Report

Page 33: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013
Page 34: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Updated AWS Management Console

• Focus on improved usability and discoverability

• New look and feel

Page 35: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

AWS Marketplace Integration

Browse, search, discover

and launch thousand of AWS

Marketplace AMIs directly

from within the Amazon EC2

console.

Page 36: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Other Amazon EC2 Console Improvements

Choose the instance

type most suitable for

your use case using the

new grouping and

instance specifications.

Easily tag your

resources with auto-

complete as you type

into the field.

Use existing security

group rules to create a

new one without starting

from scratch.

You can now search for

EBS volume when you

add storage as part of an

instance launch.

Page 37: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Q&Antil

2:30PMp.m. Until 2:30PM

Page 38: AWS Compute Services State of the Union (CPN202) | AWS re:Invent 2013

Please give us your feedback on this

presentation

As a thank you, we will select prize

winners daily for completed surveys!

CPN202