scaling by design:aws web services patterns

30
AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015 AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015 Scaling by Design: AWS Web Services Patterns Todd M. Gagorik Solutions Architect AWS Web Services - WWPS , Amazon Web Services, Inc. or its affiliates. All rights reserved.

Upload: amazon-web-services

Post on 13-Aug-2015

385 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Scaling by Design:AWS Web Services Patterns

Todd M. GagorikSolutions Architect

AWS Web Services - WWPS

©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Page 2: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Let’s start with a demo....

Page 3: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS missionEnable businesses and developers to use web

services* to build scalable, sophisticated applications.

*what people now call “the cloud”

Page 4: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Gartner Magic Quadrant for Cloud Infrastructure as a Service, Worldwide

Gartner “Magic Quadrant for Cloud Infrastructure as a Service, Worldwide,” Lydia Leong, Douglas Toombs, Bob Gill, May 18, 2015. This Magic Quadrant graphic was published by Gartner, Inc. as part of a larger research note and should be evaluated in the context of the entire report. The Gartner report is available at http://aws.amazon.com/resources/analyst-reports/. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

Page 5: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Gartner Magic Quadrant for Cloud Infrastructure as a Service

Gartner “Magic Quadrant for Cloud Infrastructure as a Service,” Lydia Leong, Douglas Toombs, Bob Gill, Gregor Petri, Tiny Haynes, May 28, 2014. This Magic Quadrant graphic was published by Gartner, Inc. as part of a larger research note and should be evaluated in the context of the entire report. The Gartner report is available at http://aws.AWS.com/resources/analyst-reports/. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

Page 6: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

on demand}uniformpay as you go

available

Page 7: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

on demand}uniformpay as you go

available

Page 8: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Compute

Storage

SecurityScaling

Database

NetworkingMonitoring

Messaging

Workflow

DNSLoad Balancing

BackupCDN}on demanduniform

pay as you goavailable

web service API

Page 9: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

physical spacecablingpower

coolingnetworking

racksserversstorage

certificationlabor

On-premises

$0to get started

no long-term contracts

Cloud computing

VS.

Page 10: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Services overview

Page 11: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

but first...

Page 12: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Architected for government security requirementsCertifications and accreditations for workloads that matter

AWS CloudTrail and AWS Config - Call logging and configuration management for governance and compliance

• Log, review, alarm on all user actions

• Browse and query database of current and previous state of cloud resources

Page 13: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Security is a shared responsibilityCustomers refocus on systems and appsSecurity experts are a scarce resource!

Refocus your security professional on a subset of the problem

Facilities

Physical security

Compute infrastructure

Storage infrastructure

Network infrastructure

Virtualization layer (EC2)

Hardened service endpoints

Rich IAM capabilities

+ =Network configuration

Security groups

Operating system firewalls

Operating systems

Application security

Proper service configuration

AuthN & acct management

Authorization policies

Customers

More secure and

compliant systems

than any single

entity could achieve

on its own

Page 14: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Economies of scale apply to security and compliance

The customer community benefits from tough scrutiny, the world-class AWS security team, market-leading capabilities, and constant improvements

everyone’s systems and applications

Security Infrastructure

security infrastructure

requirements requirements requirements

There’s nothing better for the entire community than a tough set of customers…

Page 15: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS global infrastructure

11 AWS Regions

50+ AWS edge locations

Page 16: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS global infrastructure

Availability Zone A

Availability Zone B

Availability Zone C

EU (Ireland)

Availability Zone A

Availability Zone B

South America (Sao Paulo)

Availability Zone A

Availability Zone B

Asia Pacific (Sydney)

Availability Zone A

Availability Zone B

GovCloud (OR)

Availability Zone A

Availability Zone B

Availability Zone C

Availability Zone D

US East (VA)

Availability Zone A

Availability Zone B

US West (CA)

Availability Zone A

Availability Zone B

Asia Pacific (Singapore)

Availability Zone A

Availability Zone B

Availability Zone C

Asia Pacific (Tokyo)

Availability Zone A

Availability Zone B

Availability Zone C

US West (OR)

Customer decides where applications and data reside

U.S. regions Global regions

(This is a conceptual drawing only. The number of Availability Zones may vary.)

Availability Zone A

Availability Zone B

EU (Frankfurt)

Page 17: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS global infrastructure

Application services

Networking

Deployment and administration

DatabaseStorageCompute

Page 18: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Amazon S3

Amazon SQS

Amazon EC2

Amazon SimpleDB

Amazon EBS

Amazon CloudFront

Elastic Load Balancing

Auto Scaling

Amazon VPC

Amazon RDS

Amazon SNS

AWS IAM

Amazon Route 53

Amazon SES

AWS Elastic Beanstalk

AWS CloudFormation

Amazon ElastiCache

AWS Direct Connect

AWS GovCloud (US)

AWS Storage Gateway

Amazon DynamoDB

Amazon CloudSearch

Amazon SWF

Amazon Glacier

Amazon Redshift

AWS Data Pipeline

Amazon Elastic Transcoder

AWS OpsWorks

AWS CloudHSM

Amazon AppStream

AWS CloudTrail

Amazon WorkSpaces

Amazon Kinesis

Amazon ECS

AWS Lambda

AWS Config

AWS CodeDeploy

Amazon RDS for Aurora

AWS KMS

Amazon Cognito

Amazon WorkDocs

AWS Directory Service

Amazon Mobile Analytics

2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

Amazon WorkMail

The AWS history of innovationAWS has been continually expanding its services to support virtually any cloud workload. It now has more than 40 services.

April 9, 2015

Amazon EFS

Amazon Machine Learning

Page 19: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Architect for high availability

Page 20: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

1. Use multiple Availability Zones

Page 21: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

2. Use RDS with replicas and standby

Page 22: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

3. Use Auto Scaling groups

Page 23: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

4. Use Elastic Load Balancing

Page 24: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

5. Use Route 53 to host DNS zones

Page 25: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Three services: better together

Utilization

Latency

Metrics

Amazon CloudWatch

Elastic Load Balancing

Auto Scaling

Page 26: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Use at regional levelCombined with Auto Scaling, ELB will

balance requests and resource capacity across Availability Zones

Within Amazon VPCUse to load balance between

application tiers within an Availability Zone

Instance migrations

Easily move instances from dev environments to test environments by moving between load balancers

Leverage SLAImprove application reliability with Route 53’s SLA on requests served

Weighted routingPerform A/B analysis and staged application roll-outs by moving a

portion of traffic to new infrastructure

Control TTLs and updatesTake absolute control of DNS

updates for more decisive system updates

Scale databases without admin overhead

Choose instance size for databases and scale up over time

Add high availability from management console

Create multi-AZ deployments and read replicas. AWS takes care of the

failover and re-creation of a new standby in event of master database

loss

Elastic Load Balancing Amazon Route 53 Amazon RDS

Dynamically scale resources and control costs

Provision only the resources required with scale-up and cool-

down policies that match demand

Auto Scaling

Architect to use cloud strengths

Page 27: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

So, how did it go?

Page 28: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS CloudFormation?• Simplified provisioning for the full breadth of

AWS services• Create templates of the infrastructure and

applications you want to run on AWS• CloudFormation automatically provisions the

required AWS resources and their relationships from the templates

• Easily version control, replicate, or update the infrastructure and applications

• CloudFormation integrates with other development, CI/CD, and management tools.

Page 29: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Questions?

Page 30: Scaling by Design:AWS Web Services Patterns

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Thank You.This presentation will be loaded to SlideShare the week following the Symposium.

http://www.slideshare.net/AWSWebServices

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015