digital workloads on aws

49
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Chris So, Business Development Manager 17 June New Digital Workloads on AWS Amazon.com, 17, ZALORA and Capital One

Upload: amazon-web-services

Post on 15-Apr-2017

305 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Digital Workloads on AWS

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Chris So, Business Development Manager

17 June

New Digital Workloads on AWS Amazon.com, 17,

ZALORA and Capital One

Page 2: Digital Workloads on AWS

CREDIBLY INNOVATE PHOTO HERE

Case sharing - Innovation TODAY’S AGENDA

1.  Amazon.com – Innovation, Omni Channels

2.  17 – Social Media and Live Streaming

3.  ZALORA – eCommerce 4.  Capital One – Alexa Skill

Get out of bed

Go to AWS event

Learn something

Go back to bed

Page 3: Digital Workloads on AWS

Digital Disruption

Page 4: Digital Workloads on AWS

Keys to Digital Transformation Lean Enterprise

•  Customer Centric •  Minimum Viable Products •  Metrics-driven culture •  Low-cost experimentation •  Failure-embracing culture

IT Enablers

•  Microservice architecture •  DevOps •  Agile – Scrum •  CI/CD •  Blue-Green and A-B groups •  Machine Learning •  Internet of Things (IoT) •  Mobile •  Big Analytics

Enabled By

CLOUD

Page 5: Digital Workloads on AWS

Can’t Digital Transformation occur on Premise?

•  Global economies of scale •  Immediate access to latest technology •  Improved security and risk visibility •  Open – access to industry leading solutions •  Elasticity – capacity alignment •  Improved resiliency – design for failure •  Lower cost of experimentation and innovation •  Quicker global expansion •  Easier to standardize and automate •  Easier to link the supply chain - ecosystems

CLOUD

Page 6: Digital Workloads on AWS

= 50 million deployments a year

Thousands of teams × Microservice architecture

× Continuous delivery × Multiple environments

Page 7: Digital Workloads on AWS

~11.6s

Mean time between deployments (weekday)

~1,079

Max number of deployments in a

single hour

~10,000

Mean number of hosts

simultaneously receiving a deployment

~30,000

Max number of hosts

simultaneously receiving a deployment

DEPLOYMENTS AT AMAZON.COM

Page 8: Digital Workloads on AWS

Deploying More Frequently Lowers Risk

Smaller Effort “Minimized Risk”

Frequent Release Events: “Agile Methodology”

Time

Cha

nge

Rare Release Events: “Waterfall Methodology”

Larger Effort “Increased Risk”

Time

Cha

nge

Page 9: Digital Workloads on AWS

Monolith development lifecycle

developers

release test build

delivery pipeline app

Page 10: Digital Workloads on AWS

Service-Oriented Architecture (SOA) Single-purpose primititves Connect only through APIs “Microservices”

Page 11: Digital Workloads on AWS

Microservice development lifecycle

developers delivery pipelines services

release test build

release test build

release test build

release test build

release test build

release test build

Page 12: Digital Workloads on AWS

Two-pizza teams Full ownership Full accountability Aligned incentives “DevOps”

Page 13: Digital Workloads on AWS

It’s Easy for Anyone to Start an Ecommerce Business

This Leads Eventually to Omni Channel Offerings

O2O < > O2O

Page 14: Digital Workloads on AWS

FromThis…

? … to this

Page 15: Digital Workloads on AWS

?

FromThis…

Page 16: Digital Workloads on AWS

… to this

Page 17: Digital Workloads on AWS
Page 18: Digital Workloads on AWS

This is by TW Company M2comm

Cloud-based ERP integration

Real-Time Data Push Custom low-power RF

Low Battery Consumption e-Ink displays

Page 19: Digital Workloads on AWS

Your Life’s Moment 17 –

Page 20: Digital Workloads on AWS

25

million

streams watched/month

6 million

MAU

12 million

Downloads

Page 21: Digital Workloads on AWS

What’s the need of 17 architecture?

Scalable Available Personalized

Grow with the users Always there for users Understand the users

Page 22: Digital Workloads on AWS

The journey of our architecture

Page 23: Digital Workloads on AWS

User 100 – Launch ASAP

Page 24: Digital Workloads on AWS

First 100 users

Don’t even think about scalability Launch and verify the idea ASAP

AmazonRoute 53

Amazon EC2 MongoDB

Request

Page 25: Digital Workloads on AWS

User 100,000 – CDN and Cache

Page 26: Digital Workloads on AWS

User 100,000

Cache the database Use CDN to deliver the live streaming content

CDN AmazonRoute 53

Amazon EC2

MongoDB Request

Amazon ElastiCache

Page 27: Digital Workloads on AWS

User 1 million – Design for failure

Page 28: Digital Workloads on AWS

Design for failure

Failures are the norm, not exceptions

Suppose the rate of failure of one machine is once every 10 years (120 month)

The mean time of failure (MTTF) is 1 month if you have 120 servers

Page 29: Digital Workloads on AWS

Always assume that things will go WRONG, and design for it

Page 30: Digital Workloads on AWS

Design for failure

AmazonRoute 53

Amazon EC2

MongoDB

Amazon EC2

Amazon EC2

MongoDB

MongoDB

Elastic Load Balancing

Multi-AZ Multi-AZ

Mix spot and on-demand to save the cost

TIP: Use C3 instance for spot

Amazon ElastiCache

Page 31: Digital Workloads on AWS

User 5 million – Build loosely coupled systems

Our system was a monolithic system consists of

API Server Streaming Server Worker

Application Server

Page 32: Digital Workloads on AWS

API Server Streaming Server Worker

Application Server

We discovered a bug the API server didn’t send requests to worker

Page 33: Digital Workloads on AWS

API Server Streaming Server Worker

Application Server

After fixed, the overloaded worker crashed the whole server

Page 34: Digital Workloads on AWS

Split the service, so that it’s easier to scale, and fail independently

Page 35: Digital Workloads on AWS

Build loosely coupled systems

API Server

Streaming Server

Worker

API Server

API Server

Streaming Server

Worker

Worker

AmazonSQS

API Cluster Worker Cluster Streaming Cluster

Page 36: Digital Workloads on AWS

Monitor for each service, and design for failure

Page 37: Digital Workloads on AWS
Page 38: Digital Workloads on AWS

4M customers

7M visits weekly

11M mobile app download

2M orders shipped in Q4 2015

Page 39: Digital Workloads on AWS

Before •  Platform fully hosted in a physical

DC in Hong Kong •  Average capacity utilization 10% •  Living dangerously during peak •  Lead-time for adding peak

capacity – 10 days

ZALORA cloud journey

After •  “Double 12”: China's Cyber

Monday 6X •  Redshift for click stream analysis •  Live migration in 30 days for all 8

sites •  Average 40% utilization; •  4X capacity increase in 15 mins •  1-2s faster page loads in ID & PH,

~10% better CR

Page 40: Digital Workloads on AWS

6X

6X ?

visits

resources

Page 41: Digital Workloads on AWS

Amazon Route 53

User Amazon

CloudFront

Magento

RDS Master (Multi-AZ)

Elastic Load

Balancer

RDS Slave (Multi-AZ)

Magento

Availability Zone Availability Zone

Backup Storage

Static website *.html, *.js *.css

*.jpg *.mp4

S3

Redis Read Replica

Redis Master

RDS Read Replica

RDS Read Replica

Magento Magento

Magento Admin

Private subnet Office

VPN

A Scalable Platform

Page 42: Digital Workloads on AWS

Stock Exchange NASDAQ and NYSE

1000+ Skills

Page 43: Digital Workloads on AWS

Alexa Skills Kit architecture

Amazon Alexa

service

Developer’s application

service

Amazon’s Developer

Portal Application, intents, sample data, developer service URL endpoint

Configured through portal

User intents and arguments are sent to the developer service

GUI cards are rendered in the Amazon Alexa app

User audio is streamed to the service

Audio responses are rendered on-device

Text response and/or GUI card data is returned

Page 44: Digital Workloads on AWS

Alexa is always learning. Alexa gets smarter by learning new skills. Developers can create new skills for Alexa.

Alexa is ALWAYS LEARNING

Page 45: Digital Workloads on AWS

Capital One Skill

Page 46: Digital Workloads on AWS

Capital One’s Alexa approach June: A few developers buy Echos

July: Full day tech offsite & side of desk project kickoff

August: Rapid prototyping and expanding Capital One skill

Goal: Pair Alexa with the Capital One app and

allow users to get their credit card balance

March 2016: Official Launch

Page 47: Digital Workloads on AWS

Capital One skills focus

Read-only information Transactional skills Experimenting

•  Default accounts (credit card, bank, loans)

•  Account balances •  Bill due date •  Last payment •  Last transactions •  Interest rate

•  Pay bill(s) •  Transfer $

•  App usage Patterns •  O-Auth •  Customer service/

support •  Customer

acquisition •  Alexa adoption •  Alexa evolution

Skill development segmented into three priority buckets

Page 48: Digital Workloads on AWS

Responding requires a new model

Focus on differentiating your company

Innovate at start-up like speed

Reduce risk

Page 49: Digital Workloads on AWS

Thank You