microservices architecture for digital platforms using serverless aws

Microservices Architecturefor Digital Platforms using Serverless AWS

http://www.meetup.com/AWSnewyork/events/226419743

Eugene Istrati, Technology [email protected]



mailto:[email protected]

http://www.mitocgroup.com/

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Eugene Istrati, Partner @ Mitoc Group

Microservices Architecturefor Digital Platforms with AWS Lambda,

Amazon CloudFront, and Amazon DynamoDB

[email protected]

October 2015

ARC201


Digital Platforms Challenges

Note: Credits and thanks are listed at the end of the presentation

…

…

…

Average cost of downtime• $500K - $1M / hour (IDC, Dec 2014)• $140K - $540K / hour (Garner, July 2014)• $474K / hour (Ponemon Inst., Dec 2013)

Most commonly reported consequences

• Damage to reputation (38%)• Increase in customer churn (37%)• Damage to credit rating (28%)• Increase to insurance premiums (26%)

Digital Platforms Challenges

Outage

Degradation

No impact

0% 10% 20% 30% 40% 50% 60% 70%

27%

60%

13%

Impact of DoS/DDoS Attack


Digital Enterprise End-to-end Platform

About

Eugene Istrati

• [email protected]

• Partner @ Mitoc Group Inc

• 15+ years in IT; 7+ years on AWS

• AWS Certified Solutions Architect (re-certified at re:Invent 2015)

• Companies: Hearst, Amazon, GrubHub, Tenaris (Europe)

Mitoc Group Inc

• www.mitocgroup.com

• Web Development Studio

• AWS Technology Partner

• Focusing on enterprise applications and platforms

• Working with customers from media and entertainment industry



http://www.mitocgroup.com/

Agenda• Web Apps Hosting on AWS

• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS

• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg

• Q&A + Next Steps

http://www.deep.mg/

Demo: todo.deep.mg

• Inspired from open source• www.todomvc.com

• Go to the GitHub repository• github.com/MitocGroup/deep

-microservices-todo-app

• Follow the steps from Getting Started to build and deploy

• todo.deep.com

http://www.deep.mg/

http://www.todomvc.com/

http://reinvent.awsevents.com/


http://www.awsreinvent2015.com/





http://www.deep.mg/

Web Apps Hosting / Reference Architecture

Availability Zone A Availability Zone B

Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers

• Scales in minutes



Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers

• Scales in minutes• Huge challenge for breaking

news, viral content, or attacks



Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers



• Reduced operational complexity



Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers



• Reduced operational complexity• Requires DevOps with experience



Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers




• Flexible choice of technology



Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers




• Flexible choice of technology• Requires devs with rich skill set



Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers





• Cost-effective



Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers





• Cost-effective• Over-provisioning and over-paying

AWS re:Invent 2014


AWS Summit NY 2015


Web Apps Hosting … Reinvented


Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers

S3 bucket

CloudFrontdistributio

n

Web Tier

CognitoIdentity DB Tier

SQS DynamoDB

LambdaCloudFrontlogs

API Gateway

www.example.comstatic.example.com

App Tier

AWS Region RDS Aurora





http://www.deep.mg/

What does “serverless” mean?

Not involving a server; composed only of clients.http://www.wordsense.eu/serverless

Serverless doesn’t mean servers are no longer involved. It simply means that developers no longer have to think "that much" about them. Computing resources get used as services without having to manage around physical

capacities or limits.https://www.quora.com/What-is-Serverless-Computing

http://www.wordsense.eu/serverless

http://www.wordsense.eu/serverless

https://www.quora.com/What-is-Serverless-Computing

https://www.quora.com/What-is-Serverless-Computing

Serverless vs. Reference


Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers

S3 bucket

CloudFrontdistributio

n

Web Tier


SQS DynamoDB


API Gateway


App Tier

AWS Region RDS Aurora

vs

Serverless Architecture – Web Tier

S3 bucket

CloudFrontdistribution

Web Tier

CognitoIdentity

CloudFrontlogs



Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

Serverless Architecture – Web Tier

S3 bucket


Web Tier

CognitoIdentity

CloudFrontlogs


• Static Assets• Same as in reference architecture• css, js, docs, images, videos + html

• Dynamic Functionality• Use JS framework (e.g. Angular)• SEO-friendly (Custom Error

Response + HTML5 History API)

• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance

Serverless Architecture – App Tier

CognitoIdentity

SQS

Lambda

API Gateway

App Tier


Auto Scaling Group

appservers

appservers

CognitoIdentity

SQS

Lambda

API Gateway

App Tier • Accelerated Backend• Write node.js functions and load

into Lambda• Power up Lambda with RESTful

endpoints on API Gateway• Cache, throttle, meter, version, etc.



• Accelerated Backend• Write node.js functions and load

into Lambda• Power up Lambda with RESTful

endpoints on API Gateway• Cache, throttle, meter, version, etc.



CognitoIdentity

SQS

Lambda

API Gateway

App Tier


Serverless Architecture – DB TierDB Tier

SQS DynamoDB

RDS Aurora

DB Tier

SQS DynamoDB

RDS Aurora

Serverless Architecture – DB Tier• First choice – DynamoDB + SQS

• Schema-free• Scale only reads and writes


• Next choice – RDS Aurora• Relational• MySQL-like approach, but 5x better

Serverless Architecture – DB Tier• First choice – DynamoDB + SQS

• Schema-free• Scale only reads and writes


• Next choice – RDS Aurora• Relational• MySQL-like approach, but 5x better

DB Tier

SQS DynamoDB

RDS Aurora





http://www.deep.mg/

Demo: Setup Serverless AWS1. Security - Create IAM roles2. Front-end - Create S3 bucket - Enable static website hosting - Add bucket policy - Create CloudFront distribution3. Back-end - Create Lambda function - Upload code into Lambda - Create API Gateway endpoint4. Database - Create DynamoDB table5. Code - Load code into S3 bucket - View via CloudFront (S3 as backup)

S3 bucket


Web Tier


SQS DynamoDB


API Gateway


App Tier

AWS RegionRDS Aurora

Lessons Learned

• Serverless approach is challengingly awesome

• Frontend is restricted to JS (and JS Frameworks)• Backend is restricted to Python, Java or JS (for now)• SOA and APIs are required by design

Lessons Learned



• Services must be as small as possible

• AWS Lambda constrains• Browser limitations (on mobile devices)

Lessons Learned



• Services must be as small as possible => microservices

• AWS Lambda constrains• Browser limitations (on mobile devices)





http://www.deep.mg/

Google Trends: Microservices

What does “microservices” mean?

In computing, microservices is a software architecture style in which complex applications are composed of small, independent processes communicating with each other using language-agnostic APIs. These services are small, highly

decoupled and focus on doing a small task, facilitating a modular approach to system-

building.https://en.wikipedia.org/wiki/Microservices

https://en.wikipedia.org/wiki/Microservices

https://en.wikipedia.org/wiki/Microservices

Microservices Architecture

Keynote GOTO Conference: Microservices by Martin Fowler - https://www.youtube.com/watch?v=wgdBVIX9ifA

State of the Art in Microservices by Adrian Cockcroft - https://www.youtube.com/watch?v=nMTaS07i3jk

Sam Newman atThoughtWorksLondon 2015:Deploying and OperatingMicroservices - https://www.youtube.com/watch?v=OTSlg7_y3bA

https://www.youtube.com/watch?v=wgdBVIX9ifA


https://www.youtube.com/watch?v=nMTaS07i3jk


https://www.youtube.com/watch?v=CriDUYtfrjs



Speeding Up Digital Platforms on AWS

Deploy in weeksLive for years

Deploy in minutesLive for weeks

Deploy in secondsLive for minutes/hours

Deploy in millisecondsLive for seconds

On-Premises Amazon EC2 Amazon ECS AWS Lambda





http://www.deep.mg/

Powered by AWS Lambda

AWS Lambda in Action

• AWS Lambda scaled with no effort for us

• 70M+ invocations / day• 10K+ concurrent invocations / second



Auto Scaling Group

Auto Scaling Group

www.example.com

static.example.com

webservers

webservers

appservers

appservers





• Cost-effective• Over-provisioning and over-paying

AWS Lambda in Action

• AWS Lambda scaled with no effort for us

• 70M+ invocations / day• 10K+ concurrent invocations / second

• AWS Lambda made it really easy for us

• Comes pre-scaled and charges in 100ms blocks• No under- or over-provisioning (by design)• Developers love it (especially frontend JS folks)• DevOps still in play mode (learning to build ops code)





http://www.deep.mg/

Tips and Tricks

• AWS Lambda is continuously evolving

• Set up alarms for all 4 Lambda metrics in Amazon CloudWatch• Avoid S3 throttling by integrating S3 => SNS => Lambda• Beware of potential infinite loops

Tips and Tricks

• AWS Lambda is continuously evolving

• Set up alarms for all 4 Lambda metrics in Amazon CloudWatch• Avoid S3 throttling by integrating S3 => SNS => Lambda• Beware of potential infinite loops

• Microservices are game changers

• The shorter TTL, the more secure it becomes• First, build a service or a feature• Next, break it down into microservices

Tips and Tricks – From Monolithic Approach

applicationsdevelopers

Build Test Release

development cycle

Tips and Tricks – To Microservices Approach

applicationsdevelopers

Build Test Release

development cycle

Build Test Release

Build Test Release

Build Test Release

Build Test Release

Build Test Release

Build Test Release





http://www.deep.mg/

Demo: todo.deep.mg

• Inspired from open source• www.todomvc.com

• Go to the GitHub repository• github.com/MitocGroup/deep

-microservices-todo-app

• Follow the steps from Getting Started to build and deploy

• todo.deep.mg

http://www.deep.mg/

http://www.todomvc.com/



http://www.awsreinvent2015.com/

DEEP Frameworkhttps://github.com/MitocGroup/deep-framework

“DEEP Framework is a serverless web framework, core component of the Platform-as-a-Service that abstracts web apps and web services from specific cloud providers. This

framework enables developers build cloud-native applications or platforms using microservices architecture in a completely

serverless approach”

https://github.com/MitocGroup/deep-framework

https://github.com/MitocGroup/deep-framework





http://www.deep.mg/

Q&A + Next Steps

github.com/MitocGroup medium.com/@[email protected]

Thanks:


Jag Singh from AWS NYC Meetup

Hosting Team from AWS Loft

https://github.com/MitocGroup

https://github.com/MitocGroup





Credits and Thanks• Slide 3: Digital Platforms Challenges

• http://www.buzzfeed.com/daozers/what-its-like-to-work-on-buzzfeeds-tech-team-during-record-t#.axR6WG9Yr• http://www.dailydot.com/crime/new-york-magazine-ddos-bill-cosby-cover/• http://www.cio.in/topstory/flipkart%E2%80%99s-cto-explains-the-xiaome-launch-outage

• Slide 4: Digital Platforms Challenges• http://www.slideshare.net/Radware/radware-cmg2014-tammyevertsslowtimevsdowntime• http://www.statuscast.com/application-downtime-according-to-idc-gartner-and-others• https://press.kaspersky.com/files/2014/11/B2B-International-2014-Survey-DDoS-Summary-Report.pdf

• Slide 19: AWS re:Invent 2014• https://venturebeat.com/wp-content/uploads/2014/11/aws-reinvent-lambda.png

• Slide 20: AWS Summit NY 2015• https://d0.awsstatic.com/events/aws-hosted-events/2015/AWS-Global-Summit-Series/new-york/press-room/introducing-amazon-api-

gateway.jpg

• Slide 46: Microservices Architecture• https://www.youtube.com/watch?v=nMTaS07i3jk - State of the Art in Microservices by Adrian Cockcroft• https://www.youtube.com/watch?v=wgdBVIX9ifA - Microservices by Martin Fowler• https://www.youtube.com/watch?v=OTSlg7_y3bA - Deploying and Operating Microservices by Sam Newman

http://www.buzzfeed.com/daozers/what-its-like-to-work-on-buzzfeeds-tech-team-during-record-t%23.axR6WG9Yr



http://www.dailydot.com/crime/new-york-magazine-ddos-bill-cosby-cover/



http://www.cio.in/topstory/flipkart%E2%80%99s-cto-explains-the-xiaome-launch-outage

http://www.cio.in/topstory/flipkart%E2%80%99s-cto-explains-the-xiaome-launch-outage

http://www.slideshare.net/Radware/radware-cmg2014-tammyevertsslowtimevsdowntime



http://www.statuscast.com/application-downtime-according-to-idc-gartner-and-others



https://press.kaspersky.com/files/2014/11/B2B-International-2014-Survey-DDoS-Summary-Report.pdf



https://venturebeat.com/wp-content/uploads/2014/11/aws-reinvent-lambda.png

https://venturebeat.com/wp-content/uploads/2014/11/aws-reinvent-lambda.png

https://d0.awsstatic.com/events/aws-hosted-events/2015/AWS-Global-Summit-Series/new-york/press-room/introducing-amazon-api-gateway.jpg

https://d0.awsstatic.com/events/aws-hosted-events/2015/AWS-Global-Summit-Series/new-york/press-room/introducing-amazon-api-gateway.jpg







microservices architecture for digital platforms using serverless aws

Software