to microservices and beyond

© Copyright 2015 Pivotal. All rights reserved.© Copyright 2015 Pivotal. All rights reserved.

To Microservices and Beyond!SV Microservices/Cloud Native Meetup May 13, 2015

1

Matt Stine (@mstine) Principal Engineer and Senior Product Manager

© Copyright 2015 Pivotal. All rights reserved. 2

IT SEEMS THERE’S SOME HYPE…

M!CR0S3RV!C3$!!!!!


https://twitter.com/mstine/status/557763539101032448

© Copyright 2015 Pivotal. All rights reserved.

DEFINE: Microservice

4

Loosely coupled service oriented architecture with bounded contexts

Adrian Cockcroft Technology Fellow, Battery Ventures Former Netflix Chief Cloud Architect


DEFINE: Microservice

5

Loosely coupled service oriented architecture with bounded contexts

If every service has to be updated in concert, it’s not loosely coupled!

If you have to know about surrounding services you don’t have a bounded context.


Not Monoliths

6

Relational Database

Data Access

Service

HTML JavaScript MVC

Service

Monolithic ApplicationBrowser


Not Traditional (ESB-centric) SOA

Enterprise Service Bus

Service Service Service Service

Service Service Service Service

UI UI


But Microservices!

From: http://www.slideshare.net/adriancockcroft/goto-berlin


But why?


Issues We’ll Confront•Microservices are not an inherently superior architecture.

•We’re still building big systems from smaller things.

• Just like Docker won’t save the world, neither will microservices. They’re not free.

• You absolutely cannot forget about data.

• Let’s begin!


Not an end in themselves…It’s about Continuous Delivery!


What is Continuous Delivery?

12

$Busin

ess

Devel

opm

ent

QA

Ope

ratio

nsCu

stom

er


What is Continuous Delivery?

13

$


Keep the Wheel Spinning!

Design Develop

Test

Customer Feedback Customer

Delivery

Analytics


Prod Release #1

Prod Release #2

Prod Release #3

Agile Development

Waterfall Organization!


Silo Delivery

16

Project Mgmt UX Dev QA DBA Sys

AdminNet

AdminStorage Admin

Adapted from: http://www.slideshare.net/adriancockcroft/goto-berlin

MONOLITHIC DELIVERY


Continuous Delivery

17

Product Mgr UX Dev QA DBA Sys

AdminNet

AdminStorage Admin

BUSINESS CAPABILITY TEAMS USING MICROSERVICES

PLATFORM OPERATIONS TEAM



Continuous Delivery

18

Product Mgr UX Dev QA DBA Sys

AdminNet

AdminStorage Admin

BUSINESS CAPABILITY TEAMS USING MICROSERVICES

PLATFORM OPERATIONS TEAM


Self Service

API


INVENTORY

Prod Release

Prod Release

Prod Release

CATALOG

Prod Release

Prod Release

Prod Release

REVIEWS

Prod Release

Prod Release

Prod Release

SHIPPING

Prod Release

Prod Release

Prod Release


Microservices Enabling Continuous Delivery•Decoupling Capabilities -> Decoupling Change Cycles

• Product Ownership: Tip to Tail

•We Build and Operate What We Understand BEST

•We Collaborate via API Contracts

•Microservice to Microservice

•Microservice to Platform

https://github.com/realestate-com-au/pact


Systems over ServicesComposition over Components


Microframeworks for Microservices

22

Spring Boot http://projects.spring.io/spring-boot

Dropwizard http://dropwizard.io

http://12factor.net


It can get pretty small…

23

@RestController class ThisWillActuallyRun { @RequestMapping("/") String home() { "Hello World!" } }


With Spring Data REST!

24

http://projects.spring.io/spring-data-rest

@Entity @Table(name = "city") public class City implements Serializable { ! @Id @GeneratedValue private Long id; ! @Column(nullable = false) private String name; ! @Column(nullable = false) private String county; !//... !}



25


@RepositoryRestResource(collectionResourceRel = "cities", path = "cities") public interface CityRepository extends PagingAndSortingRepository<City, Long> {}

@SpringBootApplication @EnableJpaRepositories @Import(RepositoryRestMvcConfiguration.class) public class Application { ! public static void main(String[] args) { SpringApplication.run(Application.class, args); } }



26


{ "_links" : { "next" : { "href" : "http://localhost:8080/cities?page=1&size=20" }, "self" : { "href" : "http://localhost:8080/cities{?page,size,sort}", "templated" : true } }, "_embedded" : { "cities" : [ { "name" : "HOLTSVILLE", "county" : "SUFFOLK", "stateCode" : "NY", "postalCode" : "00501", "latitude" : "+40.922326", "longitude" : "-072.637078",


But No Microservice is an Island…

27


Example Distributed System: Minified

28


Some emergent challenges of microservices systems…

•Distributed/Versioned Configuration

• Service Registration/Discovery

• Routing/Load Balancing

• Fault Tolerance (Circuit Breakers!)


Example: Coordination Boiler Plate

30


• Eureka

•Hystrix + Turbine

• Ribbon

• Feign

• Zuul

http://netflix.github.io


http://projects.spring.io/spring-cloud

@SpringCloudOSS


Example: Spring Cloud + Netflix OSS

33


Config Server


Config Server + Cloud Bus


Running a Config Server

36

@SpringBootApplication @EnableConfigServer public class ConfigServerApplication { ! public static void main(String[] args) { SpringApplication.run(ConfigServerApplication.class, args); } !}


Service Registration/Discovery


Running a Eureka Server

38

@SpringBootApplication @EnableEurekaServer public class EurekaApplication { ! public static void main(String[] args) { SpringApplication.run(EurekaApplication.class, args); } !}



39

@SpringBootApplication @EnableCircuitBreaker @EnableDiscoveryClient public class CustomerApp extends RepositoryRestMvcConfiguration { @Override protected void configureRepositoryRestConfiguration(RepositoryRestConfiguration config) { config.exposeIdsFor(Customer.class); } ! public static void main(String[] args) { SpringApplication.run(CustomerApp.class, args); } !}



40


Fault Tolerance - Circuit Breakers

41


Fault Tolerance - Circuit Breakers

42

@SpringBootApplication @EnableCircuitBreaker @EnableDiscoveryClient public class CustomerApp extends RepositoryRestMvcConfiguration { @Override protected void configureRepositoryRestConfiguration(RepositoryRestConfiguration config) { config.exposeIdsFor(Customer.class); } ! public static void main(String[] args) { SpringApplication.run(CustomerApp.class, args); } !}


Enabling a Circuit Breaker

43

@HystrixCommand(fallbackMethod = "defaultLink") public Link getStoresByLocationLink(Map<String, Object> parameters) { URI storesUri = URI.create(uri); try { ServiceInstance instance = loadBalancer.choose("stores"); storesUri = URI.create(String.format("http://%s:%s", instance.getHost(), instance.getPort())); } catch (RuntimeException e) { // Eureka not available } ! Traverson traverson = new Traverson(storesUri, MediaTypes.HAL_JSON); Link link = traverson.follow("stores", "search", "by-location") .withTemplateParameters(parameters).asLink(); ! return link; }

Client-Side Load Balancing


{ "id" : 3, "firstname" : "Matt", "lastname" : "Stine", "address" : { "street" : "9195 East Mineral Circle", "zipCode" : "80112", "city" : "Centennial", "location" : { "latitude" : 39.5738106, "longitude" : -104.8816934 } }, "_links" : { "self" : { "href" : "http://pivotalcustomers.cfapps.io/customers/3" }, "stores-nearby" : { "href" : "http://pivotalstores.cfapps.io/stores/search/findByAddressLocationNear?location=39.5738106,-104.8816934&distance=50" } } }


Circuit Breaker Fallback

46

public Link defaultLink(Map<String, Object> parameters) { return null; }

@HystrixCommand(fallbackMethod = "defaultLink") public Link getStoresByLocationLink(Map<String, Object> parameters) { //... }


{ "id" : 3, "firstname" : "Matt", "lastname" : "Stine", "address" : { "street" : "9195 East Mineral Circle", "zipCode" : "80112", "city" : "Centennial", "location" : { "latitude" : 39.5738106, "longitude" : -104.8816934 } }, "_links" : { "self" : { "href" : "http://pivotalcustomers.cfapps.io/customers/3" } } } // stores-nearby is gone!!!


Operationalized ArchitectureYou have to pay for your lunch!

© Copyright 2015 Pivotal. All rights reserved.© Copyright 2015 Pivotal. All rights reserved. 50

http://highscalability.com/blog/2014/4/8/microservices-not-a-free-lunch.html


Paying for your lunch…• Significant Operations Overhead

• Substantial DevOps Skills Required

• Implicit Interfaces

•Duplication of Effort

•Distributed System Complexity

•Asynchronicity is Difficult!

• Testability Challenges


You must be this tall to use Microservices…

52

http://martinfowler.com/bliki/MicroservicePrerequisites.html

https://www.flickr.com/photos/gusset/3723961589

• RAPID PROVISIONING

•BASIC MONITORING

• RAPID APPLICATION DEPLOYMENT

•DEVOPS CULTURE


It takes a platform…

53

http://techblog.netflix.com/2013/01/optimizing-netflix-api.htmlhttp://techblog.netflix.com/2014/03/the-netflix-dynamic-scripting-platform.html


It takes a platform…

54

Cloud Foundry Spring Cloud


Platform Features• Environment Provisioning

•On-Demand/Automatic Scaling

• Failover/Resilience

• Routing/Load Balancing

•Data Service Operations

•Monitoring


Environment Provisioning/App Deployment

56

Rou

ter

Cloud Controller Service Broker Node(s)

DEA DEA

DEA DEA

Blobstore DB

Runtime

1. Upload bits/metadata

2. Create/bind services

3. Stage via Buildpack

4. Deploy via Container

push app+ app MD

SC

+ =

http://docs.cloudfoundry.org/devguide/deploy-apps/


Environment Provisioning/App Deployment

57

Rou

ter

Cloud Controller

DEA

Blobstore DB

Runtime

Detect Compile UploadNo

System Buildpacks

+ =

Yes

http://docs.cloudfoundry.org/buildpacks/


Deployment/Load Balancing/Scaling

58

Blobstore

R

oute

r Cloud Controller

DEA

Messaging (NATS)

DEA DEA

Runtime

Access App

http://docs.cloudfoundry.org/concepts/architecture/warden.html

Container Container


Failover/Resilience

59

Blobstore

R

oute

r Cloud Controller

DEA

Messaging (NATS)

DEA DEA

Runtime

Health ManagerActual StateDesired State

http://docs.cloudfoundry.org/concepts/architecture/#hm9k

Container Container Container


Diego

https://github.com/cloudfoundry-incubator/diego-design-notes


http://lattice.cf/


Data Service Operations: Cluster Provisioning

62

Blobstore

BOSH

Health Monitor

DBDeploy my Services

IaaS

Worker VMs BOSH Director

NATS Cassandra Node

Target VMCassandra Node

Target VMCassandra Node

Target VM

http://bosh.cloudfoundry.org/


DB

Rou

ter

Data Service Operations: Application Binding

63

Service credentials

reserve resources

obtain connection data

CLI Cloud Controller

Service Broker

Data Service

Runtime

create service (HTTP)

bind service (HTTP)

create service (HTTP)

bind service (HTTP)

http://docs.cloudfoundry.org/services/api.html


Monitoring

64


It’s All About the DataWhat about the BIG QUESTIONS?


This won’t work…

66


Instead!


Bounded Contexts

68

Movie Movie

Actor

Genre

Media Type

Media Type

Kiosk

Location

Media

Product Catalog

Inventory


Polyglot Persistence

69

REST XYou shall not pass…


But I have a question!

70

REST XYou shall not pass…

?

?

? ?

?

?


Lambda Architecture

71


Join via Events!

72


http://projects.spring.io/spring-xd/


Redbox Conceptual Workflow

75


SpringBox Microservices

76

Catalog Service

Inventory Service

Kiosk

Kiosk

Kiosk

Reservation Service

https://github.com/cf-platform-eng/springbox-datacloud


…and if you have a question:

77

Kiosk

Kiosk

Kiosk

Speed Layer

Batch Layer Serving Layer

Event Ingest

https://github.com/cf-platform-eng/springbox-datacloud

“What movie genres are most popular in what geographic locations?”



78

// Aggregate preferences across all kiosks: stream create --name kiosk_agg_prefs --definition "rabbit --queues=lambda.kiosk.events | field-value-counter --fieldName=genreIds" !// Tap aggregate preferences, filter for kiosk #1: stream create --name kiosk_1_prefs --definition "tap:stream:kiosk_agg_prefs > filter --expression=#jsonPath(payload,'$.locationId').equals(1) | field-value-counter --fieldName=genreIds"



79

field-value-counter display --name kiosk_agg_prefs field-value-counter display=kiosk_agg_prefs ------------------------------------------- - ----- VALUE - COUNT Action | 14 Adventure | 6 Comedy | 27 Sci-Fi | 18


Where We’ve Been…•Microservices are an enabler to Continuous Delivery.

• Less about services, more about composed distributed systems. Patterns can help.

• You’re going to need a platform.

•Decomposed data governance -> recomposed data discovery.

• Thank You!


I wrote a little cloud book…Available to you compliments of Pivotal! !!Get the FREE e-book at http://bit.ly/cloud-native-book!

http://bit.ly/cloud-native-book

A NEW PLATFORM FOR A NEW ERA

to microservices and beyond

Software

delivery copyright

service api copyright

service oriented architecture

bounded contextsif

superior architecture

battery ventures

matt stine

mstine principal engineer