microservices, micro operations? challenges of microservice

49
© 2015 Cassini Consulting Dustin Huptas Andreas Schmidt Microservices, Micro Operations? Challenges of Microservice models at the operations level

Upload: ngonhan

Post on 13-Feb-2017

233 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Microservices, Micro Operations? Challenges of Microservice

© 2015 Cassini Consulting

Dustin Huptas Andreas Schmidt

Microservices, Micro Operations? Challenges of Microservice models at the operations level

Page 2: Microservices, Micro Operations? Challenges of Microservice

12th Feb. 2015 Micro Services, Micro Operations? 2

Page 3: Microservices, Micro Operations? Challenges of Microservice

12.02.15 Cassini Consulting 3

Page 4: Microservices, Micro Operations? Challenges of Microservice
Page 5: Microservices, Micro Operations? Challenges of Microservice

5 12.02.15 Cassini Consulting

Cassini consulting

#devops #linux #configmgt #virtualization #Containers #networking #ipv6 #security #deploy #run

Page 6: Microservices, Micro Operations? Challenges of Microservice

6 12.02.15 Cassini Consulting

Cassini consulting

#devops #linux #configmgt #security #virtualization #Containers #networking #ipv6

Dustin @dhpts System Architecture, Networking, Dev‘ing the Ops

Page 7: Microservices, Micro Operations? Challenges of Microservice

7 12.02.15 Cassini Consulting

Cassini consulting

#devops #linux #configmgt #security #virtualization #Containers #networking #ipv6

Andreas @aschmidt75 Infra-coding, #serverspec, #containers & security, #networking

Page 8: Microservices, Micro Operations? Challenges of Microservice

8 12th Feb. 2015 Micro Services, Micro Operations?

Physical Servers Virtual Servers Containers Dynamic Workloads

Years

Days to Months

Hours to Days

Msecs to Seconds

Page 9: Microservices, Micro Operations? Challenges of Microservice

12th Feb. 2015 Micro Services, Micro Operations? 9

Usually local development/test environment Single host, single network Mocked services

Page 10: Microservices, Micro Operations? Challenges of Microservice

12th Feb. 2015 Micro Services, Micro Operations? 10

Usually local development/test environment Single host, single network Mocked services

Scaling of instances (failover+performance) Services instances scattered across different hosts Networking, Security, i.e. Firewalling Logging and Monitoring on a larger scale Stuff needs to be persisted

Non-functional ReQuirements

Page 11: Microservices, Micro Operations? Challenges of Microservice

http://thenewstack.io/new-stack-mitchell-hashimoto-containers-no-containers-one-question-2015/

11 12th Feb. 2015 Micro Services, Micro Operations?

Page 12: Microservices, Micro Operations? Challenges of Microservice

12 12.02.15 Cassini Consulting

Increasing Number of Services

Discovery of Services

Dependencies

Page 13: Microservices, Micro Operations? Challenges of Microservice

Number of services: 1

Page 14: Microservices, Micro Operations? Challenges of Microservice

Software Architecture Patterns are changing

14 12th Feb. 2015 Micro Services, Micro Operations?

Page 15: Microservices, Micro Operations? Challenges of Microservice

System Architecture Patterns are changing to adapt

15 12th Feb. 2015 Micro Services, Micro Operations?

Page 16: Microservices, Micro Operations? Challenges of Microservice

The # of services are increasing

16 12th Feb. 2015 Micro Services, Micro Operations?

Year 1 Year 2 Year 3 Year 4

Page 17: Microservices, Micro Operations? Challenges of Microservice

https://www.flickr.com/photos/davebass5/8284615214/

„My name is service, micro service.“

Page 18: Microservices, Micro Operations? Challenges of Microservice

https://www.flickr.com/photos/tonyjcase/2864378286

“My name is service..“

“So what? Mine, too.“

“Yeah. And don‘t forget

about me. Like always.“

Page 19: Microservices, Micro Operations? Challenges of Microservice

https://www.flickr.com/photos/tonyjcase/2864378286

A Bag Of services

Multiplestages

Teams deploy independently

every other day

Page 20: Microservices, Micro Operations? Challenges of Microservice

https://www.flickr.com/photos/rieder91/6008439579

How to call?

Deployments

scaling

Firewalling

Logging Monitoring Sharing

knowledge debugging

Dependencies

Page 21: Microservices, Micro Operations? Challenges of Microservice

CREATE and APPLY PATTERNS

Logging Monitoring Deployments Debugging

Across allServices & Teams

META model DocumentationKnowledgeData

Keep System Maintainable

You build it,You run itDevOps

Page 22: Microservices, Micro Operations? Challenges of Microservice

22 12th Feb. 2015 Micro Services, Micro Operations?

Page 23: Microservices, Micro Operations? Challenges of Microservice

23 12th Feb. 2015 Micro Services, Micro Operations?

3 Services - handcrafted

Page 24: Microservices, Micro Operations? Challenges of Microservice

24 12th Feb. 2015 Micro Services, Micro Operations?

Scalability & Failover

Page 25: Microservices, Micro Operations? Challenges of Microservice

25 12th Feb. 2015 Micro Services, Micro Operations?

Scalability & Failover

Page 26: Microservices, Micro Operations? Challenges of Microservice

26 12th Feb. 2015 Micro Services, Micro Operations?

ENDpoints disappear

Page 27: Microservices, Micro Operations? Challenges of Microservice

27 12th Feb. 2015 Micro Services, Micro Operations?

MULTI-Version?

V3 V3 V4 V4

Page 28: Microservices, Micro Operations? Challenges of Microservice

28 12th Feb. 2015 Micro Services, Micro Operations?

Reachability

Page 29: Microservices, Micro Operations? Challenges of Microservice

29 12th Feb. 2015 Micro Services, Micro Operations?

Wiring baked inTO Proxying/LB

Configuration Management

Tool

Page 30: Microservices, Micro Operations? Challenges of Microservice

30 12th Feb. 2015 Micro Services, Micro Operations?

Solve Wiring With Appropriate Tools

Page 31: Microservices, Micro Operations? Challenges of Microservice

31 12th Feb. 2015 Micro Services, Micro Operations?

i.e. coreos/etcdconsulK/V cluster

i.e. confd, consul-template, ..Template engine

Proxying i.e. haproxy

Apps Infra i.e. progrium/registrator

Page 32: Microservices, Micro Operations? Challenges of Microservice

12.02.15 Cassini Consulting 32

Dependencies

Page 33: Microservices, Micro Operations? Challenges of Microservice

33 12th Feb. 2015 Micro Services, Micro Operations?

Internal Software dependencies

Inter-Service dependencies

@ build time

@ run time

Page 34: Microservices, Micro Operations? Challenges of Microservice

34 12th Feb. 2015 Micro Services, Micro Operations?

Startup order

Page 35: Microservices, Micro Operations? Challenges of Microservice

35 12th Feb. 2015 Micro Services, Micro Operations?

Resilience

Circuit Breaker

Page 36: Microservices, Micro Operations? Challenges of Microservice

36 12th Feb. 2015 Micro Services, Micro Operations?

Circuit closed?

Queue Full?

Execute call

Fallback Response

timeout

Success?

COMPUTE Circuit STATE

Latency OK?

positive Response

Page 37: Microservices, Micro Operations? Challenges of Microservice

It moves to another level in your system

Complexity does NOT go away

Page 38: Microservices, Micro Operations? Challenges of Microservice

Use helpers to DEAL with shifted complexiTY

manifests as DEPENDENCIES

Page 39: Microservices, Micro Operations? Challenges of Microservice

DevOps Mindset

Page 40: Microservices, Micro Operations? Challenges of Microservice

40 12th Feb. 2015 Micro Services, Micro Operations?

UPFRONT Design

Changing architecture in-between

Page 41: Microservices, Micro Operations? Challenges of Microservice

FULL Automation is key

Application Configuration needs to be dynamic

Configuration Management Tools for

SERVERS

Page 42: Microservices, Micro Operations? Challenges of Microservice

Static wiring of components reaches END-OF-LIFE

Ability to detect peers

Dynamic Service Discovery

Page 43: Microservices, Micro Operations? Challenges of Microservice

43 12th Feb. 2015 Micro Services, Micro Operations?

Dependencies externalize Call Stack

LATENCY

Introduce Circuit breakers

Page 44: Microservices, Micro Operations? Challenges of Microservice

Tools and frameworks are

moving FAST

PATTERNS are importaNT

Page 45: Microservices, Micro Operations? Challenges of Microservice

Operational behaviour changes

SHIFT to micro services introduces changes at multiple levels

Page 46: Microservices, Micro Operations? Challenges of Microservice

46 12th Feb. 2015 Micro Services, Micro Operations?

Microservices, Micro Operations?

Make Services Smarter

Meta Ops For the Service landscape

Employ suitable Patterns

Page 47: Microservices, Micro Operations? Challenges of Microservice

Q & A

Page 48: Microservices, Micro Operations? Challenges of Microservice

Recommended reading

http://www.simplicityitself.com/microservices-reactive/the-role-of-data-in-microservices/ http://highscalability.com/blog/2014/4/8/microservices-not-a-free-lunch.html https://rclayton.silvrback.com/failing-at-microservices http://www.simplicityitself.com/learning/getting-started-microservices/service-discovery-overview/ http://thenewstack.io/new-stack-mitchell-hashimoto-containers-no-containers-one-question-2015/ http://blogs.gartner.com/gary-olliffe/2015/01/30/microservices-guts-on-the-outside/ http://jaxenter.de/artikel/entwicklung-betrieb-skalierbarer-architektur-178014 (DE)

48 12.02.15 Micro Services, Micro Operations?

Page 49: Microservices, Micro Operations? Challenges of Microservice

Cassini Consulting Dustin Huptas Andreas Schmidt Oberwallstraße 24 10117 Berlin Deutschland

Alle Angaben basieren auf dem derzeitigen Kenntnisstand. Änderungen vorbehalten. Dieses Dokument von Cassini Consulting ist ausschließlich für den Adressaten bzw. Auftraggeber bestimmt. Es bleibt bis zur einer ausdrücklichen Übertragung von Nutzungsrechten Eigentum von Cassini. Jede Bearbeitung, Verwertung, Vervielfältigung und/oder gewerbsmäßige Verbreitung des Werkes ist nur mit Einverständnis von Cassini zulässig.

12.02.15 Micro Services, Micro Operations? 49