the service mesh - past present and future by william morgan
TRANSCRIPT
![Page 1: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/1.jpg)
The Service Mesh
William Morgan, CEO, Buoyant
Past, Present, and Future
![Page 2: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/2.jpg)
![Page 3: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/3.jpg)
Resilience
The property of a material that enables it to resume its original shape or position after being bent, stretched, or compressed.
![Page 4: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/4.jpg)
Stress
unpredictable load flaky hardware buggy software
Resilience
load shedding graceful failure handling provisioning & scaling
![Page 5: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/5.jpg)
2000
Dedicated hardware, big iron,overprovisioning, buy two of ‘em
“Cloud Native”
2017
![Page 6: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/6.jpg)
Containers
Orchestration
Microservices
![Page 7: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/7.jpg)
The Fundamental Abstract ions Have Changed
Virtual machines
Data centers
Hardware redundancy
Servers
IP addresses, DNS
Server monitoring
Monolithic applications
TCP/IP
Containers
Orchestrated envs
Design for failure
Services
Service discovery
Service monitoring
Microservices
gRPC, REST
![Page 8: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/8.jpg)
Service A
Service B
Service C
Runtime Communication
containers
![Page 9: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/9.jpg)
Twitter circa 2013
Service A
serviceB
Service C
![Page 10: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/10.jpg)
Example: Timeouts & Retr ies
timeout=400msretries=3
timeout=400msretries=2
timeout=200msretries=3
timelines
users
web
db
800ms!
600ms!
![Page 11: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/11.jpg)
serviceA
serviceB
serviceC
What’s missing?
?
![Page 12: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/12.jpg)
The service mesh is a dedicated layer for managing
service-to-service communication
Managed. Controlled.Monitored.
![Page 13: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/13.jpg)
Apache Apache Apache
PHP PHP PHP PHP PHP
Mysql Mysql Mysql
LAMP
![Page 14: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/14.jpg)
Nginx Nginx Nginx
DB DB DB
Fat clients
svc svc svcsvc svc
svc svc svcsvc svc svclibraries
![Page 15: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/15.jpg)
Nginx Nginx Nginx
DB DB DB
The service mesh
svc svc svcsvc svc
svc svc svcsvc svc svc
service mesh
service mesh
![Page 16: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/16.jpg)
The Linkerd service mesh
Service C
Service B
Service A
linkerd
Service C
Service B
Service A
linkerd
Service C
Service B
Service A
linkerd
application HTTPproxied HTTPmonitoring & control
Node 1 Node 2 Node 3
Service C
Service B
Service A
linkerd
Service C
Service B
Service A
linkerd
Service C
Service B
Service A
linkerd
application HTTPproxied HTTPmonitoring & control
Node 1 Node 2 Node 3
![Page 17: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/17.jpg)
Visibility Security GovernanceReliability
![Page 18: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/18.jpg)
If you’re building a cloud native application,you need a service mesh.
CENSORED
![Page 20: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/20.jpg)
The future of the service mesh
✓ Load balancing, retries, circuit breaking, service discovery, deadlines…
✓ TLS (incl. mutual auth)
✓ gRPC, HTTP/2, HTTP, Thrift…
✓ Prometheus, Zipkin
✓ Kubernetes, Consul, ZooKeeper, Mesos, …
What’s next?
![Page 21: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/21.jpg)
? How do we identify and authenticate services?
? How do we authorize communication
and apply policy?
? Per service? Per request? Per “customer”?
? How secure is the underlying mesh?
Security
The future of the service mesh
![Page 22: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/22.jpg)
? How fast can we make this?
? How lightweight can we make the service mesh footprint?
? How predictable can we make its behavior?
Performance
The future of the service mesh
![Page 23: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/23.jpg)
? Cross-datacenter failover?
? Multi-cloud, hybrid-cloud, failover-to-cloud?
? Multi-infrastructure (Kubernetes + Mesos + CloudFoundry) support?
Hybridization
The future of the service mesh
![Page 24: The Service Mesh - Past present and future by William Morgan](https://reader031.vdocuments.mx/reader031/viewer/2022022415/5a64a8247f8b9a2c568b6b83/html5/thumbnails/24.jpg)
? How debuggable is the service mesh?
? How understandable can we make it?
? How much can we best address the separation of concerns between dev and ops?
Operations
The future of the service mesh