the new open distributed application architecture
TRANSCRIPT
![Page 1: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/1.jpg)
The New Distributed Application InfrastructureGordon Haff @ghaffTechnology EvangelistRed Hat
![Page 2: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/2.jpg)
Aboutme• RedHatTechnologyEvangelist• Twitter:@ghaff• Google+:GordonHaff• Flickr:bitmason• Email:[email protected]• Blog:http://bitmason.blogspot.com• Author:ComputingNext• Formerly:Illuminata (industryanalyst)Data
General(minicomputers/Unix/NUMA/etc.)
![Page 3: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/3.jpg)
This is all very new
2007 2011
2013
2014
2006
![Page 4: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/4.jpg)
A common thread is open source innovation
And the principles and practices associated with it
![Page 5: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/5.jpg)
Computing as puntuated equilibria• Rapidly changing
environment• Open source
innovation and recombinations
• Intersecting trends• Hard to predict
![Page 6: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/6.jpg)
Traditional infrastructure & apps
Server, storage, & networking hardware
Operating system
Application& dependencies Application
& dependenciesApplication
& dependencies
![Page 7: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/7.jpg)
(One of) the problems
Server, storage, & networking hardware
Operating system
Application&dependencies Application
& dependenciesApplication
&dependencies
![Page 8: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/8.jpg)
Enter hardware virtualization
Server, storage, & networking hardwarewith CPU, memory, I/O virtualization assists
Hypervisor (or other partitioning methods)
Application& dependencies
Application& dependencies
Application& dependencies
Operating system
Operating system
Operating system
![Page 9: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/9.jpg)
What’s changed really?• Application
components still installed within OS
• Applications still long-lived & stateful
• Applications still “pets”
![Page 10: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/10.jpg)
Which was sort of the point• Improved server
utilization reduced CAPEX
• Without (at least initially) much impact on operational model
2006
![Page 11: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/11.jpg)
![Page 12: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/12.jpg)
The discontinuity hits• “Software is eating the world”• Digital transformation needed:
– More effective software delivery– Reimagined componentized
architectures– Scale– Pervasive sensors & access
![Page 13: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/13.jpg)
Better faster software with DevOps
![Page 14: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/14.jpg)
DevOps applies open source tools, principles, and practices with:
• CULTURE of collaboration valuing openness and transparency
• AUTOMATION of process from development through ongoing operations
• An evolving PLATFORM that optimizes for flexible, dynamic workloads
![Page 15: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/15.jpg)
Toward an “ant” model for apps• Stateless (often)• “Small” components• Expose an API• Replacable cogs• Portable across hybrid
infrastructures
![Page 16: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/16.jpg)
Signs you might need microservices• Having trouble coordinating function
teams like DBAs and UI engineers• Brittle apps. Minor changes cause
major breakage• Your process is bogged down by big
deployments• Different teams keep reinventing the
wheel (in gratuitously different ways)
• Hard to experiment
![Page 17: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/17.jpg)
On the other hand
• Architectural effort• Service boundaries• Communication
overhead• Do you need it?
![Page 18: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/18.jpg)
DevOps + “Cloud” = Industrialize
![Page 19: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/19.jpg)
What does this factory look like?
![Page 20: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/20.jpg)
From servers to resource pools• Software-
defined “everything”
• Dynamic resource pool
• May be provided by public cloud
Virtualized pool of IaaS resources
“Commodity” server
“Commodity” server
“Commodity” server
Operating system
Operating system
Operating system
Operating system
Software-defined storageSoftware-defined networking/NFV
![Page 21: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/21.jpg)
OpenStack: Software-defined infrastructure
Linux
![Page 22: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/22.jpg)
Containers: Isolation within OS• OS-level virtualization• Originally BSD jails• Then Solaris zones• OS kernel manages
isolation, resource use, and security
• Namespaces, SELinux, Cgroups in Linux
Operating system instance
Application& dependencies
Application& dependencies
Resource pool
![Page 23: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/23.jpg)
Making containers useful & portable• Standard packaging
format• Ecosystem App
composition specification• Optimized operating
system foundation
Lightweight, immutable OSfor running containers
Application& dependencies
Application& dependencies
Resource pool
Container packaging forimage-based deployment
![Page 24: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/24.jpg)
Key areas of container standardsOpen source communities working to drive
![Page 25: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/25.jpg)
Managing at scale as a single entity
Lightweight, immutable OSfor running containers
Application& dependencies
Application& dependencies
Resource pool
Container packaging/API forimage-based deployment
Resource management
Orchestration
![Page 26: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/26.jpg)
Everyone is scaling• Not just unicorns and
mammoths• Three main use cases:
– Large scale workloads – Diverse workloads – Complex resource
management• Grid computing: It lives!
![Page 27: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/27.jpg)
PaaS is one integration point
![Page 28: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/28.jpg)
Source:DevOps,OpenSourceandBusinessAgility:Lessonslearnedfromearlyadopters,June2015
![Page 29: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/29.jpg)
Needs for integrating with existing IT
96% see open source as an enabler of cloud native integration and conventional app modernization.
Source: Red Hat Modernization Strategies SurveyIDC September 2015
Structured & unstructured data integrationBusiness process automationModel-driven process managementEnterprise service bus & APIs
![Page 30: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/30.jpg)
Dataintegrationservices
![Page 31: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/31.jpg)
Some open questions• Role of hardware virtualization• On-premise vs. public cloud trends• Monoliths vs. Microservices• The post-NIST service model• When/where/how is data useful?
![Page 32: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/32.jpg)
How evenly distributed will the future be?
The future is already here—it's just not very evenly distributed.
William Gibson
![Page 33: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/33.jpg)
CreditsFractal: https://www.flickr.com/photos/fractal_ken/3996156539/ Flickr Creative Commons licensePunctuated equilibrium: University of California at BerkeleyMainframe: "IBM 704 mainframe" by Lawrence Livermore National Laboratory. Licensed under Attribution via Commons - https://commons.wikimedia.org/wiki/File:IBM_704_mainframe.gif#/media/File:IBM_704_mainframe.gifAnts: https://www.flickr.com/photos/pondapple/6502194585 Flickr Creative Commons license
Meteor, galaxy: NASADatacenter: GoogleDogs: https://www.flickr.com/photos/ulster/3250246355 Flickr Creative Commons license
Aircraft factory: Flickr/cc, https://www.flickr.com/photos/jetstarairways/9130160595Kids programming: Esti Alvarez cc license
Auto factory: Copyright TeslaTower: Daniel Pratts CC/flickr https://flic.kr/p/7RE6ycFrog: Kathy CC/Flickr https://flic.kr/p/b9fFV
Coupling graphic: PWCBuildings: CC/Flickr https://www.flickr.com/photos/firstdown/2456119103
![Page 34: The New Open Distributed Application Architecture](https://reader031.vdocuments.mx/reader031/viewer/2022022200/58a6b37b1a28ab661f8b492f/html5/thumbnails/34.jpg)
Thankyou!