docker platform and ecosystem nov 2015
TRANSCRIPT
Ride the Whale!Patrick Chanezon, Docker Inc.@chanezonThe Docker Platformand Ecosystem
Nov 24, 2015with updates from DockerCon Barcelona
FrenchPolyglotPlatformsSoftware PlumberSan FranciscoDeveloper Relations@chanezon
1995
2015
The future is already here it's just not very evenly distributedWilliam Gibson, Neuromancer
Dockers mission is tobuild tools of mass innovation
Internet (hardware layer)
Servers
Desktops
Phones
Cars
Houses
Drones
Network equipment
Public transit
TVs
Industrial facilities
Scientific instruments
Financial systemProgrammers
Internet (software layer)
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
Internet (hardware layer)
Servers
Desktops
Phones
Cars
Houses
Drones
Network equipment
Public transit
TVs
Industrial facilities
Scientific instruments
Financial systemProgrammers
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
a software layer to program the internet
5Cloud Market
PublicHybridPrivate
IT ProsDevopsDevelopersArchitects
Linux Container Ecosystem
Business opportunity
Their customer loves the apps they are building so fast for him: George sees $$ glint in his eyes!
George relishes complexity.Nobody understands how the system works... apart from him.
QWERTY 3.0 is a disaster, 2 years late
as Boromir would say
http://blogs.gartner.com/richard-watson/ok-get-dockers-great/
Low MTBIAMSH
MTBIAMSH(Mean Time Between Idea And Making Stuff Happen)
Agility == $$
Devops
25
Mainframe
Client-Server26
27
Web
28
Cloud - Devops
Docker
Isolation using Linux kernel featuresnamespacespidmntnetutsipcusercgroupsmemorycpublkiodevices
Image layers
Docker Mission
Docker for developers
https://registry.hub.docker.com/_/java/
docker-compose: running multiple containersRun your stack with one command: docker-compose upDescribe your stack with one file: docker-compose.ymlweb: build: . command: python app.py ports: - "5000:5000" volumes: - .:/code links: - redis:redis
redis: image: redis
docker-machinedocker-machine create -d azure \azure-subscription-id="c4f51be3-784c-xxx-7c50ad9e1b7c" \--azure-subscription-cert="/Users/pat/.ssh/docker-azure-cert.pem" \--azure-location="East US" \--azure-size=Small \--azure-username="pat" \pat-docker-machine-n
Kitematic
Docker Mission
Docker Hub
Docker Hub is Dockers cloud service for
Publishing and discovering container images through the public registryTeam collaboration and automation of application workflows
Docker HubDev & QA ColleaguesDevelopers
QA
Build & Ship
Docker Trusted Registry
Docker Trusted Registry now with Docker Content TrustDocker ToolboxBuildShipDocker Trusted Registry
DockerCon EU 2015
DAY 1 REFERENCE as we saw yesterday, Docker Content Trust uses trust service on Docker Hub (built on Notary) but now you can stand-up a trust service on-premise alongside DTRDTR to store, view, and distribute signed imagesDTR is the only registry on the market with this capability.
and to make all this easy to configure and manage, Docker Trusted Registry also features a web-based admin GUI for insights into the state of the DTR host
Docker Mission
Swarm
Scheduler plugins
Engine
Volumes plugins
Network plugins
Service discovery plugins
Engine
Volumes plugins
Network plugins
Service discovery plugins
mesos
flocker
glusterfs
weave
calico
consul
etcd
zookeeper
midokura
cisco
azure
nuagenetworks
Docker PluginsBatteries included but removable
DockerCLI
DockerCLI
DockerCLI
Docker Engine
Engine 1.9 ReleaseNetwork managementTop-level docker network commandOut of the box support for multi host overlay networkingExtensibility through plugins
Volume managementTop-level docker volume commandExtensibility through plugins
Built-in nodes discoveryDaemon --cluster-store and --cluster-advertise
Engine 1.9 ReleaseBuilderRefactoring toward client-side build supportARG: build-time arguments (provides support for HTTP_PROXY)STOPSIGNAL: choose the stop signal for the contained process
MiscellaneousQuality, stability, performance improvementsawslog logging driver
ExperimentalUser namespaces phase 1 (daemon-wide root remap)
Roadmap Engine 1.10RuntimeProgress toward runC integration
DistributionOngoing effort to rewrite push/pull layerNew manifest design, with content addressability from the grounds-up
NetworkingStabilize all the new features shipped in 1.9.0Better support for IPv6
SecurityStable user namespaces (phase 1)Progress toward seccomp support (run time profile)
us-westus-eastDockerCLI
DockerCLI
Docker SwarmSwarm
Swarm 1.0Focus on Production ReadinessStabilityScalabilityPerformance
Platform Integrationlibnetwork & overlay networkingvolume plugins support
Scalability: >1,000 nodesNEW! Parallel Scheduling
Scale Tests993 nodes12,173 containers
Lab SpecsManager: m4.xlarge (4 CPUs, 16G RAM)As powerful as your average MacBook ProNodes: t2.micro (1 CPU, 1GB RAM)Less powerful than an iPhone 5s
Reached EC2 provisioning limit
Performance
Median: 170 ms90th: 180 ms99th: 360 ms
Swarm load balancing: interlockhttps://github.com/ehazlett/interlock/tree/master/plugins/haproxy
+
Docker Containers as a Service PlatformDocker ToolboxTutum
BuildShipRunDocker Hub
Make change to appgit commitAutomated BuildProvision second data centerDeploy appFailover to a single data center
DockerCon EU 2015
You have just seen the power of Docker Hub and the Power of TutumAnd how they work togetherAnd really it is not about dev vs opsit is about dev and ops working together and moving the app through the e2e phases rapidly and predictably seamlesslyItwasagreatdemobutwhataboutreallife?
Deploy & Manage Dockerized Apps in Production
ComposeSwarmNetworkingEnginePluginsVirtual, Cloud, Physical
Docker Trusted Registry
DockerCon EU 2015
We gave a sneak peek as Project Orca at DCSF in June Everything you need to deploy and manage Dockerized apps Complements DTRIntegrated stack of our reliable, secure, scalable open source plumbing
Self-Service App Deploys & UpdatesProvisioning & Config of Heterogeneous ClustersLDAP / AD integration with Docker Trusted RegistryNative Docker APIs & CLIMonitoring, Logging, Auditing
>_
DockerCon EU 2015
its got the features teams need to move quickly with control in shipping apps to any infrastructure
Docker Containers as a Service PlatformDocker ToolboxDocker Trusted Registry
Docker UniversalControl Plane
BuildShipRun
docker pushwith image signingSearch/browse reposTeams-based RBACView signed imagesDeleting tagsAuthenticationDeploy and scale-out appMonitor statsSecrets management
DockerCon EU 2015
---To re-cap, you saw and end-to-end demo of the Docker CaaS PlatformDevs using Docker Toolbox and Docker Trusted RegistryOps using DTR and DUCPWork together to move quickly yet with controlWho wants to try these out?
Docker Trusted Registry 1.4 GA
Docker Universal Control Plane1.0 Betadocker.com/try-dtrdocker.com/try-ducp
DockerCon EU 2015
Try these solutions todayBreak-out sessions and hands-on labs
Leading Enterprises Worldwide Depend on Docker
E-CommerceMediaLife SciencesFinance
Vertical SearchIT SaaSIaaSPaaS
And distributed applications are not just something for aggressive web companies. This is an application architecture that is being adopted by all of the leaders of industryevery major enterprise organization is either already there or going down that path because of the agility it provides them in delivering applications that engage with their customers.
Open Standards
Plumbing
NotaryLets stop using curl|shTrusted collections for any content
Transport-agnostic
Reliable updates, proof of origin, resistant to untrusted transport, survivable key compromise
Build on industry-leading standards and research
RunCThe universal container runtimehttps://runc.io
Docker & Microsoft
Docker & MicrosoftBuildDocker client & Kitematic for WindowsDocker engine on Windows Server 2016 TP3yo-docker to dockerize existing projectsVisual Studio integrationShipVSO?RunAzure Docker agentSwarm ARM template from AhmetAzure Container Service
Demos
Docker Swarm, Compose and networkingdocker 1.9swarm 1.0.0compose 1.5.0 --x-networkingSpring Boot App using MongoDB
https://github.com/joshlong/spring-dogehttps://github.com/chanezon/docker-tips/orchestration-networking
Compose for build and deploy, Wildfly, Apache, Angular, Mysql, Redis, batch and API apps - Compose for buildJava EE 7 / Angular App with Docker Compose
https://github.com/mgreau/docker4dev-tennistour-app
Service Discoveryhttps://github.com/gliderlabs/registratorhttps://github.com/hashicorp/consul-templatehttps://github.com/ehazlett/interlockPersistent volumes with Swarm and Rex Ray on AWShttp://blog.emccode.com/2015/11/03/use-docker-swarm-with-a-data-persistence-layer/https://github.com/emccode/rexrayKubernetes on Swarmhttps://github.com/docker/swarm-frontendsOrchestration projects
IPVS, Andrey Sibiryov, http://www.slideshare.net/Docker/kernel-load-balancing-for-docker-containers-using-ipvsDNS Service Discovery for Docker Swarm, Ahmet Alp Balkan, http://www.slideshare.net/Docker/dns-service-discovery-for-docker-swarmLoad Balancing
Spring Boot, MongoDB, compose, swarm, networkinghttps://github.com/joshlong/spring-dogehttps://github.com/chanezon/docker-tips/orchestration-networkingJava EE 7 / Angular App with Docker Swarm by @mgreauCompose for build and deploy, Wildfly, Apache, Angular, Mysql, Redis, batch and API appshttps://github.com/mgreau/docker4dev-tennistour-appJava EE Docker & Kubernetes by @arun-guptahttps://github.com/javaee-samples/docker-javaJava Examples
Docs https://docs.docker.com/engine/userguide/networking/dockernetworks/Create a Swarm cluster with networking https://github.com/chanezon/docker-tips/orchestration-networkingNetworking in compose https://github.com/docker/compose/blob/master/docs/networking.mdNathan Leclaire Seamless Docker Multihost Overlay Networking on DigitalOcean With Machine, Swarm, and Compose, RethinkDB http://nathanleclaire.com/blog/2015/11/17/seamless-docker-multihost-overlay-networking-on-digitalocean-with-machine-swarm-and-compose-ft.-rethinkdb/Docker networking
Using Ansible with Docker Machine to Bootstrap Host Nodes http://nathanleclaire.com/blog/2015/11/10/using-ansible-with-docker-machine-to-bootstrap-host-nodes/Seamless Docker Multihost Overlay Networking on DigitalOcean With Machine, Swarm, and Compose, RethinkDB http://nathanleclaire.com/blog/2015/11/17/seamless-docker-multihost-overlay-networking-on-digitalocean-with-machine-swarm-and-compose-ft.-rethinkdb/Nathans tips
Fire up your first container today!Ride the Whale!
Learninghttp://docs.docker.com/http://training.docker.comhttp://slideshare.net/chanezonhttp://opencontainers.orghttps://github.com/chanezon/docker-tipshttps://github.com/dave-tucker/docker-network-demos
Were hiring!
https://www.docker.com/company/careers/
Q&A