data focused docker clustering. docker hamburg
DESCRIPTION
Handling persistent data with Docker using FlockerTRANSCRIPT
![Page 1: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/1.jpg)
Docker HamburgThe upcoming talk will be presented in English
![Page 2: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/2.jpg)
Data focused DockerclusteringMarcus Hughes
![Page 3: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/3.jpg)
What was HybridCluster?
• Full stack LAMP platform
• FreeBSD Chroot containers
• ZFS
• Auto scaling
• Failover
• “AwesomeProxy”
![Page 4: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/4.jpg)
Docker
• Containers!
• Application level containerisation
• Data in “volumes”
• Lack of data portability
![Page 5: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/5.jpg)
Docker containers are portable
![Page 6: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/6.jpg)
Introduction to Flocker
• Open source volume manager
• Multi-node “cluster”
• 0.1 Released on 13th August (0.2 due on 2nd)
![Page 7: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/7.jpg)
Flocker
![Page 8: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/8.jpg)
Proxy layer
• Moving an application can be disruptive
• Application port responds on any node
• Routes reconfigured on migration
![Page 9: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/9.jpg)
ZFS
• Similarities to Docker containers
• ZFS on Linux
• Resilient
• Continuous replication
![Page 10: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/10.jpg)
Migration
• Container stops
• Volumes (ZFS dataset) is sent
• Routes altered
• Container re-started on new host
0.2
• Incremental send
![Page 11: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/11.jpg)
![Page 12: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/12.jpg)
Application configuration
"version": 1
"applications":
"mongodb-volume-example":
"image": "clusterhq/mongodb"
"ports":
- "internal": 27017
"external": 27017
"volume":
"mountpoint": "/data/db"
![Page 13: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/13.jpg)
Deployment configuration
"version": 1
"nodes":
"172.16.255.250": ["mongodb-volume-example"]
"172.16.255.251": []
![Page 14: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/14.jpg)
Deployment configuration
flocker-deploy deployment.yml application.yml
![Page 15: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/15.jpg)
DemoLets see what these configuration files do!
![Page 16: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/16.jpg)
Real world uses
• Moving applications to production
• Replacing servers
• Scalability
Future
• Clone datasets
![Page 17: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/17.jpg)
The FutureIdeas from our past and possible directions
![Page 19: Data Focused Docker Clustering. Docker Hamburg](https://reader034.vdocuments.mx/reader034/viewer/2022042715/55945a351a28ab47728b4628/html5/thumbnails/19.jpg)
Questions?