Build Lightning FAST Apps with Docker and OpenPOWER
Indrajit Poddar, STSM, IBM Systems
Seetharami Seelam, RSM, IBM Research
© 2016 IBM Corporation
High performance with Big Data
2
Easy scale-out with: But….Deep Learning and Machine Learning training is hard to distribute
Training can take hours, days or weeks
Input data and model sizes are becoming larger than ever (e.g. video input, billions of features etc.)
Real-time analytics with:
Unprecedented demand for offloaded computation, accelerators, and higher memory bandwidth systems
Resulting in….
Moore’s law is dying
© 2016 IBM Corporation
OpenPOWER: Open Hardware for High Performance
3
Upto: 12 cores per cpu96 hardware threads per cpu1 TB RAM7.6Tb/s combined I/O Bandwidth GPUs and FPGAs coming…
OpenPOWER
Traditional Intel x86
Systems designed for big data analytics
and superior cloud economics
http://www.softlayer.com/bare-metal-search?processorModel[]=8
© 2016 IBM Corporation Demo Shown at DockerCon Europe 2015
Docker Containers running on Power have Superior Density
Total: 10,011 Containers on One System: Ubuntu(8028), Node.js(991), Wordpress(992)
• Wider, Faster Memory Interface, Faster Cores with More Threads• Split-Core Mode supports Interactive Web style Apps better• 2x Greater Density of Containers per systems lowers Cost• >40% better Throughput and 4x better Latency• OpenPower ecosystem offers wide range of Open HW Platforms
Open Source Docker
4
© 2016 IBM Corporation
A Consistent Developer Experience
5
docker pull ubuntu:latest will get you the POWER/LinuxOne/X86 specific ubuntu image!!! Base Image
X86
Node.js App
X86 Node.js runtme
Base ImagePower
Node.js App
Power Node.js runtime
Base ImageZ
Node.js App
Z Node.js runtime
Docker onX86
Docker onPower
Docker onZ
Node.js App2 Node.js App2 Node.js App2
Container Container Container
Multi-platform Docker images
© 2016 IBM Corporation
OpenPOWER: GPU support
6
GPU
Credit: Kevin Klaues, Mesosphere
IBM Spectrum Conductor includes enhanced support for fine grained GPU and CPU scheduling with Apache Spark and
Docker
Mesos support for GPUs coming!!
© 2016 IBM Corporation
Machine Learning and Deep Learning analytics on OpenPOWERNo code changes needed!!
7
ATLAS Automatically Tuned Linear Algebra Software)
© 2016 IBM Corporation
Try out Machine Learning and the Developer ChallengeEnter to win exciting prizes!!
Huge speed-ups with GPUs and OpenPOWER!
openpower.devpost.com
© 2016 IBM Corporation
Learn More and Get Started…
9
Power-Efficient Machine Learning on POWER Systems using FPGA Acceleration
Machine and Deep Learning on Power Systems
Register for a SuperVessel Account and take deep learning notebooks running in docker containers a spin!
https://ny1.ptopenlab.com/bigdata_cluster
© 2016 IBM Corporation
Live Demo at the Booth!!
Thank you!In: @ipoddar
@sseelam