building a deep learning (dream) machine
TRANSCRIPT
![Page 1: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/1.jpg)
Building a Deep Learning (Dream)
MachineDIY hardware hacking for the uninitiated
Roelof Pieters@graphific http://www.graph-technologies.com
27 June 2016
![Page 2: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/2.jpg)
![Page 3: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/3.jpg)
![Page 4: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/4.jpg)
![Page 5: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/5.jpg)
![Page 7: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/7.jpg)
How: Machine Thank you gamers!
![Page 8: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/8.jpg)
Why- Cheaper *- Can do things you can’t do in the cloud- Desktop = faster experiment iteration - Remote still possible- Customize to your own needs- Fun!
* in my own particular case
![Page 9: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/9.jpg)
Points to think about- How many GPUs now and later- Motherboard (40 lanes / 16x8x8x8 configuration for 4 GPUs)- Chassis with enough space + air flow- 4 GPUs: 7 PCIe slots (last GPU can be mounted at the bottom using only one
slot)- CPU: good enough, as much cores as GPUs, make sure CPU supports 40
PCIe lanes, some new Haswell CPUs only support 32;- RAM: 2x of total GPU memory- SSD = nice if data doesn’t fit into GPU+RAM (or hdfs reads from disk): get
larger SSD than your largest dataset- Mechanical disks: plenty of storage- PSU: don’t save on efficiency (titanium/platinum)- Cooling: Water (hard diy) or Fan (easy/cheap but noisy)
![Page 10: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/10.jpg)
![Page 11: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/11.jpg)
I: HARDWARE
![Page 12: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/12.jpg)
How: Machine
![Page 13: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/13.jpg)
How: Machine
![Page 14: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/14.jpg)
How: Machine (2)
![Page 15: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/15.jpg)
![Page 16: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/16.jpg)
![Page 17: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/17.jpg)
![Page 18: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/18.jpg)
![Page 19: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/19.jpg)
![Page 20: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/20.jpg)
![Page 21: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/21.jpg)
II: SOFTWARE
![Page 22: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/22.jpg)
![Page 23: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/23.jpg)
![Page 24: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/24.jpg)
![Page 25: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/25.jpg)
![Page 26: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/26.jpg)
![Page 27: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/27.jpg)
![Page 28: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/28.jpg)
https://github.com/deeplearningparis/dl-machine
![Page 29: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/29.jpg)
And so on...
![Page 30: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/30.jpg)
![Page 33: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/33.jpg)
![Page 34: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/34.jpg)
![Page 35: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/35.jpg)
GTX 1080
![Page 36: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/36.jpg)
Drive PX 2
P100
![Page 37: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/37.jpg)
![Page 38: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/38.jpg)
![Page 39: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/39.jpg)
EPGU
![Page 40: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/40.jpg)
PGU
![Page 41: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/41.jpg)
![Page 42: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/42.jpg)
READ MORE
![Page 44: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/44.jpg)
https://hackaday.io/project/12070-32-tflop-deep-learning-gpu-box
![Page 45: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/45.jpg)
http://timdettmers.com/2015/03/09/deep-learning-hardware-guide/
![Page 46: Building a Deep Learning (Dream) Machine](https://reader031.vdocuments.mx/reader031/viewer/2022030305/587152671a28ab8e5b8b47ab/html5/thumbnails/46.jpg)
https://timdettmers.wordpress.com/2014/08/14/which-gpu-for-deep-learning/