caffeインストール

31
Caffeのインストールについて Preferred Networks Inc. 野健太 [email protected] 2015/7/9 本神経回学会主催セミナー Deep Learningを使ってみよう!」

Upload: kenta-oono

Post on 05-Aug-2015

307 views

Category:

Documents


5 download

TRANSCRIPT

1. Caffe Preferred Networks Inc. [email protected] 2015/7/9 Deep Learning 2. 2015/7/6 2015/7/9GPUCaffeCUDA 2 3. 201591Deep Learning http://www.jnns.org/DeepSeminar2/home.html CPU OnlyCaffe GPUCaffe $ ls $ 3 4. OS:Ubuntu14.04 + CUDA7.0 Caffe 72(7d3a8e9) 4 5. 5 6. 6 7. CPU Only 8. Ubuntu14.04CPU OnlyCaffe AWSUbuntu14.04 https://github.com/delta2323/JNNS2015- tutorial/blob/master/caffe/cpu/install.sh ubuntu caffe /opt/caffeCaffecaffe $ cd $ sudo bash ./install.sh example $ su caffe # caffe example(MNIST) 8 9. http://caffe.berkeleyvision.org/installation.html Wiki https://github.com/BVLC/caffe/wiki WikiAWS/AMI 1-4 1. Caffe 2. Makefile.configCPU_ONLY := 1 3. Caffe 4. PythonCaffe 9 10. 1. apt-getapt-get install glog, gflags Caffe Caffe libXXX.so apt-getYYY sudo apt-get install YYY 10 11. 2. Makefile.config Makefile.configCaffeMakefile Makefile.config.example GPUCPUCaffe Caffe/ 11 12. 2. Makefile.config Caffe $ cd X # X is the path to directory Caffe is installed $ git clone https://github.com/BVLC/caffe.git Makefile.config $ cd X/caffe $ cp Makefile.config.example Makefile.config Makefile.config # CPU_ONLY := 1 CPU_ONLY := 1 12 13. Makefile, Makefile.config CXX/NVCCC++, NVCC Mac10.9CXX CXXFLAGS/NVCCFLAGSC++, NVCC CPU_ONLY1GPU USE_CUDNN1cuDNN 13 14. Makefile, Makefile.config BLASBLAS ATLAS CUDA_DIRCUDA CUDA/usr/local/cuda-X.Y (X, Y) CAFFE_ROOTCaffe Makefile 14 15. 3. Caffe $ cd $CAFFE_ROOT $ make all 15 16. example(MNIST) example http://caffe.berkeleyvision.org/ gathered/examples/mnist.html $ cd $CAFFE_ROOT $ ./data/mnist/get_mnist.sh $ ./examples/mnist/create_mnist.sh CPU examples/mnist/lenet_solver.prototxt solver_mode: GPU solver_mode: CPU $ ./examples/mnist/train_lenet.sh 16 17. Mac OS 10.9Caffe Q. Mac OS 10.9Caffe A. GPU10.8 Mac OS 10.910.8 C++Mac OS 10.9C++ Clang++libc++NVIDIACUDAlibstdc++ 2 1. Clang++libc++libstdc++() 2. (GPU) 10.8make allMakefile.config2 ( (1)--libstdc++(2)CPU_ONLY:=1) NVIDIA libc++Caffe 17 18. Caffe(GPU) 19. GPU2 AWSGPUCaffeAMI GPU GPUCaffe Ubuntu 14.04 + Cuda 7.0 AWSAmazon WebService AMIAmazon Machine Image AWSAMI AMI 20. CaffeAMI AMI ID : ami-763a311e GPUg2.2xlarge or g2.8xlarge GPUAWS https://github.com/BVLC/caffe/wiki/Caffe-on-EC2-Ubuntu-14.04-Cuda-7 20 21. http://caffe.berkeleyvision.org/installation.html 1. CUDA GPU 2. Caffe 3. Makefile.config CPU_ONLY 4. Caffe 21 22. Caffe2 https://github.com/BVLC/caffe/wiki/Caffe-on-EC2-Ubuntu-14.04-Cuda-7 CaffeAMI runtime file https://github.com/BVLC/caffe/wiki/Install-Caffe-on-EC2-from-scratch-(Ubuntu,- CUDA-7,-cuDNN) 1-4 cuDNNcuDNNNVIDIA Developer Zone AWSGPU 22 23. CUDA CUDA Toolkit Documentation 3 https://docs.nvidia.com/cuda/cuda-getting-started-guide-for- linux/index.html#package-manager-installation runtime file CUDA Toolkit Documentation 4 https://docs.nvidia.com/cuda/cuda-getting-started-guide-for-linux/index.html#runfile UbuntuaptitudeCentOS yumMacOShomebrew23 24. CUDA 3 CUDA CUDAOSGPU nvidia-smi OSGPUCaffeGPU CaffeexampleOK nvidia-smiNVIDIAGPU or https://developer.nvidia.com/nvidia-system- management-interface24 25. 1nvidia-uvm 1modprobe $ sudo modprobe nvidia-346-uvm 2deviceQuery http://blog.alpaca.ai/how-to-use-caffe-model-generated-by-labellio-on-your- machineaws/ 25 26. 27. LIBRARY_PATH / LD_LIBRARY_PATH LIBRARY_PATHgccor LD_LIBRARY_PATH.so LD_LIBRARY_PATHLIBRARY_PATH http://stackoverflow.com/questions/4250624/ld-library-path-vs-library-path LIBRARY_PATH LD_LIBRARY_PATH 27 28. ldd/ldconfig ldd : ldd /usr/bin/ls ldconfig : /etc/ld.so.conf /lib/usr/lib /etc/ld.so.cache http://www.linuxmaster.jp/linux_skill/2011/03/22linux.html28 29. (A)(B) A: error while loading shared libraries: libB.so.X: cannot open shared object file: No such file or directory 0. lddAB 1. /etc/ld.so.cacheldconfig 2. B(C) 2-12-2 3-1. LD_LIBRARY_PATHC 3-2. /etc/ld.so.confCldconfig 29 30. Python Python Pythonimport pipPython or PyPIPerlCPAN pip install < > pippip install -U pip -U PYTHONPATHPythonimport http://docs.python.jp/2/tutorial/modules.html#tut-searchpath 30 31. GPU CUDANVIDIAGPU NVCCCUDAC++ cuBLAS, cuDNNCUDA, Host/Device GPUHost = CPU, Device = GPU 31