image classification with digits · 22 caffe features protobuf model format • strongly typed...
TRANSCRIPT
![Page 1: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/1.jpg)
1
Twin Karmakharm
Image Classification with DIGITS
Certified Instructor, NVIDIA Deep Learning InstituteNVIDIA Corporation
![Page 2: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/2.jpg)
2
DEEP LEARNING INSTITUTE
DLI Mission
Helping people solve challenging problems using AI and deep learning.
• Developers, data scientists and engineers
• Self-driving cars, healthcare and robotics
• Training, optimizing, and deploying deep neural networks
![Page 3: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/3.jpg)
3 3
TOPICS
• Lab Perspective
• What is Deep Learning
• Handwritten Digit Recognition
• Caffe
• DIGITS
• Lab
• Discussion / Overview
• Launching the Lab Environment
• Lab Review
![Page 4: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/4.jpg)
4
LAB PERSPECTIVE
![Page 5: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/5.jpg)
5
WHAT THIS LAB IS
• An introduction to: • Deep Learning• Workflow of training a network • Understanding the results
• Hands-on exercises using Caffe and DIGITS for computer vision and classification
![Page 6: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/6.jpg)
6
WHAT THIS LAB IS NOT
• Intro to machine learning from first principles
• Rigorous mathematical formalism of neural networks
• Survey of all the features and options of Caffe, DIGITS, or other tools
![Page 7: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/7.jpg)
7
ASSUMPTIONS
• No background in Deep Learning needed
• Understand how to:
• Navigate a web browser
• Download files
• Locate files in file managers
![Page 8: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/8.jpg)
8
TAKE AWAYS
• Understanding of the workflow of Deep Learning
• Ability to setup and train a convolutional neural network
• Enough info to be “dangerous”
• i.e., you can setup your own CNN and know where to go to learn more
![Page 9: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/9.jpg)
9
WHAT IS DEEP LEARNING?
![Page 10: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/10.jpg)
10
Machine Learning
Neural Networks
Deep Learning
![Page 11: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/11.jpg)
11
ARTIFICIAL NEURONS
From Stanford cs231n lecture notes
Biological neuron
w1 w2 w3
x1 x2 x3
y
y=F(w1x1+w2x2+w3x3)
Artificial neuron
Weights (Wn) = parameters
![Page 12: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/12.jpg)
12
ARTIFICIAL NEURAL NETWORKA collection of simple, trainable mathematical units that collectively
learn complex functions
Input layer Output layer
Hidden layers
Given sufficient training data an artificial neural network can approximate very complexfunctions mapping raw data to output decisions
![Page 13: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/13.jpg)
13
DEEP NEURAL NETWORK (DNN)
Input Result
Application components:
Task objectivee.g. Identify face
Training data10-100M images
Network architecture~10s-100s of layers1B parameters
Learning algorithm~30 Exaflops1-30 GPU days
Raw data Low-level features Mid-level features High-level features
![Page 14: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/14.jpg)
14 14
0
0
0
0
0
0
0
0
1
1
1
0
0
0
0
1
2
2
1
1
1
0
1
2
2
2
1
1
0
1
2
2
2
1
1
0
0
1
1
1
1
1
0
0
0
0
0
0
0
4
0
0
0
0
0
0
0
-4
1
0
-8
Source Pixel
Convolution kernel (a.k.a. filter) New pixel value
(destination pixel)
Center element of the kernel is placed over the source pixel. The source pixel is then replaced with a weighted sum of itself and nearby pixels.
CONVOLUTION
![Page 15: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/15.jpg)
15
DEEP LEARNING APPROACH
Deploy:
Dog
Cat
Honey badger
Errors
DogCat
Raccoon
Dog
Train:
DNN
DNN
![Page 16: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/16.jpg)
16
DEEP LEARNING APPROACH - TRAINING
Input
Process• Forward propagation
yields an inferred label for each training image
• Loss function used to calculate difference between known label and predicted label for each image
• Weights are adjusted during backward propagation
• Repeat the process
Forward propagation
Backward propagation
![Page 17: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/17.jpg)
17
ADDITIONAL TERMINOLOGY• Hyperparameters – parameters specified before training begins
• Can influence the speed in which learning takes place• Can impact the accuracy of the model• Examples: Learning rate, decay rate, batch size
• Epoch – complete pass through the training dataset
• Activation functions – identifies active neurons• Examples: Sigmoid, Tanh, ReLU
• Pooling – Down-sampling technique• No parameters (weights) in pooling layer
![Page 18: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/18.jpg)
18
HANDWRITTEN DIGIT RECOGNITION
![Page 19: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/19.jpg)
19 19
HANDWRITTEN DIGIT RECOGNITION
• MNIST data set of handwritten digits from Yann Lecun’s website
• All images are 28x28 grayscale
• Pixel values from 0 to 255
• 60K training examples / 10K test examples
• Input vector of size 784
• 28 * 28 = 784
• Output value is integer from 0-9
HELLO WORLD of machine learning?
![Page 20: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/20.jpg)
20
CAFFE
![Page 21: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/21.jpg)
21
WHAT IS CAFFE?
• Pure C++/CUDA architecture
• Command line, Python, MATLAB interfaces
• Fast, well-tested code
• Pre-processing and deployment tools, reference models and examples
• Image data management
• Seamless GPU acceleration
• Large community of contributors to the open-source project
An open framework for deep learning developed by the Berkeley Vision and Learning Center (BVLC)
caffe.berkeleyvision.orghttp://github.com/BVLC/caffe
![Page 22: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/22.jpg)
22 22
CAFFE FEATURES
Protobuf model format
• Strongly typed format
• Human readable
• Auto-generates and checks Caffe code
• Developed by Google
• Used to define network architecture and training parameters
• No coding required!
name: “conv1”type: “Convolution”bottom: “data”top: “conv1”convolution_param {
num_output: 20kernel_size: 5stride: 1weight_filler {
type: “xavier”}
}
Deep Learning model definition
![Page 23: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/23.jpg)
23
NVIDIA’S DIGITS
![Page 24: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/24.jpg)
24
NVIDIA’S DIGITSInteractive Deep Learning GPU Training System
• Simplifies common deep learning tasks such as:
• Managing data
• Designing and training neural networks on multi-GPU systems
• Monitoring performance in real time with advanced visualizations
• Completely interactive so data scientists can focus on designing and training networks rather than programming and debugging
• Open source
![Page 25: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/25.jpg)
25
DIGITS - HOME
Clicking DIGITS will bring you to this Home screen
Clicking here will present different options for model and dataset creation
Click here to see a list of existing datasets or models
![Page 26: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/26.jpg)
26
DIGITS - DATASET
Different options will be presented based upon the task
![Page 27: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/27.jpg)
27
DIGITS - MODEL
Differences may exist between model tasks
Can anneal the learning rate
Define custom layers with Python
![Page 28: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/28.jpg)
28
DIGITS - TRAINING
Annealed learning rate
Loss function and accuracy during training
![Page 29: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/29.jpg)
29
DIGITS - VISUALIZATION
Once training is complete DIGITS provides an easy way to visualize what happened
![Page 30: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/30.jpg)
30
DIGITS – VISUALIZATION RESULTS
![Page 31: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/31.jpg)
31
LAB DISCUSSION / OVERVIEW
![Page 32: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/32.jpg)
32
LAB OVERVIEW• Learn about the workflow of Deep Learning
• Create dataset• Create model• Evaluate model results• Try different techniques to improve initial results
• Train your own Convolutional Neural Network using Caffe and DIGITS to identify handwritten characters
![Page 33: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/33.jpg)
33
CREATE DATASET IN DIGITS
• Dataset settings
• Image Type: Grayscale
• Image Size: 28 x 28
• Training Images: /home/ubuntu/data/train_small
• Select “Separate test images folder” checkbox
• Test Images: /home/ubuntu/data/test_small
• Dataset Name: MNIST Small
![Page 34: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/34.jpg)
34
CREATE MODEL
• Select the “MNIST small” dataset
• Set the number of “Training Epochs” to 10
• Set the framework to “Caffe”
• Set the model to “LeNet”
• Set the name of the model to “MNIST small”
• When training done, Classify One :
/home/ubuntu/data/test_small/2/img_4415.png
![Page 35: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/35.jpg)
35 35
Loss function(Validation)
Loss function(Training)
Accuracyobtained from
validation dataset
EVALUATE THE MODEL
![Page 36: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/36.jpg)
36
ADDITIONAL TECHNIQUES TO IMPROVE MODEL
• More training data
• Data augmentation
• Modify the network
![Page 37: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/37.jpg)
37
LAUNCHING THE LAB ENVIRONMENT
![Page 38: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/38.jpg)
38
NAVIGATING TO QWIKLABS
1. Navigate to: https://nvlabs.qwiklab.com
2. Login or create a new account
![Page 39: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/39.jpg)
39
ACCESSING LAB ENVIRONMENT
3. Select the event specific In-Session Class in the upper left
4. Click the “Image Classification with DIGITS” Class from the list
![Page 40: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/40.jpg)
40
LAUNCHING THE LAB ENVIRONMENT5. Click on the Select
button to launch the lab environment
• After a short wait, lab Connection information will be shown
• Please ask Lab Assistants for help!
![Page 41: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/41.jpg)
41
LAUNCHING THE LAB ENVIRONMENT
6. Click on the Start Lab button
You should see that the lab environment is “launching” towards the upper-right corner
![Page 42: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/42.jpg)
42
CONNECTING TO THE LAB ENVIRONMENT
7. Click on “here” to access your lab environment / Jupyter notebook
![Page 43: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/43.jpg)
43
CONNECTING TO THE LAB ENVIRONMENT
You should see your “Getting Started With Deep Learning” Jupyter notebook
![Page 44: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/44.jpg)
44
JUPYTER NOTEBOOK
1. Place your cursor in the code
2. Click the “run cell” button
3. Confirm you receive the same result
![Page 45: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/45.jpg)
45
STARTING DIGITS
Instruction in Jupyter notebook will link you to DIGITS
![Page 46: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/46.jpg)
46
ACCESSING DIGITS
• Will be prompted to enter a username to access DIGITS
• Can enter any username
• Use lower case letters
![Page 47: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/47.jpg)
47
LAB REVIEW
![Page 48: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/48.jpg)
48
FIRST RESULTSSmall dataset ( 10 epochs )
• 96% of accuracy achieved
• Training is done within one minute
SMALL DATASET
1 : 99.90 %
2 : 69.03 %
8 : 71.37 %
8 : 85.07 %
0 : 99.00 %
8 : 99.69 %
8 : 54.75 %
![Page 49: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/49.jpg)
49
FULL DATASET6x larger dataset
• Dataset
• Training Images: /home/ubuntu/data/train_full
• Test Image: /home/ubuntu/data/test_full
• Dataset Name: MNIST full
• Model
• Clone “MNIST small”.
• Give a new name “MNIST full” to push the create button
![Page 50: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/50.jpg)
50
SMALL DATASET FULL DATASET
1 : 99.90 % 0 : 93.11 %
2 : 69.03 % 2 : 87.23 %
8 : 71.37 % 8 : 71.60 %
8 : 85.07 % 8 : 79.72 %
0 : 99.00 % 0 : 95.82 %
8 : 99.69 % 8 : 100.0 %
8 : 54.75 % 2 : 70.57 %
SECOND RESULTSFull dataset ( 10 epochs )
• 99% of accuracy achieved
• No improvements in recognizing real-world images
![Page 51: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/51.jpg)
51
DATA AUGMENTATIONAdding Inverted Images
• Pixel(Inverted) = 255 – Pixel(original)
• White letter with black background
• Black letter with white background
• Training Images:/home/ubuntu/data/train_invert
• Test Image:/home/ubuntu/data/test_invert
• Dataset Name: MNIST invert
![Page 52: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/52.jpg)
52
SMALL DATASET FULL DATASET +INVERTED
1 : 99.90 % 0 : 93.11 % 1 : 90.84 %
2 : 69.03 % 2 : 87.23 % 2 : 89.44 %
8 : 71.37 % 8 : 71.60 % 3 : 100.0 %
8 : 85.07 % 8 : 79.72 % 4 : 100.0 %
0 : 99.00 % 0 : 95.82 % 7 : 82.84 %
8 : 99.69 % 8 : 100.0 % 8 : 100.0 %
8 : 54.75 % 2 : 70.57 % 2 : 96.27 %
DATA AUGMENTATIONAdding inverted images ( 10 epochs )
![Page 53: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/53.jpg)
53
MODIFY THE NETWORKAdding filters and ReLU layer
layer { name: "pool1“type: "Pooling“…
}
layer {name: "reluP1"type: "ReLU"bottom: "pool1"top: "pool1"
}
layer {name: "reluP1“
layer { name: "conv1" type: "Convolution"
...convolution_param {num_output: 75...
layer {name: "conv2"type: "Convolution"...convolution_param {num_output: 100...
![Page 54: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/54.jpg)
54
MODIFY THE NETWORKAdding ReLU Layer
![Page 55: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/55.jpg)
55
SMALL DATASET FULL DATASET +INVERTED ADDING LAYER
1 : 99.90 % 0 : 93.11 % 1 : 90.84 % 1 : 59.18 %
2 : 69.03 % 2 : 87.23 % 2 : 89.44 % 2 : 93.39 %
8 : 71.37 % 8 : 71.60 % 3 : 100.0 % 3 : 100.0 %
8 : 85.07 % 8 : 79.72 % 4 : 100.0 % 4 : 100.0 %
0 : 99.00 % 0 : 95.82 % 7 : 82.84 % 2 : 62.52 %
8 : 99.69 % 8 : 100.0 % 8 : 100.0 % 8 : 100.0 %
8 : 54.75 % 2 : 70.57 % 2 : 96.27 % 8 : 70.83 %
MODIFIED NETWORKAdding filters and ReLU layer ( 10 epochs )
![Page 56: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/56.jpg)
56
WHAT’S NEXT
• Use / practice what you learned
• Discuss with peers practical applications of DNN
• Reach out to NVIDIA and the Deep Learning Institute
![Page 57: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/57.jpg)
57 57
WHAT’S NEXT
…for the chance to win an NVIDIA SHIELD TV.
Check your email for a link.
TAKE SURVEYCheck your email for details to access more DLI training online.
ACCESS ONLINE LABS
Visit www.nvidia.com/dli for workshops in your area.
ATTEND WORKSHOPVisit https://developer.nvidia.com/join for more.
JOIN DEVELOPER PROGRAM
![Page 58: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/58.jpg)
58 58
![Page 59: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/59.jpg)
59
www.nvidia.com/dli
Instructor: Charles Killam, LP.D.
![Page 60: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/60.jpg)
60
Activation functions
tanh Sigmoid ReLU
![Page 61: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/61.jpg)
61
•
![Page 62: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/62.jpg)
62
•
![Page 63: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/63.jpg)
63
•
![Page 64: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/64.jpg)
64
•
![Page 65: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/65.jpg)
65
•
![Page 66: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/66.jpg)
66
•
![Page 67: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/67.jpg)
67
•
![Page 68: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/68.jpg)
68
![Page 69: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/69.jpg)
69
![Page 70: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/70.jpg)
70
![Page 71: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/71.jpg)
71
![Page 72: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/72.jpg)
72
![Page 73: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/73.jpg)
73
![Page 74: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/74.jpg)
74
•
![Page 75: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/75.jpg)
75
•
![Page 76: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/76.jpg)
76
•
![Page 77: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/77.jpg)
77
•
![Page 78: Image Classification with DIGITS · 22 CAFFE FEATURES Protobuf model format • Strongly typed format • Human readable • Auto-generates and checks Caffe code • Developed by](https://reader030.vdocuments.mx/reader030/viewer/2022041011/5ebacb42caba8b2ade1c84e6/html5/thumbnails/78.jpg)
78
••