r g.ai ork - deep learningcs230.stanford.edu/files/c1m4.pdf · andrew ng applied deep learning is a...
TRANSCRIPT
![Page 1: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/1.jpg)
deeplearning.ai
Deep NeuralNetworks
Deep L-layerNeural network
![Page 2: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/2.jpg)
AndrewNg
What is a deep neural network?
logistic regression
1 hidden layer
2 hidden layers
5 hidden layers
![Page 3: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/3.jpg)
AndrewNg
Deep neural network notation
![Page 4: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/4.jpg)
deeplearning.ai
Deep NeuralNetworks
Forward Propagationin a Deep Network
![Page 5: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/5.jpg)
AndrewNg
Forward propagation in a deep network
![Page 6: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/6.jpg)
deeplearning.ai
Getting your matrixdimensions right
Deep Neural Networks
![Page 7: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/7.jpg)
Andrew Ng
Parameters !["] and "["]
$%&!&"
![Page 8: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/8.jpg)
Andrew Ng
Vectorized implementation
!"#!#"
![Page 9: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/9.jpg)
deeplearning.ai
Whydeeprepresentations?
DeepNeuralNetworks
![Page 10: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/10.jpg)
AndrewNg
Intuition about deep representation
!"
![Page 11: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/11.jpg)
AndrewNg
Circuit theory and deep learningInformally: There are functions you can compute with a “small” L-layer deep neural network that shallower networks require exponentially more hidden units to compute.
![Page 12: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/12.jpg)
deeplearning.ai
Building blocks ofdeep neural networks
Deep NeuralNetworks
![Page 13: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/13.jpg)
AndrewNg
Forward and backward functions
![Page 14: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/14.jpg)
AndrewNg
Forward and backward functions
![Page 15: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/15.jpg)
![Page 16: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/16.jpg)
![Page 17: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/17.jpg)
![Page 18: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/18.jpg)
deeplearning.ai
Parameters vsHyperparameters
Deep Neural Networks
![Page 19: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/19.jpg)
Andrew Ng
What are hyperparameters?Parameters: ! " , % " ,! & , % & ,! ' , % ' …
![Page 20: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/20.jpg)
Andrew Ng
Applied deep learning is a very empirical process
cost !
# of iterations
Idea
Experiment Code
![Page 21: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/21.jpg)
deeplearning.ai
What does thishave to do with
the brain?
Deep Neural Networks
![Page 22: r g.ai ork - Deep Learningcs230.stanford.edu/files/C1M4.pdf · Andrew Ng Applied deep learning is a very empirical process cost ! # of iterations Idea Experiment Code](https://reader033.vdocuments.mx/reader033/viewer/2022042122/5e9c50852735c475d5276e4a/html5/thumbnails/22.jpg)
Andrew Ng
Forward and backward propagation!["] = #["]$ + &["]'["] = ( " (! " )![$] = #[$]'["] + &[$]'[$] = ( $ (! $ )
'[%] = ( % ! % = +,
…
…
-![%] = '[%] − +-#[%] = 1
0-! % ' % &
-&[%] = 1012. sum(d! % , 9:;< = 1, =>>2-;0< = ?@A>)
-![%'"] = -# % &-! % (( % (! %'" )
-#["] = 10-! " ' " &
-&["] = 1012. sum(d! " , 9:;< = 1, =>>2-;0< = ?@A>)
-!["] = -# % &-! $ (( " (! " )