cs230: lecture 3 · cs230: lecture 3 the mathematics of deep learning backpropagation,...
TRANSCRIPT
![Page 1: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/1.jpg)
CS230:Lecture3ThemathematicsofdeeplearningBackpropagation,Initializations,Regularization
KianKatanforoosh
![Page 2: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/2.jpg)
I– BackpropagationII– InitializationsIII– Regularization
![Page 3: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/3.jpg)
I- Backpropagation
![Page 4: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/4.jpg)
Problemstatement
![Page 5: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/5.jpg)
A– LogisticRegressionbackpropagationforonetrainingexample
![Page 6: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/6.jpg)
B– LogisticRegressionbackpropagationforabatchofmexamples
![Page 7: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/7.jpg)
Question:Youhavetrainedananimalclassifier.Canyoutellwhatpartoftheinputledtothisprediction?
![Page 8: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/8.jpg)
II- Initializations
![Page 9: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/9.jpg)
Problemstatement
![Page 10: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/10.jpg)
Inclass,you’veseenthat:
![Page 11: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/11.jpg)
Thegoal:
![Page 12: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/12.jpg)
Let’sprovethat: !"# "[%&'] = !"# "[%] → !"# +[%] = 1-[%&']
![Page 13: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/13.jpg)
Let’sprovethat: !"# "[%&'] = !"# "[%] → !"# +[%] = 1-[%&']
!"# "[%] = !"# .[%] = !"# / +',1% "1%&'2 345
16'Checkpoint:
![Page 14: CS230: Lecture 3 · CS230: Lecture 3 The mathematics of deep learning Backpropagation, Initializations, Regularization Kian Katanforoosh](https://reader036.vdocuments.mx/reader036/viewer/2022070809/5f07b94f7e708231d41e6b61/html5/thumbnails/14.jpg)
We’veshownthatforeverylayerl: !"# "[%] = -[%&']!"# +[%] !"# "[%&']