high level-api in tensorflow
TRANSCRIPT
![Page 1: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/1.jpg)
High Level APIs In
TensorflowSCG AI Research Group
Hyungjoo Cho
![Page 2: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/2.jpg)
Who I am• (ex) LG Electronics, VC company
- Printing image processing - Proximity sensing - Gesture recognition
• Seoul City Gas, AI Research Group - Gas meter recognition - Text classification - Automatic pipeline network design system
• Interest - Human Action Recognition - Medical Image Processing - Generative Adversarial Networks
![Page 3: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/3.jpg)
What is Tensorflow??
![Page 4: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/4.jpg)
Tensorflow
• Open source software library for numerical computation using data flow graphs.
![Page 5: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/5.jpg)
Why should we use Tensorflow??
![Page 6: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/6.jpg)
*http://chainer.org/general/2017/02/08/Performance-of-Distributed-Deep-Learning-Using-ChainerMN.html
![Page 8: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/8.jpg)
![Page 9: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/9.jpg)
…???
![Page 10: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/10.jpg)
![Page 11: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/11.jpg)
Features
• Very low level (Flexible)
• Extensible
• Maintainable
• Higher level primitives (X)
![Page 12: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/12.jpg)
High level API
![Page 13: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/13.jpg)
Imagenet challenge
![Page 14: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/14.jpg)
Break-through
2012 CHALLANGE
![Page 15: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/15.jpg)
What happened??
![Page 16: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/16.jpg)
Alex-net
![Page 17: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/17.jpg)
Alex-net in Tensorflow
![Page 18: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/18.jpg)
How about deeper net
![Page 19: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/19.jpg)
VGG-Net
![Page 20: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/20.jpg)
Its code
![Page 21: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/21.jpg)
How about more deeper …
![Page 22: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/22.jpg)
Deep Residual Networks
We might use a network which has more than 1k layers
* https://github.com/daviddao/awesome-very-deep-learning
![Page 23: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/23.jpg)
…
![Page 24: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/24.jpg)
Let’s make it as a module
![Page 25: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/25.jpg)
VGG-Net
![Page 26: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/26.jpg)
Wide-Res-Net
*https://github.com/szagoruyko/wide-residual-networks
![Page 27: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/27.jpg)
Wide-Res-Net
![Page 28: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/28.jpg)
Fusion-Net
![Page 29: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/29.jpg)
Activation functions
tf.nn.sigmoid tf.nn.tanh tf.nn.relu
*http://adilmoujahid.com/posts/2016/06/introduction-deep-learning-python-caffe/
![Page 30: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/30.jpg)
Others…
Leaky Relu/Parametric Relu
There’s no function…
![Page 31: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/31.jpg)
Let’s make!!
![Page 32: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/32.jpg)
Loss functions• L1
• L2
• Binomial Cross Entropy
• Multinomial Cross Entropy
• Gan loss
• Pixel wise loss
• …
![Page 33: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/33.jpg)
Make!!
![Page 34: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/34.jpg)
Benefits
• Fast iteration
• Best practices
• Easily modify
![Page 35: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/35.jpg)
Should we make this ourselves?
![Page 36: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/36.jpg)
There is a number of High level API in
Tensorflow
![Page 37: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/37.jpg)
High level API in TF
• TF-Slim
• TF-layers, losses, metrics
• TF-Learn
• Keras
![Page 38: High level-api in tensorflow](https://reader031.vdocuments.mx/reader031/viewer/2022022205/58d0db561a28ab47238b659d/html5/thumbnails/38.jpg)
Thanks❤https://github.com/NySunShine/fusion-net