mixtaiwan 20170222 清大電機 孫民 ai the next big thing
TRANSCRIPT
![Page 1: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/1.jpg)
![Page 2: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/2.jpg)
Artificial Intelligence: The Next Big Thing
from a computer vision perspective
VSLab 清大電機
孫民
![Page 3: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/3.jpg)
AlphaGo
2016 by Google DeepMind
Are these what AI all about?
![Page 4: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/4.jpg)
2014 Subfields of AI
![Page 5: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/5.jpg)
2015
Artifical General Intelligence (AGI)
![Page 6: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/6.jpg)
2016
![Page 7: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/7.jpg)
Deep Learning (DL)
• Data
• GPU Computing
• Talents
![Page 8: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/8.jpg)
Data:
• 開始於 2007 @ Princeton
• 初登場於 2009 @ CVPR
• 照片停止搜集於 2010
總共類別:21841
總共圖片:1千4百萬
• ILSVR Challenge 從2010到現今
Jia Deng Fei-Fei Li
Info from http://www.image-net.org/
![Page 9: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/9.jpg)
1K Image Classification
Figure from Olga Russakovsky ECCV'14 workshop
Deep Learning 深度學習
Label = f(Image)
![Page 10: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/10.jpg)
GPU: NVIDIA CUDA
Tesla P100 With Over 20 TFLOPS Of FP16 Read more: http://wccftech.com/nvidia-pascal-gpu-gtc-2016/#ixzz456KT75Jf
![Page 11: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/11.jpg)
Talents: DNNresearch acquired by Google
Geoffrey Hinton (right: Professor) Alex Krizhevsky (middle; PhD student), and Ilya Sutskever (left; Postdoc)
A story in computer Vision!
![Page 12: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/12.jpg)
DL Fuses AI-subfields • Vision and Language
• Vision and Control
http://mscoco.org/
Atari Breakout game & AlphaGo, DeepMind.
-> AGI
• Multiple Encoding and Decoding
![Page 13: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/13.jpg)
Image Captioning
f( ) = The man at bat is
ready to swing at the pitch
Vision Language
Recurrent Neuron Network (RNN) credit: Nature
convolutions
Convolution Neuron Network (CNN) credit: wiki
![Page 14: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/14.jpg)
Video Captioning/Titling
Zhen et al. ECCV 2016 from VSLab and Stanford AI Lab
![Page 15: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/15.jpg)
Big Video Data with Titles • Pairs of
Raw Video
CNN CNN CNN CNN
Title
![Page 16: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/16.jpg)
Viral Videos
![Page 17: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/17.jpg)
Huge Video Repository
Currently 28740 videos and keep growing
![Page 18: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/18.jpg)
Vision and Control
https://gym.openai.com/
• Learning to play game with weak supervision:
Reinforcement Learning (RL)
![Page 19: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/19.jpg)
Where It All Begins …
by DeepMind in NIPS 2013 Deep Learning Wrokshop
Playing Atari with
Deep Reinforcement Learning
slides by Yen-Chen Lin
![Page 20: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/20.jpg)
Self-driving Car: Trigger Accident Warning
VSLab Under Submission
![Page 21: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/21.jpg)
Fusing Multiple Sensors
Ke# le%
Medium+wrap%
Ke# le%
Medium+wrap%
thumb+4+finger%
Manipula7on%Region%
Side+view%
Chan et al. ECCV 2015 from VSLab
![Page 22: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/22.jpg)
Real-time Wearable Demo
Fisheye camera NVIDIA TK1
![Page 23: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/23.jpg)
Real-time Wearable Demo cellphone, bottle, keyboard, mouse, free hand
![Page 24: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/24.jpg)
Deep Learning (DL)
• Data
• GPU Computing
• Talents
![Page 25: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/25.jpg)
Talents
• Teach as many/early as possible
• Open! Open! Open!
• Critical mass
![Page 26: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/26.jpg)
How to Find Talents
• Our students know deep learning is HOT!
[ 2015 Deep Learning Workshop 中研院 ] 500 位參加者
![Page 27: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/27.jpg)
Deep Learning Courses
• NTU – http://speech.ee.ntu.edu.tw/~tlkagk/courses_MLSD1
5_2.html
– https://www.csie.ntu.edu.tw/~yvchen/f105-adl/syllabus
• NTHU – https://thecedl.github.io/
– http://www.cs.nthu.edu.tw/~shwu/courses/ml/
• NCTU – https://course.nctu.edu.tw/Course/CrsOutline/show.a
sp?Acy=105&Sem=2&CrsNo=5259&lang=zh-tw
![Page 28: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/28.jpg)
Teach As Early As Possible
![Page 29: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/29.jpg)
Case Study: Fu-Hsiang Chan NTHU Master Student
https://github.com/smallcorgi/Faster-RCNN_TF
https://github.com/smallcorgi/Faster-RCNN_TF/issues/17
![Page 30: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/30.jpg)
Case Study: YenChen Lin NTHU Undergraduate
https://github.com/yenchenlin1994/DeepLearningFlappyBird
![Page 31: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/31.jpg)
http://www.victoria.ac.nz/design/about/staff/tom-white
![Page 32: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/32.jpg)
Start Doing Research Early!
![Page 33: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/33.jpg)
Case Study: UNIST@Korean Undergraduate
![Page 34: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/34.jpg)
Comment from Andrej Karpathy
![Page 35: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/35.jpg)
Use Github in Class
• https://github.com/NTHU-EE-CV-2016-Fall/homework2
• https://github.com/NTHU-EE-CV-2016-Fall/homework2/pull/8
![Page 36: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/36.jpg)
Open Paper Review
https://openreview.net/ https://openreview.net/forum?id=BkjLkSqxg¬eId=BkjLkSqxg https://openreview.net/forum?id=r1Cy5yrKx¬eId=r1Cy5yrKx
![Page 37: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/37.jpg)
Arxiv
• http://arxiv-sanity.com/
![Page 38: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/38.jpg)
Critical Mass
• Google Brain
• Google Deepmind
• Facebook AI Lab
• Microsoft Research
• Baidu Research
![Page 39: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/39.jpg)
A Team of Talents
Most of them fresh PhDs
1 Billion Pledged USD
![Page 40: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/40.jpg)
A Team of Talents
![Page 41: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/41.jpg)
A Team of Talents
![Page 42: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/42.jpg)
Taiwan Issues
• Critical mass
• Collaboration
• Not open
![Page 43: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/43.jpg)
Taiwan’s Opportunities
• Factory Automation
– Manufacture Data
• Intelligent of Things (IoT)
– Sensors: AI for sensor fusion
• Smart Cities
– Government Open Data (http://index.okfn.org/place/taiwan/)
• Health Care
– Causality
• VR
– Content Generation
![Page 44: MixTaiwan 20170222 清大電機 孫民 AI The Next Big Thing](https://reader031.vdocuments.mx/reader031/viewer/2022020103/58e7382f1a28ab49038b4c2f/html5/thumbnails/44.jpg)
Thanks!