introductiondsba.korea.ac.kr/wp/wp-content/seminar/cs231n/cs231n... · 2017-01-08 · linear...

27
Introduction Data Science & Business Analytic Lab KyoungHyun Mo Vision history CS231n 1 / 26

Upload: lykhanh

Post on 09-Aug-2018

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

IntroductionData Science & Business Analytic Lab

KyoungHyun Mo

Vision historyCS231n

1 / 26

Page 2: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

CS231n

Stanford Vision Lab

Fei-Fei LiAndrej

KarpathyJustin

Johnson

2 / 26

Page 3: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

CS231n

Fei-Fei Li

Andrej Karpathy

Justin Johnson

class : 1Introduction

class : 2~7, 9~10, 14Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization, Recurrent Neural Network

class : 8, 11~13Localization and Detection, Deep Learning libraries, Segmentation, Unsupervised Learning

class : 15Invited Talk

Jeff Dean

3 / 26

Page 4: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

CS231n

Visual recognition problem

- Image classification

- 3D modeling

- Grouping

- Segmentation

CS231n focuses on one of the most important problems of

visual recognition, especially image classification

4 / 26

Page 5: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Image classification focus on the whole big image

There is a number of visual recognition problems that are related to image

classification, such as object detection, image captioning

CS231n

Object Detection Image Captioning

5 / 26

Page 6: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

- 생명체에 Vision Capacity가생김

- Leonardo da Vinci의카메라모델로 engineering vision이시작

Vision History

6 / 26

Page 7: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- 생물학적 Vision Processing에대한의문

- Hubel & Wiesel의실험

- Vision Processing의첫단계는심플한구조에뉴런이반응을한다

7 / 26

Page 8: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- 1963년 Larry Roberts의 Object의 Edge를추출하는실험

- Edge는어떤 Interior보다 Object의 Shape를정확히정의할수있음

8 / 26

Page 9: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- 1960년 First AI Lab (MIT의 Marvin Minskey / Stanford의 John McCarthy)

- 1966년 Artificial Intelligence Lab

- The Summer Vision Project부터시작하여 CVPR, ICCV 등유명학학회로발전

9 / 26

Page 10: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- Computer Vision에서 Influential Book

- Vision 분야에큰 Insight를제공

- Hierarchical Model을제시

10 / 26

Page 11: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- 3D 모델을인식하기위한방법론

- Generalizaed Cylinder : 단순한 Object의결합

- Pictorial Structure : Variability Concept을설명

11 / 26

Page 12: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- Colorful Image를사용하기시작

- Grouping Problem : 아직해결되지않은 Computer Vision 분야의문제

12 / 26

Page 13: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- 처음으로 Consumer Product에 Computer Vision이적용된알고리즘

- Localization과관련

- Focus of Computer Vision이 3D Modeling에서 Object Recognition으로이동

13 / 26

Page 14: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- Important Feature Extract

- Object Recognition을위해서 Global Shape를알아야하는것이아님

14 / 26

Page 15: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

- 2000년대 Object Recognition을위해서 Machine Learning 적용

15 / 26

Page 16: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

16 / 26

- Computer Vision 분야의성숙

- Global Standard의필요성대두

Page 17: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

17 / 26

Page 18: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

CNN(Convolutional Neural Network) win!!

18 / 26

Page 19: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

19 / 26

Page 20: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

Convolutional Neural Network(CNN) is not invented overnight

20 / 26

Page 21: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

Convolutional Neural Network(CNN) is not invented overnight

21 / 26

Page 22: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

Convolutional Neural Network(CNN) is not invented overnight

1. Hardware performance2. Availability of data

22 / 26

Page 23: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

The quest for visual intelligencegoes far beyond object recognition…

23 / 26

Page 24: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

1. Labeling of an entire scene, 3D modeling

24 / 26

Page 25: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

2. Visual genome, explain relationship betweenb object

25 / 26

Page 26: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Vision History

3. Give one picture and outcome a description

4. Explain the socializing andunderstand the world

26 / 26

Page 27: Introductiondsba.korea.ac.kr/wp/wp-content/seminar/CS231n/CS231n... · 2017-01-08 · Linear Classification, Optimization, Neural Networks, Convolutional Neural Network, Visualization,

Thank you