convolutional neural networks for object recognition...overview •what is computer vision ?...

42

Convolutional Neural Networks for Object Recognition Marius Leordeanu University Politehnica of Bucharest LeMas-2017 Summer School

Upload: others

Post on 22-Jul-2020

20 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Convolutional Neural Networks for Object Recognition

Marius Leordeanu

University Politehnicaof Bucharest

LeMas-2017Summer School

Page 2: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Overview

• What is Computer Vision ?

• Convolutional Neural Networks

• Convolutional Networks for Visual Object Recognition

Based on the course materials and slides by Fei-Fei Li, Andrej Karpathy and Justin Johnson at Stanford Universityhttp://cs231n.stanford.edu/syllabus.html

Page 3: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Learning to SeeFrom Eyes … to Vision

Marius Leordeanu

Page 4: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

What is vision ?

What we see What a computer sees

Page 5: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Vision is an inference problemit is a way of thinking

Many different 3D scenes could have given rise to the same 2D picture.

Page 6: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 7: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 8: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 9: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 10: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 11: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 12: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 13: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 14: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 15: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 16: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 17: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 18: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 19: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 20: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 21: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 22: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 23: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 24: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 25: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 26: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 27: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 28: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 29: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 30: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 31: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 32: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 33: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 34: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 35: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 36: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 37: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 38: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 39: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 40: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Page 41: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Computational Frameworks for ConvNets

• Caffe

http://caffe.berkeleyvision.org/

• Torch

http://torch.ch/

• TensorFlow

https://www.tensorflow.org/versions/r0.9/tutorials/deep_cnn/index.html

• Matconvnet

http://www.vlfeat.org/matconvnet/

http://caffe.berkeleyvision.org/

http://torch.ch/

https://www.tensorflow.org/versions/r0.9/tutorials/deep_cnn/index.html

http://www.vlfeat.org/matconvnet/

Page 42: Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

What is vision ?

We learn patterns from past visual experiences and recognize them now, to create our present visual world.

Using Convolutional Neural Networks for ...lasp.colorado.edu/.../Poster2019_SerenaFlint.pdf · Using Convolutional Neural Networks for Spectropolarimetric Inversions Serena Flint1,2,

Deep Neural Networks Convolutional Networks II

Deep Neural Networks Convolutional Networks II - Deep Learningdeeplearning.cs.cmu.edu/document/slides/lec9.CNN.pdf · Deep Neural Networks Convolutional Networks II Bhiksha Raj Spring

Convolutional Neural Networks - arXiv

Convolutional Neural Networks

Convolutional neural networks for direct inference of ...eprints.whiterose.ac.uk/142937/1/Convolutional Neural Networks for... · This is a repository copy of Convolutional neural

Lecture 17 Convolutional Neural Networks

Convolutional Neural Network · Convolutional Neural Networks (CNN) •A.k.a. CNN or ConvNet Adit Deshpande, A Beginner's Guide To Understanding Convolutional Neural Networks. Digital

Intro To Convolutional Neural Networks

Convolutional Neural Networks (CNN)

Convolutional Networks with Adaptive Inference Graphs€¦ · Keywords Convolutional neural networks · Gumbel-Softmax · Residual networks 1 Introduction Often, convolutional networks

Understanding Convolutional Neural Networks

Convolutional Neural Networks - Virginia Techjbhuang/teaching/ece5554-4554/fa17/... · Convolutional Neural Networks Computer Vision ... ImageNet Classification with Deep Convolutional

Convolutional Neural Networks for Deep Learning: An Introduction · 2017-10-05 · Introduction: Convolutional Neural Networks (CNN) Convolutional Neural Networks: A deep learning

Convolutional Neural Networksimft.ftn.uns.ac.rs/ssip2017/wp-content/uploads/... · Convolutional Neural Networks for Semantic ... Shelhamer, Darrell, Fully Convolutional Networks

Introduction to Convolutional Neural Networks

VIP Cheatsheet: Convolutional Neural Networks

Convolutional Neural Networks Summary - auth

Convolutional Neural Networks for No-Reference Image Quality Assessmentopenaccess.thecvf.com/...Convolutional_Neural_Networks_2014_CVPR_paper.pdf · Convolutional Neural Networks

Constrained Convolutional Neural Networks for …vgg/rg/slides/ccnn1.pdf · Constrained Convolutional Neural Networks for Weakly Supervised Segmentation ... [CCNN] Convolutional Neural

Convolutional Neural Networks - TJ Machine Learning Clubtjmachinelearning.com/lectures/cnn/cnn.pdf · 2018-05-23 · Convolutional Neural Networks Mihir Patel ... Traditional neural

Deep convolutional neural networks - Computer Science- …web.cs.ucdavis.edu/.../lee_lecture19_deeplearning_notes.pdf · Deep convolutional neural networks ... “Deep” architecture

CONVOLUTIONAL NEURAL NETWORKS: MOTIVATION, …

Convolutional Neural Networks Analyzed via Convolutional ... · PDF fileConvolutional Neural Networks Analyzed via Convolutional Sparse Coding ... Deep Learning, Convolutional Neural

Convolutional Neural Networks: Epic Fails

Deep Convolutional Neural Networks - Cjoint.com

SUPERRESOLUTION RECURRENT CONVOLUTIONAL NEURAL NETWORKS

Neural Network Part 3: Convolutional Neural Networkspages.cs.wisc.edu/.../lecture12-neural-networks-3.pdf · Convolutional neural networks •Strong empirical application performance

Accelerating Convolutional Neural Network Systemshgrg1/publications/honours.pdf · 2015-07-29 · Accelerating Convolutional Neural Network Systems ... Convolutional Neural Networks

Convolutional Neural Networks - tjmachinelearning.com · Convolutional Neural Networks Mihir Patel November 2017 1 Introduction Neural networks are a very robust machine learning

O-CNN: Octree-based Convolutional Neural Networks for … · O-CNN: Octree-based Convolutional Neural Networks for 3D ... object classification, ... Octree-based Convolutional Neural

Lecture 10: Convolutional Neural Networks · CS231n: Convolutional Neural Networks K. Simonyan and A. Zisserman, Very Deep Convolutional Networks for Large -Scale Image Recognition,

Convolutional Neural Networks (CNNs / ConvNets)web.stanford.edu/class/cs379c/archive/2018/class...Convolutional Neural Networks (CNNs / ConvNets) Convolutional Neu ral Networks are

Convolutional Neural Networks: An Introduction

Convolutional Neural Networks · 2017-10-10 · Convolutional? –Pruning Convolutional Neural Networks for Resource Efficient Inference –FILTER SHAPING FOR CONVOLUTIONAL NEURAL