Upload File

machine learning and deep learning - mathworks · 3 deep learning is everywhere computer vision...

  • Home
  • Documents
  • Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical
29
1 © 2015 The MathWorks, Inc. Machine Learning and Deep Learning Abhijit Bhattacharjee

Upload: others

Post on 20-May-2020

30 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

1© 2015 The MathWorks, Inc.

Machine Learning and

Deep Learning

Abhijit Bhattacharjee

Page 2: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

2

Deep Learning is Everywhere

&

MATLAB Accelerates Deep Learning

Page 3: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

3

Deep Learning is Everywhere

Computer Vision

Pedestrian and traffic sign detection

Landmark identification

Scene recognition

Medical diagnosis and drug discovery

Text and Signal Processing

Speech Recognition

Speech & Text Translation

Robotics & Controlsand many more…

Page 4: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

4

What is Deep Learning?

Page 5: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

5

http://googleresearch.blogspot.com/2014/11/a-picture-is-worth-thousand-coherent.html

Deep Learning is a Subset of Machine Learning

E.g. Google Captioning Project

Machine learning is the science of getting computers to act without being explicitly programmed.

Deep learning algorithms can learn tasks directly from data, eliminating the need for manual feature selection.

http://googleresearch.blogspot.com/2014/11/a-picture-is-worth-thousand-coherent.html
Page 6: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

6

MODEL

PREDICTION

Shallow Machine Learning Workflow

Train: Iterate until you find the best model

Predict: Integrate trained models into applications

MODELSUPERVISED

LEARNING

CLASSIFICATION

REGRESSION

PREPROCESS

DATA

Contrast

Adjustment

Feature

ExtractionCropping

Feature

Analysis

LOAD

DATAPREPROCESS

DATA

Contrast

Adjustment

Feature

ExtractionCropping

Feature

Analysis

NEW

DATA

Page 7: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

7

Shallow vs Deep Learning

Deep learning performs end-to-end learning by learning features, representations and tasks directly

from images, text and sound

Deep learning algorithms also scale with data – shallow learning convergesShallow Machine Learning

Deep Learning

Page 8: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

8

Shallow vs Deep Learning

Page 9: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

9

What problem does Deep Learning solve?

Data

Tasks

Metrics

1.2 million images

Object recognition

Top-5 error rate

Image credit: http://image-net.org/synset

ImageNet Large Scale Visual Recognition Challenge (ILSVRC)

1000 categories

Localization, and more

Page 10: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

10

RESULTS: Unparalleled accuracy

in image recognition

DATA: Enormous labeled data sets available

– e.g. ImageNet , PASCAL VoC , Kaggle

COMPUTING POWER: GPUs enable training on

massive amounts of data

BOOTSTRAPPING: Start prototyping with the best

available solutions

Why is Deep Learning so popular?

Page 11: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

11

Three Reasons to Use MATLAB for Deep Learning

Easily manipulate big data and networks

Use MATLAB to learn about the field

Unify multiple domains in a single workflow

ACCESS

LEARN

INTEGRATE

Page 12: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

12

Three Reasons to Use MATLAB for Deep Learning

Easily manipulate big data and networks

Use MATLAB to learn about the field

Unify multiple domains in a single workflow

ACCESS

LEARN

INTEGRATE

Page 13: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

13

Object Recognition using Deep Learning

Training

(using GPU)Millions of images from 1000 different categories

Prediction Real-time object recognition using a webcam connected to a

laptop

ACCESS

LEARN

INTEGRATE

Page 14: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

14

Handle Large Image Sets Easily

Also datastore for other collections of

data

ACCESS

LEARN

INTEGRATE

Page 15: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

15

Three Reasons to Use MATLAB for Deep Learning

Easily manipulate big data and networks

Use MATLAB to learn about the field

Unify multiple domains in a single workflow

ACCESS

LEARN

INTEGRATE

Page 16: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

16

Two Approaches for Deep Learning

1. Train a Deep Neural Network from Scratch

2. Fine-tune a pre-trained model (transfer learning)

ACCESS

LEARN

INTEGRATE

Page 17: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

17

Transfer Learning in MATLAB

ACCESS

LEARN

INTEGRATE

Page 18: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

18

Manipulate Deep Learning Networks Easily

ACCESS

LEARN

INTEGRATE

DELETE LAYERS

ADD LAYERS

Page 19: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

19

Manipulate Deep Learning Networks Easily

GPU CPU

ACCESS

LEARN

INTEGRATE

Page 20: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

20

Three Reasons to Use MATLAB for Deep Learning

Easily manipulate big data and networks

Use MATLAB to learn about the field

Unify multiple domains in a single workflow

ACCESS

LEARN

INTEGRATE

Page 21: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

21

Visualize Deep Learning Features

ACCESS

LEARN

INTEGRATE

Page 22: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

22

Other Resources

Documentation

Examples and Tutorials

MATLAB Community

Videos and Seminars

ACCESS

LEARN

INTEGRATE

Page 23: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

23

Three Reasons to Use MATLAB for Deep Learning

Easily manipulate big data and networks

Use MATLAB to learn about the field

Unify multiple domains in a single workflow

ACCESS

LEARN

INTEGRATE

Page 24: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

25

MATLAB

SIMULINK

ACCESS

LEARN

INTEGRATE

Deep Learning

Tools

Math, Stats,

And Optimization

Application

Deployment

Database

Integration

Camera

Integration

Real-Time

Simulation

Simulation

Graphics

Physical

Modeling

Verification and

Validation

Event-Based

Modeling

Code Generation

Deep Learning Tools

• Image Processing

• Computer Vision

• Machine Learning

• Neural Networks

• Parallel Computing

Page 25: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

26

Customer Examples

Page 26: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

27

• Extract hundreds of thousands of signs

• Confirm sign type and build a database

• Train system to deal with normal and imperfect signs

75,000speed limit signs

in the training set

Continental

Machine Learning for traffic sign recognition

ACCESS

LEARN

INTEGRATE

Page 27: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

28

• Detect cars, pedestrians, and other obstacles

• Median recognition rate of 99%

• Converted to C code running without MATLAB

Alpine

Machine Learning and MATLAB Coder for automatic ground detection

ACCESS

LEARN

INTEGRATE

Page 28: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

29

Deep Learning is Everywhere

MATLAB Accelerates Deep Learning

ACCESS

LEARN

INTEGRATE

Page 29: Machine Learning and Deep Learning - MathWorks · 3 Deep Learning is Everywhere Computer Vision Pedestrian and traffic sign detection Landmark identification Scene recognition Medical

30© 2015 The MathWorks, Inc.

Questions and Answers


Learning Simulink - MathWorks

Introduction to Deep Learning - Computer Graphics€¦ · Introduction to Deep Learning CS468 Spring 2017 Charles Qi. What is Deep Learning? Deep learning allows computational models

MathWorks in Academia...Loren Shure MathWorks MathWorks goal: Change the world by accelerating the pace of discovery, innovation, development, and learning in engineering and science

Machine Learning for Risk Management in MATLAB · Machine Learning for Risk Management in MATLAB Marshall Alphonso Senior Engineer - Finance. MathWorks. ... Deep refers to the number

Mathworks - Machine Learning Made Easy

An Introduction to Deep Learning · Deep Learning An Introduction to ... •Deep Learning •Feed Forward Network •Problems of Deep Learning •AutoEncoders •Restricted Boltzmann

Text Analytics & Sentiment Analysis - MathWorks · 7 What is Text Analytics/NLP? Artificial Intelligence Machine Learning Deep Learning Natural Language Processing Text Analytics

Lecture 3: Deep Learning Optimizations - GitHub Pagesuvadlc.github.io/lectures/nov2019/lecture3.pdf · Lecture 3: Deep Learning Optimizations Deep Learning @ UvA. UVA DEEP LEARNING

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

Demystifying Deep Learning - MathWorks · Demystifying Deep Learning Mandar Gujrathi [email protected]. 2. 3 ... Model learns to perform classification tasks directly

Deep Learning in - it.mathworks.com€¦ · Deep Learning in From Concept to Embedded Code Alexander Schreiber Principal Application Engineer MathWorks Germany MathWorks Automotive

Deep Learning with MATLAB and Multiple GPUs - MathWorks · • MATLAB, Neural Network Toolbox, Parallel Computing Toolbox™ • A MathWorks account • Access to MATLAB Distributed

Hangzhou Deep Learning Meetup-Deep Reinforcement Learning

Makers Faire Roma, ottobre 2014 - it.mathworks.com€¦ · Intro SIMULINK 15:00 Visione artificiale con Deep Learning in MATLAB Giuseppe Ridinò, MathWorks Aumentare l’affidabilità

Introducing Deep Learning with MATLAB - MathWorks · PDF fileDeep learning is a type of machine learning in which a model learns to perform classification tasks directly from images,

Deep Learning for Computer Vision - MathWorks Dense 8 SURF HOG Image ... Addressing Challenges in Deep Learning for Computer Vision ... Face recognition Key Takeaways MATLAB for Deep

What’s New in MATLAB and Simulink - MathWorks...Deep Learning Onramp Learn to use deep learning techniques in MATLAB for image recognition. MATLAB Onramp Quickly learn the essentials

Deep Learning : new tools for algorithm design and validation · Deep Learning New tools for algorithm design and validation MathWorks Automotive Conference 2017 Arvind Jayaraman

Lecture 1: Introduction to Deep Learning - uvadlc.github.io · Lecture 1: Introduction to Deep Learning Efstratios Gavves. UVA DEEP LEARNING COURSE UVA DEEP LEARNING COURSE –EFSTRATIOS

Deep Learning in real world @Deep Learning Tokyo

Deep Learning - South Dakota State UniversityDeep Learning Deep learning (also known as deep structured learning, hierarchical learning or deep machine learning) is a branch of machine

Deep Learning for Computer Vision - MathWorks

Diagnostics and Prognostics with MATLAB - MathWorks · Different Types of Learning Machine Learning Supervised Learning Classification Regression Unsupervised Learning Clustering

Master Class: Deep Learning › content › dam › mathworks › ...4 MATLAB Deep Learning Framework Access Data Design + Train Deploy Manage large image sets Automate image labeling

Deep Learning for Computer Vision - MathWorks · Challenges using Deep Learning for Computer Vision Steps Challenge Importing Data Managing large sets of labeled images Preprocessing

Deep Learning Lab Course 2017 (Deep Learning …ais.informatik.uni-freiburg.de/teaching/ws17/deep...Deep Learning Lab Course 2017 (Deep Learning Practical) Labs: (Computer Vision)

Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Learning

Deep Learning : new tools for algorithm design and validationuk.mathworks.com/content/dam/mathworks/mathworks-dot-com/... · Deep Learning New tools for algorithm design and validation

Deep Learning for Reinforcement Learning in · PDF fileDeep Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning für ... Während

AI, Machine, Deep learning and NLP - MathWorks...3 Artificial Intelligence Machine Learning AI, Machine Learning and Deep Learning Timeline 1950s 1980s Today Breadth Bioinformatics

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

Unlocking the Power of Machine Learning › content › dam › mathworks › mathworks... · Machine Learning Supervised Learning Classification Regression Unsupervised Learning

20151216 Computer Vision Meetup Deep Learning Deep Learning - Rene...Deep Learning . René Donner Deep Learning Overview 2 ... coursera ... 20151216 Computer Vision Meetup Deep Learning

Introduction to Deep Learning - Joyce Hojoyceho.github.io/cs534_s17/slide/25-deep-learning.pdf · Deep Learning: Overview ... Review: Backpropogation https: ... • Deep Learning

Deep Learning: An Introduction from the NLP Perspective Deep Learning - An...Deep Learning Approach 1 Deep Learning Approach 2 Disclaimer I am not (yet) an expert in Deep Learning