marvin minsky - nice workshop · 2018-05-02 · marvin minsky. why vision is a hard problem....

30

Upload: others

Post on 02-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,
Page 2: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,
Page 3: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Marvin Minsky

Page 4: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,
Page 5: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Why Vision is a Hard ProblemWhy Vision is a Hard Problem

Page 6: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

PerceptronPerceptron

Page 7: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

1969

Page 8: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,
Page 9: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Boltzmann MachinesLearning Probability Distributions

Boltzmann MachinesLearning Probability Distributions

Hinton and Sejnowski, 1983

Geoffrey Hinton

)( sleepwake

jijiij ssssw

Page 10: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,
Page 11: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Visual Cortex

Hubel and Wiesel, 1969

Page 12: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Hubel and Wiesel, 1962Hubel and Wiesel, 1962

Simple CellSimple Cell

Page 13: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Complex CellComplex Cell

Page 14: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Felleman and Van Essen,1991

Page 15: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Geoffrey Hinton and Yann Le Cun

Page 16: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Deep LearningDeep Learning

Yamins and DiCarlo, 2016Yamins and DiCarlo, 2016

Page 17: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,
Page 18: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Saddle Points in High DimensionsSaddle Points in High Dimensions

Error

Weights

Page 19: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

January 5, 2017: “After humanity spent thousands of years improving our tactics, computers tell us that humans are completely wrong.”

Ke JieKe Jie

Page 20: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

RUBIRUBI

Javier Movellan

Page 21: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Neuromorphic EngineeringNeuromorphic Engineering

Kwabena Boahen and Kareem Zaghloul

Page 22: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,
Page 23: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Retinal Ganglion CellsRetinal Ganglion Cells

Kuffler, 1953

Page 24: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Neuromorphic CameraNeuromorphic Camera

Tobi Delbruck

Lichtsteiner, Posch and Delbruck, 2008

Page 25: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Sejnowski and Delbruck, Scientific American 2012

Page 26: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

BRAIN InitiativeBrain Research through Advancing

Innovative Neurotechnologies

April 2, 2013

BRAIN InitiativeBrain Research through Advancing

Innovative Neurotechnologies

April 2, 2013 April 2, 2013

Page 27: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

Sophie Aimon

Page 28: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

BRAIN InitiativeBRAIN Initiative

Page 29: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,
Page 30: Marvin Minsky - NICE Workshop · 2018-05-02 · Marvin Minsky. Why Vision is a Hard Problem. Perceptron. 1969. Boltzmann Machines Learning Probability Distributions Hinton and Sejnowski,

The Deep Learning RevolutionThe Deep Learning Revolution

Terrence SejnowskiSalk Institute

UCSD

Terrence SejnowskiSalk Institute

UCSD