the biological path towards strong ai strange loop 2017, st. louis

41
The Biological Path Toward STRONG AI Matt Taylor @rhyolight Numenta HTM Community Manager

Upload: numenta

Post on 21-Jan-2018

115 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

The Biological Path Toward STRONG AI

Matt Taylor@rhyolight

Numenta HTM Community Manager

Page 2: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Agenda• Why Weak AI is not intelligent

• Cortex anatomy lesson

• The power of the pyramidal neuron

• Layers within columns

• HTM Theory details: SDRs, Spatial Pooling, Temporal Memory

• HTM Sensorimotor Theory details

Page 3: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Weak AI won’t produce Intelligence

Page 4: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

what’s missing?

Page 5: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Realistic Neurons

Page 6: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Movement

Page 7: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Let’s talk about

brains

Page 8: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 9: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 10: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Layers

Page 11: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Layers and Columns

Page 12: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Layers contain Neurons

Page 13: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

The Pyramidal

Neuron

Page 14: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

The Pyramidal

NeuronInactive State

Page 15: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

The Pyramidal

NeuronInactive State

Active State

Page 16: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

The Pyramidal

NeuronInactive State

Active StatePredictive State

Page 17: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

The Pyramidal

Neuron

Page 18: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Apical

Distal

Proximal

The Pyramidal

Neuron

Page 19: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Layer Integration Zones

Page 20: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Layers ComputeApical

Distal

ProximalDriver Signal

Modulatory Signals

Page 21: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Layer in Software

Page 22: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Layer in Software

Page 23: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Layer in Software

Page 24: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Sparse Distributed Representationshow neurons encode information

Page 25: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

EncodersExample: Date Encoding

Page 26: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Spatial Pooling

• proximal feedforward input activates mini-columns• normalizes sparsity of encoded representation• maintains semantic meaning of representations

Page 27: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

ProximalDriver Signal

Page 28: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 29: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 30: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 31: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Distal

Page 32: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Temporal Memory

• identifies context of input based upon distal segments• works within structure of mini-columns• puts cells into predictive states for next time step

Page 33: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Apical

Distal

ProximalDriver Signal

Modulatory Signals

Page 34: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 35: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 36: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 37: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 38: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 39: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

numenta.com/papers/

Page 40: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis
Page 41: The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

numenta.org

@rhyolight @numenta