learning associations while retaining specificity: competing demands on network plasticity rules

74
ning associations while retaining specificit ompeting demands on network plasticity rules Paul Miller, Brandeis University with Mark Bourjaily (Neuroscience Program) Talk Synopsis 1) Introduction to task and plasticity mechanisms 2) Associativity and specificity without persistence

Upload: vianca

Post on 19-Mar-2016

48 views

Category:

Documents


0 download

DESCRIPTION

Learning associations while retaining specificity: Competing demands on network plasticity rules. Paul Miller, Brandeis University with Mark Bourjaily (Neuroscience Program). Talk Synopsis Introduction to task and plasticity mechanisms Associativity and specificity without persistence - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Learning associations while retaining specificity: Competing demands on network plasticity rules.

Paul Miller, Brandeis University

with Mark Bourjaily (Neuroscience Program)

Talk Synopsis

1) Introduction to task and plasticity mechanisms

2) Associativity and specificity without persistence

3) Formation of sequential working memory

Page 2: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Introduction: paired associates

Page 3: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Introduction: paired associates

Page 4: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Introduction: paired associates

Page 5: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Introduction: paired associates

Page 6: Learning associations while retaining specificity:  Competing demands on network plasticity rules

The Associative Inference Task (phases 1,2)

Bunsey and Eichenbaum 1996 Nature 379 25-257

Introduction: paired associates

Associative inference task phases 1-2.

Page 7: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Introduction: stimulus-response pools

Page 8: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Introduction: stimulus-response pools

Page 9: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Introduction: stimulus-response pools

Page 10: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Biased choicearises from reward-based plasticity?

Pair-responsivepools form via correlations of stimuli?

Introduction: stimulus-response pools

Page 11: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Questions to address

How can all these connections form?

Can they be stable once they have formed?

What biological plasticity rules help/don’t help?

Does initial network “architecture” matter much?

Page 12: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Plasticity mechanisms: STDP

Page 13: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Long-term potentiation of inhibition, LTPi

Maffei et al, Nature 2006

I to E connection increases with I-spike, veto by E-spike

Page 14: Learning associations while retaining specificity:  Competing demands on network plasticity rules

E-cells, random sparseconnections

I-cells,all-to-all

2) Associativity and specificity without persistencea) Structured inputs

Page 15: Learning associations while retaining specificity:  Competing demands on network plasticity rules

2) Associativity and specificity without persistenceProtocol, 2 secs of separate inputs A : B : A+B

Page 16: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Initial responses of selected cells in each pool2) Associativity and specificity without persistenceInitial responses

Page 17: Learning associations while retaining specificity:  Competing demands on network plasticity rules

2) Associativity and specificity without persistenceCell responses after 200 trials: enhanced selectivity

Page 18: Learning associations while retaining specificity:  Competing demands on network plasticity rules

A

B

AB

Post synaptic pool

Pre

syna

ptic

poo

l

Post synaptic pool

Pre

syna

ptic

poo

l

Page 19: Learning associations while retaining specificity:  Competing demands on network plasticity rules

STDP alone destroys AB specificity (200 trials with homeostasis)

Page 20: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 21: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Inputs are all-to-all, randomized, no structure.AB selectivity arises with inhibitory plasticity alone

Page 22: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 23: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Summary of Part 2 (no persistence)

STDP tends to over-associateLTPi enhances specificity of neural activity

Inhibitory plasticity in an unstructured network can lead to specific stimulus-pair responses

Page 24: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Part 3 (formation of sequential working memory)

E-to-E plasticity certainly needed for persistence(cf GQ Bi’s work)

Best results with small-world connectivity:Mostly local E-E connections< 1% all-to-all E-E connections

STDP can generate “bumps” of memory activity.

Page 25: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memoryBump and ring attractor schematic

Page 26: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memoryBump and ring attractor schematic

Page 27: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memoryBump and ring attractor schematic

Page 28: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memoryBump and ring attractor schematic

Page 29: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memoryBump and ring attractor schematic

Page 30: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memoryBump and ring attractor schematic

Page 31: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memoryBump and ring attractor schematic

Page 32: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:Initial network response to X then Y

I-cells

Y

X

B

A

cue 2cue 1 Time (sec)

Page 33: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:Evolved network response to X then Y

Icells

Y

X

B

A

cue 2cue 1

Page 34: Learning associations while retaining specificity:  Competing demands on network plasticity rules

cue 1 cue 2

3) Formation of sequential working memory:Evolved network response to A then Y

Icells

Y

X

B

A

Page 35: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:Evolved network response to A then B

Icells

Y

X

B

A

cue 2cue 1

Page 36: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Icells

Y

X

B

A

cue 1 cue 2

3) Formation of sequential working memory:Evolved network response to X then B

Page 37: Learning associations while retaining specificity:  Competing demands on network plasticity rules

A-YA-BX-BX-Y

Stimulus-pair-dependent activity profiles (average firing rates between 1.5-2s after 2nd cue)

Page 38: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Some cells most responsive to X-B …

Page 39: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Some cells most responsive to X-B …

… only a few most responsive to A-B

Page 40: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 41: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 42: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

M. Warden and E.K. Miller, Cereb Cortex 2007

Page 43: Learning associations while retaining specificity:  Competing demands on network plasticity rules

M. Warden &E.K. Miller, Cereb Cortex 2007

Page 44: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 45: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 46: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 47: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 48: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 49: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 50: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 51: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 52: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 53: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 54: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 55: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 56: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory:What about order of stimuli?

Page 57: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Icells

C

B

A

3) Formation of sequential working memory: orderEvolved network response to A then B

cue 1 cue 2

Page 58: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory: orderEvolved network response to B then A

cue 1 cue 2

Icells

C

B

A

Page 59: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory: orderEvolved network response to C then A

cue 1 cue 2

Icells

C

B

A

Page 60: Learning associations while retaining specificity:  Competing demands on network plasticity rules

3) Formation of sequential working memory: orderEvolved network response to C then B

cue 1 cue 2

Icells

C

B

A

Page 61: Learning associations while retaining specificity:  Competing demands on network plasticity rules

A-BB-A

C-AC-B

Page 62: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Future Directions Small-world topology without seeding?Generalize to more stimuli => higher-D topologyHow essential is each form of plasticity?

Are other stages of task with distinct roles of HC vs cortex explained by random vs small-world topologies?

AcknowledgmentsBrandeis Neuroscience Program, Swartz Foundation

Page 63: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 64: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 65: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 66: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 67: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 68: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 69: Learning associations while retaining specificity:  Competing demands on network plasticity rules

F

Y

Page 70: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 71: Learning associations while retaining specificity:  Competing demands on network plasticity rules

F

Y

Page 72: Learning associations while retaining specificity:  Competing demands on network plasticity rules
Page 73: Learning associations while retaining specificity:  Competing demands on network plasticity rules

F

Y

Page 74: Learning associations while retaining specificity:  Competing demands on network plasticity rules

Y

F