learning and memory adapted from: home.cc.umanitoba.ca/~marotta/3350/lecture18_memory.ppt ... -...
TRANSCRIPT
![Page 1: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/1.jpg)
Learning and Memory
Adapted from:home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt
www.hartnell.edu/faculty/.../powerpoint/...PPT/Coon_08... - United States
![Page 2: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/2.jpg)
Why are learning and memory important?
To be able to adapt to changes in the environment Learning
•Acquire and process information from the environment
Changes the nervous system
Memory•Ability to retain this information
![Page 3: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/3.jpg)
Hypothesized Memory Processes
Incoming information
Performance
Retrieval
Working memory
Short-term storageEncoding
Long-term storage
ConsolidationSensory buffers
Sight
Sound
Smell
Touch
Adapted from Rozenzeig, 2002
Loss of information
![Page 4: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/4.jpg)
Multiple Trace Hypothesis of Memory
0
1
2
3
4
5
6
7
8
9
1 0
Time
Str
eng
th o
f m
emo
ry t
race Sensory buffer
Short-term memory
Intermediate-term memoryLong-term memory
High
Low
Input
Adapted from Rozenzeig, 2002
![Page 5: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/5.jpg)
Multiple Memory Systems Hypothesis
Memory can be divided into categories that reflect the type of information being remembered.
Each system primarily employs a distinct brain region Declarative Hippocampus Procedural Basal Ganglia
Emotional Amygdala ‘Working With’ Memory Prefrontal Cortex
![Page 6: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/6.jpg)
![Page 7: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/7.jpg)
Sensory memory
• Large capacity, but rapid decay
• Sensory association areas involved
• Example: Your mother is lecturing you and you aren’t paying attention, however, if asked, you can repeat the last sentence she said.
0
1
2
3
4
5
6
7
8
9
1 0
Time
Stre
ngth
of m
emor
y tr
ace
Sensory buffer
High
Low
Input
![Page 8: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/8.jpg)
Short-term memory(Working memory)
• Lasts for seconds to minutes• Severely limited capacity
• magical 7 ± 2 – hold for digits, letters, etc.
• Available to conscious awareness• Prefrontal cortex involved• Example: remember a phone
number between looking it up and dialing
0
1
2
3
4
5
6
7
8
9
1 0
Time
Stre
ngth
of m
emor
y tr
ace
Sensory buffer
Short-term memory
High
Low
Input
![Page 9: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/9.jpg)
Intermediate-term Memory
• Lasts for hours and days • May be transferred to LTM
through rehearsal• Example: remembering where
you parked your car
0
1
2
3
4
5
6
7
8
9
1 0
Time
Str
engt
h of
mem
ory
trac
e
Sensory buffer
Short-term memory
Intermediate-term memory
High
Low
Input
![Page 10: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/10.jpg)
STM and Forgetting
• Decay theory• memory fades away with time, unless
there is rehearsal• Interference theory
• memory for other material interferes with information we are trying to remember
![Page 11: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/11.jpg)
Decay Theory of Forgetting
100%Rehears
al
Day 1 Day 2 Day 7 Day 30
• Example: reviewing notes after class
Am
ount
of
info
rmati
on
• Memory fades away with time• unless there is rehearsal
![Page 12: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/12.jpg)
Interference Theory of Forgetting
Example: studying versus cramming
0
20
40
60
80
100
Per
cent
Cor
rect
Massed Learning
Spaced Learning
• Better recall when presentation of information is spaced
Massed
Spaced
![Page 13: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/13.jpg)
Interference Theory of Forgetting
BOOK CAP HAWK BALL LETTER BIRD CAN SHIRT LION DOOR
• Better recall for items presented first (primacy) and last (recency) in a list
![Page 14: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/14.jpg)
Mechanisms of Primacy and Recency
Primacy: • Memory system has enough resources
to transfer items at the beginning of a list into LTM
Recency: • Items at the end of the list are still in
STM and are therefore available for recall
1. BOOK 2. CAP 3. HAWK 4. BALL 5. LETTER 6. BIRD 7. CAN 8. SHIRT 9. LION10. DOOR
![Page 15: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/15.jpg)
Hypothesized Memory Processes
Incoming information
Performance
Retrieval
Working memory
Short-term storageEncoding
Long-term storage
ConsolidationSensory buffers
Sight
Sound
Smell
Touch
Adapted from Rozenzeig, 2002
Attention Rehearsal
![Page 16: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/16.jpg)
Factors Affecting Primacy and Recency
• A distractor task at the end of a list interfered with recency, but not primacy.• Interrupts rehearsal
• A faster presentation rate interfered with primacy, but not recency.• Increases load and effects transfer of information
from STM to LTM
• Changing the length of delay between training and testing interfered with both primacy and recency.
![Page 17: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/17.jpg)
Effect of Delay on Primacy and Recency
40
60
80
100
Serial Position of Memory Item
Per
cen
t C
orr
ect
Test immediatelyTest after short delay
Test after long delay
PrimacyRecency
![Page 18: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/18.jpg)
Consolidation
• Hippocampus and amygdala involved
• Memories are subject to modification during reactivation and reconsolidation
• Memories are more likely to reflect how person perceived the event, rather than what actually happened • Confidence is not correlated with accuracy• Implications for eyewitness accounts, repressed
memories of abuse
![Page 19: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/19.jpg)
Story so far…
Learning and memory involves multiple processes, traces and systems.
• Processes• Encoding, consolidation and retrieval
• Traces• Sensory, short-, intermediate- and long-term
• Systems• Declarative, procedural, emotional, ‘working-
with’
![Page 20: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/20.jpg)
Long-term memory
• Lasts for months and years• Takes a long time to consolidate
0
1
2
3
4
5
6
7
8
9
1 0
Time
Stre
ngth
of m
emor
y tra
ce
Sensory buffer
Short-term memory
Intermediate-term memoryLong-term memory
High
Low
Input
Declarative• Episodic• Semantic
Non-declarative• Procedural• Perceptual• Conditioning• Non-associative
![Page 21: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/21.jpg)
Declarative memory
• Knowledge we have conscious access to • Often referred to as explicit memory
• Episodic• Personal experiences / events etc.
• Canoeing on Lake Winnipeg, surfing in San Diego
• Often referred to as autobiographical memory
• Semantic• Conceptual knowledge
• “Where is Lake Winnipeg, where is San Diego?”• “How do you canoe, how do you surf?”
![Page 22: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/22.jpg)
Non-declarative Memory
• Performance informed by implicit knowledge
• Perceptual memory• Priming
• Procedural memory• Operant / instrumental conditioning
• Emotional memory• Conditioned fear response
• Non-associative memory • Habituation / sensitization
![Page 23: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/23.jpg)
Perceptual Memory: Priming
• An alteration of response to a stimulus as a result of prior exposure
![Page 24: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/24.jpg)
• Can last for hours• Not dependent on level of processing• Reduced (but not eliminated) when presentation and
test modalities are different• Perceptual short-term memory involves the sensory association cortices
Perceptual Memory: Priming
![Page 25: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/25.jpg)
Procedural Memory: Instrumental / Operant Conditioning
Pressing a button provides a reward • Increases the likelihood that the animal will press the button again
![Page 26: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/26.jpg)
Procedural Memory: Instrumental / Operant Conditioning
• Association between stimulus-response• Stimuli following a behaviour can be either:
• Reinforcing: perceived as positive• Punishing: perceived as negative
• Basal ganglia are involved
![Page 27: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/27.jpg)
Procedural Memory: Motor Learning
Other examples: how to tie a shoe lace, ride a bike, drive a manual transmission, play piano
Series of connected movements that become automatic with practice.
![Page 28: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/28.jpg)
Emotional Memory: Conditioned Fear
• Little Albert• Conditioned to fear rats – hammer hitting
metal• Extended to other furry animals and
objects
• Association between stimulus-valence (pleasant-unpleasant)
• Amygdala is involved
![Page 29: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/29.jpg)
Emotional Memory: Conditioned Fear
• Nothing lasts forever! • If CS is repeated without US often enough, then the
CR disappears (extinction)
![Page 30: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/30.jpg)
Non-associative Memory: Habituation
• Ignore incoming information that is not relevant
• Most basic form of learning• Even worms can do it
![Page 31: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/31.jpg)
Short-term memory• Prefrontal cortex, sensory
association areas
Declarative long-term memory• Hippocampus
Procedural long-term memory• Basal ganglia, motor
association areas, cerebellum
Emotional long-term memory• Amygdala
Memory can be subdivided into multiple categories• involve distinct brain regions.
![Page 32: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/32.jpg)
Long-term potentiation
• Stimulation of pre-synaptic neuron leads to a long-term increase in the magnitude of EPSPs in post-synaptic neurons
• First measured in hippocampal tissue
![Page 33: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/33.jpg)
LTP and Firing Rate
• For LTP to occur, rapid rate of stimulation is needed
• EPSP’s are summated as successive EPSP’s occur and before past EPSP’s have dissipated
![Page 34: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/34.jpg)
Synaptic plasticity
• LTP strengthens existing synapses and creates new ones• Important for recovery of function post stroke
Before LTP
Presynaptic density
After LTP
Synaptic structure
Before LTP After LTP
![Page 35: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/35.jpg)
Long-term depression• A long-term decrease in the excitability of a neuron to a
particular synaptic input caused by stimulation of the terminal button while the postsynaptic membrane is hyperpolarized.
• Low frequency stimulation decreasing the strength of synaptic connections (> 10 Hz)
•May allow for reversal of learned patterns in response to changes in the environment
![Page 36: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/36.jpg)
Learning: Some Key Terms
Learning: Relatively permanent change in behavior due to experience Does NOT include temporary changes due to
disease, injury, maturation, or drugs, since these do NOT qualify as learning even though they can alter behavior
Reinforcement: Any event that increases the probability that a response will recur
Response: Any identifiable behavior Internal: Faster heartbeat Observable: Eating, scratching
![Page 37: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/37.jpg)
Learning: More Key TermsAntecedents: Events that precede a responseConsequences: Effects that follow a response
![Page 38: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/38.jpg)
Classical Conditioning and Ivan Pavlov
Russian physiologist who studied digestionUsed dogs to study salivation when dogs were
presented with meat powderAlso known as Pavlovian or Respondent
ConditioningReflex: Automatic, non-learned response
![Page 39: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/39.jpg)
Fig. 8.1 In classical conditioning, a stimulus that does not produce a response is paired with a stimulus that does elicit a response. After many such pairings, the stimulus that previously had no effect begins to produce a response. In the example shown, a horn precedes a puff of air to the eye. Eventually the horn alone will produce an eye blink. In operant conditioning, a response that is followed by a reinforcing consequence becomes more likely to occur on future occasions. In the example shown, a dog learns to sit up when it hears a whistle
![Page 40: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/40.jpg)
Fig. 8.2 An apparatus for Pavlovian conditioning. A tube carries saliva from the dog’s mouth to a lever that activates a recording device (far left). During conditioning, various stimuli can be paired with a dish of food placed in front of the dog. The device pictured here is more elaborate than the one Pavlov used in his early experiments.
![Page 41: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/41.jpg)
Fig. 8.3 The classical conditioning procedure.
![Page 42: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/42.jpg)
Principles of Classical Conditioning
Acquisition: Training period when a response is strengthened
Higher Order Conditioning: A conditioned stimulus (CS) is used to reinforce further learning
Expectancy: Expectation about how events are interconnected
Extinction: Weakening of a conditioned response through removal of reinforcement
Spontaneous Recovery: Reappearance of a learned response following apparent extinction
![Page 43: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/43.jpg)
Fig. 8.4 Acquisition and extinction of a conditioned response. (after Pavlov, 1927).
![Page 44: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/44.jpg)
Fig. 8.5 Higher order conditioning takes place when a well-learned conditioned stimulus is used as if it were an unconditioned stimulus. In this example, a child is first conditioned to salivate to the sound of a bell. In time, the bell will elicit salivation. At that point, you could clap your hands and then ring the bell. Soon, after repeating the procedure, the child would learn to salivate when you clapped your hands
![Page 45: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/45.jpg)
Principles of Classical Conditioning (cont.)
Stimulus Generalization: A tendency to respond to stimuli that are similar, but not identical, to a conditioned stimulus (e.g., responding to a buzzer or a hammer banging when the conditioning stimulus was a bell)
Stimulus Discrimination: The ability to respond differently to various stimuli (e.g., Rudy will respond differently to various bells (alarms, school, timer))
![Page 46: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/46.jpg)
Fig. 8.6 (a) Stimulus generalization. Stimuli similar to the CS also elicit a response. (b) This cat has learned to salivate when it sees a cat food box. Because of stimulus generalization, it also salivates when shown a similar-looking detergent box.
![Page 47: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/47.jpg)
Classical Conditioning in Humans
Phobia: Fear that persists even when no realistic danger exists (e.g., arachnophobia (fear of spiders; see the movie!))
Conditioned Emotional Response (CER): Learned emotional reaction to a previously neutral stimulus
Desensitization: Exposing phobic people gradually to feared stimuli while they stay calm and relaxed
Vicarious Classical Conditioning: Learning to respond emotionally to a stimulus by observing another’s emotional reactions
![Page 48: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/48.jpg)
Fig. 8.7 Hypothetical example of a CER becoming a phobia. Child approaches dog (a) and is frightened by it (b). Fear generalizes to other household pets (c) and later to virtually all furry animals (d).
![Page 49: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/49.jpg)
Operant Conditioning (Instrumental Learning)
Definition: Learning based on the consequences of responding; we associate responses with their consequences
Law of Effect (Thorndike): The probability of a response is altered by the effect it has; responses that lead to desired effects are repeated; those that lead to undesired effects are not
Operant Reinforcer: Any event that follows a response and increases its likelihood of recurring
![Page 50: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/50.jpg)
Operant Conditioning (Instrumental Learning) (cont.)
Conditioning Chamber (Skinner Box): Apparatus designed to study operant conditioning in animals
Response-Contingent Reinforcement: Reinforcement given after a desired response occurs
![Page 51: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/51.jpg)
Fig. 8.8 Assume that a child who is learning to talk points to her favorite doll and says either “doll,” “duh,” or “dat” when she wants it. Day 1 shows the number of times the child uses each word to ask for the doll (each block represents one request). At first, she uses all three words interchangeably. To hasten learning, her parents decide to give her the doll only when she names it correctly. Notice how the child’s behavior shifts as operant reinforcement is applied. By day 20, saying “doll” has become the most probable response.
![Page 52: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/52.jpg)
Fig. 8.9 The Skinner box. This simple device, invented by B. F. Skinner, allows careful study of operant conditioning. When the rat presses the bar, a pellet of food or a drop of water is automatically released. (A photograph of a Skinner box appears in Chapter 1.)
![Page 53: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/53.jpg)
Timing of Reinforcement
Operant reinforcement most effective when given immediately after a correct response
Response Chain: A linked series of actions that leads to reinforcement
Superstitious Behaviors: Behaviors that are repeated because they appear to produce reinforcement, even though it is not necessary
Shaping: Molding responses gradually in a step-by-step fashion to a desired pattern
Successive Approximations: Ever-closer matches
![Page 54: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/54.jpg)
ig. 8.10 Reinforcement and human behavior. The percentage of times that a severely disturbed child said “Please” when he wanted an object was increased dramatically by reinforcing him for making a polite request. Reinforcement produced similar improvements in saying “Thank you” and “You’re welcome,” and the boy applied these terms in new situations as well. (Adapted from Matson et al., 1990
![Page 55: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/55.jpg)
Operant ExtinctionDefinition: When learned responses that are NOT
reinforced gradually fade awayNegative Attention Seeking: Using misbehavior to
gain attention
![Page 56: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/56.jpg)
More Operant Conditioning Terms
Positive Reinforcement: When a response is followed by a reward or other positive event
Negative Reinforcement: When a response is followed by the removal of an unpleasant event (e.g., the bells in Fannie’s car stop when she puts the seatbelt on); ends discomfort
Punishment: Any event that follows a response and decreases the likelihood of it recurring (e.g., a spanking)
Response Cost: Reinforcer or positive thing is removed, e.g., losing X-Box privileges
![Page 57: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/57.jpg)
Fig. 8.11 Average number of innings pitched by major league baseball players before and after signing long-term guaranteed contracts. (Data from O’Brien et al., 1981.)
![Page 58: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/58.jpg)
Fig. 8.12 The effect of delay of reinforcement. Notice how rapidly the learning score drops when reward is delayed. Animals learning to press a bar in a Skinner box showed no signs of learning if food reward followed a bar press by more than 100 seconds (Perin, 1943).
![Page 59: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/59.jpg)
Types of Reinforcers
Primary Reinforcer: Non-learned and natural; satisfies biological needs (e.g., food, water, sex)
Intracranial Stimulation (ICS): Natural primary reinforcer; involves direct activation of brain’s “pleasure centers”
Secondary Reinforcer: Learned reinforcer (e.g., money, grades, approval, praise)
Token Reinforcer: Tangible secondary reinforcer (e.g., money, gold stars, poker chips)
Social Reinforcer: Provided by other people (e.g., learned desires for attention and approval)
![Page 60: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/60.jpg)
Fig. 8.15 Poker chips normally have little or no value for chimpanzees, but this chimp will work hard to earn them once he learns that the “Chimp-O-Mat” will dispense food in exchange for them.
![Page 61: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/61.jpg)
Fig. 8.16 Reinforcement in a token economy. This graph shows the effects of using tokens to reward socially desirable behavior in a mental hospital ward. Desirable behavior was defined as cleaning, bed making, attending therapy sessions, and so forth. Tokens earned could be exchanged for basic amenities such as meals, snacks, coffee, game-room privileges, or weekend passes. The graph shows more than 24 hours per day because it represents the total number of hours of desirable behavior performed by all patients in the ward. (Adapted from Ayllon & Azrin,1965.)
![Page 62: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/62.jpg)
Feedback and Knowledge of Results
Definition: Information about the effect of a response
Knowledge of Results (KR): Increased feedback; almost always improves learning and performance
![Page 63: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/63.jpg)
Reinforcement ConceptsSchedules of Reinforcement: Plans for determining
which responses will be reinforcedContinuous Reinforcement: A reinforcer follows
every correct responsePartial Reinforcement: Reinforcers do NOT follow
every responsePartial Reinforcement Effect: Responses acquired
with partial reinforcement are very resistant to extinction
![Page 64: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/64.jpg)
Fig. 8.12 The effect of delay of reinforcement. Notice how rapidly the learning score drops when reward is delayed. Animals learning to press a bar in a Skinner box showed no signs of learning if food reward followed a bar press by more than 100 seconds (Perin, 1943).
![Page 65: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/65.jpg)
Fig. 8.14 In the apparatus shown in (a), the rat can press a bar to deliver mild electric stimulation to a “pleasure center” in the brain. Humans also have been “wired” for brain stimulation, as shown in (b). However, in humans, this has been done only as an experimental way to restrain uncontrollable outbursts of violence. Implants have not been done merely to produce pleasure.
![Page 66: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/66.jpg)
Schedules of Partial Reinforcement
Fixed Ratio Schedule (FR): A set number of correct responses must be made to obtain a reinforcer
Variable Ratio Schedule (VR): Varied number of correct responses must be made to get a reinforcer
Fixed Interval Schedule (FI): The first correct response made, after a certain amount of time has elapsed, is reinforced
Variable Interval Schedule (VI): Reinforcement is given for the first correct response made after a varied amount of time
![Page 67: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/67.jpg)
Fig. 8.19 Typical response patterns for reinforcement schedules.
![Page 68: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/68.jpg)
PunishmentPunisher: Any consequence that reduces the
frequency of a target behaviorKeys: Timing, consistency, and intensity Severe Punishment: Intense punishment, capable
of suppressing a response for a long periodMild Punishment: Weak punishment; usually slows
responses temporarily
![Page 69: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/69.jpg)
Fig. 8.21 The effect of punishment on extinction. Immediately after punishment, the rate of bar pressing is suppressed, but by the end of the second day, the effects of punishment have disappeared. (After B. F. Skinner, The Behavior of Organisms. © 1938. D. Appleton-Century Co., Inc. Reprinted by permission of Prentice-Hall, Inc.)
![Page 70: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/70.jpg)
Punishment ConceptsAversive Stimulus: Stimulus that is painful or
uncomfortable (e.g., a shock)Escape Learning: Learning to make a response to
end an aversive stimulusAvoidance Learning: Learning to make a response
to avoid, postpone, or prevent discomfort (e.g., not going to a doctor or dentist)
Punishment may also increase aggression
![Page 71: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/71.jpg)
Fig. 8.22 Types of reinforcement and punishment. The impact of an event depends on whether it is presented or removed after a response is made. Each square defines one possibility: Arrows pointing upward indicate that responding is increased; downward-pointing arrows indicate that responding is decreased. (Adapted from Kazdin, 1975.)
![Page 72: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/72.jpg)
Cognitive Learning
Higher-level learning involving thinking, knowing, understanding, and anticipating
Latent Learning: Occurs without obvious reinforcement and is not demonstrated until reinforcement is provided
Rote Learning: Takes place mechanically, through repetition and memorization, or by learning a set of rules
Discovery Learning: Based on insight and understanding
![Page 73: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/73.jpg)
Fig. 8.23 Latent learning. (a) The maze used by Tolman and Honzik to demonstrate latent learning by rats. (b) Results of the experiment. Notice the rapid improvement in performance that occurred when food was made available to the previously unreinforced animals. This indicates that learning had occurred, but that it remained hidden or unexpressed. (Adapted from Tolman & Honzik, 1930.)
![Page 74: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/74.jpg)
Steps to Successful Modeling Pay attention to model Remember what was done Reproduce modeled behavior If a model is successful or his/her behavior is rewarded, behavior more
likely to recur Bandura created modeling theory with classic Bo-Bo Doll (inflatable
clown) experiments
Fig. 8.26 This graph shows the average number of aggressive acts per minute before and after television broadcasts were introduced into a Canadian town. The increase in aggression after television watching began was significant. Two other towns that already had television were used for comparison. Neither showed significant increases in aggression during the same time period. (Data compiled from Joy et al., 1986.)
![Page 75: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/75.jpg)
Self-Managed Behavioral Principles Choose a target behavior
Record a baseline Establish goals Choose reinforcers Record your progress Reward successes Adjust your plan as you learn more about your behavior
Premack Principle: Any high frequency response can be used to reinforce a low frequency response (e.g., no GameBoy Advance SP until you finish your homework)
Self-Recording: Self-management based on keeping records of response frequencies
![Page 76: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/76.jpg)
How to Break Bad HabitsAlternate Responses: Try to get the same
reinforcement with a new responseExtinction: Try to discover what is reinforcing an
unwanted response and remove, avoid, or delay the reinforcement
Response Chains: Scramble the chain of events that leads to an undesired response
Cues and Antecedents: Try to avoid, narrow down, or remove stimuli that elicit the bad habit
![Page 77: Learning and Memory Adapted from: home.cc.umanitoba.ca/~marotta/3350/Lecture18_memory.ppt ... - United](https://reader037.vdocuments.mx/reader037/viewer/2022110209/56649e3f5503460f94b30651/html5/thumbnails/77.jpg)
How to Break Bad Habits (cont.): Behavioral Contracting
Behavioral Contract: Formal agreement stating behaviors to be changed and consequences that apply; written contract
State the rewards you will get, privileges you will forfeit, or punishments you must accept
Type the contract, sign it, and get a person you trust to sign it