LearningLearning

Modules (Chapters) 20, 21, 22Modules (Chapters) 20, 21, 22Pages 303 - 338Pages 303 - 338

LearningLearning LearningLearning

relatively relatively permanent permanent change in an change in an organism’s organism’s behavior due behavior due to experienceto experience

AssociationAssociation We learn by associationWe learn by association

Our minds naturally connect events that Our minds naturally connect events that occur in sequenceoccur in sequence

Associative LearningAssociative Learning learning that two events occur togetherlearning that two events occur together

a response and its consequencesa response and its consequences

AssociationAssociation

Learning to Learning to associate associate two eventstwo events

Event 1 Event 2

Sea snail associates splash with a tail shock

Seal learns to expect a snack for its showy antics

Classical or Pavlovian Classical or Pavlovian ConditioningConditioning

We learn We learn to to associate associate two two stimulistimuli

OperantOperant ConditioningConditioning

We learn to We learn to associate a associate a response response and its and its consequencconsequencee

Classical Classical ConditioningConditioning

Ivan PavlovIvan Pavlov 1849-19361849-1936 Russian Russian

physician/ physician/ neurophysiologisneurophysiologistt

Nobel Prize in Nobel Prize in 19041904

studied digestive studied digestive secretionssecretions

Pavlov’s Classic Pavlov’s Classic ExperimentExperiment

Before Conditioning

During Conditioning After Conditioning

UCS (foodin mouth)

Neutralstimulus(tone)

Nosalivation

UCR (salivation)

Neutralstimulus(tone)

UCS (foodin mouth)

UCR(salivation)

CS(tone)

CR (salivation)

ClassicalClassical ConditioningConditioning

Pavlov’s Pavlov’s device for device for recording recording salivationsalivation

Pavlov VideoPavlov Video

Classical Classical ConditioningConditioning Classical ConditioningClassical Conditioning

organism comes to associate two organism comes to associate two stimulistimuli

a neutral stimulus that signals an a neutral stimulus that signals an unconditioned stimulus begins to unconditioned stimulus begins to produce a response that produce a response that anticipates and prepares for the anticipates and prepares for the unconditioned stimulusunconditioned stimulus

Classical Classical ConditioningConditioning Unconditioned Stimulus (UCS)Unconditioned Stimulus (UCS)

stimulus that unconditionally--stimulus that unconditionally--automatically and naturally--triggers a automatically and naturally--triggers a responseresponse

Unconditioned Response (UCR)Unconditioned Response (UCR) unlearned, naturally occurring response unlearned, naturally occurring response

to the unconditioned stimulusto the unconditioned stimulus salivation when food is in the mouth salivation when food is in the mouth

Classical Classical ConditioningConditioning

Conditioned Stimulus (CS)Conditioned Stimulus (CS) originally irrelevant stimulus that, after originally irrelevant stimulus that, after

association with an unconditioned association with an unconditioned stimulus, comes to trigger a conditioned stimulus, comes to trigger a conditioned responseresponse

Conditioned Response (CR)Conditioned Response (CR) learned response to a previously neutral learned response to a previously neutral

conditioned stimulusconditioned stimulus

Classical Classical ConditioningConditioning

AcquisitionAcquisition the initial stage in classical conditioningthe initial stage in classical conditioning the phase associating a neutral stimulus the phase associating a neutral stimulus

with an unconditioned stimulus so that with an unconditioned stimulus so that the neutral stimulus comes to elicit a the neutral stimulus comes to elicit a conditioned responseconditioned response

in operant conditioning, the in operant conditioning, the strengthening of a reinforced responsestrengthening of a reinforced response

Classical Classical ConditioningConditioning

ExtinctionExtinction diminishing of a CR diminishing of a CR in classical conditioning, when in classical conditioning, when

a UCS does not follow a CSa UCS does not follow a CS in operant conditioning, when in operant conditioning, when

a response is no longer a response is no longer reinforced reinforced

Classical Classical ConditioningConditioning Spontaneous RecoverySpontaneous Recovery

reappearance, after a rest reappearance, after a rest period, of an extinguished CRperiod, of an extinguished CR

GeneralizationGeneralization tendency for stimuli similar to tendency for stimuli similar to

CS to elicit similar responsesCS to elicit similar responses AltoidAltoid

Classical Classical ConditioningConditioning DiscriminationDiscrimination

in classical conditioning, the in classical conditioning, the learned ability to distinguish learned ability to distinguish between a CS and other stimuli between a CS and other stimuli that do not signal a UCSthat do not signal a UCS

Big Bang VideoBig Bang Video

BehaviorismBehaviorism John B. WatsonJohn B. Watson

Baby Albert HandoutBaby Albert Handout Baby Albert VideoBaby Albert Video

Nausea Conditioning in Nausea Conditioning in Cancer PatientsCancer Patients

UCS(drug)

UCR(nausea)

CS(waiting room)

CS(waitingroom) CR

(nausea)

UCS(drug)

UCR(nausea)

Operant ConditioningOperant Conditioning

Operant ConditioningOperant Conditioning type of learning in which behavior is type of learning in which behavior is

strengthened if followed by reinforcement strengthened if followed by reinforcement or diminished if followed by punishmentor diminished if followed by punishment

Law of EffectLaw of Effect Thorndike’s principle that behaviors Thorndike’s principle that behaviors

followed by favorable consequences followed by favorable consequences become more likely, and behaviors become more likely, and behaviors followed by unfavorable consequences followed by unfavorable consequences become less likelybecome less likely

Operant Conditioning vs. Operant Conditioning vs. Classical ConditioningClassical Conditioning

Operant Conditioning involves Operant Conditioning involves voluntary actions! Rolling voluntary actions! Rolling over, playing dead, Retrieving over, playing dead, Retrieving the newspaper. Navy pigeons.the newspaper. Navy pigeons.

Classical Conditioning involves Classical Conditioning involves involuntary actions! Salivating, involuntary actions! Salivating, blinking, feeling sick. Shock blinking, feeling sick. Shock baby in hospital.baby in hospital.

Operant ConditioningOperant Conditioning

B.F. SkinnerB.F. Skinner (1904-1990)(1904-1990) elaborated elaborated

Thorndike’s Law Thorndike’s Law of Effectof Effect

developed developed behavioral behavioral technologytechnology

Operant ChamberOperant Chamber

Skinner BoxSkinner Box chamber with a chamber with a

bar or key that an bar or key that an animal animal manipulates to manipulates to obtain a food or obtain a food or water reinforcerwater reinforcer

contains devices contains devices to record to record responsesresponses

Chinatown Chinatown ChickenChicken

Operant ConditioningOperant Conditioning ReinforcerReinforcer

anything that strengthens the anything that strengthens the behavior it follows (scooby behavior it follows (scooby snacks, trophies, good grades, snacks, trophies, good grades, high fives)high fives)

ShapingShaping operant conditioning procedure operant conditioning procedure

in which in which reinforcersreinforcers guide guide behavior toward closer behavior toward closer approximations of a desired goalapproximations of a desired goal

Skinner VideoSkinner Video

Operant ConditioningOperant Conditioning

Principles of Principles of ReinforcementReinforcement

Primary ReinforcerPrimary Reinforcer innately reinforcing stimulusinnately reinforcing stimulus i.e., satisfies a biological need – i.e., satisfies a biological need –

food, water, sleep.food, water, sleep. Conditioned ReinforcerConditioned Reinforcer

stimulus that gains its reinforcing stimulus that gains its reinforcing power through its association with power through its association with primary reinforcerprimary reinforcer

secondary reinforcer – ex. Money secondary reinforcer – ex. Money (just paper)(just paper)

Schedules of Schedules of ReinforcementReinforcement Continuous ReinforcementContinuous Reinforcement

reinforcing the desired response each time it reinforcing the desired response each time it occursoccurs

Partial (Intermitent) ReinforcementPartial (Intermitent) Reinforcement reinforcing a response only part of the timereinforcing a response only part of the time results in slower acquisitionresults in slower acquisition greater resistance to extinctiongreater resistance to extinction

Ex. If you throw a tennis ball to two dogs.Ex. If you throw a tennis ball to two dogs.

Changing Behavior With Operant Conditioning VideoChanging Behavior With Operant Conditioning Video

Schedules of Schedules of ReinforcementReinforcement

Fixed Ratio (FR)Fixed Ratio (FR) reinforces a response only after a reinforces a response only after a

specified specified number of responsesnumber of responses Ex. $5 for every 3 bushels of applesEx. $5 for every 3 bushels of apples

Schedules of Schedules of ReinforcementReinforcement

Variable Ratio (VR)Variable Ratio (VR) reinforces a response after an reinforces a response after an

unpredictable unpredictable number of number of responsesresponses

Ex. gambling (slot machines), Ex. gambling (slot machines), fishingfishing

very hard to extinguish because very hard to extinguish because of unpredictabilityof unpredictability

Schedules of Schedules of ReinforcementReinforcement

Fixed Interval (FI)Fixed Interval (FI) reinforces a response only after reinforces a response only after

a specified a specified timetime has elapsed has elapsed Ex. Getting paid every two Ex. Getting paid every two

weeks.weeks.

Schedules of Schedules of ReinforcementReinforcement

Variable Interval (VI)Variable Interval (VI) reinforces a response at reinforces a response at

unpredictable unpredictable timetime intervals intervals Ex. pop quizEx. pop quiz Give a pop quiz Give a pop quiz

PunishmentPunishment

PunishmentPunishment aversive event that aversive event that

decreases the behavior that decreases the behavior that it followsit follows

powerful controller of powerful controller of unwanted behaviorunwanted behavior

Use of Reinforcement and Punishment VideoUse of Reinforcement and Punishment Video

PunishmentPunishment

Cognition and Operant Cognition and Operant ConditioningConditioning Cognitive MapCognitive Map

mental representation of the layout of mental representation of the layout of one’s environmentone’s environment

Example: after exploring a maze, rats Example: after exploring a maze, rats act as if they have learned a cognitive act as if they have learned a cognitive map of itmap of it

FeedbackFeedback Two demos on feedbackTwo demos on feedback

Drawing shapes with no Drawing shapes with no feedback and tennis ball toss feedback and tennis ball toss

Cognition and Operant Cognition and Operant ConditioningConditioning

Overjustification EffectOverjustification Effect the effect of promising a reward the effect of promising a reward

for doing what one already likes for doing what one already likes to doto do

the person may now see the the person may now see the reward, rather than intrinsic reward, rather than intrinsic interest, as the motivation for interest, as the motivation for performing the taskperforming the task

Cognition and Operant Cognition and Operant ConditioningConditioning

Intrinsic MotivationIntrinsic Motivation Desire to perform a behavior for Desire to perform a behavior for

its own sake and to be effectiveits own sake and to be effective

Extrinsic MotivationExtrinsic Motivation Desire to perform a behavior due Desire to perform a behavior due

to promised rewards or threats of to promised rewards or threats of punishmentspunishments

Observational LearningObservational Learning

Observational LearningObservational Learning learning by observing otherslearning by observing others Alda Videos (Monkey See Monkey Do #80 & Octopus #81)Alda Videos (Monkey See Monkey Do #80 & Octopus #81)

ModelingModeling process of observing and imitating a specific behaviorprocess of observing and imitating a specific behavior Bandura’s Bobo DollsBandura’s Bobo Dolls

Prosocial BehaviorProsocial Behavior positive, constructive, helpful behaviorpositive, constructive, helpful behavior opposite of antisocial behavioropposite of antisocial behavior http://www.youtube.com/watch?v=frpp6DjCaJU&safet

y_mode=true&persist_safety_mode=1

• Learned HelplessnessLearned Helplessness– The hopelessness and passive resignation The hopelessness and passive resignation

learned when an animal or human is learned when an animal or human is unable to avoid repeated aversive events.unable to avoid repeated aversive events.

ExpectanciesExpectanciesIf you think you are able to learn or If you think you are able to learn or accomplish something, you will. If you accomplish something, you will. If you think you can’t, you won’t.think you can’t, you won’t.