attention and emotion: from data to conceptual issues
DESCRIPTION
Attention and emotion: From data to conceptual issues. Luiz Pessoa Department of Psychology University of Maryland, College Park. Background. 1990s: work showing limitations of visual processing and the need for attention Change blindness Attentional blink. L. R. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/1.jpg)
Attention and emotion: Attention and emotion: From data to conceptual issuesFrom data to conceptual issues
Luiz PessoaDepartment of Psychology
University of Maryland, College Park
![Page 2: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/2.jpg)
Background
• 1990s: work showing limitations of visual processing and the need for attention Change blindness Attentional blink
![Page 3: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/3.jpg)
Background
• Processing of emotion-laden information is prioritized Independent of awareness
RL
Morris et al. (1998)Whalen et al. (1998)
![Page 4: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/4.jpg)
LeDoux
“Automatic” Processing
Amygdala
![Page 5: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/5.jpg)
Research goal
• Understand the role of attention and awareness during the processing of emotional visual items
Employ strong attentional manipulations
Evaluate awareness with Signal Detection Theory
![Page 6: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/6.jpg)
Role of spatial attention
• Is activity evoked by emotional faces automatic?
OR
• Does activity evoked by emotional faces require attention?
![Page 7: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/7.jpg)
200 ms
Same/differentDifficult: 64% correct
Not drawn to scale
200 ms
Attended Faces
Unattended Faces
Spatial attention
Male/femaleEasy: 91% correct
![Page 8: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/8.jpg)
Attention is required for the expression of valence (N = 21)
• Strong valence X attention interaction: Effect of valence depends on attention
Fear UNATT
Happy UNATT
Neutral UNATT
Happy ATTNeutral ATTFear ATT
-0.10 2 4 6 8 10 12
-0.05
0
0.05
0.1
0.15
0.2
0.25
Right Amygdala
Re
spo
nse
Am
plit
ude
Seconds
Pessoa et al. (2002): PNAS
X
L R
![Page 9: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/9.jpg)
Emotional perception requires attention
• Attention parametrically manipulated within the same task
• Affective significance enhanced via conditioning
Lim et al. (2008): NeuropsychologiaTask: find X
Easy Hard
Pessoa et al. (2005): NeuroimageHsu and Pessoa (2007): Neuropsychologia
![Page 10: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/10.jpg)
Role of visual awareness
Pessoa et al. (2005): Emotion
Target
Mask
Yes/No
1-3 scaleConfidence?
![Page 11: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/11.jpg)
67 ms
33 ms
Visual awareness: Signal Detection
![Page 12: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/12.jpg)
67 ms
Y = -4
AWARE
L R
33 ms
Y = -4
UNAWARE
L R
Amygdala responses
VS.
Pessoa et al. (2006): Cerebral Cortex
![Page 13: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/13.jpg)
• Many participants can detect fearful faces even at 17 ms
Behavioral results: Individual differences
Szczepanowski and Pessoa et al. (2007): Journal of Vision
17 ms
![Page 14: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/14.jpg)
Fear stimulus > Neutral stimulusAmygdala
Pessoa et al. (2006): Cerebral Cortex
67 ms
“Normals”
N = 19Y = -4
AWARE
L R
“Detecters”
N = 8Y = -6
AWARE
L R
33 ms
Y = -4
UNAWARE
L R
Y = -6
AWARE
L R
x
.
![Page 15: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/15.jpg)
Role of temporal attention/awareness
. . .
. . .
100 ms
100 ms
Lim, Padmala, and Pessoa (2009): PNAS
2 s
T2T1 CS+ vs. CS–
![Page 16: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/16.jpg)
Attentional blink: Behavior (N = 30)
• Enhanced perception of CS+: Reduced blink
T1T2
50
55
60
65
70
75
80
CS+ CS-scene category
T2 a
ccur
ay (%
)CS+
CS–Building or House?
![Page 17: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/17.jpg)
Role of attention/awareness
. . .
. . .
Parahippocampal gyrus
T2
![Page 18: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/18.jpg)
Miss trials
. . .
. . .
T2
Parahippocampal gyrus
![Page 19: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/19.jpg)
Role of attention/awareness
• Miss trials: no differences observed between CS+ and CS- trials
Visual ctx
Amygdala
Time
CS+CS-
![Page 20: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/20.jpg)
Conceptual issues
![Page 21: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/21.jpg)
Impasse
• While a great deal has been learned about the extent and limits of affective visual processing, two camps have opposing and entrenched views
![Page 22: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/22.jpg)
Impasse
• While a great deal has been learned about the extent and limits of affective visual processing, two camps have opposing and entrenched views
Capacity-limited Capacity-Unlimited
![Page 23: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/23.jpg)
Impasse
• While a great deal has been learned about the extent and limits of affective visual processing, two camps have opposing and entrenched views
Capacity-limited Capacity-Unlimited
![Page 24: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/24.jpg)
Not too surprising…
• Emotional stimuli are sufficiently potent that they exhibit a host of properties that do not appear to occur with neutral items
They are processed when unattended
• Affective processing is subject to capacity limitations, as revealed by several experimental manipulations
Attentional blink
![Page 25: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/25.jpg)
Impasse: will it go away?
• Advocates of limited processing can claim that processing resources have not been consumed
“If the manipulation were stronger, the impact of affective items would go away…”
![Page 26: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/26.jpg)
Impasse
• Showing that the emotional effect has disappeared is always subject to the “null problem”
Arguing for the absence of an effect
![Page 27: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/27.jpg)
Power vs. strength of manipulation
Fear unatt
Happy unatt
Neutral unatt
Happy att
Neutral att
Fear att
0 2 4 6 8 10 12
Right Amygdala
Seconds
Res
pons
e A
mpl
itude
Left Amygdala
0 2 4 6 8 10 12-0.1
-0.05
0
0.05
0.1
0.15
0.2
0.25
Seconds
Pessoa et al. (2002): PNAS
X
![Page 28: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/28.jpg)
processing resources
Processing resources
• Given the limited capacity of mental processes, performance is impaired if demands are greater than available resources
Easy/efficient
Hard/inefficient
Norman and Bobrow (1975)
![Page 29: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/29.jpg)
Processing resources
processing resources
processing resources
“automatic”
Nakayama and Joseph (1998)
![Page 30: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/30.jpg)
Processing resources
processing resources
processing resources
Capacity limitation Dual-tasks
Nakayama and Joseph (1998)
![Page 31: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/31.jpg)
Processing resources
• Moors and De Houwer (2006): Every process is uncontrolled, efficient, unconcious, and fast
![Page 32: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/32.jpg)
Processing resources
• Moors and De Houwer (2006): Every process is uncontrolled, efficient, unconcious, and fast, to some degree…
• Relative to what?
• Affective processing: relative to neutral not enough Fine comparisons needed (e.g., abrupt onsets,
search, etc.) Broad set of comparison tasks
![Page 33: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/33.jpg)
Two camps
Capacity-limited Capacity-Unlimited
![Page 34: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/34.jpg)
Preattentive-attentive model
t1t2
Stage 1:Preattentive
Stage 2:Attentive
boundary
![Page 35: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/35.jpg)
Preattentive-attentive model
• Some features are processed pre-attentively in virtue of the fact that they are optimally matched to properties of the early visual system (e.g., orientation)
• Affective processing: Sub-cortical pathway Superior colliculus pulvinar amygdala
![Page 36: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/36.jpg)
Dynamic model
Multiple interactive “stages”
![Page 37: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/37.jpg)
Dynamic model
• Processing is not pre-attentive or attentive, but a gradient of processing efficiency is hypothesized to exist
• Gradient based on the properties of early visual areas
• But critically, gradient is dynamically configured based on task demands
• Configuring is suggested to depend on parietal and frontal cortex
![Page 38: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/38.jpg)
Dynamic model
• Multiple “gates”
• Variable permeability
Less susceptible to capacity limitations
More susceptible to capacity limitations
“bottlenecks”
![Page 39: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/39.jpg)
Dynamic model
• Hierarchical and “short-cut” connections
![Page 40: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/40.jpg)
Multiple waves
• Initial processing of visual information proceeds simultaneously along parallel channels
• “Multiple waves” of activation across visual cortex and beyond
• The multiple waves are engaged dynamically based on task requirements
![Page 41: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/41.jpg)
Subcortical processing
![Page 42: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/42.jpg)
Subcortical processing
Pessoa and Adolphs, Nat. Rev. Neurosci (2010)
“passive”
“integrative”
![Page 43: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/43.jpg)
Subcortical processing
Pessoa and Adolphs, Nat. Rev. Neurosci (2010)
![Page 44: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/44.jpg)
Processing architecture and attention
Task 1
Task 2
![Page 45: Attention and emotion: From data to conceptual issues](https://reader035.vdocuments.mx/reader035/viewer/2022062409/56814bd6550346895db8aeb5/html5/thumbnails/45.jpg)
Collaborators
Ralph Adolphs Jan Engelmann Shruti Japee Shen-Mou Hsu Seung-Lark Lim Srikanth Padmala Remik Szczepanowski Leslie Ungerleider
National Institute of Mental Health
emotioncognition.org