erp studies of semantic processinggrammar.ucsd.edu/.../lign170.sp2005/lectures/lecture17.pdf ·...
TRANSCRIPT
![Page 1: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/1.jpg)
ERP Studies ofSemantic Processing
LIGN 170, Lecture 17
![Page 2: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/2.jpg)
Non-invasive methods - ElectricalEvent-related brain potentials
![Page 3: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/3.jpg)
Prelude to language ERPs: P300
• Increase in positive amplitude at 300 milliseconds after stimulus onset over the crown of the head
• Elicited by rare or unexpected stimuli
![Page 4: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/4.jpg)
Early ERP language studies• What ERP response is elicited when a word
at the end of a sentence is printed in an unexpectedly large font?
![Page 5: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/5.jpg)
Kutas & Hillyard (1980a)
• Example stimulus:
PLEASE GETTHEFILEFROMTHECABINET
![Page 6: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/6.jpg)
• Unexpectedly large fonts lead to increase in P300 amplitude, like other unexpected stimuli
Kutas & Hillyard (1980a)
CABINET
![Page 7: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/7.jpg)
• Is the P300 elicited with other kinds of unexpected linguistic stimuli?
• What happens with sentences like:
• The pizza was too hot to drink?
Obvious question
![Page 8: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/8.jpg)
• Combined physical and semantic incongruities in single experiment
• Physical: oversized, bold font
• Semantic: “absurd, semantically inappropriate words in otherwise meaningful sentences”
Kutas & Hillyard (1980b)
![Page 9: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/9.jpg)
![Page 10: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/10.jpg)
Introducing the N400 • Semantic anomalies elicit an increase in
negative amplitude from 300-500 milliseconds that peaks 400msec after the onset of the anomaly
• This negativity is usually largest over centrałparietal area of the scalp
![Page 11: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/11.jpg)
Basic questions about the N400
• Is the N400 only found to anomalous words at the end of a sentence?
![Page 12: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/12.jpg)
Basic questions about the N400
• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
Susan ate a statue for breakfast.
![Page 13: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/13.jpg)
Basic questions about the N400• Is the N400 only found to anomalous words at the end of a
sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
![Page 14: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/14.jpg)
Basic questions about the N400• Is the N400 only found to anomalous words at the end of a
sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn’t differ hugely from fast presentation
![Page 15: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/15.jpg)
Basic questions about the N400
• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn’t differ hugely from fast presentation
• Is this something that’s limited to reading?
![Page 16: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/16.jpg)
N400s to spoken and signed language
• Similar N400 effects have been found for violations in both spoken and signed modalities
• N400 is not limited to written language processing
• In fact, when pitch has linguistic properties (e.g. tone in tonal languages), incorrect pitch can trigger N400 effects
![Page 17: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/17.jpg)
Mandarin Chinese• Word meaning is in part determined by
lexical tone
• Two words that differ only by tone can mean two distinct things
• /dan/: eggs, gall bladder
Brown-Schmidt & Canseco-Gonzales (2004)
![Page 18: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/18.jpg)
• My mother’s chicken is very ill, she doesn’t lay any
• (1) eggs (dàn)
• (2) gallbladder (dan)
• (3) moat (qiàn)
• (4) footpath (qian)
• Results: N400 effects to (2),(3) & (4) compared to (1)
Brown-Schmidt & Canseco-Gonzales (2004)
Example
![Page 19: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/19.jpg)
Basic questions about the N400
• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn’t differ hugely from fast presentation
• Is this something that’s limited to reading?
![Page 20: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/20.jpg)
Basic questions about the N400
• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn’t differ hugely from fast presentation
• Is this something that’s limited to reading?
• No, it is sensitive to semantic anomalies in other modalities
![Page 21: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/21.jpg)
Basic questions about the N400• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn’t differ hugely from fast presentation
• Is this something that’s limited to reading?
• No, it is sensitive to semantic anomalies in other modalities
• Is the effect tied to sentence meaning or lexical meaning?
![Page 22: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/22.jpg)
Fischler et al. (1983)• N400 Effect for
• A robin is a vehicle.
(A robin is a bird.)
• But also N400 effect for
• A robin is not a vehicle.
(A robin is not a bird.)
• So false sentence gets bigger N400 than true!
![Page 23: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/23.jpg)
Basic questions about the N400• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn´t differ hugely from fast presentation
• Is this something that’s limited to reading?
• No, it is sensitive to semantic anomalies in other modalities
• Is the effect tied to sentence meaning or lexical meaning?
![Page 24: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/24.jpg)
Basic questions about the N400• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn´t differ hugely from fast presentation
• Is this something that’s limited to reading?
• No, it is sensitive to semantic anomalies in other modalities
• Is the effect tied to sentence meaning or lexical meaning?
• Lexical meaning
![Page 25: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/25.jpg)
Basic questions about the N400• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn’t differ hugely from fast presentation
• Is this something that’s limited to reading?
• No, it is sensitive to semantic anomalies in other modalities
• Is the effect tied to sentence meaning or lexical meaning?
• Lexical meaning
• Can N400 effects be elicited by pictures?
![Page 26: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/26.jpg)
Ganis et al. (1996)• Will images depicting anomalous concepts
elicit an N400 effect?
• I take my coffee with cream and
Answer: Yes
![Page 27: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/27.jpg)
Basic questions about the N400• Is the N400 only found to anomalous words at the end of a sentence?
• No, it is also found within sentence
• Does it matter how fast or slow the words are presented?
• No, slow presentation doesn’t differ hugely from fast presentation
• Is this something that’s limited to reading?
• No, it is sensitive to semantic anomalies in other modalities
• Is the effect tied to sentence meaning or lexical meaning?
• Lexical meaning
• Can N400 effects be elicited by pictures?
• Yes
![Page 28: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/28.jpg)
Summary so far• The N400 is elicited by semantic anomalies
• At the end and middle of sentences
• Regardless of speed of presentation
• Regardless of modality of presentation
• At the level of lexical meaning
• Even represented in pictures
![Page 29: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/29.jpg)
Summary so far• This evidence suggests that the N400 is an
index of lexical semantic processing - probably with access to conceptual knowledge
![Page 30: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/30.jpg)
Scope of the N400• Thus far: very strange semantic anomalies
• The pizza was too hot to drink.
• Interesting, but if the N400 is limited to only these kinds of violations, then there’s only so much it can help us understand.
• What else is the N400 sensitive to?
![Page 31: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/31.jpg)
Beyond semantic anomalies• What counts as a “semantic anomaly”?
• Impossible
• Strange, but possible
• Plausible but unexpected
![Page 32: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/32.jpg)
Beyond semantic anomalies• What counts as a “semantic anomaly”?
• .
• .
• Plausible but unexpected
Impossible
Strange, but possible
![Page 33: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/33.jpg)
Beyond semantic anomalies• What counts as a “semantic anomaly”?
• Impossible
• Strange, but possible
• .Plausible but unexpected
![Page 34: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/34.jpg)
Expected: Cloze probability(1) Bob mailed the letter without a .
(2) Julie sat down on the .
(3) There was something wrong with the .
![Page 35: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/35.jpg)
Contextual constraints• Sentences can constrain the identity of
upcoming words
• High close probability
• Low cloze probability
• More context = more constraint
• So, is the N400 sensitive to violations to cloze probability (not just violations of (common-) sense)?
![Page 36: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/36.jpg)
Kutas & Hillyard (1984)
![Page 37: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/37.jpg)
Beyond semantic anomalies• What counts as a “semantic anomaly”?
• Impossible
• Strange, but possible
• .
• N400 sensitive to contextual constraints on word identity - not simply semantic violations
Plausible but unexpected
![Page 38: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/38.jpg)
Related to expected word
• At the dinner party, I wondered why my mother wasn’t eating her soup. Then I noticed that she didn’t have a
• Expected: spoon
• Same category: knife
• Different category: bowl
![Page 39: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/39.jpg)
More than just anomalies• N400 amplitude appears to reflect processes
related to word expectancy and relatedness
• Smallest amplitudes to high-constraining contexts with high probability words
• Largest amplitudes to semantic anomalies
![Page 40: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/40.jpg)
Beyond anomalies: Expectation
• Suggests a model of lexical processing in which comprehenders use context to develop expectations about the identity of the next word
• But, what about when there isńt a lot of context to go by?
![Page 41: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/41.jpg)
• Increased N400 to early words compared to later words
Van Petten & Kutas (1990)
![Page 42: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/42.jpg)
A more complete view of the N400
• Present to every word in a sentence
• More predictable words elicit smaller N400 than less predictable words
• N400 amplitude decreases for each word over the course of a sentence
• Frequency has an influence only when context doesn’t allow prediction
![Page 43: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/43.jpg)
Sentence initial?• Sentence-initial N400 amplitude is lost when
the sentence is itself part of a larger discourse
![Page 44: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/44.jpg)
Wrapping up: Semantic processes
• For each word, there is neural response starting roughly 200msec after the onset of the word and peaking at 400msec
• Labelled N400
• The strength (i.e. amplitude) of this response appears to be sensitive to number of factors related to the context in which the word appears
![Page 45: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/45.jpg)
Growing Old...
from Kutas & Iragui (1998)
![Page 46: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/46.jpg)
Syntactic violations• The children runs to the ice cream truck
every afternoon.
• The children run the to ice cream truck every afternoon.
• The children gave the ice cream to she.
![Page 47: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/47.jpg)
Syntactic violations• Two ERP responses are generally elicited
• Left Anterior Negativity
• Same latency as N400, but different scalp distribution
• P600/Late Positivity/Late Positive Component (LPC)/Syntactic Positive Shift
• Can start as early as 200msec
![Page 48: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/48.jpg)
The P600 and probability• Sensitive to local probability
• Can be found in response to grammatical sentences compared to ungrammatical sentences
• When 80% of experimental trials have similar ungrammaticalities
![Page 49: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/49.jpg)
The P600 and musical syntax
• Western European “Tonal” music
• Has certain norms for how music is constructed
• Musical “keys” determine which notes are sharp, which are flat
• Key of C-major: No sharps or flats
![Page 50: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/50.jpg)
C
E-fla
t
D-fl
at
![Page 51: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/51.jpg)
Theoretical construct
Distance between “keys”
Measured in number of flats/
sharps
Adjacent keys differ by only one flat/sharp Psychologically real for musicians
![Page 52: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/52.jpg)
Target key Constructing musical materials
![Page 53: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/53.jpg)
Predictions• Nearby key is a “syntactic” anomaly, but not
too different from the expected key
• Distant key also an anomaly and is more different from expected
• N400?
• P600?
![Page 54: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/54.jpg)
Predictions• Nearby key is a “syntactic” anomaly, but not
too different from the expected key
• Distant key also an anomaly and is more different from expected
• N400?
• P600
![Page 55: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/55.jpg)
P600 to musical syntax• At least part of the processes used for
syntactic processing of language are not unique to language.
• Are involved in other kinds of “syntactic” structural processing
![Page 56: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/56.jpg)
Similar effect in math• Nunez-Pena & Honrubia-Serrano (2004)
• Number sequences
• 4, 7, 10, 13, 16, 19, X
• Where X was correct, close or very far off
• 22, 24, 46
• Largest P600 effect to “46”
![Page 57: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/57.jpg)
Code switching• Production: Could simply be a change in
language form - same meaning produced with whatever word form is most available
• Comprehension?
• Mixed results: Some studies show increase in processing difficulty, others do not
![Page 58: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/58.jpg)
Moreno et al. (2002)• ERP study of English-Spanish Bilinguals
• Will code switches cause problems with lexical processing similar to those found for unexpected within-language words?
• N400
• Will code switches be treated as an unexpected change in form, not meaning?
• Late positivity
![Page 59: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/59.jpg)
Materials• Regular contexts:
• Each night the campers built a
• fire, fuego, blaze
![Page 60: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/60.jpg)
Results Summary • For lexical switches
• N400 response
• For code switches
• Large P600 response
• Small N400-like negativity
![Page 61: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/61.jpg)
Discussion• Code switches appear to not pose greater difficulty
for lexical processing
• Instead, they appear to be processed as something structurally unexpected
• Same response as that seen to improbable and ungrammatical stimuli
• Goes well with other findings suggesting that code switching doesn’t affect language areas, but parts of the brain associated with executive control
![Page 62: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/62.jpg)
![Page 63: ERP Studies of Semantic Processinggrammar.ucsd.edu/.../lign170.SP2005/Lectures/Lecture17.pdf · 2005-06-02 · LIGN 170, Lecture 17. Non-invasive methods - Electrical Event-related](https://reader033.vdocuments.mx/reader033/viewer/2022042310/5ed81076cba89e334c672d7c/html5/thumbnails/63.jpg)
Syntactic violations• Two ERP responses are generally elicited
• Left Anterior Negativity
• Same latency as N400, but different scalp distribution
• P600/Late Positivity/Late Positive Component (LPC)/Syntactic Positive Shift
• Can start as early as 200msec
• Linked to other structural processes