language mind and brain: the unification problem colin phillips cognitive neuroscience of language...
TRANSCRIPT
![Page 1: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/1.jpg)
Language Mind and Brain:The Unification Problem
Colin PhillipsCognitive Neuroscience of Language Laboratory
Department of LinguisticsUniversity of Maryland
![Page 2: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/2.jpg)
• Objective is to bridge gap between linguistic models, real-time models of mental processes, and brain-level models, i.e., focus is on the Unification Problem
• Cognitive Neuroscience of Language necessarily draws on disparate areas - not just looking at pictures of brains!
Unification Problem
![Page 3: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/3.jpg)
??
Unification Problem
![Page 4: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/4.jpg)
Unification Problem
• No longer concerned with questions of whether linguistics is a natural science
• Language is clearly a remarkable specialization of human neurobiology (e.g., a sophisticated symbolic, recursive system, with fixed and parameterized aspects)
• What is it about human psychology & neurobiology that allows it to support the things that we know about language?
• In addressing this question, are we faced with problems or with mysteries?
![Page 5: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/5.jpg)
Unification Problem
• ...And if there are mismatches between theories at different levels, whose problem is this?
Linguists?
Psychologists?
Neuroscientists?
![Page 6: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/6.jpg)
Unification Problem
On mismatches between cognitive and neural models
“The more we learn about the brain,the greater the disanalogy becomes.”
(A philosophy of (neuro-)science talk, October 2001)
![Page 7: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/7.jpg)
Unification Problem
On mismatches between cognitive and neural models
“If language is unlike anything else in the biological world,…then too bad for biology!”
(linguist, often accompanied by story about chemistry & physics)
![Page 8: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/8.jpg)
Encoding & Computation
• Two main issues– How are linguistic representations encoded?– How are linguistic representations computed?
![Page 9: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/9.jpg)
Sensory Maps
Internal representations of the outside world. Cellular neuroscience has discovered a great deal in this area.
![Page 10: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/10.jpg)
Notions of sensory maps may be applicable to human phonetic representations…
…although attempts to find them have had little success to date.
Vowel Space
![Page 11: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/11.jpg)
Encoding of Symbols: Abstraction
• But most areas of linguistics (phonology, morphology, syntax, semantics) are concerned with symbolic, abstract representations,
...which do not involve internal representations of dimensions of the outside world.
…hence, the notion of sensory maps does not get us very far into language
![Page 12: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/12.jpg)
Computation: Discrete Infinity
• In neuroscience there are many findings about long-term storage of object representations (e.g., edges, faces, grandmothers, toothbrushes, …).
• Such representations are always finite in number, which can be retrieved from long-term memory
• BUT, much of what interests us in linguistics is infinite
• If representations are drawn from an infinite set, they cannot be retrieved from long-term memory; they must be constructed on-line, as needed - this poses a different kind of challenge …
![Page 13: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/13.jpg)
Overview of Talks
![Page 14: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/14.jpg)
Overview of Talks
1. The Unification Problem
![Page 15: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/15.jpg)
Overview of Talks
1. The Unification Problem
2. Building Syntactic Relations
In-situ
600
700
800
900
1000
1100
1 2 3 4 5 6 7 8
Region
Reading Time
DeclC
QP
どの生徒に…
![Page 16: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/16.jpg)
Overview of Talks
1. The Unification Problem
2. Building Syntactic Relations
3. Abstraction: Sounds to Symbols
In-situ
600
700
800
900
1000
1100
1 2 3 4 5 6 7 8
Region
Reading Time
DeclC
QP
どの生徒に…
![Page 17: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/17.jpg)
Overview of Talks
1. The Unification Problem
2. Building Syntactic Relations
3. Abstraction: Sounds to Symbols
4. Linguistics and Learning
In-situ
600
700
800
900
1000
1100
1 2 3 4 5 6 7 8
Region
Reading Time
DeclC
QP
どの生徒に…
![Page 18: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/18.jpg)
with help from ...University of Maryland
Shani AbadaSachiko Aoshima
Daniel Garcia-PedrosaAna Gouvea
Nina KazaninaMoti LiebermanLeticia PablosDavid PoeppelBeth RabbinSilke Urban
Carol Whitney
University of Delaware
Evniki EdgarBowen HuiBaris KabakTom Pellathy
Dave SchneiderKaia Wong
Alec Marantz, MITElron Yellin, MIT
National Science FoundationJames S. McDonnell Foundation
Human Frontiers Science ProgramJapan Science & Technology Program
Kanazawa Institute of Technology
![Page 19: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/19.jpg)
Outline
• The Challenge• Real-time Grammar• Accurate Parsing• Incremental Parsing• Mapping onto the Brain: Electrophysiology• Encoding• Outlook
![Page 20: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/20.jpg)
Outline
• The Challenge• Real-time Grammar• Accurate Parsing• Incremental Parsing• Mapping onto the Brain: Electrophysiology• Encoding• Outlook
![Page 21: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/21.jpg)
Discrete Infinity
• Linguistic CreativityAbility to make infinite use of finite means
• The finite and infinite aspects of this system present rather different challenges for explicit linking hypotheses
![Page 22: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/22.jpg)
Discrete Infinity
• Linguistic CreativityAbility to make infinite use of finite means
• Lexical entries, Argument Structure templates• Widespread assumption: same representations
accessed in comprehension, production, acceptability ratings, etc.
• Learner’s task is to construct a single lexical entry that covers all of these tasks
![Page 23: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/23.jpg)
Discrete Infinity
• Linguistic CreativityAbility to make infinite use of finite means
• Sentence structures• Structures must be assembled, cannot simply be
retrieved from memory• Widespread assumption: multiple different systems
responsible for structure assembly in comprehension, production, acceptability, etc.
• Learner must master a number of different systems
![Page 24: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/24.jpg)
Discrete Infinity
• Linguistic CreativityAbility to make infinite use of finite means
• Time-independent vs. Time-dependent systems
![Page 25: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/25.jpg)
Standard View
324697+ ?
217 x 32 = ?
arithmetic
![Page 26: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/26.jpg)
Standard View
324697+ ?
217 x 32 = ?
specialized algorithmspecialized algorithm
arithmetic
![Page 27: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/27.jpg)
Standard View
324697+ ?
217 x 32 = ?
specialized algorithmspecialized algorithm
?
something deeper
arithmetic
![Page 28: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/28.jpg)
Standard View
specialized algorithmspecialized algorithm
speaking understanding
grammaticalknowledge,competencelanguage
![Page 29: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/29.jpg)
Standard View
specialized algorithmspecialized algorithm
speaking understanding
grammaticalknowledge,competence
precisebut ill-adapted toreal-time operationlanguage
![Page 30: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/30.jpg)
Standard View
specialized algorithmspecialized algorithm
speaking understanding
grammaticalknowledge,competence
well-adapted toreal-time operationbut maybe inaccuratelanguage
![Page 31: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/31.jpg)
If speaking and understanding involve different systems, there must be an additional store of knowledge that encodes what is shared between speaking and understanding.
![Page 32: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/32.jpg)
As soon as we assume constructs such as ‘parsing strategies’, we are adopting task-specific mechanisms, and endorsing something like the standard architecture.
![Page 33: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/33.jpg)
Standard View
specialized algorithmspecialized algorithm
speaking understanding
grammaticalknowledge,competencelanguage
![Page 34: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/34.jpg)
speaking,understanding,grammaticality
Analysis-by-Synthesis
• Sentences are understood by internally generating a representation that matches the input
• No separate time-independent system of knowledge
• We know that humans have a real-time system for linguistic computation - issue is whether that’s all there is
![Page 35: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/35.jpg)
But wait a minute...
• Wasn’t this all shown to be wrong long ago?
(Fodor, Bever & Garrett 1974; Levelt 1974; Fillenbaum 1971; etc., etc.)?
• And a recent commentary:
“In this desert of ignorance there have been attempts to resurrect earlier claims that the grammar and the parser are one and the same thing. … The enterprise is misconceived … probably incoherent.” (Smith, 1999)
![Page 36: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/36.jpg)
Motivation for Standard Architecture
• How to constrain hypothesis generation• Grammars are not incremental real-time systems• Evidence for input/output-specific strategies• Analysis-by-synthesis implies active generation,
ahead of input• Reputation of performance systems as fast but
inaccurate• Debunking of ‘Derivational Theory of Complexity’
![Page 37: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/37.jpg)
• Time-dependent system of computation makes it feasible to generate testable linking hypotheses
Motivation for Alternative Architecture
![Page 38: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/38.jpg)
Outline
• The Challenge• Real-time Grammar• Accurate Parsing• Incremental Parsing• Mapping onto the Brain: Electrophysiology• Encoding• Outlook
![Page 39: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/39.jpg)
Linear Order and Constituency
Linguistic Inquiry, 2003
![Page 40: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/40.jpg)
Incremental Structure Building
• Evidence that sentence structures can only be assembled in a left-to-right derivation.
![Page 41: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/41.jpg)
John
said
that
he
ate the entire pizza
S
NP VP
S’
Comp
V
S
NP VP
V NP
![Page 42: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/42.jpg)
John
said
that
he
ate the entire pizza
S
NP VP
S’
Comp
V
S
NP VP
V NP
Constituents
![Page 43: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/43.jpg)
John
said
that
he
ate the entire pizza
S
NP VP
S’
Comp
V
S
NP VP
V NP
Constituents
![Page 44: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/44.jpg)
John
said
that
he
ate the entire pizza
S
NP VP
S’
Comp
V
S
NP VP
V NP
Constituents
![Page 45: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/45.jpg)
John
said
that
he
ate the entire pizza
S
NP VP
S’
Comp
V
S
NP VP
V NP
Constituents
![Page 46: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/46.jpg)
• Many tools used to diagnose groupings of words:
– coordination
– deletion
– interpretation (coreference)
– movement, focus, topicalization
– etc.
• There are many cases where the tools converge on the same result
• There are also many cases where the tools yield conflicting results
![Page 47: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/47.jpg)
Incremental Structure Building
A
(Phillips 2003)
![Page 48: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/48.jpg)
Incremental Structure Building
A B
(Phillips 2003)
![Page 49: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/49.jpg)
Incremental Structure Building
A
B C
(Phillips 2003)
![Page 50: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/50.jpg)
Incremental Structure Building
A
B
C D
(Phillips 2003)
![Page 51: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/51.jpg)
Incremental Structure Building
A
B
C
D E
(Phillips 2003)
![Page 52: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/52.jpg)
Incremental Structure Building
A B
(Phillips 2003)
![Page 53: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/53.jpg)
Incremental Structure Building
A B constituent
(Phillips 2003)
![Page 54: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/54.jpg)
Incremental Structure Building
A
B Cconstituent is destroyed by addition of new material
(Phillips 2003)
![Page 55: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/55.jpg)
Incremental Structure Building
A
B C
(Phillips 2003)
![Page 56: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/56.jpg)
Incremental Structure Building
A
B Cconstituent
(Phillips 2003)
![Page 57: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/57.jpg)
Incremental Structure Building
A
B
C Dconstituent is destroyed by addition of new material
(Phillips 2003)
![Page 58: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/58.jpg)
Incremental Structure Building
the cat
(Phillips 2003)
![Page 59: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/59.jpg)
Incremental Structure Building
the cat sat
(Phillips 2003)
![Page 60: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/60.jpg)
Incremental Structure Building
the cat
sat on
(Phillips 2003)
![Page 61: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/61.jpg)
Incremental Structure Building
the cat
sat
on the rug
(Phillips 2003)
![Page 62: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/62.jpg)
Incremental Structure Building
the cat
sat on
(Phillips 2003)
![Page 63: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/63.jpg)
Incremental Structure Building
the cat
sat
on the rug
(Phillips 2003)
![Page 64: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/64.jpg)
Incremental Structure Building
the cat
sat
on the rug
[sat on] is a temporary constituent, which is destroyed as soon as the NP [the rug] is added.
(Phillips 2003)
![Page 65: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/65.jpg)
Incremental Structure Building
Conflicting Constituency Tests
Verb + Preposition sequences can undergo coordination…
(1) The cat sat on and slept under the rug.
…but cannot undergo pseudogapping (Baltin & Postal, 1996)
(2) *The cat sat on the rug and the dog did the chair.
(Phillips 2003)
![Page 66: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/66.jpg)
Incremental Structure Building
the cat
sat on
(Phillips 2003)
![Page 67: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/67.jpg)
Incremental Structure Building
the cat
sat on slept under
and
(Phillips 2003)
![Page 68: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/68.jpg)
Incremental Structure Building
the cat
sat on slept under
and
coordination applies early, before the V+P constituent is destroyed.
(Phillips 2003)
![Page 69: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/69.jpg)
Incremental Structure Building
the cat
sat on
(Phillips 2003)
![Page 70: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/70.jpg)
Incremental Structure Building
the cat
sat
on the rug
(Phillips 2003)
![Page 71: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/71.jpg)
Incremental Structure Building
the cat
sat
on the rug
and the dog did
(Phillips 2003)
![Page 72: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/72.jpg)
Incremental Structure Building
the cat
sat
on the rug
and the dog did
pseudogapping applies too late, after the V+P constituent is destroyed.
(Phillips 2003)
![Page 73: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/73.jpg)
Incremental Structure Building
• Constituency ProblemDifferent diagnostics of constituency frequently yield conflicting results
• Incrementality Hypothesis(a) Syntactic processes see a ‘snapshot’ of a derivation - they target constituents that are present when the process applies(b) Conflicts reflect the fact that different processes have different linear properties
start
![Page 74: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/74.jpg)
Ellipsis blocks Scope/Binding
Bill read all the books in a week (ambiguous: collective/distributive scope)
…and Sue did in a month (unambiguous: collective scope only)
Bill read as many books as Sue did in a week. (ambiguous)
Bill read as many books in a week as Sue did in a month. (unambiguous)
![Page 75: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/75.jpg)
Ellipsis blocks Scope/Binding
John gave books to the children on Tuesday
…and Mary did on Thursday
John gave books to the children on each other’s birthdays
*…and Mary did on each other’s first day of school
![Page 76: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/76.jpg)
Japanese
John
![Page 77: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/77.jpg)
gave
books
to the children
on each other’s birthdays
VP
V
VP
V
VP
IP
John
+fin
I’
read
all the books
in a week
VP
V
VP
PP
IP
John
+fin
I’
![Page 78: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/78.jpg)
gave
books
to the children
on each other’s birthdays
VP
V
VP
V
VP
IP
John
+fin
I’
read
all the books
in a week
VP
V
VP
PP
IP
John
+fin
I’
![Page 79: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/79.jpg)
gave
books
to the children
on each other’s birthdays
VP
V
VP
V
VP
IP
IP
John
+fin
I’
and
VP
IP
Bill
did
I’
![Page 80: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/80.jpg)
gave
books
to the children
on each other’s birthdays
VP
V
VP
V
VP
IP
IP
John
+fin
I’
and
VP
IP
Bill
did
I’
![Page 81: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/81.jpg)
gave
books
to the children
VP
V
VP
IP
John
+fin
I’
![Page 82: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/82.jpg)
gave
books
to the children
on each other’s birthdaysVP
V
VP
VP
IP
John
+fin
I’
![Page 83: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/83.jpg)
gave
books
to the children
on each other’s birthdaysVP
V
VP
VP
IP
John
+fin
I’
IP
and
VP
IP
Bill
did
I’
![Page 84: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/84.jpg)
gave
books
to the children
on each other’s birthdaysVP
V
VP
VP
IP
John
+fin
I’
IP
and
VP
IP
Bill
did
I’
![Page 85: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/85.jpg)
gave
books
to the children
on each other’s birthdaysVP
V
VP
VP
IP
John
+fin
I’
IP
and
VP
IP
Bill
did
I’
gave
books
to the childrenV
VP
![Page 86: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/86.jpg)
gave
books
to the children
on each other’s birthdaysVP
V
VP
VP
IP
John
+fin
I’
IP
and
VP
IP
Bill
did
I’
gave
books
to the childrenV
VP
on each other’s first day of schoolVP
![Page 87: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/87.jpg)
Movement & Binding
a. John gave books to them on each other’s birthdays.
![Page 88: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/88.jpg)
Movement & Binding
a. John gave books to them on each other’s birthdays.
gave
books
to them
on each other’s birthdays
VP
V
VP
V
VP
(Pesetsky 1995)
![Page 89: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/89.jpg)
Movement & Binding
a. John gave books to them on each other’s birthdays.
gave
books
to them
on each other’s birthdays
VP
V
VP
V
VP
(Pesetsky 1995)
![Page 90: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/90.jpg)
Movement & Binding
b. …and [give books to them] he did ___ on each other’s birthdays
(Pesetsky 1995)
![Page 91: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/91.jpg)
give
books
VP
V
VP
to them
![Page 92: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/92.jpg)
give
books
VP
V
VP
to them
IP
IP
he did
![Page 93: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/93.jpg)
give
books
VP
V
VP
to them
IP
IP
he did
![Page 94: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/94.jpg)
give
books
to them
VP
V
VP
give
books
VP
V
VP
to them
IP
IP
he
did
I’
constituentmovement
![Page 95: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/95.jpg)
give
books
to them
on each other’s birthdays
VP
V
VP
V
VP
give
books
VP
V
VP
to them
IP
IP
he
did
I’
constituentmovement
![Page 96: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/96.jpg)
give
books
to them
on each other’s birthdays
VP
V
VP
V
VP
give
books
VP
V
VP
to them
IP
IP
he
did
I’
constituentmovement
binding underc-command
![Page 97: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/97.jpg)
Interim Conclusion
• By building syntactic structures from left-to-right we can explain a number of otherwise mysterious constituency phenomena (see Phillips 1996, 2003 for more examples; see Richards 1999, 2002 for some applications to Japanese)
• We knew independently that humans have a left-to-right structure-building system (i.e. parser, producer)
• Possibility arises that the incremental left-to-right system is the only structure-building system that humans have
• Other arguments leading to related conclusions about grammar, in widely varying formalisms: Kempson et al. (2001), Steedman (2000), Kempen (1999), Milward (1992, 1994)
![Page 98: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/98.jpg)
Outline
• The Challenge• Real-time Grammar• Accurate Parsing• Incremental Parsing• Mapping onto the Brain: Electrophysiology• Encoding• Outlook
![Page 99: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/99.jpg)
Grammatical Accuracy
• It is not enough to show that syntactic structure-building looks like a real-time process
• If the real-time system is the only system, then it should also show the syntactic sophistication normally associated with the grammar - the parser cannot be ‘dumb’
• Question: does the parser access only grammatically legal structural analyses?
![Page 100: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/100.jpg)
Beyond Ambiguity
• Much of parsing literature focuses on issues of ambiguity,
i.e. when 2 structures are grammatically possible, how to choose the right one?
• More basic question: grammatical search
i.e. how do we figure out if a sequence of words has any grammatical analyses?
![Page 101: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/101.jpg)
Example: Argument Structure
Dative and Double-Object Constructions
Alternator Verb: give
The millionaire gave the painting to the museum.
The millionaire gave the museum the painting.
Non-alternator Verb: donate
The millionaire donated the painting to the museum.
*The millionaire donated the museum the painting.
(Phillips, Edgar & Kabak, 2000)
![Page 102: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/102.jpg)
Example: Argument Structure
A Severe Garden-Path Sentence
Alternator Verb: give
The man gave the boy the dog bit a cookie
![Page 103: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/103.jpg)
Example: Argument Structure
A Severe Garden-Path Sentence
Alternator Verb: give
The man gave [the boy [the dog bit]] a cookie
![Page 104: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/104.jpg)
Example: Argument Structure
A Severe Garden-Path Sentence
Alternator Verb: give
The man gave [the boy [the dog bit]] a cookie
availability of double-object parseleads to difficulty at embedded verb
![Page 105: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/105.jpg)
Example: Argument Structure
A Severe Garden-Path Sentence
Alternator Verb: give
The man gave [the boy [the dog bit]] a cookie
Non-Alternator Verb: donate
The man donated [the boy [the dog bit …
availability of double-object parseleads to difficulty at embedded verb
difficulty should ariseearlier in the sentence
![Page 106: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/106.jpg)
Results (partial)
G
G GG
G
G
G
G
G
G
GG
G
G
G
G
G
G
B
B
B
B B
B
BB
BB
B
B
B
B
B
B
B
B
B
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
-100
-50
0
50
100
150
Region
G alternators, ambig
B alternators, unambig
NP1 NP2 verb
C
C
C
C
C
C
C
C C
C
C
C
C
C
C
C
C
C
H
H
H
HH
H
H
H
H H
H
H
H
H
H
H
H
H
H
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
-100
-50
0
50
100
150
Region
C datives, ambig
H datives, unambig
NP1 NP2 verb
Relative to unambiguous control sentence, readers get intodifficulty at V with alternator verbs, at NP2 with non-alternators.--> Argument structure constraint immediately active on-line
Alternators (e.g. give) Non-Alternators (e.g. donate)
start
![Page 107: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/107.jpg)
Example: Movement Constraints
![Page 108: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/108.jpg)
Grammatical Accuracy in Parsing
Wh-Questions
Englishmen cook wonderful dinners.
![Page 109: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/109.jpg)
Grammatical Accuracy in Parsing
Wh-Questions
Englishmen cook wonderful dinners.
![Page 110: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/110.jpg)
Grammatical Accuracy in Parsing
Wh-Questions
Englishmen cook what
![Page 111: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/111.jpg)
Grammatical Accuracy in Parsing
Wh-Questions
Englishmen cook what
![Page 112: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/112.jpg)
Grammatical Accuracy in Parsing
Wh-Questions
What do Englishmen cook
![Page 113: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/113.jpg)
Grammatical Accuracy in Parsing
Wh-Questions
What do Englishmen cook gap
![Page 114: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/114.jpg)
Grammatical Accuracy in Parsing
Wh-Questions
What do Englishmen cook gap
![Page 115: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/115.jpg)
Grammatical Accuracy in Parsing
Long-distance Wh-Questions
Few people think that anybody realizes that Englishmen cook wonderful dinners
![Page 116: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/116.jpg)
Grammatical Accuracy in Parsing
Long-distance Wh-Questions
Few people think that anybody realizes that Englishmen cook what
![Page 117: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/117.jpg)
Grammatical Accuracy in Parsing
Long-distance Wh-Questions
What do few people think that anybody realizes that Englishmen cook gap
![Page 118: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/118.jpg)
Grammatical Accuracy in Parsing
The plan to remove the equipment ultimately destroyed the building.
![Page 119: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/119.jpg)
Grammatical Accuracy in Parsing
The plan to remove the equipment ultimately destroyed the building.
Direct Object NP Direct Object NP
![Page 120: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/120.jpg)
Grammatical Accuracy in Parsing
The plan to remove the equipment ultimately destroyed the building.
Direct Object NP Direct Object NP
Main Clause
![Page 121: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/121.jpg)
Grammatical Accuracy in Parsing
The plan to remove the equipment ultimately destroyed the building.
Direct Object NP Direct Object NP
Main Clause
Subject NP
Embedded Clause
![Page 122: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/122.jpg)
Grammatical Accuracy in Parsing
What did the plan to remove the equipment ultimately destroy
![Page 123: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/123.jpg)
Grammatical Accuracy in Parsing
What did the plan to remove the equipment ultimately destroy gap
![Page 124: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/124.jpg)
Grammatical Accuracy in Parsing
What did the plan to remove ultimately destroy the building
![Page 125: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/125.jpg)
Grammatical Accuracy in Parsing
What did the plan to remove gap ultimately destroy the building
![Page 126: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/126.jpg)
Grammatical Accuracy in Parsing
What did the plan to remove gap ultimately destroy the building
Subject
Island Constraint
A wh-phrase cannot be moved out of a subject.
![Page 127: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/127.jpg)
Question…
• Do people respect island constraints on movement immediately on-line?
(tomorrow’s talk)
![Page 128: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/128.jpg)
Outline
• The Challenge• Real-time Grammar• Accurate Parsing• Incremental Parsing• Mapping onto the Brain: Electrophysiology• Encoding• Outlook
![Page 129: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/129.jpg)
Incrementality
• Question: is structure building immediate?
Does it operate on a word-by-word level?
…Even in a language where this may be hard?
![Page 130: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/130.jpg)
Incremental Application of Binding Constraints in Japanese
Sachiko AoshimaColin Phillips
Amy Weinberg
![Page 131: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/131.jpg)
Structure-building in Japanese
• NP-wa NP-ni [NP-ga NP-o V] V
• Head-driven Parsing (e.g. Pritchett 1991, Mulders 2002)Structure-building is delayed until verbs are processed– explains how parsing is possible in Japanese
– accounts for flexibility, limited garden-paths in Japanese
• Incremental ParsingStructure-building occurs immediately– accounts for native-speaker intuition of continuous comprehension
– hard to demonstrate experimentally
![Page 132: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/132.jpg)
John-ga …
(Mazuka & Itoh 1995)
![Page 133: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/133.jpg)
John-ga Mary-ni …
(Mazuka & Itoh 1995)
![Page 134: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/134.jpg)
John-ga Mary-ni ringo-o …
(Mazuka & Itoh 1995)
![Page 135: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/135.jpg)
John-ga Mary-ni ringo-o tabeta …
(Mazuka & Itoh 1995)
![Page 136: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/136.jpg)
John-ga Mary-ni ringo-o tabeta inu-o ageta
(Mazuka & Itoh 1995)
![Page 137: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/137.jpg)
Verb Surprise Effects
• Surprise effect appears at verb
Can be explained by both head-driven and incremental theories (Schneider 1999, Mulders 2002)
• Better: evidence of structure-building that precedes the verb
e.g. immediate application of grammatical constraints
![Page 138: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/138.jpg)
English
To which of his children did the man give a gift
(Aoshima, Phillips & Weinberg 2002)
![Page 139: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/139.jpg)
English
To which of his children did the man give a gift
Which of his children gave the man a gift?
(Aoshima, Phillips & Weinberg 2002)
![Page 140: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/140.jpg)
Japanese
which of his children (DAT) the man (NOM) …
which of his children (NOM) the man (DAT) …
(Aoshima, Phillips & Weinberg 2002)
![Page 141: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/141.jpg)
Japanese pronoun and its antecedent
which of his children (DAT) the man (NOM) … his
which of his children (NOM) the man (DAT) …**??
which of his children (DAT)
![Page 142: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/142.jpg)
which of his children (DAT) the man (NOM) …
which of his children (NOM) the man (DAT) …
Gender Mismatch
the woman
the woman
![Page 143: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/143.jpg)
Gender Mismatch
which of his children (DAT) the man (NOM) … his
which of his children (NOM) the man (DAT) …**??
which of his children (DAT)
the womanGender mismatch
the womanGender mismatch irrelevant
![Page 144: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/144.jpg)
Conditionsa. Scrambled - Gender Mismatch
Adverb / [his / which NP]-dat / Adverb / NP FEMALE-nom / Adverb / NP-acc /
verb-Q / NPMALE-top / verb
b. Scrambled - Gender Match
Adverb / [his / which NP]-dat / Adverb / NP MALE-nom / Adverb / NP-acc /
verb-Q / NPFEMALE-top / verb
c. Non-scrambled - Gender Mismatch
Adverb / [his / which NP]-nom / Adverb / NP FEMALE-dat / Adverb / NP-acc /
verb-Q / NPMALE-top / verb
d. Non-scrambled - Gender Match
Adverb / [his / which NP]-nom / Adverb / NP MALE-dat / Adverb / NP-acc /
verb-Q / NPMALE-top / verb.
![Page 145: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/145.jpg)
Examples
a. 台所で 彼の どの子供に 朝食後 叔母が 急いで お弁当を 渡したか 父親は 覚えていた。
b. 台所で 彼の どの子供に 朝食後 叔父が 急いで お弁当を 渡したか 叔母は 覚えていた。
c. 台所で 彼の どの子供が 朝食後 叔母に 急いで お弁当を 渡したか 父親は 覚えていた。
d. 台所で 彼の どの子供が 朝食後 叔父に 急いで お弁当を 渡したか 父親は 覚えていた。
![Page 146: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/146.jpg)
Design & Procedure
• 2 X 2 factorial design• 4 lists were created by distributing 24 items in a
Latin Square design• 56 filler sentences• Comprehension questions: matching a subject
with a predicate• Self-paced reading task -Moving Window -• 40 native speakers of Japanese
![Page 147: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/147.jpg)
Self-paced reading task
----- --- --- ---- ---- --- ------ -------
![Page 148: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/148.jpg)
Self-paced reading task
どの子供に --- --- ---- ---- --- ------ -------
![Page 149: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/149.jpg)
Self-paced reading task
----- 叔母は --- ---- ---- --- ------ -------
![Page 150: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/150.jpg)
Self-paced reading task
----- --- 母親が ---- ---- --- ------ -------
![Page 151: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/151.jpg)
Self-paced reading task
----- --- --- ケーキを ---- --- ------ -------
![Page 152: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/152.jpg)
Self-paced reading task
----- --- --- ---- 焼いたと --- ------ -------
![Page 153: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/153.jpg)
Self-paced reading task
----- --- --- ---- ---- 台所で ------ -------
![Page 154: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/154.jpg)
Self-paced reading task
----- --- --- ---- ---- --- お手伝いさんに -------
![Page 155: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/155.jpg)
Self-paced reading task
----- --- --- ---- ---- --- ------ 知らせましたか。
![Page 156: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/156.jpg)
Results: Scrambled conditions
Slowdown at mismatching NP is observed.
500
600
700
800
900
1000
1100
1 2 3 4 5 6 7 8 9 10
scramble,match
scramble,mismatch
his/her
± Match F1(1, 39) = 8.6, p<.01; F2(1,23)=7.4, p<.01
![Page 157: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/157.jpg)
Results: Non-scrambled conditions
Slowdown at mismatching NP only when NP is possible antecedent.
500
600
700
800
900
1000
1100
1 2 3 4 5 6 7 8 9 10
unscr,match
unscr,mismatch
his/her
± Match FS<1
![Page 158: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/158.jpg)
Summary: Experiment 3
NP-nom
Verb
HIS-WH
gap
Binding constraint application takes place in advance of the verb.
Wh-gap is posited in a simple clause.
start
![Page 159: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/159.jpg)
Experiment 3 (off-line):Grammatical judgment test
which of his children (DAT) the man (NOM) …
which of his children (NOM) the man (DAT) …
**??
![Page 160: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/160.jpg)
Experiment 3 (off-line): Stimuli
a. Non-wh, Non-scrambled
[His children]-nom Adv the man-dat
b. Non-wh, Scrambled
[His children]- dat Adv the man-nom
c. Wh, Non-scrambled
[Which of his children]-nom Adv the man-dat
d. Wh, Scrambled
[Which of his children]-dat Adv the man-nom
![Page 161: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/161.jpg)
Experiment 3 (off-line):Design & Procedure
• 4 lists were created by distributing 32 items in a Latin Square design
• 16 items: same materials from online test, and 16 items: different from those in online test.
• 32 filler sentences
• Anaphoric relation judgment task
• 40 native speakers of Japanese, same individuals as the online test
![Page 162: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/162.jpg)
Experiment 3 (off-line):Results
• Backwards anaphora are more allowed in scrambled conditions.
• It confirms that the binding facts underlying in the online test are correct.
1
1.5
2
2.5
3
3.5
4
4.5
5
Non-wh, Unscr Non-wh, Scr Wh, Unscr Wh, Scr
start
![Page 163: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/163.jpg)
Grammatical Search and Reanalysis
David SchneiderColin Phillips
Journal of Memory & Language, 2001
![Page 164: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/164.jpg)
• Previous study showed incremental application of grammatical constraints,
i.e. derivations operate on a word-by-word time-scale
• Next study: do real-time derivations show consistency,
i.e does structure-building keep to a single derivation?how does is grammar searched to find possible analyses?
![Page 165: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/165.jpg)
Grammatical Search
the man
knows the womanNP
VP
V
NP
S
(Schneider & Phillips, 2001)
![Page 166: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/166.jpg)
Grammatical Search
the man
knows the womanNP
VP
V
S
NP
likesV
(Schneider & Phillips, 2001)
![Page 167: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/167.jpg)
Grammatical Search
the man
knows
the womanNP
VP
V
S
NP
likesV
S
(Schneider & Phillips, 2001)
![Page 168: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/168.jpg)
Grammatical Search
the man
knows
the womanNP
VP
V
S
NP
likesV
S
It’s clear that this is the right conclusion, but it’s less clear how the system reaches this conclusion.
(Schneider & Phillips, 2001)
![Page 169: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/169.jpg)
Grammatical Search
the man
knows the womanNP
VP
V
S
NP
likesV
Option 1: combine with a local NP, ignoring existing status of the NP.
(Schneider & Phillips, 2001)
![Page 170: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/170.jpg)
Grammatical Search
the man
knows the womanNP
VP
V
S
NP
likesV
Option 1: combine with a local NP, ignoring existing status of the NP.
(Schneider & Phillips, 2001)
![Page 171: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/171.jpg)
Grammatical Search
the man
knows the womanNP
VP
V
S
NP
likesV
Option 2: search the structure for an NP subject that currently lacks a -role,i.e., focused search.
(Schneider & Phillips, 2001)
![Page 172: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/172.jpg)
Grammatical Search
the man
knows the womanNP
VP
V
S
NP
likesV
Option 2: search the structure for an NP subject that currently lacks a -role,i.e., focused search.
(Schneider & Phillips, 2001)
![Page 173: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/173.jpg)
Grammatical Search
the man
knows the womanNP
VP
V
S
NP
likesV
Option 2: search the structure for an NP subject that currently lacks a -role,i.e., focused search.
This fails, so reanalysis is needed, … but only as a last resort operation.
![Page 174: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/174.jpg)
the man
knows the womanNP
VP
V
S
NP
likesV
Test CaseIf there is a higher NP, currently lacking a -role, a focused search will find it.
(Schneider & Phillips, 2001)
![Page 175: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/175.jpg)
the man
knows the womanNP
VP
V
S
NP
likesV
S’
NP
t
who
Test CaseIf there is a higher NP, currently lacking a -role, a focused search will find it.
(Schneider & Phillips, 2001)
![Page 176: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/176.jpg)
the man
knows the womanNP
VP
V
S
NP
likesV
S’
NP
t
who
STest CaseIf there is a higher NP, currently lacking a -role, a focused search will find it.
(Schneider & Phillips, 2001)
![Page 177: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/177.jpg)
the man
knows the womanNP
VP
V
S
NP
Test CaseIf there is a higher NP, currently lacking a -role, a focused search will find it.
S’
NP
t
who
An unconstrained search will not be affected by the presence of the higher NP.
likesV
(Schneider & Phillips, 2001)
![Page 178: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/178.jpg)
the man
knows
the womanNP
VP
V
S
NP
Test CaseIf there is a higher NP, currently lacking a -role, a focused search will find it.
S’
NP
t
who
An unconstrained search will not be affected by the presence of the higher NP.
likesV
S
(Schneider & Phillips, 2001)
![Page 179: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/179.jpg)
the man
knows
the womanNP
VP
V
S
NP
Test CaseIf there is a higher NP, currently lacking a -role, a focused search will find it.
S’
NP
t
who
An unconstrained search will not be affected by the presence of the higher NP.
likesV
S
ProbeAntecedents for reflexives.
(Schneider & Phillips, 2001)
![Page 180: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/180.jpg)
the man
knows
the womanNP
VP
V
S
NP
Test CaseIf there is a higher NP, currently lacking a -role, a focused search will find it.
S’
NP
t
who
An unconstrained search will not be affected by the presence of the higher NP.
likesV
S
ProbeAntecedents for reflexives.
...the recipe herself
...the recipe himself
(Schneider & Phillips, 2001)
![Page 181: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/181.jpg)
Test CaseIf there is a higher NP, currently lacking a -role, a focused search will find it.
An unconstrained search will not be affected by the presence of the higher NP.
ProbeAntecedents for reflexives.
the man
knows the womanNP
VP
V
S
NP
likesV
S’
NP
t
who
S
...the recipe herself
...the recipe himself
(Schneider & Phillips, 2001)
![Page 182: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/182.jpg)
Grammatical Search
Relative to its unambiguous control, high attached reflexives pose no difficulty.
(Schneider & Phillips, 2001)
![Page 183: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/183.jpg)
Grammatical Search
Relative to its unambiguous control, high attached reflexives pose no difficulty.
…but low attached reflexives present great difficulty.
(Schneider & Phillips, 2001)
![Page 184: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/184.jpg)
Therefore...High attachment is chosen
…despite well-known local-attachment biases.
the man
knows the womanNP
VP
V
S
NP
likesV
S’
NP
t
who
S
Grammatical search is focused, constrained by existing commitments
(Schneider & Phillips, 2001)
![Page 185: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/185.jpg)
Therefore...High attachment is chosen
…despite well-known local-attachment biases.
Grammatical search is focused, constrained by existing commitments
knows the womanNP
VP
V
S
likesV
the manNP
This helps us to understand how grammatical search proceeds in simple cases.
![Page 186: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/186.jpg)
Conclusions
• Local attachment is easy• The local reanalysis is easy (cf. Sturt et al. 2000)• So why is local attachment avoided?
Reanalysis is a Last Resort (even if it’s easy)
![Page 187: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/187.jpg)
Reversal of results…
![Page 188: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/188.jpg)
H
H
HH
H
H
H
H
H
H
H
H
B B
BB
B
B
B
B
B
B
B
B
C
C
C
C
C C
C
C
C
CC
CC
G
G
G
G
GG
G
G
G
G
G
GG
1 3 4 5 6 7 8 9 10 11 12 13 14
-100
-50
0
50
100
150
Sentence Region
H High Ambiguous
B High Unambiguous
C Low Ambiguous
G Low Unambiguous
verb reflexive
H
H H H HH
H
H
H
H H
H
B
B
B
B
B B BB
B
B
B
B
C
C
C C
C
C
C
C
C
C
C
C
C
G
G
G G
G
G
G
G
G
G
G
G
G
1 3 4 5 6 7 8 9 10 11 12 13 14
-100
-50
0
50
100
150
Sentence Region
H High Ambiguous
B High Unambiguous
C Low Ambiguous
G Low Unambiguous
verb reflexive
NP-biased
hear, warn,understand
S-biased
claim, believe,suspect
![Page 189: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/189.jpg)
Outline
• The Challenge• Real-time Grammar• Accurate Parsing• Incremental Parsing• Mapping onto the Brain: Electrophysiology• Encoding• Outlook
![Page 190: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/190.jpg)
Time Resolution
• Syntax: phrase-by-phrase time scale
• Reading-time studies: word-by-word time scale
• Brain recordings: millisecond time scale
![Page 191: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/191.jpg)
Event-Related Potentials (ERPs)
s1 s2 s3
John is laughing.
![Page 192: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/192.jpg)
Evolving understanding of ERP components associated with language…
![Page 193: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/193.jpg)
Semantically unexpected input
• She spread the warm bread with socks.(Kutas & Hillyard,
1980)
• She was stung by a fly.(Kutas, et al., 1984;
Federmeier & Kutas, 1999)
(Slide from Kaan (2001)
![Page 194: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/194.jpg)
N400
• Negative polarity• peaking at around 400 ms• central scalp distribution
(Slide from Kaan (2001)
![Page 195: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/195.jpg)
ERP Sentence Processing
• Developing understanding of N400 is informative
• Response to ‘violations’
N400
I drink my coffee with cream and sugarI drink my coffee with cream and socks
Kutas & Hillyard (1980)
![Page 196: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/196.jpg)
Vervet Monkeys
• Many predators: leopard, lionhyena, jackal, eagle, etc. etc.
• Distinct alarm calls for different predators
![Page 197: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/197.jpg)
ERP Sentence Processing
• Developing understanding of N400 is informative
• Response to normal sentences
N400
Fully CongruentMost new drugs are tested onwhite lab rats.
Van Petten & Kutas (1991)
![Page 198: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/198.jpg)
ERP Sentence ProcessingN400
• N400 to semantic anomalies is a special case of a much more general phenomenon
• All words elicit N400-like response, timing and amplitude proportional to congruency, frequency, etc.
• More detailed understanding is contingent on more detailed models of semantic interpretation
![Page 199: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/199.jpg)
Morpho-Syntactic violations
Every Monday he mows the lawn.
Every Monday he *mow the lawn.
The plane brought us to paradise.
The plane brought *we to paradise.(Coulson et al., 1998)
(Slide from Kaan (2001)
![Page 200: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/200.jpg)
he mowshe *mow
P600
(Slide from Kaan (2001)
![Page 201: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/201.jpg)
he mowshe *mow
P600
Left Anterior Negativity (LAN)
(Slide from Kaan (2001)
![Page 202: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/202.jpg)
ERP Sentence ProcessingLAN, P600
Sie bereist dasneuter Landneuter …Sie bereist denmasculine Landneuter …she travels the land ... Gunter et al. (2000)
![Page 203: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/203.jpg)
Kaan et al. (2000)
ERP Sentence ProcessingP600
Emily wondered who the performer in the concert had imitated for the audience’s amusement.Emily wondered whether the performer in the concert had imitated a pop star for the audience’s amusement.
• P600 reflects normal structure-building processes.
![Page 204: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/204.jpg)
Electrophysiology of Wh-movement
Colin Phillips, Nina Kazanina, Shani Abada, Daniel Garcia-Pedrosa
[revision of work done at UDel in 2000]
![Page 205: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/205.jpg)
Experiment DesignMaterials
a. The actress wished that the producers knew that the witty host would tell the jokes during the party.
b. The actress wished that the producers knew which jokes the witty host would tell __ during the party.
c. The producers knew that the actress wished that the witty host would tell the jokes during the party.
d. The producers knew which jokes the actress wished that the witty host would tell __ during the party.
![Page 206: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/206.jpg)
a. The actress wished that the producers knew that the witty host would tell the jokes during the party.
b. The actress wished that the producers knew which jokes the witty host would tell during the party.
c. The producers knew that the actress wished that the witty host would tell the jokes during the party.
d. The producers knew which jokes the actress wished that the witty host would tell during the party.
Short wh-dependency
Experiment DesignMaterials
![Page 207: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/207.jpg)
a. The actress wished that the producers knew that the witty host would tell the jokes during the party.
b. The actress wished that the producers knew which jokes the witty host would tell during the party.
c. The producers knew that the actress wished that the witty host would tell the jokes during the party.
d. The producers knew which jokes the actress wished that the witty host would tell during the party.
Long wh-dependency
Experiment DesignMaterials
![Page 208: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/208.jpg)
-100 0 100 200 300 400 500 600 700 800 900 1000
-5
-4
-3
-2
-1
0
1
2
3
4
5
+wh
-wh
Electrode PZ Short Conditionsn=20
Effect of wh-movement significant (p<.01) from 300-400ms onwards
Verb
![Page 209: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/209.jpg)
-100 0 100 200 300 400 500 600 700 800 900 1000
-5
-4
-3
-2
-1
0
1
2
3
4
5
+wh
-wh
Electrode PZ Long Conditionsn=20
Effect of wh-movement significant (p<.01) from 300-400ms onwards
Verb
start
![Page 210: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/210.jpg)
How fast is Structural Computation?
Silke UrbanColin Phillips
![Page 211: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/211.jpg)
Background
Early Left Anterior Negativity
(Angela Friederici, Anja Hahne, et al.)
![Page 212: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/212.jpg)
Neville et al., 1991
The scientist criticized a proof of the theorem.
The scientist criticized Max’s of proof the theorem.
![Page 213: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/213.jpg)
500ms/word
![Page 214: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/214.jpg)
500ms/word
![Page 215: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/215.jpg)
Hahne & Friederici, 1999
Das Baby wurde gefüttertThe baby was fed
Das Baby wurde im gefüttertThe baby was in-the fed
Question: are the brain responses to violations automatic?
![Page 216: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/216.jpg)
Hahne & Friederici, 1999
P600
![Page 217: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/217.jpg)
P600
![Page 218: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/218.jpg)
Hahne & Friederici, 1999
ELAN
![Page 219: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/219.jpg)
ELAN
![Page 220: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/220.jpg)
ELAN
• Very fast: 150-250ms• Automatic• Left anterior (= frontal) scalp distribution• Elicited by a subclass of syntactic violations
“Phase 1 (100–300 ms) represents the time window in which the initial syntactic structure is formed on the basis of information about the word category.”
(Friederici 2002)
![Page 221: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/221.jpg)
Questions about ELAN
• How plausible is it that ELAN reflects syntactic structure building?
– Speed: 150ms is faster than lexical access!
– Generality: ELAN is not elicited by most violations; almost all studies on ELAN involve one construction (for each of German, English)
– Localization…
![Page 222: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/222.jpg)
Brodmann Areas
![Page 223: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/223.jpg)
160 SQUIDwhole-headarray
pickup coil & SQUIDassembly
Magnetoencephalography (MEG)
![Page 224: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/224.jpg)
(Friederici et al. 2000)
![Page 225: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/225.jpg)
Two regions of interest
(Friederici et al. 2000)
![Page 226: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/226.jpg)
(Friederici et al. 2000)
![Page 227: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/227.jpg)
Anterior Temporal Lobe?
• Why is anterior temporal lobe so important in ELAN?
• How does it differ from Broca’s area (BA 44 etc.) that are implicated so often in other studies?
• Friederici: both responsible for ‘structure building’; BA44 also responsible for ‘syntactic working memory’; ‘the inferior portion of BA44 is selectively activated when syntactic processes are in focus.’
• Anterior temporal lobe associated with– lexical information
– activated in fMRI by comparisons of sentences with word lists
![Page 228: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/228.jpg)
Alternative Interpretation
• ELAN reflects violation/suppression of automatic lexical prediction– accounts for localization to anterior temporal lobe
– accounts for very early timing
– might account for automaticity
– accounts for very limited distribution
![Page 229: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/229.jpg)
Neville et al., 1991
The scientist criticized a proof of the theorem.
The scientist criticized Max’s of proof the theorem.
NP
Max’s N
![Page 230: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/230.jpg)
Hahne & Friederici, 1999
Das Baby wurde gefüttertThe baby was fed
Das Baby wurde im gefüttertThe baby was in-the fed
NP
the N
in
PP
![Page 231: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/231.jpg)
Prediction
• If ELAN reflects violation of lexical prediction, rather than syntactic structure-building, then…
– change lexical predictions
– keep syntactic violation the same
– should ‘turn off’ ELAN brain response
![Page 232: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/232.jpg)
Neville et al., 1991
The scientist criticized a proof of the theorem.
The scientist criticized Max’s of proof the theorem.
NP
Max’s N
Possible to block the automatic prediction of an N following a possessor: ellipsis
![Page 233: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/233.jpg)
Ellipsis
• Possessors may appear alone in ellipsis contexts:
Although I like Mary’s theory, I don’t like John’s.
![Page 234: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/234.jpg)
Experimental Conditions
Although Erica kissed Mary’s mother, she did not kiss the daughter of the bride.
Although Erica kissed Mary’s mother, she did not kiss Dana’s of the bride.
Although the bridesmaid kissed Mary, she did not kiss the daughter of the bride.
Although the bridesmaid kissed Mary, she did not kiss Dana’s of the bride.
![Page 235: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/235.jpg)
Experimental Conditions
Although Erica kissed Mary’s mother, she did not kiss the daughter of the bride.
Although Erica kissed Mary’s mother, she did not kiss Dana’s of the bride.
Although the bridesmaid kissed Mary, she did not kiss the daughter of the bride.
Although the bridesmaid kissed Mary, she did not kiss Dana’s of the bride.
ellipsis possible
ellipsis impossible
![Page 236: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/236.jpg)
Experimental Design
• 384 sentences per session– 128 targets (drawn from 128 sets of 4 conditions)
– 64 items designed to elicit ‘agreement violation’ LAN
– 192 filler items, designed to hide violations and promote ellipsis
• Procedure– RSVP (Rapid Serial Visual Presentation), 500ms/word
– Grammaticality judgment task
• Recording: 32-electrode montage
• 22 subjects (so far)
![Page 237: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/237.jpg)
+
![Page 238: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/238.jpg)
Although
![Page 239: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/239.jpg)
Erica
![Page 240: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/240.jpg)
kissed
![Page 241: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/241.jpg)
Mary’s
![Page 242: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/242.jpg)
mother,
![Page 243: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/243.jpg)
she
![Page 244: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/244.jpg)
did
![Page 245: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/245.jpg)
not
![Page 246: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/246.jpg)
kiss
![Page 247: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/247.jpg)
Dana’s
![Page 248: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/248.jpg)
of
![Page 249: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/249.jpg)
the
![Page 250: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/250.jpg)
bride.
![Page 251: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/251.jpg)
???
good bad
![Page 252: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/252.jpg)
Preliminary Results
a. Although … Mary’s mother … Dana’s of …b. Although … Mary … Dana’s of …
b
a
![Page 253: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/253.jpg)
Interim Conclusion
• Preliminary results lend support to our interpretation of the (E)LAN - the anterior negativity is reduced in an ellipsis context
– structural violation is identical in both conditions
– obligatory lexical prediction of N following possessor (e.g. Mary’s…) is absent in ellipsis context
• Structure-building may begin ~250-300ms after a word is presented
![Page 254: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/254.jpg)
Outline
• The Challenge• Real-time Grammar• Accurate Parsing• Incremental Parsing• Mapping onto the Brain: Electrophysiology• Encoding• Outlook
![Page 255: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/255.jpg)
The Binding Problem
• Discrete infinity
Individual neurons (or groups of neurons) can store finite information about objects, words, etc.
But sentences are infinite in number!
• Representing structure: can’t just activate all words
e.g. THE + MAN + ATE + PIZZA
• Must create & discard structures quickly: 100s of msec
![Page 256: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/256.jpg)
Temporal Binding
the
man
ate
pizza
phaselocked
phaselocked
~25ms, 40Hz
![Page 257: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/257.jpg)
Evidence from Animals & Humans
• Direct recordings (cat) • EEG recordings (human)
(Singer 1999) (Tallon-Baudry & Bertrand 1999)
![Page 258: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/258.jpg)
Limitations…
• No evidence yet of role in human syntax• Limited capacity - ~7 bindings• 1-level of hierarchy only
• Interesting hypothesis (Whitney & Weinberg 2002)– temporal binding is the neural representation used for the
‘syntactic workspace’
– additional neural encoding mechanism used for long-term representation and storage
![Page 259: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/259.jpg)
Outline
• The Challenge• Real-time Grammar• Accurate Parsing• Incremental Parsing• Mapping onto the Brain: Electrophysiology• Encoding• Outlook
![Page 260: Language Mind and Brain: The Unification Problem Colin Phillips Cognitive Neuroscience of Language Laboratory Department of Linguistics University of Maryland](https://reader036.vdocuments.mx/reader036/viewer/2022062517/56649f355503460f94c53d08/html5/thumbnails/260.jpg)
Outlook• Overview
– challenge for unification: real-time hypotheses
• Real-time Grammar– syntactic derivations look like real-time derivations
• Accurate Parsing– real-time derivations have the sophistication that is needed
• Incremental Parsing– real-time interpretation is time-locked to incoming words
• Mapping onto the Brain: Electrophysiology– extreme time-precision of EEG/MEG can be linked to detailed
linguistic constructs
• Encoding– plausible models of neural encoding of structure are emerging
• Unification: Problem or Mystery…