“comparable materials” eva m. fernández queens college & graduate center, cuny...
TRANSCRIPT
“Comparable Materials”
Eva M. Fernández
Queens College & Graduate Center, CUNY
Bilingualism Research Group ● June 24, 2004
Grosjean, 1998
Studying bilinguals: Methodological and conceptual issues.Bilingualism: Language and Cognition, 1, 131-149.
“…some of the difficulties encountered by researchers could have been lessened, if not avoided, had close attention been paid to methodological and conceptual issues…”
The issues: “…bilingual participants, language mode, stimuli, tasks as well as models of bilingual representation and processing.”
(p. 131)
Today’s Approach
Good Practices which should plausiblyapply to: studies of bilinguals and L2 speakers cross-linguistic studies of monolinguals
(alas, the over-represented minority!)
Learning from examples of poor materials construction studies of both bilinguals and monolinguals mostly sentence-level issues
Participants
Language history for Lx and Ly Order and manner of acquisition Frequency of use
Stability and functions of Lx and Ly Language dominance Other potentially relevant biographical data
Socio-economics, education, handedness, sex, etc.
Cutler, Mehler, Norris & Segui, 1991The monolingual nature of speech segmentation by bilinguals.
Cognitive Psychology, 24, 381-410.
Answering the “Neuro-surgery” Question N=77 Spanish/English Bilinguals
0% 20% 40% 60% 80% 100%
SP: N=10, 26%
EN: N=29, 74%
ENGLISH-DOMINANT:
EN: N=11, 29%
SP: N=27, 71%
SPANISH-DOMINANT:
L-DOM
HARDER-L
L1
MAJORITY-L
FINANCE
FAMILY
HERITAGE
EMOTIONAL
SPANISH-DOMINANT
ENGLISH-DOMINANT
Fernández, 2000/2003
Language Mode and Tasks
Given Lx as base language, activation of Ly differs based on language mode:
greater activation of Ly in bilingual mode
Consequences for performance?
Implications for task design and laboratory set-up?Source: Grosjean, 1998, p. 136
“Comparable Materials”, because…
… we’re control freaks! but what are the variables one needs to
control for?
But, seriously, we have a problem if materials in Lx and Ly aren’t comparable: across studies within a given study
E.g.: Homographs in Lx ~ Ly … but Variable Otherwise pays
[ ] V, 3rd SG, PRES or
N, infrequently in PL more graphic
neighbors
lame [ ] ADJ or V or infr N
pays (“country”) [ ] N, SG, MASC
less graphic neighbors
lame (“blade”) [ ] N
Beauvillain & Grainger, 1987, as cited by Grosjean, 1998
“Comparable Materials” Means…
Comparable structure Comparable felicity/naturalness Comparable degree of ambiguity or
disambiguation And comparable anything else that might matter,
as far as you know, based on existing research: prosody? phonetic content? word frequency? number of neighbors? cognate status?
Comparable Structure
Doubly self-embedded sentences easier in Spanish than in English … because Spanish speakers “do not need
to process the whole clause at once, but can use relatively local cues to process the sentence” (p. 280)
Hoover, 1992, JPR, 21-4, 275-299
The butcher the waiter the boxer helped killed warned the gypsy.El carnicero que el camarero que el boxeador ayudó mató avisó al gitano.
Comparable Structure?
The bakers the electrician the teacher greeted amused kicked the lawyer.
The bakers that the electrician that the teacher greeted amused kicked the lawyer.
El dependiente que los actores que el químico encontró mataron escuchó al gitano.
El dependiente que los actores que encontró el químico mataron escuchó al gitano.
Hoover, 1992, JPR, 21-4, 275-299
40%
45%
85%
47%
Comparable Felicity / Naturalness… the nephew of the teacher who was in the Communist party
… el sobrino del maestro que estaba en el partido comunista
… the cup of sugar that fell on the floor
… la taza de azúcar que se cayó al suelo
… the suitcase of clothes that we use in the summer
… la maleta de ropa que usamos en verano
… the belt of leather that Pedro liked a lot
… el cinturón de piel que le gusta a Pedro
… the table of wood that John carved this Christmas
… la mesa de madera que Juan serró estas navidades
Gilboy, Sopena, Clifton & Frazier, 1995
Comparable Felicity / Naturalness Marginally grammatical items:
To my sister they gave the lamp of alabaster that they polished until it looked like marble.
A mi hermana le regalaron la lámpara de alabastro que pulieron hasta que pareciera mármol
Items in Lx with proper names in Ly:Maria bought a belt made in Malaga.
María compró un cinturón hecho en Málaga.
Goofy itemsThe father-confessor of the monk who prayed met the abbot.
El padre-confesor del monje que rezaba conoció al abad.
Comparable Disambiguation
The police arrested
the sister of the handymanthe brother of the nursemaid
who recently gave birth to twins.
La policíadetuvo
a la hermana del criadoal hermano de la niñera
que dio a luz recientementea dos gemelos.
SPANISH: preference for N1 disambiguation
ENGLISH: no preference for either disambiguation
Carreiras & Clifton, 1993
Comparable Disambiguation?
… the daughter of the madman who was trying out new eye shadow.
… el hijo de la loca que estaba probándose una nueva pintura de ojos.
… the mother of the count who always wears flaming red lipstick.
… la madre del conde que siempre se pinta los labios de rojo brillante.
… the landlady of the businessman who was a sergeant in the reserves.
… la casera del ejecutivo que fue sargento de la legión.
… the bride of the prince who had been a football player in college.
… la prometida del príncipe que había sido jugador de fútbol en el instituto.
Carreiras & Clifton, 1993
Comparable Disambiguation? NO!
Plausibility ratings for suspect v. unbiased materials: English (N=6) and Spanish (N=6) monolingual judges 5-point scale, 1 = “very plausible”, 5 = “very implausible” Two simplex versions of each sentence, read individually,
and interspersed among other materials undergoing norming
(Fernández, 2000/2003)
Suspect Materials
Presumably Unbiased Materials
ImplausiblePredicate
PlausiblePredicate
English 2.37 1.15 1.08
Spanish 3.60 1.33 1.56
1.23 0.18 0.48
Non-Comparable Reflexes of Aspects of the Grammar: Gender
the daughter of the madman who looked at herself in the mirror
the son of the madwoman who looked at herself in the mirror
la hija del loco que se miró en el espejo [AMBIG!]
la hija del loco que estaba sentada en el sofá
el hijo de la loca que estaba sentada en el sofa
the daughter of the madman who was sitting on the sofa [AMBIG!]
Non-Comparable Reflexes of Aspects of the Grammar: Prosody
the daughter of the hostages who was crying
the daughters of the hostage who was crying
la hija de los rehenes que estaba llorando
las hijas del rehén que estaba llorando
PWd1
′PWd2
′PWd3
′
PWd1
′PWd2
′PWd4
′lloraba
lloraba
PWd3
′
Non-Comparable Lexical Items
Mary had underlined the book that she read to her boyfriend.
María había subrayado el libro que leyó a su novio.
Mary read the book that she had underlined to her boyfriend.
María leyó el libro que había subrayado a su novio.
And Comparable Everything Else
An illustration: Fernández & Bradley choosing subset from superset of 32
Recommendations
Become a theoretical linguist, OR Work with corpora
(only kidding!)
Recommendations
Don’t compare apples to naranjas (¡o peras!) Recycle and reuse existing stimulus sets Norm your stimuli Don’t be afraid to consult with experts Take your time when constructing items,
and be prepared to replicate with a new item set Don’t translate! Write Lx/Ly items at the same time Stack the cards against your predictions Exploit existing sources of information
One Last Comment: Models
Studying bilinguals permits examining cross-linguistic phenomena within participants impossible to do with monolinguals! and eliminating unwanted variance induced
by culture, socio-economics, education, etc., likely to differ across two groups of monolinguals
However, is there good reason to believe that bilinguals perform like monolinguals in tasks where language knowledge and language processing are at issue?
Language history questionnaires
http://qcpages.qc.edu/~efernand/QCPL
A copy of this presentation:
http://qcpages.qc.edu/~efernand/CompMats.ppt