parafoveal processing influences word frequency & predictability effects on eye movements during...

47
Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language Processing

Upload: russell-glenn

Post on 17-Dec-2015

222 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Parafoveal Processing InfluencesWord Frequency & Predictability

Effects on Eye Movementsduring Reading

University of Glasgow(est. 1451)

GlasgowLanguageProcessing

Page 2: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Christopher Hand

Sébastien Miellet

Paddy O’Donnell

Page 3: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Graham Scott

Emotion Word Processing:Evidence from Eye Movements

Scott, O’Donnell, & Sereno

Page 4: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language
Page 5: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Frequency & Predictability

• Word frequency– High-frequency (HF) words are read more quickly

than low-frequency (LF) words.– A word frequency effect (HF<LF) is used as a marker

(index) of successful word recognition (lexical access).

• Contextual Predictability– Given a prior context, words that are highly predictable

(HP) from context are read more quickly than those that are less predictable (LP).

– The temporal locus of predictability effects, lexical (interactive) or post-lexical (modular), is a matter of continued debate.

Page 6: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Freq X Pred: Early RT Studies

Stanovich & West (1981):Naming

700

750

800

850

900

950

1000

Incongruous Congruous

Predictability

RT

(m

s)

LF

HF

Schuberth & Eimas (1977):Lexical Decision

500

550

600

650

700

Incongruous Congruous

Predictability

RT

(m

s)

LF

HF

Additive Interactiveor

TargetCondition Context HF LFCongruous The skier was buried in the…Incongruous The bodyguard drove the…

snowsnow avalancheavalanche

Page 7: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

TargetCondition Context HF LFBiasing Flying to its nest was a…Neutral To our surprise we saw a…

bird bird hawkhawk

1

1.2

1.4

1.6

1.8

2

Neutral Biasing

Predictability

Un

sig

ned

Vo

ltag

e (μ

V)

LF

HF

Freq X Pred: ERP Study

Sereno, Brewer, O’Donnell (2003)

N1 component: 132-192 ms

Page 8: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Freq X Pred: Eye MovementsAltarriba, Kroll, Sholl, & Rayner (1996)Lavinge, Vitu, & d’Ydewalle (2000)Rayner, Binder, Ashby, & Pollatsek (2001)- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -Rayner, Ashby, Pollatsek, & Reichle (2004)Miellet, Sparrow, & Sereno (in press)

Inhoff (1984)

500

550

600

650

700

Low High

Predictability

Fix

ati

on

Du

rati

on

(m

s)

LF

HF500

550

600

650

700

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Page 9: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Freq X Pred: Eye MovementsAltarriba, Kroll, Sholl, & Rayner (1996)Lavinge, Vitu, & d’Ydewalle (2000)Rayner, Binder, Ashby, & Pollatsek (2001)- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -Rayner, Ashby, Pollatsek, & Reichle (2004)Miellet, Sparrow, & Sereno (in press)

Inhoff (1984)

500

550

600

650

700

Low High

Predictability

Fix

ati

on

Du

rati

on

(m

s)

LF

HF500

550

600

650

700

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Page 10: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Freq X Pred: Eye MovementsAltarriba, Kroll, Sholl, & Rayner (1996)Lavigne, Vitu, & d’Ydewalle (2000)Rayner, Binder, Ashby, & Pollatsek (2001)- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -Rayner, Ashby, Pollatsek, & Reichle (2004)Miellet, Sparrow, & Sereno (in press)

Inhoff (1984)

500

550

600

650

700

Low High

Predictability

Fix

ati

on

Du

rati

on

(m

s)

LF

HF500

550

600

650

700

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

conducteden

français

Page 11: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Bugs Bunny eats lots of carrotscarrots to stay healthy.

June Cleaver always serves meat and potatoespotatoes for dinner.

LF

HF

High Predictability

June Cleaver always serves meat and carrotscarrots for dinner.

Bugs Bunny eats lots of potatoespotatoes to stay healthy.

LF

HF

Low Predictability

Rayner et al. (2004)

Page 12: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Rayner et al. (2004)

Limitations Remedies

Items per condition:8

Targets embedded in:single sentence

Length of context (# pre-target words):7.7 words

22

15.5

2nd of 2sentences

Page 13: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Bugs Bunny eats lots of carrotscarrots to stay healthy.

June Cleaver always serves meat and potatoespotatoes for dinner.

June Cleaver always serves meat and carrotscarrots for dinner.

Bugs Bunny eats lots of potatoespotatoes to stay healthy.

LF

LF

HF

HF

High Predictability

Low Predictability

Page 14: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Although a rugby player, Clive struggled through the crowdat the bar carrying glasses of lagerlager and bags of crisps.

Gillian was on the last mile of the women’s marathon. Shegrabbed a bottle of waterwater from a spectator and drank it.

Gillian was on the last mile of the women’s marathon. Shegrabbed a bottle of lagerlager from a spectator and drank it.

Although a rugby player, Clive struggled through the crowdat the bar carrying glasses of waterwater and bags of crisps.

LF

LF

HF

HF

High Predictability

Low Predictability

Page 15: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Ingrid’s boiler had suddenly broken down. Fortunately, herneighbour’s father was a plumberplumber and would be able to help.

Callum was having trouble with his homework. He asked hisuncle who was a teacherteacher to help him with the assignment.

Callum was having trouble with his homework. He asked hisuncle who was a plumberplumber to help him with the assignment.

Ingrid’s boiler had suddenly broken down. Fortunately, herneighbour’s father was a teacherteacher and would be able to help.

LF

LF

HF

HF

High Predictability

Low Predictability

Page 16: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Method

• Materials & Design:Frequency (HF,LF) x Predictability (HP,LP)

HF & LF targets matched pair-wise on word length (mean = 5.84 letters; range: 5-8 letters)

HF LF

HP LP HP LP

Frequency (BNC, per million) 145 145 4 4

Predictability (1-7) 6.19 4.07 6.11 3.69Cloze probability .57 .02 .50 .01

# of items 22 22 22 22

Page 17: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Method

• Materials & Design:Frequency (HF,LF) x Predictability (HP,LP)

HF & LF targets matched pair-wise on word length (mean = 5.84 letters; range: 5-8 letters)

HF LF

HP LP HP LP

Frequency (BNC, per million) 145 145 4 4

Predictability (1-7) 6.19 4.07 6.11 3.69Cloze probability .57 .02 .50 .01

# of items 22 22 22 22

Page 18: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Method

• Participants: 64 (mean age = 22; #F = 47)

• Apparatus:– Dual-Purkinje Eyetracker (Gen 5.5)– 4 characters ≈ 1o of visual angle

• Procedure:– 88 experimental passages– Yes/No comprehension questions on half the trials

WOW!

Page 19: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Results: Fixation Time Measures

• Early– First fixation duration (FFD)– Single fixation duration (SFD)– Gaze duration (GD)

• Later– Next forward-going fixation after target (‘spillover’)– Total Fixation Time (TT)

reject 4%skip 21%

1 fix 63%

2+ fix 12%

Page 20: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Single Fixation Duration: Freq x Pred

250

260

270

280

290

300

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms

)

LF

HF

26 ms

9 ms

Page 21: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

First Fixation Duration

250

270

290

310

330

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Gaze Duration

250

270

290

310

330

Low High

Predictability

Fix

ati

on

Du

rati

on

(m

s)

LF

HF

Just then,a smug grincomes overhis face…

Ha! Told you so!

Page 22: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

• In reading, words are initially processed parafoveally before they are directly foveated.

• Prior research indicates that both the frequency and predictability of the parafoveal word can influence its subsequent fixation duration.

• Specifically,– HF parafoveal words are subsequently fixated for less

time than LF ones (Inhoff & Rayner, 1986).– HP parafoveal words are subsequently fixated for less

time than LP ones (Balota, Pollatsek, & Rayner, 1985).

Parafoveal Pre-Processing

Page 23: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

The sore on Tam-Tam’s rump was swollen.

invisibleboundary

* ** *

* * *

Boundary Technique

The sore on Tam-Tam’s tnam was swollen.

invalid parafoveal preview

Page 24: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

…grabbed a bottle of waterwater from a… 1-3

…grabbed a bottle of waterwater from a… 7-9

…grabbed a bottle of waterwater from a… 4-6

…grabbed a bottle of waterwater from a… 10-12

…grabbed a bottle of waterwater from a… 13+

Launch Distance

Page 25: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

(Poorly) Simulated Perceptual Span

…grabbed a bottle of waterwater from a… 10-12

…grabbed a bottle of waterwater from a… 4-6

…grabbed a bottle of waterwater from a… 7-9

…grabbed a bottle of waterwater from a… 1-3

…grabbed a bottle of waterwater from a… 13+

Page 26: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

%Data Contingent on Launch Distance

1-3 (16%)

4-6 (24%)

7-9 (21%)

10-12 (10%)

13+ (5%)

skips (21%)

rejected(4%)

(15%)

(21%)

(17%)

(6%)

(4%)

Page 27: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

#items#subjects #conditions per cond # data points

64 x 4 x 22 = 5632

Page 28: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

# Data Points by Condition: SFD

0

50

100

150

200

250

300

350

13+ 10-12 7-9 4-6 1-3

Launch Distance (# letters)

# D

ata

Po

ints LF-LP

LF-HP

HF-LP

HF-HP

Page 29: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

SFD: Freq x Pred x Launch

200

220

240

260

280

300

1 2 3 4 5 6 7 8

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Low HighPredictability

7-9

Low HighPredictability

4-6

Low HighPredictability

1-3

Launch Distance from Target (# letters)

Page 30: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

• RT studies, in general, find that word frequency and contextual predictability interact.

• Eye movement studies, measuring target word fixation time in normal reading, find that frequency and predictability are additive.

• When the amount of parafoveal preview is manipulated (post-hoc via launch distance), however, different patterns of data emerge.

Summary of Results

Page 31: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Summary of Results

• Specifically,

• Fixation duration vs. RT?– Far condition ≈ RT physically, but not behaviorally– Near condition ≈ RT behaviorally, but not physically

Launch distance Freq Pred FxP

Far (7-9)

Mid (4-6) HFHF

Near (1-3) HFHF,LFLF HFHF<LFLF

Page 32: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

• Apparent additive effect of Freq & Pred in reading is comprised of opposing interactive effects.

Conclusions

SFD: Freq x Pred X Launch

200

220

240

260

280

300

1 2 3 4 5 6 7 8F

ixa

tio

n D

ura

tio

n (

ms

)

LF

HF

LP HP

7-9

Launch Distance from Target (# letters)

Single Fixation Duration: Freq x Pred

250

260

270

280

290

300

Low High

Predictability

Fix

ati

on

Du

rati

on

(m

s)

LF

HF

LP HP

4-6

LP HP

1-3

Page 33: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

• Explanation 1: Frequency First

Conclusions

Single Fixation Duration: Freq x Pred

250

260

270

280

290

300

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Page 34: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

• Explanation 2: Floors & Ceilings

Conclusions

SFD: Freq x Pred X Launch

200

220

240

260

280

300

1 2 3 4 5 6 7 8

Fix

atio

n D

ura

tio

n (

ms

)

LF

HF

LP HP

7-9

Launch Distance from Target (# letters)

LP HP

4-6

LP HP

1-3

Page 35: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

• Launch Site

Conclusions

Used as a tool to capturethe temporal dynamics ofparafoveal processing.

Demonstrated sensitivityto the temporal & spatialcontingencies intrinsic toreading.

Provides a more fluid ortransitional account ofconcurrent oculomotorand linguistic processing.

Page 36: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Thank y’all

Page 37: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language
Page 38: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

• “Parafoveal-on-foveal” effects (oh no!):– When the ease or difficulty in processing a parafoveal

target initially manifests itself on the current, pre-target fixation.

Effects Before the Target?

…grabbed a bottle of waterwater from a…

location of current,pre-target fixation

Page 39: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Fixation Before Target: Freq x Pred

240

250

260

270

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

4 ms(marg.)

6 ms (p<.01)

Page 40: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Fixation Before Target: Launch Dist.

200

220

240

260

280

300

1 2 3 4 5 6 7 8

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Low HighPredictability

7-9

Low HighPredictability

4-6

Low HighPredictability

1-3

Launch Distance from Target (# letters)

Page 41: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

FFD: Freq x Pred X Launch

200

220

240

260

280

300

320

1 2 3 4 5 6 7 8

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Low HighPredictability

7-9

Low HighPredictability

4-6

Low HighPredictability

1-3

Launch Distance from Target (# letters)

Page 42: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

SFD: Freq x Pred X Launch

200

220

240

260

280

300

320

1 2 3 4 5 6 7 8

Fix

ati

on

Du

rati

on

(m

s)

LF

HF

Low HighPredictability

7-9

Low HighPredictability

4-6

Low HighPredictability

1-3

Launch Distance from Target (# letters)

Page 43: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

GD: Freq x Pred X Launch

200

220

240

260

280

300

320

1 2 3 4 5 6 7 8

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Low HighPredictability

7-9

Low HighPredictability

4-6

Low HighPredictability

1-3

Launch Distance from Target (# letters)

Page 44: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

TT: Freq x Pred

290

310

330

350

370

390

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms

)

LF

HF

Effects: F1 F2

Freq *** *** Pred *** *** FxP marg n.s.

Page 45: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Probability of Skipping

0.15

0.20

0.25

0.30

Low High

Predictability

Pro

bab

ility

LF

HF

Page 46: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language

Next Fwd Fix: Freq x Pred

250

260

270

280

290

300

Low High

Predictability

Fix

atio

n D

ura

tio

n (

ms)

LF

HF

Effects: F1 F2

Freq n.s. n.s. Pred marg. n.s. FxP ** marg.

Page 47: Parafoveal Processing Influences Word Frequency & Predictability Effects on Eye Movements during Reading University of Glasgow (est. 1451) Glasgow Language