reading different writing systems: the grapholinguistic equilibrium hypothesis mark s. seidenberg...

74
Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin- Madison

Upload: jahiem-blanding

Post on 01-Apr-2015

226 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Reading different writing systems:The grapholinguistic equilibrium

hypothesis

Mark S. SeidenbergUniversity of Wisconsin-Madison

Page 2: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison
Page 3: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Golden era for reading research!

One of the big success stories in cognitive science/neuroscience

(links to education: not so good, at least in US)

Not just English; many writing systems, languages

Lots of progress!

Page 4: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

My own work

Children, adultsNormal, dyslexicEnglish, Serbian, Chinese,other writing systems

Brain circuits BehaviorComputational modelsConnectionist models that simulate detailed aspects of acquisition, skilled performance. Dyslexia = anomalies in how system develops

Research at UW, MedicalCollege of Wisconsin, Haskins Labs (CT)

Page 5: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

For today’s talk, I tried to pick a topic that is of interest to this audience

Page 6: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Writing Systems and Reading

• Do properties of writing systems affect – Skilled reading– Learning to read– Brain circuits that support reading– Dyslexia

Page 7: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

We have this framework….

1. Mappings between codes are statistical, not categorical

2. Ouput determined by multiple constraints 3. Division of labor among components varies

between writing systemsbetween individuals

meaning

spelling sound

context

Page 8: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison
Page 9: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Other models?

There are some.Not the time or place to do comparisons.But, DRC

Doesn’t Read CorrectlyAnd CDP+

Can’d Do Pronunciation, and other stuff

Post-hoc fitting of models to data.Only allows models to fit individual studies of a phenomenon, sort of.“incremental, nested”? No, not actually.

Page 10: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

But that’s a different talk

Page 11: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Impact of writing systems: an area where dual-route models

have little to say

• Fitting models to writing systems/languages

• Each gets a different model, different parameters

• Similarities/differences built in: have to know them already

• No learning• No semantics• No “why”

Page 12: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

But that’s a different talk

Page 13: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

It’s a golden era for reading research but it’s taken a while for cross-linguistic issues to come into focus

Most research: it’s about the properties of writing systemsOrthographic depth

I don’t think this is quite right. It’s about writing systems and the languages they represent

Page 14: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

There are tradeoffs between writing systems and languages

There is Grapholinguistic Equilibrium

Page 15: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Confidential:

I don’t actually know how every writing system in the world works.For example, I don’t know

český jazyk

Grapholinguistic Equilibrium is a hypothesis.

Most of the evidence is circumstantial.

Not much direct experimental evidence.

Page 16: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Let’s do an experiment here! Now!

When you hear

Ask: is it true of český jazyk?

If it is, great.

If it isn’t, I’ll go

this

Page 17: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

orthography phonology

semantics

Writing affords routes to meaning!

ALL writing

So:

Page 18: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Whether your word is

PICTURE

or

or

obrázek

Page 19: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

An early division of labor theory:

Orthographic Depth

Page 20: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

orthography phonology

semantics

Orthographic depth hypothesis:shallow: more orth-phon-semdeep: more orth-semEnglish: both

1980sKatz, Turvey,Haskins Labs

Page 21: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Among alphabetic writing systems, English is unusual

many inconsistenciesunlike Finnish, Italian, Russian, Korean,

others

orth-->phon is a big issue for English learnersnot for everyone else

Czech

Page 22: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

We don’t want theories of reading to be based on the outlier data!

Page 23: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

It’s true that written English differs from shallower alphabetic systems

Assumptions derived from English may not be valid.Findings differ in important respects.

But, there are no “outlier” orthographies. Just:Different tradeoffs between writing systems and languages

Page 24: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Is English an outlier?

For example, Learning to read: are shallow orthographies easier?

Page 25: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Case study: Welsh vs. English

• Welsh: shallow English: deep• Different schools, same communities• Natural controls for SES etc.

(These are older studies, Marketa.)

Page 26: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Ellis & Hooper, 2001: Welsh-reading 7 year olds correctly name twice as many words as English readers

Spencer & Hanley, 2003: 6 year olds

Out of 30 items/condition

Page 27: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Similar findings in other languages

ItalianSpanishGermanFrenchFinnishSerbianTurkishAlbanianothers

Handbook of Orthography and Literacy,Joshi & Aron (Eds.), Erlbaum 2006

Seymour et al. (2003)Ziegler et al. (2010)

Czech?

Page 28: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Issue: These studies equate “reading” with “reading aloud”

Question:What is the relationship between reading aloud and comprehension?

Not tested or not tested in detail.

Page 29: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

The word “comprehension” does not occur in this article.

Why not?

Page 30: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

1. Many studies of English show that learning orth-phon is hardReading aloud is related to comprehension skill

2. Therefore, writing systems that make it easier to learn orth-phon should be easier to learn to read = comprehend

Case where thinking was too tied to studies of English.

Page 31: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

But Reading Aloud ≠ Reading

I shall demonstrate…

Page 32: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

1. Dissociations of reading aloud and comprehension

Good reading aloudZero comprehension

Page 33: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Bar Mitzvah Languages

• Must be able to read Hebrew aloud• Do not have to comprehend• Can be done if the writing system is shallow• Which vowelled Hebrew is.

Welsh: also a very good Bar Mitzvah language!

For the Bar/Bat Mitzvah, the boy/girl

Page 34: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Do Shallow Orthographies Promote Better Comprehension?

Not in the Welsh-English studiesEllis and Hooper

Pronunciation Welsh > EnglishComprehension English > Welsh*

Hanley et al.Comprehension English > WelshCorrelation between pronunciation, comprehension: English highly significant Welsh n.s.

Page 35: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

“This result suggests that a transparent orthography does not confer any advantages as far as reading comprehension is concerned. As comprehension is clearly the goal of reading this finding is potentially reassuring for teachers of English.”

Hanley et al. 2004

Page 36: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

What about other Bar Mitzvah Languages?

Turkish: Aydin Durgunoğlu has looked at both reading aloud and comprehension in detail

“Phonological awareness and decoding develop rapidly in both young and adult readers of Turkish because of the transparent orthography and the special characteristics of phonology and morphology. However, reading comprehension is still a problem.”

Durgunoğlu, 2006

Page 37: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Also true of other shallow orthographies?

Czech?

Page 38: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

English speakers all have (or had) words of this sort in our vocabularies.

2. People comprehend words they cannot pronounce correctly

Page 39: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

URANUS “URINE-OUS?”

EgregiousPiquantSuaveRapportQuayNon-pareilAutomataChaosCoitus

Page 40: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

If we tested my reading aloud, I might perform more poorly than Welsh readers too.

Page 41: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

3. How shallow are shallow orthographies?

Writing systems are not transcriptions of speech.

Information relevant to pronunciation is left out.

Creates limit on strictly orth-phon-sem processing.

Page 42: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Example: Serbo-Croatian, the original “shallow” orthography

Grapheme-phoneme correspondences easy, but not sufficientPronunciation requires more

syllabic stress: pitch accent:ZATvori prisons RIBA fish vs. to scrubzatVORi to shut LUK onion vs. arch

PROIZvodi productsproizVODi to produce

A lot like English!CONductconDUCT

Page 43: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Czech?

Page 44: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

4. What prevents people from learning orth-->sem?Even in shallow orthographies?

Harm & Seidenberg (2004) division of labor model learned

Orth-phon-semOrth-sem

At the same time.

Maybe people do too.

Page 45: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

5. If shallow is so GREAT, what about Hebrew?

It’s shallow all right…

… but they leave out the vowels!

Page 46: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

6. And what about the spoken language?

• Writing systems differ• So do the languages they represent

Comprehension depends on both!

Gough, Simple view of reading

Decoding X Spoken language comprehension

Page 47: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Orthographic depth Morphological complexity

DEEPER SHALLOWERMorphologically simple Morphologically complex

English, Chinese Finnish, Serbian, Italian, RussianAlbanian, Welsh, Spanish, etc.

Czech?

Page 48: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Why would this relation hold, in general?

Page 49: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Consider Serbo-Croatian

• They get the spelling-sound correspondences for free

• But the morphology is very complex!

3 genders 2 numbers 7 cases

masc sing nominativefem plural genitiveneuter dative

accusative instrumental locative vocativeCzech

Page 50: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Mirkovic, Seidenberg, Joanisse (Cognitive Science, 2011)

Model of learning Serbian inflectional system

Page 51: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Now: imagine learning to read Serbian if, as in English,many letters had multiple pronunciations

A few consonants like C and GEach vowel represents many sounds

This additional level of complexity would make the system vastly more difficult to learn.

Too hard!

Page 52: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Contrast: Learning to read in English

• NOT: one spelling - one sound– But, irregulars are mostly short, high-frequency

words– And not arbitrary: HAVE is not “glorp”

• The inflectional system is trivial

– Number on nouns, tense and number on verbs– Makes words shorter too

Page 53: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Grapholinguistic Equilibrium

The simple view of writing systems and reading:G = orth opacity x linguistic complexity)

English: high opacity, low complexitySerbian: low opacity, high complexity

Languages/writing systems tend to keep G constant.

Page 54: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Languages get the writing systems they deserve

In other words

(why English spelling reform is pointless)

Page 55: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Even more broadly

Writing systems provide cues about sound and meaning

Page 56: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Late Hieroglyphics

Hememu = “humanity”

Sound cues

+

Meaning cues

(man, woman, many)

meaningsound

Page 57: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Chinese

Semantic cue“radical”

Sound cue“phonetic”

“Mother”

Page 58: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

In Hebrew and ArabicK-T-B

Page 59: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

In EnglishRedhead

Blockhead

Deadheads

Morphemes = convergence of sound and meaning

Page 60: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

In Serbo-Croatian

all related to “advisor”

Lemmas = strong semantic cues

Page 61: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

In Czech

Page 62: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Conclusions

• Most comparative research on reading has focused on reading aloud– definitely easier in shallow orthographies

• However, comprehension depends on knowledge of spoken language

• Spoken languages vary in “morphological depth” and other ways

• Tradeoffs between properties of writing systems and languages = grapholinguistic equilibrium

• Writing systems are codes for conveying sound + meaning, universally.

Page 63: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

meaning

spelling sound

context

Thanks for listening!

Page 64: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison
Page 65: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Are Some Writing Systems Easier

to Learn to Read?We won’t know without taking into account properties of spoken language

But it doesn’t look like it.

Page 66: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

But, additional assumptions:

• Each code is learned,constrained by other codes;

• Interactivity, not modularity;

• Information encoded by collections of units, etc.

Not specific to reading.

Every theory/model must have these basic elements

What is different about “dual-route” models (e.g., DRC, CDP+):

meaning

spelling sound

context

But, for what?

Also: Models don’t address computation of meaning!

Page 67: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Millions of readers taught by Whole Language Method!

No no no!

In the US there are many people who are poor at pronouncing words and nonwords aloud:

X

Page 68: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

orthographyphonology

“Dual-route” models are different!!!

Two routes to phonology

Lexical route

Nonlexical route

Not about computing meaning!

Page 69: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

Other talk!

Page 70: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

University of Wisconsin-Madison

A birthplace of American psychology(1886)

NRC rankings, 2010

Page 71: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison

DRC

Page 72: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison
Page 73: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison
Page 74: Reading different writing systems: The grapholinguistic equilibrium hypothesis Mark S. Seidenberg University of Wisconsin-Madison