ellopa 2001 and 2002 early language listening & oral proficiency assessment

1

ELLOPA 2001 and 2002Early Language Listening & Oral Proficiency Assessment

Spanish & Japanese Partial Immersion Program

Compiled by Michele Anciaux Aoki, Ph.D.

John Stanford International School Seattle, WA

John Stanford International School 2

Overview of the Evaluation 2001 ELLOPA was conducted by team from

Center for Applied Linguistics over 4 days in May with K and 1st grade students (completing first year of immersion)

2002 Evaluation was completed by JSIS staff and UW graduate students over 3 weeks in May-June with K, 1st, and 2nd grade students (1st and 2nd graders completing second year of immersion)

2002 Evaluators received training in ELLOPA interviewing and rating at UW in April, 2002, as well as on-site training and coaching with Beverly Boyson of CAL in May, 2002


About the ELLOPA

Language Areas:

Oral Fluency Grammar Vocabulary Listening

Comprehension

Proficiency Levels: Junior Novice Low (1) Junior Novice Mid (2) Junior Novice High (3) Junior Intermediate Low (4)

Notes: All ratings above 4 were categorized

as 4 for the purposes of the ELLOPA statistics.

Teachers used the same Rating Profile to rate students based on classroom experience.


What do we want the data to tell us?

How well are our students learning Spanish or Japanese? (Can we see growth across years?)

Do students learn Japanese at the same rate as Spanish?

How well did we do in assessing our students’ language proficiency? (How do ELLOPA ratings compare to Teacher Ratings?)


ELLOPA – Kindergarten

Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 15.4% 53.8% 15.4% 15.4%Grammar 15.4% 53.8% 15.4% 15.4%Vocabulary 15.4% 53.8% 19.3% 11.5%Listening Comp 3.8% 13.5% 50.0% 32.7%


ELLOPA Spanish 2001 - K


ELLOPA Japanese 2002 - KJr Nov Low Jr Nov Mid Jr Nov High Jr Int Low

Oral Fluency 67.9% 17.9% 0.0% 14.3%Grammar 67.9% 17.9% 0.0% 14.3%Vocabulary 75.0% 10.7% 0.0% 14.3%Listening Comp 17.9% 53.6% 7.1% 21.4%


Teacher Ratings – KindergartenTeacher Ratings Spanish 2001 - K

Teacher Ratings Spanish 2002 - K

Teacher Ratings Japanese 2002 - K

Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 38.5% 42.3% 19.2%Grammar 34.6% 46.2% 19.2%Vocabulary 34.6% 46.2% 19.2%Listening Comp 46.2% 34.6% 19.2%

Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 17.9% 67.9% 14.3%Grammar 17.9% 67.9% 14.3%Vocabulary 21.4% 57.1% 7.1% 14.3%Listening Comp 17.9% 67.9% 14.3%



0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow

Oral FluencyGrammarVocabularyListening Comp



0.0%5.0%

10.0%15.0%20.0%25.0%30.0%35.0%40.0%45.0%50.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow



Teacher Ratings Spanish 2002 - K

0.0%5.0%

10.0%15.0%20.0%25.0%30.0%35.0%40.0%45.0%50.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow



ELLOPA Japanese 2002 - K

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow



Teacher Ratings Japanese 2002 - K

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow



ELLOPA Spanish/Japanese KMean or Average of Scores in 2001 and 2002

Oral Fluency Grammar Vocabulary Listening CompSpanish 2001 2.31 2.31 2.27 3.11Spanish 2002 2.00 1.96 1.96 2.81Japanese 2002 1.61 1.61 1.54 2.32


ELLOPA Spanish/Japanese 2001 - 2002 - K

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

Spanish2001

Spanish2002

Japanese2002


Mean or Average


ELLOPA 1st Grade

ELLOPA Spanish 2001 – 1st (after first year of language)

ELLOPA Spanish 2002 – 1st (after second year of language)




ELLOPA Spanish 2001 – 1st

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow


(first year in the program)


ELLOPA Spanish 2002 – 1st

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow


(second year in the

program)


Teacher Ratings Spanish 2002 – 1st

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow


(second year in the

program)


ELLOPA & Teacher Ratings 2nd Grade

ELLOPA Spanish 2002 – 2nd (after second year of language) Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 16.7% 16.7% 22.2% 44.4%Grammar 16.7% 16.7% 16.7% 50.0%Vocabulary 11.1% 27.8% 27.8% 33.3%Listening Comp 5.6% 22.2% 16.7% 55.6%

Teacher Ratings Spanish 2002 – 2nd (after second year of language) Jr Nov Low Jr Nov Mid Jr Nov High Jr Int LowOral Fluency 2.7% 29.7% 21.6% 45.9%Grammar 10.8% 29.7% 24.3% 35.1%Vocabulary 2.7% 24.3% 35.1% 37.8%Listening Comp 0.0% 2.7% 37.8% 59.5%


ELLOPA Spanish 2002 – 2nd

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow


(second year in the

program)


Teacher Ratings Spanish 2002 – 2nd

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

Jr NovLow

Jr NovMid

Jr NovHigh

Jr IntLow


(second year in the

program)


ELLOPA/Teacher Rating – K

ELLOPA/Teacher Rating Spanish 2001 vs. 2002 – KOral Fluency Grammar Vocabulary Listening Comp

ELLOPA 2001 2.31 2.31 2.27 3.11Teacher 2001 2.56 2.67 3.02 3.17ELLOPA 2002 2.00 1.96 1.96 2.81Teacher 2002 2.00 2.04 2.04 2.73


ELLOPA/Teacher Rating Spanish 2001, 2002 - K

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

ELLOPA2001

Teacher2001

ELLOPA2002

Teacher2002


Mean or Average


ELLOPA/Teacher Rating 1st – 2nd

ELLOPA/Teacher Rating Spanish 2001 – 1st, 2002 – 1st

ELLOPA/Teacher Rating Spanish 2002 – 2nd

Oral Fluency Grammar Vocabulary Listening CompELLOPA 2001 2.22 2.22 2.20 3.11Teacher 2001 2.41 2.46 2.89 3.43ELLOPA 2002 3.08 2.98 3.00 3.48Teacher 2002 2.93 2.93 3.02 3.61


ELLOPA/Teacher Rating Spanish 2001, 2002 – 1st

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

ELLOPA2001

Teacher2001

ELLOPA2002

Teacher2002


Mean or Average

(2001 – one year of study;

2002 – two years of study)


ELLOPA/Teacher Rating Spanish 2001, 2002 – 2nd

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

ELLOPA 2002 Teacher 2002


Mean or Average


ELLOPA/Teacher Rating Growth

ELLOPA/Teacher Rating Spanish 2001 – K, 2002 – 1st

ELLOPA/Teacher Rating Spanish 2001 – 1st, 2002 – 2nd




ELLOPA/Teacher Rating Spanish 2001, 2002 – K-1 growth

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

ELLOPA2001

Teacher2001

ELLOPA2002

Teacher2002


Mean or Average

(growth over 2 years)


ELLOPA/Teacher Rating Spanish 2001, 2002 – 1-2 growth

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

ELLOPA2001

Teacher2001

ELLOPA2002

Teacher2002


Mean or Average

(growth over 2 years)


Paired ELLOPA Ratings 2001, 2002 – K-1 and 1-2 growth

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

2001(K)

2002(1st)

2001(1st)

2002(2nd)


Mean or Average

This is the most accurate representation of growth because it compares only students who were in the

program both years.

According to CAL, the rate of growth is

statistically significant.


How did JSIS raters compare to CAL?

020406080

100120140160180200

K 1st 2nd

Total RatingsSame as CALHigher than CALLower than CAL

Number of Ratings of Oral Fluency, Grammar,

Vocabulary, and Listening Comprehension

Beverly Boyson of CAL reviewed ELLOPA note sheets from JSIS raters and modified ratings where appropriate

ellopa 2001 and 2002 early language listening & oral proficiency assessment

Documents