national center on educational outcomes n c e o reporting assessment results for students with...

National Center on Educational Outcomes

N C

E O

Reporting Assessment Results for Students with Disabilities

Martha Thurlow


University of Minnesota


N C

E O

What Data Sources Does NCEO Use to Identify State Reporting Practices?

Analysis of State Data Reports

Analysis of State Biennial Performance Reports

State Survey Results (2003 and older)


N C

E O

Analyses of Biennial Performance Reports (2002)

Study Procedures

NCEO

1. Received data from OSEP, U.S. Dept of Ed

2. Summarized findings and sent to states to verify

3. States sent corrections

4. No numbers changed (unless incorrect) except those in resubmitted BPRs

[Data for 2000-2001]


N C

E O

WA MT ND

OR

NV

CA

ID WY

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PA

NY

ME

WV

AK

HI

VT NH

CTNJ

DEMD

State Reported General Assessment Participation Data (49 regular, 8 unique)

IN

MA

RI

American Samoa

Bureau of Indian Affairs

Commonwealth Mariana Islands

District of Columbia

Guam

Marshall Islands

Palau

Puerto Rico

Virgin Islands

2000-2001 General Assessment Participation Data – BPRs


N C

E O

WA MT ND

OR

NV

CA

ID WY

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA**

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PA

NY

ME

WV

AK

HI

VT** NH

CTNJ

DE**MD

25-49% (1 regular, 2 unique)




No Participation Rate Data (7 regular, 3 unique)

IN

MA**

RI

American Samoa


Commonwealth N. Mariana Islands**


Guam

Marshall Islands

Palau

Puerto Rico

Virgin Islands

Rates are for the population of students receiving special education services at the grades assessed.

** Indicates that the participation rate was close to the cut for the next higher grouping (see Appendix B).

*Rates are the highest reported participation rate

No state had participation rates below 25%

Biennial Performance Report 2000-2001 General Assessment Participation*


N C

E O

2000-2001 Alternate Assessment Participation Data – BPRs

WA MT ND

OR

NV

CA

ID WY

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PA

NY

ME

WV

AK

HI

VT NH

CTNJ

DEMD

IN

MA

RI

American Samoa




Guam

Marshall Islands

Palau

Puerto Rico

Virgin Islands

State Reported Alternate Assessment Participation Data (43 regular, 4 unique)


N C

E O

WA MT ND

OR

NV

CA

ID WY

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PANY

ME

WV

AK

HI

VT NH

CTNJ

DEMD





> 21% (1 regular, 1 unique)

No Overall Participation Rate Data (12 regular, 6 unique)

IN

MA

RI

American Samoa


Commonwealth N. Mariana Islands


Guam

Marshall Islands

Palau

Puerto Rico

Virgin Islands

Rates are for the population of students receiving special education services at the grades assessed.

Biennial Performance Report 2000-2001 Alternate Assessment Participation*


N C

E O

Major Findings Nearly all states reported numbers of students

participating in general and alternate assessments, but rates could not be calculated in all states

Average participation rates were

General assessments: 84.2% (regular states) and

63.8% (unique states)

Alternate assessments: 5.6% (regular states) and

12.3% (for unique states)

OF STUDENTS WITH DISABILITIES IN THOSE STATES FOR WHICH RATES COULD BE CALCULATED


N C

E O

2000-2001 General Assessment Performance Data – BPRs

WA MT ND

OR

NV

CA

ID WY

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PA

NY

ME

WV

AK

HI

VT NH

CTNJ

DEMD

State Reported General Assessment Performance Data (49 regular, 8 unique)

IN

MA

RI

American Samoa




Guam

Marshall Islands

Palau

Puerto Rico

Virgin Islands


N C

E O

WA MT ND

OR

NV

CA

ID WY

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PA

NY

ME

WV

AK

HI

VT NH

CTNJ

DEMD

State Reported Alternate Assessment Performance Data (28 regular, 2 unique)

IN

MA

RI

American Samoa




Guam

Marshall Islands

Palau

Puerto Rico

Virgin Islands

2000-2001 Alternate Assessment Performance Data – BPRs


N C

E O

% Proficient?

Not yet summarized across states, but may do so in the future!


N C

E O

Visit the NCEO website:

http://education.umn.edu/nceo

Go to “What’s New” to find the “Biennial Performance Report

Summary”


N C

E O

Analyses of Public Education Reports (2003)

Study Procedures

NCEO

1. Searched Web sites of all 50 states

2. Summarized findings and sent to states to verify

3. States sent additional public reports

4. Changes made only if reports were available to the public

[Collected reports through May 2002]


N C

E O

56%

8%

20%

4%

12% Participation and Performancefor all (n=28)

Performance for all (n=4)

Participation and Performancefor some (n=10)

Performance for some (n=2)

No disaggregated data (n=6)

Number and Percent of States with Disaggregation of General Assessment Results for Students with Disabilities


N C

E O

WA MT ND

OR

NV

CA

ID WY

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PA

NY

ME

WV

AK HI

VTNH

CTNJ

DEMD

IN

MA

RI


Performance data only for some tests (n=2)

Performance and Participation data for some tests (n=10)

Performance data only for all tests (n=4)

Performance and Participation data for all tests (n=28)

Public Reporting2002 Study

General Assessments


N C

E O

55%

13%

13%

19%

Same page (n=33)

Same document (n=8)

1 click apart (n=8)

2 clicks apart (n=13)

Proximity of Special Education Data to Data for All Students or Special Education Students


N C

E O

Number and Percent of States with Disaggregation of Alternate Assessment Results for Students with Disabilities

50%

20%

4%

26% No Information (n=25)

Participation Only (n=10)

Performance Only (n=2)

Participation andPerformance (n=13)


N C

E O

WA MT ND

OR

NV

CA

ID WY

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PA

NY

ME

WV

AK HI

VT NH

CTNJ

DEMD

IN

MARI


Participation data only (n=10)

Performance data only (n=2)

Participation and Performance data (n=13)

Public Reporting2002 Study

Alternate Assessments


N C

E O

State Survey of Special Education Directors (2003)

Study Procedures

NCEO

1. Notified all state directors of on-line or paper survey in February

2. Collected responses through April 15th +

3. Summarizing results

4. Verification will occur after data tabulated or graphed

[February – April, 2003 +]


N C

E O

Do Participation Numbers Include Students Who are Absent or Hospitalized, or Students who Refuse?

Of the 42 states that responded (so far):

0 10 20 30 40 50

Not Counted, NoScore

Counted, NoScore

Zero Score

Do Not Know

Lowest Score

Percent of States

PRELIMINARY DATA


N C

E O

WA MT ND

OR

NV

CA

ID WY*

UT

AZ

CO

NM

SD

NE

KS

TX

OK

MN

IA

MO

AR

LA

WI

IL

MI

OH

KY

MS

TN

FL

ALGA

SCNC

VA

PANY

ME

WV

AK

HI

VT NH*

CTNJ

DEMD

Plans for How Scores from “Not Okay” Accommodations Will be Reported?

Ways in Which States Report Data for Non-Approved Accommodations

*IN, NH, & WY used lowest or zero score

IN*

MA

RI

Not Reported

Aggregated

Separate

Aggregated and Separate


N C

E O

0 10 20 30 40 50

Std/NStdMarked

Some/AllListed on Form

IEP Listed onForm/Verified

Collected byState

Used OnesMarked

Percent of States

How Do States Keep Track of Accommodations Used During Testing?

Of the 42 states that responded (so far):

PRELIMINARY DATA

national center on educational outcomes n c e o reporting assessment results for students with...

Documents

regular states

unique slide

participation rate data

unique states of students

highest reported participation

md state

data sources

older slide