data analysis state accountability. data analysis (what) needs assessment (why ) improvement plan...

115
Data Analysis State Accountability

Upload: norman-henton

Post on 15-Jan-2016

220 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Data Analysis State

Accountability

Page 2: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 3: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Data Analysis(What)

Needs Assessment

(Why)

Improvement Plan

(How)

Implement and Monitor

Page 4: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Details

Page 5: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index Framework Statutory Goal

Improving Student achievement at all levels in the core subjects of the state curriculum

1

Page 6: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index Framework Statutory Goal

Ensuring the progress of all students toward achieving Advanced Academic Performance

2

Page 7: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index Framework Statutory Goal

Closing Advanced Academic Performance level gaps among groups

3

Page 8: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index Framework Statutory Goals

Closing gaps among groups in percentage of students graduating under the recommended high school program and advanced high school program

4

Page 9: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 1: Student Achievement

Page 10: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 2: Student Progress

Page 11: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 3: Closing Performance Gaps

Page 12: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 4: Postsecondary Readiness

Page 13: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

System Safeguards

Page 14: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Why a Performance Index ?

Page 15: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

With a performance Index, the resulting rating reflects overall performance for the campus or district rather than the weakest performance of one student group/subject area.

Page 16: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Multiple indexes can be used in the framework to ensure accountability for every student.

Page 17: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Any number of indicators and student groups can be added to the system without creating additional targets for campuses and districts to meet.

Page 18: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 19: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

2013

Page 20: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Met Standard

Met Alternative StandardImprovement Required

Page 21: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index Standards

Index Score

50

AEA-25

5th Percentile

Index Score

55

AEA-30

Index Score

75

AEA-45

Page 22: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Differences

Page 23: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

English Language Learners

Student Groups…Economically Disadvantaged

African AmericanAmerican IndianAsianHispanicPacific IslanderWhiteTwo or more races

Special Education

Page 24: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Minimum Group Size

25

Page 25: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Common

Elements

Page 26: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 27: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 28: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

If student was enrolled on the campus/district on this date:

Then these results are included in the campus/district accountability subset

Fall 2011 enrollment snapshot

EOC summer 2012

Fall 2012 enrollment snapshot

EOC Fall 2012

EOC Spring 2013

Grade 3-8 Spring 2013

Page 29: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 30: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 31: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Different

“Let Go”Keep

Page 32: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Different

“Let Go”Keep

Minimum Group Size 25 30/10/50 or

50/10/200

Page 33: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What does this report tell you about a

campus?

Page 34: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

New Reports• Calculation Report-Tables used to

aggregate scores to determine Index Points

• Data Table- Table of disaggregated data used for the Calculation Report. The highlighted cells indicate data used in calculations.

Page 35: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 1: Student

Achievement

Page 36: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 37: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

No Minimum Size3 year average if less than

10 students

Which student groups are calculated in Index 1?

Page 38: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 1 :Student Achievement

Subjects: Combined over Reading, Mathematics, Writing, Science, and Social Studies.

Tests: STAAR English, STAAR Spanish, EOC, STAAR and EOC Modified and Alternate, TAKS Grade 11

Performance Standards: Phase-in 1 Level II

(2013)

MSR: None

Page 39: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

# Met Phase in Level II for Reading

# Met Phase in Level II for Writing

# Met Phase in Level II for Math

# Met Phase in Level II for Science# Met Phase in Level II for Social Studies

# Tested Reading

# Tested Writing

# Tested Math

# Tested Science

# Tested Social Studies

Page 40: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What does the calculation report indicate about a

campus?What would an Index score

of 45 indicate about the campus?

Page 41: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What are the strengths and weaknesses of the campus based on the calculation report?

What reflective questions would you ask the campus about this data?

What are your unanswered questions about this campus based on the calculation report?

Page 42: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 43: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 2: Student Progress

Page 44: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 45: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

We do not know? Scores for :Did not Meet Expectations Met ExpectationsExceeded Expectations

The Index scores that identifies the lowest 5%

Page 46: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What we do know?

Page 47: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Subjects Reading

Math

Writing

Applies to available grades

Page 48: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Student Groups

Two or More Races

Pacific IslanderHispanic

Asian

American Indian

African American

Special Education

ELL

White

All Students

Page 49: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Minimum Size CriteriaAll Students = 10 testsRace/ Ethnicity groups = 25

Page 50: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Methodology

Met- one point for each percent of students at the Met growth expectation levelExceeded- two points for each percent of students at the Exceeded growth expectations level

Page 51: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Set a side for a minute

Page 52: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Methodology

Met- one point for each percent of student at the Met growth expectation levelExceeded- two points for each percent of students at the Exceeded growth expectations level

Page 53: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 54: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 55: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 56: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 57: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

How is the data in Index 2 different from Index 1?

How does improved performance on Index 2 impact the other

Indexes?

What advice would you give this campus to impact Index 2? (using

the sample reports)

Page 58: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 3: Closing

Performance Gaps

Page 59: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 60: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What you need to know to calculate Index 3?

Page 61: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Subjects…

Page 62: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

• STAAR English 3-8 and STAAR Spanish 3-5 at phase-in Level II

• EOC at phase-in Level II for spring, and the previous fall and summer

• STAAR 3-8 and EOC Modified and Alternative at Level II

• Retest results 5 and 8 from 1st retest• TAKS Grade 11 in 2013

Results include…

Page 63: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

2 lowest performing race/ethnicity groups from the previous year

Student Groups…Economically Disadvantaged

African AmericanAmerican IndianAsianHispanicPacific IslanderWhiteTwo or more races

Page 64: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Accountability Subset…

Page 65: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Minimum Group Size… >=25 for Race/Ethnicity groups

Page 66: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 67: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Methodology…

Phase-in Level II- 2013 and beyond- one point for each percent of students at the phase-in Level II performance standard and above

Advanced Level III-2014 and beyond- one additional point for each percent of students at the Level III performance standard

Page 68: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Calculations

Number of Tests

Number at Phase in Level II

Number of Tests

Number at Level III

2014

Page 69: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Economically Disadvantaged group always

evaluated

Page 70: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Set a Side

Page 71: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Set a Side

Page 72: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 73: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 74: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 75: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 76: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 77: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

How will each subject tested affect the

overall Index 3 score?

What recommendations would you make to this campus based

on the sample reports?

Page 78: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 79: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index 4: Postsecondary Readiness

Page 80: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Indicators

STAAR Percent Met Final Level II on One or More Tests

Grade 9-12 Graduation Rate

Grade 9-12 Annual Dropout Rate

Recommended/ Distinguished Achievement (Advanced) High School Program (RHSP/DAP)

2013-2014

Page 81: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

STAAR Percent Met Final Level II on One or More TestsIncludes Assessment results

for:STAAR English (Grade 3-8 and Spanish (Grade 3-5) at final Level II performance standard for assessments administered in the springEOC at final Level II performance standard for assessments administered in the spring and the previous fall and summerSTAAR Grades 3-8 and EOC Modified and Alternative at final Level II performanceRetest results

2013-2014

Page 82: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Number of Students Met final II Standard on One or More Tests

Number of Students with One or More Tests

2013-2014

Page 83: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 84: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Class of

2011 and beyond Student Groups:

All Students ELL-Identified in Grade 9 Special Education 7 Race/ Ethnicity Groups

25

Graduation Rate

Page 85: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Graduates

Graduates + continuers +

GED recipients + dropouts

Page 86: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

2013 and beyond

Student Groups: All Students ELL-Identified in during reported year Special Education 7 Race/ Ethnicity Groups

Annual Drop Out Rate

Campuses with Grade 9, 10, 11, & 12

25

Page 87: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Number of students who dropped out during

year

Number of students enrolled during year

Page 88: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 89: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Student Groups: All Students 7 Race/ Ethnicity Groups

Recommended/ Distinguished Achievement High School Program

25

Page 90: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Number of prior year graduates with graduation

codes for RHSP or DAP

Number of prior year graduates

Page 91: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Index Standards

Index Score

50

AEA-25

5th Percentile

Index Score

55

AEA-30

Index Score

75

AEA-45

Page 92: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 93: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 94: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Why is some of the data marked out?

Why is only graduation rate and RHSP/DAP

calculated in the sample report for Index 4 points?

Page 95: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 96: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

System Safeguards

Page 97: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Purpose• Ensure system disaggregates

performance by student group, performance level, subject area, and grade

• Target for disaggregated results meet and exceed federal requirements– Performance Target– Participation Rate – Graduation rate targets and improvement– Limit on Alternative Assessments

Page 98: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Impact• Results are reported for any cell that

meets minimum size criteria.• Failure to meet the safeguard target

for any reported cell must be addressed

• Performance on the safeguard indicators are incorporated into the Texas Accountability Intervention System (TAIS)

Page 99: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 100: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 101: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 102: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

How does the system safeguards ensure high

expectations for all students?

Using these sample reports, how would you advise a

campus that met all Index standards but only 85% of the system safeguards?

Page 103: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Who are our AEA campuses?

Page 104: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Current 10 eligibility Criteria Primarily Grades 6-12

AEA Eligibility

Page 105: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor
Page 106: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Residential Facilities

No rating for 2013

Page 107: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What’s different for AEA?

GED

Page 108: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What’s different for AEA?

GED 4, 5 and 6 Year Graduation rates

Choose the best

4, 5 and 6 Year Graduation rates

Page 109: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What’s different for AEA?

Dropout Rate

Less then 20%

Bonus points given for Index 4

Page 110: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

75 %Graduation

and GED Score

What’s different for AEA?

25 %% met Level II

on one or more tests

Page 111: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

Alternate Education Accountability

Index Score

50

AEA-25

5th Percentile

Index Score

55

AEA-30

Index Score

75

AEA-45

Page 112: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

AEA

BON

US

POIN

TSRHSD and DAP Plans

Continuing Student who Graduate in 5th or 6th year

Graduating/GED for “statutorily excluded students”

Page 113: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What is the 4 year graduation rate?

What happens if you do not meet graduation for a student group?

What effect does drop out rate have

on index score?

Why will elementary and middle schools not be scored on Index 4 this year?

Page 114: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor

What information can the AEA Index Scores and the System

Safeguards data tell you about alternative campuses?

Page 115: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor