understanding your top from your bottom: a guide to michigan’s accountability system

Understanding Your Top from Your Bottom: A Guide to Michigan’s Accountability System

September 2013Mitch Fowler

fowlerm@calhounisd.org

Agenda

• Scorecard Overview• Scorecard Components• Top to Bottom Overview• Understanding Z-Scores• Z-Score Components

Outcomes

Participants will:• Identify Scorecard Components and Scoring Guidelines• Complete an Audit to Identify Areas of Concern• Understand Top to Bottom Components and Scoring

Guidelines• Complete a Top to Bottom Audit to Identify Areas of Concern• Identify Resources from BAA (TTB Lookup Tool, BTO Look Up

Tool, Focus Achievement Gap Tool)

Accountability Pre Assessment

Two Sides to AccountabilityAYP Scorecard Top to Bottom Ranking

(Priority/Focus/Reward/No Label)

Criterion – Referenced: New Target with New Cut Scores, 85% Proficient by 2022.

Normative – Ranking relative to the state average if at least 30 FAY students.

Annual Measurable Objectives (AMOs) based on linear trajectory from 2011/12

Focuses attention on smaller subset of schools; designates Priority, Focus, & Rewards

Given to all schools; acts as an “early warning” system; looks at subgroups, set targets

The primary mechanism for sanctions and supports for Priority and Focus Schools.

All Schools (Approx. 3,400 buildings)

Fewer Schools (2,866 buildings)

Scorecard Availability

• Available on BAA Secure Site

• Available on MI School Data (Public or Secure)

Scorecard

Scorecard Components

• Proficiency– Based on Annual Measurable Objectives– Must be at 85% Proficient by 2022 in ALL Areas and Subgroups

• Participation– Must Test 95% of Students

• Completion Rate– Graduation / Attendance Rate

• Other Factors– SIP / DIP– Educator Evaluations

Scorecard Components - Proficiency

ANNUAL MEASURABLE OBJECTIVES (AMO)

Activity: Identifying AMOs

Scorecard Components - Proficiency

• AMO ExampleContent

AreaAnnual

Increment2011-12

Base Target2012-13

Target2013-14

TargetMathematics 5.49 30.10 35.59 41.08

Reading 2.35 61.54 63.89 66.23

Science 7.12 13.82 20.94 28.06

Social Studies 5.51 29.87 35.38 40.90

Writing 3.87 46.26 50.13 54.01

Scorecard Components - ProficiencyContent

AreaAnnual

Increment2011-12

Base Target2012-13

Target2013-14

TargetScience 7.12 13.82 20.94 28.06

All Students made the 20.94% proficiency mark… 2 points.

The Bottom 30% of students did not meet the 20.94% proficiency mark… 0 points.

Scorecard Components - Proficiency

This is awesome!

Scorecard Components - Proficiency

1 = Top 30%2 = Middle 40%3 = Bottom 30%

Activity: Who are the Bottom 30%?

Scorecard Components - Proficiency

Of the 33 proficient students, 18 were provisional… they

received a 3.

Activity: Revealing Proficiency

Activity: Proficiency Audit

Scorecard Components - Participation

95% Tested!

Scorecard Components - Participation

Activity: Participation Audit

Scorecard Components – Completion Rate

Completion Rate OR

Attendance Rate

Activity: Completion Rate Audit

Scorecard Components – Other Factors

Activity: Other Factors Audit

Scorecard Decision Tree

http://www.michigan.gov/documents/mde/ScorecardOverallColorDecisionTree_433459_7.pdf

Activity: Overall Color

Top to Bottom Availability

• Available via the BAA Look Up Tool – (On the BAA Website Here)

• Available on MI School Data (Public or Secure)

Top to Bottom Ranking

• Schools are compared to other schools in the state by utilizing z-scores (a statistical measure that describes how far you are from the middle of the pack).

• Z-scores that are positive, show that you are above the 50th percentile when compared to the state. Z-scores that are negative, show that you are below the 50th percentile when compared to the state.

• Z-scores are centered around zero or the “state average”

• Positive is ABOVE the state avg.• Negative is BELOW the state avg.

Z-scores (Standard Deviations)

State AverageZ-score = Zero

-1-2-3 1 2 3

50% 68% 84% 98%

0.5

-0.532%16%2%

PercentileState

Average

Top 1/3 > +0.5Middle 1/3

Between-0.5 & 0.5

Bottom 1/3 < -0.5

Slide courtesy of Doug Greer, Ottawa ISD

Z-Score Structure

Weight

Subject Area Sub Z-Scores

Subject Area

Z- scores

Overall Ranking

33rd

Science

Achievement 50%

Improvement 25%

Achievement Gap 25%Math

Reading

Writing

Social Studies

Graduation

Top to Bottom Report (MI School Data)

Overall Rank

Subject Area Z-Scores

Subject Area Sub Z-Scores

Accountability Labels (Priority, Focus, Reward)Overall Rank (Priority or

Reward) Top or Bottom 5%

Achievement Gap z-score

(Focus)

Activity: Z Score Review

How Close to Focus Are We?

http://www.michigan.gov/documents/mde/2013_Individual_School_Gap_Lookup_Tool_431296_7.xls

Focus Cut Off

School’s Location

Achievement Gap Z-Scores

TTB Resources and Look Up Tools

http://www.michigan.gov/mde/0,4615,7-140-22709_59490---,00.html

Accountability Post Assessment

Thank YouQuestions?

Mitch FowlerSchool Data Consultant

fowlerm@calhounisd.org