www.engageny.org 1 new york state education department using growth measures for educator evaluation...

www.engageNY.orgwww.engageNY.org1

New York State Education Department

Using Growth Measures for Educator Evaluation

August 2012

www.engageNY.orgwww.engageNY.org2 www.engageNY.orgwww.engageNY.org2

By the End of This Presentation…. You should be able to:

–Explain how growth ratings (HEDI) and scores will be obtained from educator overall MGPs and confidence ranges based on 2011-12 State-provided growth measures


Evaluating Educator Effectiveness 2011-12


Key Points about NYS Growth Measures

–We are measuring student growth and not achievement

Allow teachers to achieve high ratings regardless of incoming levels of achievement of their students

–We are measuring growth compared to similar students

Similar students: Up to three years of the same prior achievement, three student-level characteristics (economic disadvantage, SWD, and ELL status)

Every educator has a fair chance to demonstrate effectiveness on these measures regardless of the composition of his/her class or school.


Review of Terms SGP (student growth percentile):

–the result of a statistical model that calculates each student’s change in achievement between two or more points in time on a State assessment or other comparable measure and compares each student’s performance to that of similarly achieving students

Similar students: –students with the similar prior test scores,(up to three years),

and ELL, SWD, and economic disadvantage status

Unadjusted and adjusted MGP (mean growth percentile):

–the average of the student growth percentiles attributed to a given educator

–For evaluation purposes, the overall adjusted MGP is used. This is the MGP that includes all a teacher or principal’s students and takes into account student demographics.


MGPs and Statistical Confidence

8787

Confidence Range

Upper

Limit

Lower

Limit

MGP

• NYSED will provide a 95% confidence range, meaning we can be 95% confident that an educator’s “true” MGP lies within that range. Upper and lower limits of MGPs will also be provided.

• An educator’s confidence range depends on a number of factors, including the number of student scores included in his or her MGP and the variability of student performance in the classroom.


Growth Ratings and Score Ranges 2011-12

Growth Rating Description Growth Score Range

(2011–12)

Highly Effective

Well above state average for similar students

18–20

Effective Results meet state average for similar students

9–17

Developing Below state average for similar students

3–8

Ineffective Well below state average for similar students

0–2

The growth scores and ratings are based on an educator’s combined MGP.


HEDI Classification Approach: Teachers and Principals

Highly Effective (Well Above Average) requires:–An educator’s MGP is greater than 1.5 standard deviations above the State

mean.

–For 2011-12 this means MGP’s greater than or equal to 69 for teachers.

Effective (Average) requires:–An educator’s MGP is between 1 standard deviation below the State mean

and 1.5 standard deviations above the State mean.

–For 2011-12, MGPs of 42 through 68 for teachers.

Developing (Below Average) requires:–An educator’s MGP is between 1 and 1.5 standard deviations below the

State mean.

–For 2011-12, MGPs of 36 through 41 for teachers.

Ineffective (Well Below Average) requires:–An educator’s MGP is more than 1.5 standard deviations below the State

mean.

–For 2011-12 this means MGPs less than or equal to 35 for teachers.


From MGPs to Growth Ratings: TeachersRules on last slide result in these HEDI criteria for 2011-12

Yes

No

Is your MGP ≥ 69?

Is your Lower Limit > Mean of

52?

Highly Effective: Results are well

above state average for

similar students

Is your MGP ≤ 35?

Is your Upper Limit

< 44?

Ineffective: Results are well

below state average for

similar students

Developing: Results are below state average for similar students

No

Effective: Results equal

state average for similar students

Mean Growth Percentile Confidence Range HEDI Rating

Is your MGP 42-

68?

Any Confidence

Range

Yes

No

Is your MGP 36-

41?

Is your Upper Limit < Mean of

52?

Yes

Yes

Yes

Yes

Yes

Yes

No

No

No


From MGPs to Growth Ratings: PrincipalsFor principals the rules lead to these HEDI criteria for 2011-12

Yes

No

Is your MGP ≥ 61?

Is your Lower Limit > Mean of

51?

Highly Effective: Results are well

above state average for

similar students

Is your MGP ≤ 41?

Is your Upper Limit

< 46?

Ineffective: Results are well

below state average for

similar students

Developing: Results are below state average for similar students

No

Effective: Results equal

state average for similar students

Mean Growth Percentile Confidence Range HEDI Rating

Is your MGP 45-

60?

Any Confidence

Range

Yes

No

Is your MGP 41.5-

44?

Is your Upper Limit < Mean of

51?

Yes

Yes

Yes

Yes

Yes

Yes

No

No

No


Illustrating Teacher Growth Ratings: (Another Way) (2011-12 cut scores)

MGP 1 MGP 99

MGP

MGP

MGP

MGP

MGP

MGP

MGP

Below Average

(41)

Below Average

(41)

Well Below

Average (35)

Well Below

Average (35)

Average (52)

Average (52)

Upper limit CR for

Ineffective(44)

Upper limit CR for

Ineffective(44)

Well Above

Average (69)

Well Above

Average (69)


Illustrating Teacher Growth Ratings: (2011-12 cut scores)

MGP 1 MGP 99Below Average

(41)

Below Average

(41)

Well Below

Average (35)

Well Below

Average (35)

Average (52)

Average (52)

Upper limit CR for

Ineffective(44)

Upper limit CR for

Ineffective(44)

Well Above

Average (69)

Well Above

Average (69)

MGP

Ineffective

MGP

Highly Effective


Illustrating Teacher Growth Ratings (2011-12 cut scores)

MGP 1 MGP 99Below Average

(41)

Below Average

(41)

Well Below

Average (35)

Well Below

Average (35)

Average (52)

Average (52)

Upper CI for

Ineffective(44)

Upper CI for

Ineffective(44)

Well Above

Average (69)

Well Above

Average (69)

MGP

MGP

Developing

Effective

Effective

MGP

Developing MGP

Effective

MGP

IneffectiveMGP

Highly Effective

MGP


NYS Growth Subcomponent Results for 2011-12: Teachers

Rating &Points (2011–12 )

Number of Teacher MGPs

Percent of Teacher MGPs

Highly Effective18–20

2206 7%

Effective9–17

25,578 77%

Developing3–8

3341 10%

Ineffective0–2

2004 6%

Total 33,129


NYS results for 2011-12: Principals

Rating &Points (2011–12 )

Number of Principal

MGPs

Percent of Principal

MGPs

Highly Effective18–20

223 6%

Effective9–17

2821 79%

Developing3–8

269 8%

Ineffective0–2

243 7%

Total 3556


Assignment of Points with HEDI Category

HEDI Points

Min MGP

Max MGP

N of Teacher

s

0 3 28 660

1 29 32 651

2 33 35 693

3 29 35 241

4 36 37 826

5 38 38 495

6 39 39 535

7 40 40 561

8 41 41 683

9 36 44 2661

10 45 46 2001

11 47 49 3376

12 50 51 2432

13 52 54 3648

14 55 56 2415

15 57 59 3144

16 60 62 2624

17 63 68 3277

18 69 70 662

19 71 73 666

20 74 96 878

HEDI Points

Min MGP

Max MGP

N of School

s

0 16 36.5 71

1 37 39 75

2 39.5 41 97

3 34.5 41 22

4 41.5 42 65

5 42.5 42.5 40

6 43 43 37

7 43.5 43.5 41

8 44 44 64

9 41.5 46 270

10 46.5 48 350

11 48.5 49 209

12 49.5 50.5 328

13 51 52 313

14 52.5 53.5 324

15 54 55 316

16 55.5 57 353

17 57.5 63.5 358

18 61 61.5 65

19 62 63 70

20 63.5 74 88

Point value of 3 includes educators with MGPs in the Ineffective category but CRs above 44 (for teachers) and above 46 (for principals)

Point value of 3 includes educators with MGPs in the Ineffective category but CRs above 44 (for teachers) and above 46 (for principals)

Point value of 9 includes educators with MGPs in the Developing category but CRs above state average

Point value of 9 includes educators with MGPs in the Developing category but CRs above state average

Point value of 17 Includes educators with MGPs in the Highly Effective category but CRs below state average

Point value of 17 Includes educators with MGPs in the Highly Effective category but CRs below state average

Teachers Principals

Teachers Principals

www.engageny.org 1 new york state education department using growth measures for educator evaluation...

Documents

growth scores

student growth percentiles

principals students

students performance

nys growth measures

state assessments state

growth ratings hedi

state mean