School Performance Scorecard: Recalibration Rubric II

SPS CATEGORIES

2

WEIGHTED CATEGORIES

3

Weighted Rubric Categories

Category K-8 Schools

K-12 Schools

Achievement 40% 35%Growth 40% 35%Climate 20% 10%

College & Career n/a 20%

ACADEMIC ACHIEVEMENT

4

Academic Achievement, along with Academic Growth, is one of the most heavily weighted categories –

K-12: 35%K-8: 40%

The Achievement rating is based on on-track plus mastered rates in reading/language arts, mathematics, social studies and science for all students.

ACADEMIC GROWTH

5

Academic Growth, along with Academic Achievement, is one of the most heavily weighted categories –

K-12: 35%K-8: 40%

The Growth rating is based on TVAAS growth levels and reduction of below rates for all students in reading/language arts, mathematics, science and social studies.

COLLEGE-/CAREER-READINESS

6

College-/Career-Readiness is substantially weighted given the District’s 80-90-100% goals –

K-12: 20%

This rating is based on graduation rate, improvement of graduation rate, and ACT composite score.

SCHOOL CLIMATE

7

Recognizing the relationship between school climate and performance, this helps parents know more about the educational environment their child will experience –

K-12: 10%K-8: 20%

The School Climate rating is based on attendance, suspension and expulsion data results for all students.

SCORECARD LEVELS

8

The District will publish a scorecard with ratings for all

schools.

• Indicators are specific to K-8 (Elementary and Middle School) and K-12 (High School)

• Scoring scale of 1-5 determined for all indicators based on a comparison of all school data

• 1-5 scale chosen due to familiarity with current TVAAS & TEM ratings• Schools receive 1-5 rating for each category and

an overall composite score of 1-5

SPS RubricRecalibration of Quintiles

9

10* 17-18 TNReady results were excluded due to “hold harmless” State designation, which would have been on Scorecard 2018.

• Created by:• 2016-17 Data• 2017-18 Data• 2018-19 Data

Scorecard 2019(past)

• Created by:• Composite Results from

Scorecard 2017 and Scorecard 2019*Scorecard 2020

School Performance Scorecard Recalibration

11

School Performance Scorecard Calibration

Rubric ICreated on 2016 Scores

Rubric IICreated on 2019

composite

Scorecard 2017

Scorecard 2018

Scorecard 2019

Scorecard 2020

2016-17 2017-18 2018-19 2019-20

2016-17 2017-18 2018-19

2016-17 2017-18

The year list is the year that the students

were tested. For example Scorecard

2020 is the most updated composite which includes the most recent testing data of Spring 2020.

Composites are built off of 3 years of data. With the first scorecard with a full 3-year

composite happening on Scorecard 2019.

These were the ramp up years to for a complete 3-year scorecard.

12

School Performance Scorecard Calibration

The quintiles have been adjusted to reflect more current

performance.

13

• Metric data are equally weighed within the category, and category data are weighed based on the previously shared percentages

• Two metrics, graduation rate improvement and below percentage reduction have caps:

Graduation Rate of 95%+ = Level 5Below Percentage of Less than 5% = Level 5

• Three metrics, graduation rate, graduation rate improvement, and ACT composite use data from the “lag-year”

School Performance Scorecard Recalibration

Rubric II: Recalibrated K8 Rubric

14

Rubric II: Recalibrated K12 Rubric

15

Recalibration of Rubric

o As student performance improves so do the standards by which schools are evaluated.

o Typically, the quintile ranges shift to the more positive result.

o Level 3 example provided, here.

16

To Earn a 3 (40th %tile)

Rubric I (Initial)

Rubric II (ReCalibrated)

K8 ELA 13.4% 14.6%

K8 Math 15.3% 18.9%

K8 Social Studies 11.8% 10.1%

K12 ELA 10.8% 13.0%

K12 Math 3.3% 5.3%

K12 Social Studies 5.4% 8.0%

K8 Reduction in Below 1.2 0.1

K12 Reduction in Below -1.7 -0.3

K12 Graduation 76.2% 80.4%

K12 Graduation Improvement

0.6 0.1

K12 ACT Composite 15.8 16.1

K8 Attendance 94.3% 94.4%

K8 Suspension 16.2% 14.1%

K8 Expulsion 0.41% 0.27%

K12 Attendance 91.7% 92.2%

K12 Suspension 39.8% 31.7%

K12 Expulsion 1.78% 1.45%

17

Grade Structure Count

InitialRubric

Mean Final Score

Updated Rubric

Mean Final Score

DifferenceMaximum Negative Change

Maximum Positive Change

Count of Schools with No Change

All Schools 192 3.16 3.05 -0.11 -.40 +.18 28

K8 149 3.20 3.09 -0.11 -.38 +.15 25

K12 43 3.03 2.91 -0.12 -.40 +.18 3

Results are correlated at a rate of .987. As expectations change, scores change, but relative rank remains constant.

Applying 2017-2018 & 2018-2019 Results on Both Rubrics for Comparison

Applying 2017-2018 & 2018-2019 Results on Both Rubrics for Comparison

18

Grade Structure Type Count

InitialRubric

Mean Final Score

Updated Rubric

Mean Final Score

DifferenceMaximum Negative Change

Maximum Positive Change

All Charter 48 3.14 3.06 -.08 -.37 +.18

All DistrictManaged 144 3.16 3.04 -.12 -.40 +.13

K8 Charter 34 3.08 2.98 -.10 -.37 +.15

K8 DistrictManaged 115 3.23 3.12 -.11 -.38 +.09

K12 Charter 14 3.29 3.26 -.03 -.27 +.18

K12 DistrictManaged 29 2.90 2.75 -0.15 -.40 +.13

Rubric change had more significant impact on District Managed Schools than on Charter Schools.

Location of Current SPS Results

SharePoint Folder SCS Web Page

19

Reviewing the SPS Results (Main Page)

20

Discussion

21

Appendix

RUBRIC NOTES

23

• The initial (Rubric I) SPS rubric was developed using results, earned by SCS district schools, from the 16-17 school year.

• This rubric was used to determine scorecard levels published in school years 16-17, 17-18, and 18-19.

• However, the rubric to be used to determine scorecard levels, published in school year 20-21 was developed using composite results, earned by SCS district schools, from school years 16-17 and 18-19.

• 17-18 TNReady results were excluded due to “hold harmless” State designation.• Science Achievement rubric will be determined using 19-20 Science Results.

24

25

26

27