sas evaas value-added basics - independence › downloads › value... · sas® evaas® value-added...

SAS® EVAAS® VALUE-ADDED BASICS 2013 RESOURCE FOR SUPPORTING AWARENESS AND UNDERSTANDING

© 2013, Battelle for Kids. All Rights Reserved.

Today’s Session Objective

  Develop a basic, shared awareness of Ohio’s value-added information provided by SAS® EVAAS®   MRM Model (Multivariate Response Model)  Used with Reading and Math OAAs

© 2013, Battelle for Kids. All Rights Reserved.

Growth & Achievement: Understanding the Difference

Achievement

Growth

© 2013, Battelle for Kids. All Rights Reserved.

SAS® EVAAS® Value-Added MRM Model

  Uses OAA Reading and Math State Tests.  Compares the average growth of students in the

most recent year to the average growth of students in 2010 (state’s baseline year).

 Expected growth is defined as maintaining placement in the distribution of NCE scores from one year to the next.

© 2013, Battelle for Kids. All Rights Reserved.

Value-Added Terminology Normal Curve Equivalent (NCE)

 The NCE is similar to a percentile rank in that scores are derived from scaled scores and ranked based upon performance.

 A significant difference between percentile rank and NCE is that an NCE scale is an equal interval scale.

© 2013, Battelle for Kids. All Rights Reserved.

What is a Normal Curve Equivalent (NCE)?

1 10 20 30 40 50 60 70 80 90 99

1 5 10 20 30 40 50 60 70 80 90 95 99

Normal Curve Equivalent

Distribution of Scores

Normal Curve Equivalents

Percentile Equivalents

© 2013, Battelle for Kids. All Rights Reserved.

Value-Added Terminology

  Baseline Score  Students’ prior year mean NCE  Example: Spring 2012 OAA mean NCE

  Observed Score  Students’ new/most recent mean NCE  Example: Spring 2013 OAA mean NCE

© 2013, Battelle for Kids. All Rights Reserved.

Conceptual Example

  Scaled scores are converted to NCEs

394 = 46 Student 1 430 = 59 402 = 50 Student 2 417 = 54 384 = 42 Student 3 400 = 49 394 = 46 Student 4 390 = 44 410 = 52 Student 5 425 = 57

Mean Baseline = 47.2

Grade 6 Baseline

Grade 7 Observed

Mean Observed = 52.6

A crude measure of the growth for this group is 5.4 NCEs

Growth = Mean Observed – Mean Baseline Growth = 52.6 – 47.2 = 5.4 (Mean NCE Gain)

© 2013, Battelle for Kids. All Rights Reserved.

Understanding Basic Value-Added Calculations

© 2013, Battelle for Kids. All Rights Reserved.

Value-Added Terminology

  Standard Error  Standard error is a measure of the uncertainty

around the estimate or mean gain.

  In the teacher value-added report, the size or magnitude of the standard error is influenced by the N size (size of the student group).

© 2013, Battelle for Kids. All Rights Reserved.

Value-Added Terminology

  Growth Index  Since the size of the standard error (degree of

certainty) will vary across teachers, their estimated gain must be standardized to include both the estimate and the degree of certainty (standard error).

 Divides a teacher’s estimated gain by the associated standard error.

© 2013, Battelle for Kids. All Rights Reserved.

Resources

  Additional information around Ohio’s value-added calculations can be accessed through the Ohio Student Progress Portal at http://portal.battelleforkids.org/ohio

© 2013, Battelle for Kids. All Rights Reserved.

Teacher Value-Added Guide Book

© 2013, Battelle for Kids. All Rights Reserved.

Questions?

Thank You!

@BattelleforKids

facebook.com/battelleforkidsorg

youtube.com/battelleforkids

www.BattelleforKids.org