sas evaas value-added basics - independence › downloads › value... · sas® evaas® value-added...

15
SAS ® EVAAS ® VALUE-ADDED BASICS 2013 RESOURCE FOR SUPPORTING AWARENESS AND UNDERSTANDING

Upload: others

Post on 10-Jun-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

SAS® EVAAS® VALUE-ADDED BASICS 2013 RESOURCE FOR SUPPORTING AWARENESS AND UNDERSTANDING

Page 2: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Today’s Session Objective

  Develop a basic, shared awareness of Ohio’s value-added information provided by SAS® EVAAS®   MRM Model (Multivariate Response Model)  Used with Reading and Math OAAs

Page 3: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Growth & Achievement: Understanding the Difference

Achievement

Growth

Page 4: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

SAS® EVAAS® Value-Added MRM Model

  Uses OAA Reading and Math State Tests.  Compares the average growth of students in the

most recent year to the average growth of students in 2010 (state’s baseline year).

 Expected growth is defined as maintaining placement in the distribution of NCE scores from one year to the next.

Page 5: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Value-Added Terminology Normal Curve Equivalent (NCE)

 The NCE is similar to a percentile rank in that scores are derived from scaled scores and ranked based upon performance.

 A significant difference between percentile rank and NCE is that an NCE scale is an equal interval scale.

Page 6: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

What is a Normal Curve Equivalent (NCE)?

1 10 20 30 40 50 60 70 80 90 99

1 5 10 20 30 40 50 60 70 80 90 95 99

Normal Curve Equivalent

Distribution of Scores

Normal Curve Equivalents

Percentile Equivalents

Page 7: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Value-Added Terminology

  Baseline Score  Students’ prior year mean NCE  Example: Spring 2012 OAA mean NCE

  Observed Score  Students’ new/most recent mean NCE  Example: Spring 2013 OAA mean NCE

Page 8: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Conceptual Example

  Scaled scores are converted to NCEs

394 = 46 Student 1 430 = 59 402 = 50 Student 2 417 = 54 384 = 42 Student 3 400 = 49 394 = 46 Student 4 390 = 44 410 = 52 Student 5 425 = 57

Mean Baseline = 47.2

Grade 6 Baseline

Grade 7 Observed

Mean Observed = 52.6

A crude measure of the growth for this group is 5.4 NCEs

Growth = Mean Observed – Mean Baseline Growth = 52.6 – 47.2 = 5.4 (Mean NCE Gain)

Page 9: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Understanding Basic Value-Added Calculations

Page 10: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Value-Added Terminology

  Standard Error  Standard error is a measure of the uncertainty

around the estimate or mean gain.

  In the teacher value-added report, the size or magnitude of the standard error is influenced by the N size (size of the student group).

Page 11: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Value-Added Terminology

  Growth Index  Since the size of the standard error (degree of

certainty) will vary across teachers, their estimated gain must be standardized to include both the estimate and the degree of certainty (standard error).

 Divides a teacher’s estimated gain by the associated standard error.

Page 12: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Resources

  Additional information around Ohio’s value-added calculations can be accessed through the Ohio Student Progress Portal at http://portal.battelleforkids.org/ohio

Page 13: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Teacher Value-Added Guide Book

Page 14: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

© 2013, Battelle for Kids. All Rights Reserved.

Questions?

Thank You!

Page 15: SAS EVAAS VALUE-ADDED BASICS - Independence › Downloads › Value... · SAS® EVAAS® Value-Added MRM Model Uses OAA Reading and Math State Tests. Compares the average growth of

@BattelleforKids

facebook.com/battelleforkidsorg

youtube.com/battelleforkids

www.BattelleforKids.org