© 2014, battelle for kids. all rights reserved. roster verification overview © 2014, battelle for...

© 2014, Battelle for Kids. All Rights Reserved.

ROSTER VERIFICATION OVERVIEW

© 2014, Battelle for Kids. All Rights Reserved.

© 2014, Battelle for Kids. All Rights Reserved.

The Challenge

Data accuracy

Do we believe that our current data system accurately represents the student experience throughout the school year?

What about… Regrouping of students? Students moving in and out of classrooms? Shared instructional responsibilities?

© 2014, Battelle for Kids. All Rights Reserved.

The Challenge

Widespread Data Quality Issues

In 2012–13, working with more than 600,000 rosters, Battelle for Kids found that:

© 2014, Battelle for Kids. All Rights Reserved.

Existing data systems capture a teacher of record, not a record of teaching.Many systems capture activity not influence of learning

Other potential data issues:Data may not exist in one centralized dataset.Lack of documentation of mid-year changes to course scheduling, student mobility,

or shared instruction.

The Challenge

Issues that Erode Trust

© 2014, Battelle for Kids. All Rights Reserved.

Student mobility Support or enrichment provided by

multiple teachers Maternity leave, sick time, new hires,

resignations, and retirement Teachers regrouped or reassigned to

other classrooms Co-teaching arrangements And the list goes on…

Measures must be built on data that account for all the nuances of teaching, learning, and the classroom.

The Challenge

Learning Experiences Are Complex…

© 2014, Battelle for Kids. All Rights Reserved.

Roster Verification was developed to give teachers an opportunity to correct data that will be used to inform policy and create high-stakes measures of effectiveness.

They become involved in a process to ensure the record of instruction is official and right, not official and wrong.

With roster verification, teachers get class rosters they can literally see, correct, and confirm.

The Opportunity

Solving the Data Quality Problem

© 2014, Battelle for Kids. All Rights Reserved.

Source: Ensuring Fair and Reliable Measures of Effective Teaching- Culminating findings from the MET Project’s three-year study, Bill and Melinda Gates Foundation, 2013

From the Measures of Effective Teaching (MET) Study Culminating Report:

The Opportunity

Increasing Accuracy, Reducing Mistakes

© 2014, Battelle for Kids. All Rights Reserved.

Roster Verification allows teachers to help district data systems correct these data sins:

Teacher-subject attribution Student-teacher attribution Student and teacher mobility Situations where multiple teachers shared responsibility for instruction

and student learning

The Opportunity

What Roster Verification Achieves

© 2014, Battelle for Kids. All Rights Reserved.

1- Teachers verify which students they taught

2- Teachers verify during what months they taught those students

3- Teachers verify the percent of instruction

The Opportunity

The Process Is Simple for teachers…It’s as easy as 1-2-3

© 2014, Battelle for Kids. All Rights Reserved.

The Solution

Software That Helps Teachers Verify Rosters

© 2014, Battelle for Kids. All Rights Reserved.

The Process

Phases of Roster Verification:

May 19- May 23 May 27 – May 30

Due June 6

© 2014, Battelle for Kids. All Rights Reserved.

Prior to teacher verifying rosters, principals or designated support personnel ensure classes and teacher roles are correct.

We want the proper classes and teachers to be associated

Phase 1: School Set Up phase

Principals and support team responsibilities

© 2014, Battelle for Kids. All Rights Reserved.

Phase 1: School Set Up phase

Principals and support team responsibilities

© 2014, Battelle for Kids. All Rights Reserved.

Teachers verify these three statements:I taught these studentsDuring these monthsFor this percent of instruction

Phase 2: Teacher roster verification phase

Teachers verify rosters

© 2014, Battelle for Kids. All Rights Reserved.

The teacher roster verification dashboard

© 2014, Battelle for Kids. All Rights Reserved.

Phase 2: Teacher roster verification phase

1-2-3 step process

© 2014, Battelle for Kids. All Rights Reserved.

Phase 2: Teacher roster verification phase

1-2-3 step process

© 2014, Battelle for Kids. All Rights Reserved.

Teacher roster verification phase

Principals monitor progress during this phase

© 2014, Battelle for Kids. All Rights Reserved.

Phase 3: Review and approval phase

Principals review and approve rosters

© 2014, Battelle for Kids. All Rights Reserved.

The process builds will and skill to empower schools to participate through:

Communications – build awareness and buy-inTraining – prepare staff to lead the process

Provides multiple layers of support to address issues and influence schools to complete the process

The Role of Support

How We Ensure Schools Are Successful

© 2014, Battelle for Kids. All Rights Reserved.

Accessing the demo site: School Set up (Principals Only)

Go to demo.battelleforkids.org

Enter Stanley Foley’s email:

foley.Stanley@demodistrict42A.org

foley.Stanley@demodistrict43A.org

foley.Stanley@demodistrict44A.org

foley.Stanley@demodistrict45A.org

foley.Stanley@demodistrict46A.org

All passwords are “school”

© 2014, Battelle for Kids. All Rights Reserved.

Accessing the demo site: Teacher RV

Go to demo.battelleforkids.org

Enter Joan Bartlett’s email:

Bartlett.joan@demodistrict41A.org

Bartlett.joan@demodistrict42A.org

Bartlett.joan@demodistrict43A.org

Bartlett.joan@demodistrict44A.org

Bartlett.joan@demodistrict45A.org

All passwords are “school”

© 2014, Battelle for Kids. All Rights Reserved.

Accessing the demo site: Principal review and approval

Go to demo.battelleforkids.org

Enter Stanley Foley’s email:

foley.stanley@demodistrict42B.org

foley.stanley@demodistrict43B.org

foley.stanley@demodistrict44B.org

foley.stanley@demodistrict45B.org

foley.stanley@demodistrict46B.org

All passwords are “school”

© 2014, Battelle for Kids. All Rights Reserved.

Next steps

School Set Up Phase1. Authorize Support Team members for your school to assist in

roster verification. 2. Review staff and teaching assignments loaded into the system. 3. Correct teachers and/or instructional assignments by adding,

updating or removing incorrect classes.

© 2014, Battelle for Kids. All Rights Reserved.

Next steps

Teacher Roster Verification Phase1. Plan and conduct a rollout with teachers who will complete

roster verification to encourage participation, show them how to access the system and demonstrate how to complete the three-step roster verification process.

2. Monitor teacher completion regularly to ensure all teachers assigned to complete roster verification do so by the deadline.

3. Assist teachers with questions or concerns.

© 2014, Battelle for Kids. All Rights Reserved.

Next steps

Principal Review and Approval Phase1. Review reports and alerts in the system and make corrections

where appropriate. 2. Review changes with teachers who completed roster verification

as necessary and appropriate. 3. Approve your school’s verified roster information as accurate

and complete.

© 2014, Battelle for Kids. All Rights Reserved.

@BattelleforKids

facebook.com/battelleforkidsorg

youtube.com/battelleforkids

BattelleforKids.org

Thank you!