Evaluating 1:1 Initiatives and Other Technology Initiatives

The MassCUE Evaluators Program

Sun Associates Program evaluators State and local initiatives www.sun-associates.com/masscue jsun@sun-associates.com

Our take on evaluation Evaluation is a part of a strategic approach to

project planning and implementation Links vision to goals to actions to measures

MassCUE Evaluators

A professional development project that helps districts integrate evaluation within projects: Clearly articulate goals Plan and coordinate activities strategically Develop performance measures

The majority of the districts currently in the program are focusing on designing evaluations for iPad and 1:1 initiatives.

BedfordBurlingtonConcordNeedhamReadingWayland

DanversDuxburyHopkintonHudsonWinchester

In our experience, most projects need to answer the “What’s the value?” question.

Particularly, the educational – teaching and learning – value.

Preparing for this in advance can insure a smooth progression for your project.

A Strategic Approach

It starts with a central claim How will this initiative positively impact

teaching and learning? What issues does this initiative address, and

what solutions does it propose? Your claim should connect to core values of

teaching and learning…not just the need for technology.

The claim will be supported by data on how your project goals are addressed, and ultimately through evaluation, how well your project is meeting the claim. Current status – documenting the situation

before your implementation Formative assessment – documenting the

impact your project is having

Indicators and Outcomes

Indicators are developed by a committee of stakeholders to your project … the MassCUE Evaluators team! Teachers, administrators, technology staff,

and others This also generates broad buy-in to the

project and its perceived value…which is helpful in terms of sustainability

Gathering Data

The next task is to develop data collection tools and to collect data based on the indicators Teachers Students Parents/Community Technical

ObservationsSurveysFocus GroupsRelevant Technical and Cost Information

MassCUE Evaluators learn how to create and use these data collection tools

With data in-hand, the task is to analyze the collected data against the indicators The indicators serve as performance

benchmarksFindings provide the answer to the basic

question of Is the project accomplishing what it set out to

do? In sum, this is what the evaluation addresses.

Reporting The whole point of the evaluation is to

communicate the progress – formative and summative – of your project

Reporting should be to your school or district community

Remember, you can report on your current status…and this establishes the baseline for the gains and benefits that your project will bring.

Other Benefits of the Process

The evaluation provides data that can guide the scaling up of initiatives What’s working in the pilot? What needs to be tweaked in the next round

of the project implementation?

Summary Points

Central Claim – what are you aiming for? Indicators – what domains does your project

address? Baseline Data Collection – establishes “readiness”

and identifies strategic priorities for your project to address

On-Going Data Collection – Observations, surveys, focus groups, etc.

Formative/Summative Reporting – communicating success and engaging your community in the project’s implementation

How to Join

The next cohort starts in Januarywww.masscue.orgwww.sun-associates.com/masscuejsun@sun-associates.com