Evaluation and Evaluation and Refinement:Refinement:Charting the Uncharted Charting the Uncharted WatersWaters

“True genius resides in the capacity for evaluation of uncertain, hazardous, and conflicting information.”

Winston Churchill

Today’s GoalsToday’s GoalsDetermine data points, evidence

of success, and timeline for data collection

Look ahead at continued implementation and on-going professional development activities

3 Levels of Evaluation3 Levels of EvaluationOrganizational change in

program & policy

Change in teacher practice

Change in student achievement

Organizational ChangeOrganizational ChangeProgram & PolicyProgram & PolicyDocument change in program and policy

as a result of participating in the ELL PDAWhat evidence do you have that the ELL

PDA has impacted the way you do things?

◦ ESL pull-out to inclusion◦ Self contained sheltered courses◦ Hiring of ESL and/or mainstream teachers◦ Quality, quantity and type of PD

Others?

Organizational ChangeOrganizational ChangeInterviews & SurveysInterviews & Surveys

Conduct interviews and/or surveys◦What do you want to know about your

organizational change?◦Who? Leadership team, district and

school administrators, teachers, students, parents?

◦Few questions & small sampling to provide a snapshot

What do you want to know?

Organizational ChangeOrganizational ChangePlan & TimelinePlan & Timeline

What Who When

Determine essential questions and interview protocol

Leadership team October 2009

Conduct interviews and/or surveys

? December 2009

Analyze data & write report

? January 2009

Data Collection Data Collection continued…continued…Level II-Teacher Practice (Jan.-April ‘10)

◦ Teacher self assessments with reflection questions

◦ Walkthroughs◦ Focus group interviews

Level III-Student Achievement (May-June ‘10)◦ Reading, math, and Eng. Prof. scores for group

of ELLs 3 yrs.◦ ELL promotion/retention rates 3 yrs.◦ ELL program exit rates 3 yrs.◦ Focus group interview with kids◦ Data on Sheltered v. non-sheltered courses

Questions, comments, Questions, comments, concerns?concerns?

Refinement-Continuing to GrowRefinement-Continuing to GrowProfessional Development Professional Development ContinuumContinuumResource ManagementContent PresentationsClassroom VisitsCo-PlanningProfessional Learning

CommunitiesDemonstration LessonsPeer CoachingCo-Teaching

ResourcesResourcesTECHNOLOGYTECHNOLOGYCreate a webpage/website

◦Post information, dates, times, articles, other resources

◦Post power points and other presentations◦Log mtg. dates, times, attendance,

topic/task◦Create sub-components like Wikis and

Blogs

Timeline: NowOn-Going

Learning Communities and Learning Communities and CollaborationCollaborationCase Studies

◦Teams rally around a particular student

◦Create student profile◦Co-plan lessons◦Meet, discuss and plan on a regular

basis

Timeline: SeptemberOn-Going

Co-Teaching and Co-Teaching and DebriefingDebriefingCo-teach and debrief 2 lessons

◦Co-plan◦Co-teach◦Video tape◦Watch tape and reflect◦May choose to focus on a particular

aspect of SIOP rather than an entire lesson for either/both the teaching and reflection

Timeline: After testingApril/May

Michele Cheneymichelecheney@gmail.com518.494.3887