Evaluation and Evaluation and Refinement:Refinement:Charting the Uncharted Charting the Uncharted WatersWaters
“True genius resides in the capacity for evaluation of uncertain, hazardous, and conflicting information.”
Winston Churchill
Today’s GoalsToday’s GoalsDetermine data points, evidence
of success, and timeline for data collection
Look ahead at continued implementation and on-going professional development activities
3 Levels of Evaluation3 Levels of EvaluationOrganizational change in
program & policy
Change in teacher practice
Change in student achievement
Organizational ChangeOrganizational ChangeProgram & PolicyProgram & PolicyDocument change in program and policy
as a result of participating in the ELL PDAWhat evidence do you have that the ELL
PDA has impacted the way you do things?
◦ ESL pull-out to inclusion◦ Self contained sheltered courses◦ Hiring of ESL and/or mainstream teachers◦ Quality, quantity and type of PD
Others?
Organizational ChangeOrganizational ChangeInterviews & SurveysInterviews & Surveys
Conduct interviews and/or surveys◦What do you want to know about your
organizational change?◦Who? Leadership team, district and
school administrators, teachers, students, parents?
◦Few questions & small sampling to provide a snapshot
What do you want to know?
Organizational ChangeOrganizational ChangePlan & TimelinePlan & Timeline
What Who When
Determine essential questions and interview protocol
Leadership team October 2009
Conduct interviews and/or surveys
? December 2009
Analyze data & write report
? January 2009
Data Collection Data Collection continued…continued…Level II-Teacher Practice (Jan.-April ‘10)
◦ Teacher self assessments with reflection questions
◦ Walkthroughs◦ Focus group interviews
Level III-Student Achievement (May-June ‘10)◦ Reading, math, and Eng. Prof. scores for group
of ELLs 3 yrs.◦ ELL promotion/retention rates 3 yrs.◦ ELL program exit rates 3 yrs.◦ Focus group interview with kids◦ Data on Sheltered v. non-sheltered courses
Questions, comments, Questions, comments, concerns?concerns?
Refinement-Continuing to GrowRefinement-Continuing to GrowProfessional Development Professional Development ContinuumContinuumResource ManagementContent PresentationsClassroom VisitsCo-PlanningProfessional Learning
CommunitiesDemonstration LessonsPeer CoachingCo-Teaching
ResourcesResourcesTECHNOLOGYTECHNOLOGYCreate a webpage/website
◦Post information, dates, times, articles, other resources
◦Post power points and other presentations◦Log mtg. dates, times, attendance,
topic/task◦Create sub-components like Wikis and
Blogs
Timeline: NowOn-Going
Learning Communities and Learning Communities and CollaborationCollaborationCase Studies
◦Teams rally around a particular student
◦Create student profile◦Co-plan lessons◦Meet, discuss and plan on a regular
basis
Timeline: SeptemberOn-Going
Co-Teaching and Co-Teaching and DebriefingDebriefingCo-teach and debrief 2 lessons
◦Co-plan◦Co-teach◦Video tape◦Watch tape and reflect◦May choose to focus on a particular
aspect of SIOP rather than an entire lesson for either/both the teaching and reflection
Timeline: After testingApril/May
Michele [email protected]
