phase iv: taking action and monitoring implementation and impact
TRANSCRIPT
![Page 1: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/1.jpg)
Phase IV: Taking Action
and Monitoring
Implementation
and Impact
![Page 2: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/2.jpg)
Phase IV: Taking Action and Monitoring Implementation and Impact
Step 1: Implement the action steps.
Step 2: Monitor the implementation and impact of the action steps.
Step 3: Adjust and revise the action step.
2
![Page 3: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/3.jpg)
Step 2: Monitor the implementation and
impact of action steps
Manning the Crow’s Nest
3
![Page 4: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/4.jpg)
1. Why is it important to monitor implementation and impact?
2. What are some ways to monitor implementation and impact?
Session Questions
4
![Page 5: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/5.jpg)
Implementation/Impact
• Implementation: Did we do what we said we would do?
• Impact: Did we get the outcomes we wanted?
Both are important to monitor!
5
![Page 6: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/6.jpg)
Session Questions
1. Why is it important to monitor implementation and impact?
2. What are some ways to monitor implementation and impact?
6
![Page 7: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/7.jpg)
Research on Implementation and Leadership
1.Find someone who is not from your ESC.
2. Reflect on implementation research and leadership actions. (Handout 1)
(10 minutes)
7
![Page 8: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/8.jpg)
5 Minutes Left
![Page 9: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/9.jpg)
4 Minutes Left
![Page 10: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/10.jpg)
3 Minutes Left
![Page 11: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/11.jpg)
2 Minutes Left
![Page 12: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/12.jpg)
1 Minute Left
![Page 13: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/13.jpg)
Time is Up!
![Page 14: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/14.jpg)
Degrees of Implementation (Handout 2)
• Paper implementation
• Process implementation
• Performance implementation
Fixsen, et al., (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, p. 2 8
![Page 15: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/15.jpg)
Thinking about Implementation and Impact
• Think about improvement efforts that you have experienced in districts, schools, your ESC, and other organizations.
• Discuss with your table group:
– Were they designed primarily as paper, process, or performance implementation strategies?
– What degree of implementation resulted?
(15 minutes)
9
![Page 16: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/16.jpg)
5 Minutes Left
![Page 17: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/17.jpg)
4 Minutes Left
![Page 18: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/18.jpg)
3 Minutes Left
![Page 19: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/19.jpg)
2 Minutes Left
![Page 20: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/20.jpg)
1 Minute Left
![Page 21: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/21.jpg)
Time is Up!
![Page 22: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/22.jpg)
MonitoriMonitoring!ng!
![Page 23: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/23.jpg)
From the research: Why monitoring is important (Handout 3)
•Provides information about what is happening
•Involves individuals at all levels of the system
•Keeps the improvement process from faltering/failing
•Helps ensure quality and successPankake, A. M. (1998). Implementation: Making things happen. Larchmont, NY: Eye on Education.
11
![Page 24: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/24.jpg)
From the research: Why monitoring is important
•Provides information on progress and informs needed adjustments
•Helps communicate what is important in a district/school
•Helps us know where we started, how far we’ve come, and how much further we have to go
•Helps prevent unanticipated problems
12
Pankake, A. M. (1998). Implementation: Making things happen. Larchmont, NY: Eye on Education.
![Page 25: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/25.jpg)
From your experience, which three reasons seem to you to be most important for implementing district or campus improvement plans?
What happens in these three areas if monitoring doesn’t occur?
Importance of Monitoring
13
![Page 26: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/26.jpg)
8 Minutes Left
![Page 27: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/27.jpg)
7 Minutes Left
![Page 28: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/28.jpg)
6 Minutes Left
![Page 29: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/29.jpg)
5 Minutes Left
![Page 30: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/30.jpg)
4 Minutes Left
![Page 31: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/31.jpg)
3 Minutes Left
![Page 32: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/32.jpg)
2 Minutes Left
![Page 33: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/33.jpg)
1 Minute Left
![Page 34: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/34.jpg)
Time is Up!
![Page 35: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/35.jpg)
Implementation Bridge
Hall, G. E., & Hord, S. M. (2006). Implementing change: Patterns, principles, and potholes. Boston: Pearson. 14
![Page 36: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/36.jpg)
Monitoring Requires Leadership
•Pressure
• Support
15
![Page 37: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/37.jpg)
Session Questions
1. Why is it important to monitor implementation and impact?
2. What are some ways to monitor implementation and impact?
16
![Page 38: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/38.jpg)
Examples of Implementation Data
Did we do what we said we would do?
Example: • Action Step from Plan: Hold focus groups with students in grades 5–12 on their perceptions of the learning environment.
• Implementation Data: The district held focus groups with 10% of students in grades 5–12 on perceptions of the learning environment during the week of November 3, 2008.
17
![Page 39: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/39.jpg)
Examples of Implementation Data
Did we do what we said we would do?
Example: • Action Step from Plan: Analyze and report student focus group data to teachers and principals in all intermediate, middle, and high schools.
• Implementation Data: The district leadership team analyzed the student focus group data at their November 4 meeting and reported a summary of the data to teachers and principals in grades 5–12 schools during the week of November 10, 2008.
18
![Page 40: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/40.jpg)
Examples of Impact Data
Did our action steps result in. . . • use of more research-based instructional strategies?
• higher student achievement?• lower failure rate?• increased parent involvement?• higher student attendance?• more active student engagement?• more students enrolled in after-school tutorials?
• lower discipline referrals?• increased teacher participation in collaboration?
• greater alignment of instruction to our curriculum ? 19
![Page 41: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/41.jpg)
Student Learning
Demographic
Percep
tion
sS
cho
ol
Pro
cess
es
Bernhardt’s Data Categories
Bernhardt, V. (2004). Data analysis for continuous school improvement (2nd ed.). Larchmont, NY: Eye on Education.
Examples:EnrollmentAttendanceDrop-out RateEthnicityGenderGrade LevelLanguage Proficiency
Examples:Perceptions of learning environmentValues and beliefsAttitudesObservations
Examples:Criterion-referenced testsNorm-referenced testsTeacher observationsAuthentic assessments
Example:Description of school programs and processesDescription of meetingsDescriptions of parent/teacher conferences
20
![Page 42: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/42.jpg)
Thinking about data
Implementation Impact
Demographic
Student learning
Perceptions
School processes
How could each category of data be used to measure implementation and impact? (Handout 6)
21
![Page 43: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/43.jpg)
Refer to your district/school plan
• What categories of data are the district/school collecting now?
• What other categories of data would help to monitor implementation and impact in their plan?
• How could you help the district/school monitor implementation and impact data?
• Be ready to share in 15 minutes.
22
![Page 44: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/44.jpg)
10 Minutes Left10 Minutes Left
![Page 45: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/45.jpg)
9 Minutes Left
![Page 46: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/46.jpg)
8 Minutes Left
![Page 47: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/47.jpg)
7 Minutes Left
![Page 48: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/48.jpg)
6 Minutes Left
![Page 49: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/49.jpg)
5 Minutes Left
![Page 50: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/50.jpg)
4 Minutes Left
![Page 51: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/51.jpg)
3 Minutes Left
![Page 52: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/52.jpg)
2 Minutes Left
![Page 53: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/53.jpg)
1 Minute Left
![Page 54: Phase IV: Taking Action and Monitoring Implementation and Impact](https://reader038.vdocuments.mx/reader038/viewer/2022110402/56649e4c5503460f94b42211/html5/thumbnails/54.jpg)
Time is Up!