keri s. bethune, ph.d., bcba-d james madison university
DESCRIPTION
Improving Teacher Fidelity when Implementing PBS Procedures: Coaching to Build Sustainability in our Schools. Keri S. Bethune, Ph.D., BCBA-D James Madison University. Introduction. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/1.jpg)
Improving Teacher Fidelity when Implementing PBS Procedures:
Coaching to Build Sustainability in our Schools
Keri S. Bethune, Ph.D., BCBA-DJames Madison University
![Page 2: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/2.jpg)
Introduction
• Research has shown that the prevalence of challenging behaviors is higher among individuals with disabilities compared to challenging behaviors of their typically developing peers (Sigafoos, Arthur, & O’Reilly, 2003).• More specifically, individuals with autism spectrum
disorders (ASD) and intellectual disability (ID) are more likely to exhibit self-injurious behavior and stereotypic behaviors than individuals with ID alone (Rojahn et al., 2010).
![Page 3: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/3.jpg)
Introduction
• Some of the negatives effects of challenging behavior for students include
(a)failure to reach their academic potential,(b)increased school suspensions and increased school
absences,(c)higher rates of peer rejection accompanied by a lack
of an appropriate social network,(d)disruption of other students’ learning, and(e)an increase in the time required for planning from
the entire educational team which negatively impacts the time teachers can spend on academic planning (Chandler & Dahlquist, 2006).
![Page 4: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/4.jpg)
Introduction
• FBAs and resulting function-based interventions have been more successful in reducing challenging behaviors than non-function-based interventions (Filter & Horner, 2009; Mustian, 2010; Umbreit et al., 2007). • Although conducting FBAs and implementing
function-based interventions are effective in reducing challenging behavior among students with disabilities, and are federally mandated, many school personnel fail to implement this process with the fidelity needed to achieve successful outcomes (Blood & Neel, 2007; Scott, Nelson, & McIntyre, 2005).
![Page 5: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/5.jpg)
Introduction
• Coaching is when an initial training occurs and afterwards an expert in the targeted area provides individualized feedback and support to help teachers implement and sustain the new teaching behaviors (Kretlow & Bartholomew, 2010).
• The purpose is to increase teachers’ accuracy when implementing evidence-based practices (EBPs; Kretlow & Bartholomew, 2010).
• Throughout the coaching process, the expert prompts the teacher to use the targeted teaching behavior in an actual teaching situation and provides immediate feedback on his or her performance (Kretlow & Bartholomew, 2010).
![Page 6: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/6.jpg)
Introduction
• Coaching can be divided into a number of types including supervisory coaching, side-by-side coaching, and bug-in-ear coaching.
• Side-by-side coaching is when an expert, but not a direct supervisor, observes the teacher implementing the target practice, provides feedback in vivo, and may even model the practice with the students while the teacher observes (Kretlow & Bartholomew, 2010).
![Page 7: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/7.jpg)
Introduction
• Coaching has been used to increase teachers’ accuracy when implementing evidence based practices (EBPs) and to have promising results towards improved student achievement (Kretlow & Bartholomew, 2010).• Coaching has been effective in increasing teacher accuracy
in implementation of • classwide positive behavior supports (PBS; Filcheck, McNeil, Greco, &
Bernard, 2004), • reading interventions (Jager, Reezigt, & Creemers, 2002; Kohler, Ezell, &
Paluselli, 1999; Linguaris-Kraft & Marchand-Martella, 1993; Morgan et al., 1994),
• explicit math instruction (Kretlow, Cooke, & Wood, 2011; Kretlow, Wood, & Cooke, 2011), and
• teacher praise in an RTI model (Myers, Simonsen, & Sugai, 2011).
![Page 8: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/8.jpg)
Coaching Teachers on Function-Based Interventions
![Page 9: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/9.jpg)
Introduction
Purpose of the Study
• To evaluate the effects of coaching on special education teachers’ implementation of function-based interventions with students with severe disabilities
![Page 10: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/10.jpg)
Research Questions
• What are the effects of coaching on special education teachers’ accuracy of implementation of function-based interventions?
• What is the effect of coaching on teachers’ ability to generalize a function-based intervention (developed using the same process) to a second identified challenging behavior and/or setting with their students?
![Page 11: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/11.jpg)
Research Questions
• To what extent do students’ challenging behaviors decrease and replacement behaviors increase as teachers implement function-based interventions with increasing fidelity?
• Do teachers and administrators find the use of coaching appropriate and efficient?
![Page 12: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/12.jpg)
Method
• Participants & Setting• Elementary school in rural county in the
southeastern US• 4 teacher/student pairs • Student inclusion criteria • received special education services• displayed challenging behavior that interfered
with participation in school activities
![Page 13: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/13.jpg)
Method
• Participants & Setting• Teacher inclusion criteria • Held a current North Carolina teaching license in
special education• Taught at least one student receiving special
education services• Agreed to attend a one day workshop on FBA• Had not previously been involved in a
coaching/mentoring program• Was not a Board Certified Behavior Analyst or a
Board Certified Associate Behavior Analyst
![Page 14: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/14.jpg)
Method
Demographic InformationTeacher Student Age Disability Problem Behavior
Mrs. Yacht
Susan 4 trisomy 9 mosaicism
taking glasses off
Mrs. Williams
Karla 8 Down syndrome
noncompliance
Mr. Carlisle
Michael 5 autism tantrum
Mrs. Green
Jack 10 autism off task behavior
![Page 15: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/15.jpg)
Method
• Dependent Measures• Teachers• Percent accuracy of teacher implementation of the
function-based intervention as measured by the procedural fidelity checklist
• Students• Students’ problem behavior (frequency or percent
interval)• Students’ replacement behavior (frequency or percent
interval)• Social Validity Questionnaire
![Page 16: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/16.jpg)
Method
Research Design•Teachers - delayed multiple baseline across participants• Delayed multiple was used because of practical difficulties
encountered after the beginning of student data collection• Delayed multiple baselines use the same experimental logic as
standard multiple baselines with the exception that participants enter the baseline phase in a staggered fashion (Cooper et al., 2007)• Note: Although the terms are sometimes used synonymously,
the delayed multiple baseline used in this study is not the same as a non-concurrent multiple baseline as described by Watson and Workman (1981) and Gast (2010)
![Page 17: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/17.jpg)
Method
Research Design
•Students - multiple baseline across participants’ design•Phase changes were dependent on teacher behavior
![Page 18: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/18.jpg)
Method
General Procedures•Initial observation• General observations• Collect ABC data
•Inservice Training (workshop)• One-day, six hour inservice• First half of the day provided information regarding
function-based interventions in a PowerPoint format• Second half of the day moved to a workshop format where
the researcher worked with the participants to complete an FBA and develop function-based interventions for their paired students
![Page 19: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/19.jpg)
Method
General Procedures• Student baseline• Data were taken on the frequency or percent intervals of
the student challenging and replacement behavior• Teachers did not start function-based interventions• 10 min sessions
• Functional Analysis• Researcher conducted a brief alternating treatments design
to confirm the hypothesis regarding the function of each student’s problem behavior• 4 sessions, five min per session
![Page 20: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/20.jpg)
Method
General Procedures• Teacher baseline • Teachers implemented function-based
interventions during the same activity•Researcher provided no prompting or
support•10 min sessions
![Page 21: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/21.jpg)
Method
General Procedures• Coaching• Researcher provided side-by-side coaching with
the teacher as they worked with the target student during the identified task• After coaching , the researcher observed the
teacher implementing the same task/activity and scored the teacher accuracy of implementation and student behaviors• Once teachers had a minimum of 90% accuracy for
two consecutive days no more coaching sessions were implemented.
![Page 22: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/22.jpg)
Method
General Procedures• Generalization• Generalization was measured by observing the teacher
work with the same student during a different activity• 10 min sessions
• Maintenance • Maintenance data were collected once per week until all
participants had completed coaching, then again after two and a half weeks
• Data Analysis• Visual inspection of graphed data
![Page 23: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/23.jpg)
Method
• Interobserver reliability was conducted on 32.2% of teacher sessions and 31.3% of student sessions distributed evenly across phases. • Averaged 100% for teachers’ accuracy of
implementation of function-based interventions• Averaged 99.7% (range 90% through 100%) for
student behavior
• Fidelity was conducted on 50% of coaching sessions and averaged 100%.
![Page 24: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/24.jpg)
Method
• Social validity questionnaire • Teacher survey (nine questions) and psychologist
survey (eight questions) focused on• If coaching was an effective method to improve teachers’
implementation of function-based intervention• If coaching was a feasible method to improve teachers’
implementation of function-based intervention• If coaching was a socially acceptable method for
improving teachers’ implementation of function-based intervention
![Page 25: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/25.jpg)
TeacherResults
![Page 26: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/26.jpg)
Teacher Results
![Page 27: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/27.jpg)
Student FA Results
![Page 28: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/28.jpg)
Student Intervention
Results
![Page 29: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/29.jpg)
Teacher Survey Results
![Page 30: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/30.jpg)
Teacher Survey Results
![Page 31: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/31.jpg)
Psychologist Survey Results
![Page 32: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/32.jpg)
Psychologist Survey Results
![Page 33: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/33.jpg)
Discussion
• These results support the use coaching to improve teachers implementation of function-based interventions• Functional relationship• Teachers generalized skills across activities
• All problem behavior decreased during the study; however, some decreased during teacher baseline while others did not decrease until accurate implementation• A functional relationship exists between accurate
implementation of the function-based intervention and increases in the primary replacement behaviors
![Page 34: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/34.jpg)
Discussion
• Limitations• Experimenter was not removed from FBA
process• Use of long intervals for data recording (30s
or 1 min) could lead to over/under estimation of behavior• Need for future replication• Use of researcher as coach
![Page 35: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/35.jpg)
Discussion
• Implications for practice• Workshop trainings alone are insufficient ,
coaching was a quick and easy way to improve teacher implementation• Schools might be able to use their high scoring
teachers as coaches• Development of an ongoing FBA team within
schools may help teachers develop and review the results of FBAs and function-based interventions
![Page 36: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/36.jpg)
Coaching on Tier One Implementation of SWPBS
![Page 37: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/37.jpg)
School Wide Positive Behavior Supports
School wide positive behavior supports (SWPBS) is a proactive system of behavior support that is implemented in a tiered model in many elementary, middle, and high schools (Lewis & Sugai, 1999).
![Page 38: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/38.jpg)
Introduction
• Teachers are expected to implement the basic components of the SWPBS plan, including;
a. teaching students expected behavior, b. appropriately reinforcing expected behavior, c. discouraging problem behavior, and d. accurately recording student data according to
the SWPBS system (Lewis & Sugai, 1999).
![Page 39: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/39.jpg)
Introduction
• Benefits of SWPBS include reduced office referrals, improved school attendance, improved academic achievement, reduced rates of dropouts, and reduced referrals for special education services (Cregor, 2008). • SWPBS plans have been shown to be more
effective that punitive and reactionary approaches to student problem behavior (Lewis & Sugai, 1999).
![Page 40: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/40.jpg)
Introduction
• SWPBS plans are being implemented by an increasing number of school districts, with the majority of states having adopted SWPBS models as part of their systems level school improvement plans (George & Kincaid, 2008).
• A key component when implementing SWPBS is the accuracy with which the plan is implemented.
![Page 41: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/41.jpg)
Introduction
• When examining training and implementation protocols for SWPBS, the use of SWPBS coaches is a core component to used to promote the success of the SWPBS plan (Horner, Sugai, Smolkowski, Eber, Nakasato, Todd, & Esperanza, 2009; McIntosh, Filter, Nennett, Ryan, & Sugai, 2009; & Stormont & Reinke, 2012).
• Some literature has made recommendations towards coaching and SWPBS (Scott & Martinek; 2006; Stormon & Reinke, 2012; TACPBIS, 2010).
![Page 42: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/42.jpg)
Introduction
• At this time, little research has examined the training and effectiveness of the the coaches.
• Given the increase of SWPBS implementation in schools, and the importance of coaching to the success of the SWPBS plan, the effectiveness of coaching needs to be evaluated.
![Page 43: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/43.jpg)
Introduction
• The purpose of this study was to determine the effects of coaching on teacher’s accuracy of SWPBS implementation. • The research questions include:
a) What is the effect of coaching on teachers accuracy of implementation of a SWPBS plan?; and
b) Do teachers and coaches find the coaching process effective, socially, acceptable, cost effective, and manageable?
![Page 44: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/44.jpg)
Method
Setting•The study took place in elementary school in a small city in the eastern US•The school had recently undergone a change to a more comprehensive SWPBS plan•They already had a PBS Team that was providing training to the school through the use of faculty meetings and analyzing the data on a monthly basis •All teachers were implementing the SWPBS plan when the study began
![Page 45: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/45.jpg)
Method
Participants •The coach was selected from the school’s SWPBS Team• The coach was also the instructional coach for the
school
•Four teacher participants were recruited by volunteering after the entire staff was presented the opportunity at a faculty meeting • Teachers had to be licensed teachers who taught
at least one group instructional lesson per day
![Page 46: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/46.jpg)
Method
Design•Multiple baseline across participants designData Collection•Teacher’s implementation of SWPBS by the percentage of correctly implemented steps using a SWPBS•Fidelity data was collected on coaches ability to accurately implement the coaching procedure in the form of percentage of correctly implemented steps using a coaching fidelity checklist
![Page 47: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/47.jpg)
![Page 48: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/48.jpg)
![Page 49: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/49.jpg)
Method
Intervention•The coach provided two side-by-side coaching to teacher participants, including: • A pre-coaching meeting• An individual coaching session• A feedback meeting
•Each participant got two coaching sessions
![Page 50: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/50.jpg)
Method
General Procedures•Coach training• The coach was provided with the SWPBS plan and a
written description of the side-by-side coaching process and the teacher data sheet
• The researcher and the coach met to verbally review the information
• Then, the researcher and the coach watched videos of group classroom instruction. Both scored the teachers using the data sheet, and then compared data (80% minimum was acceptable)
• Finally, the coach modeled how to coach the teachers on the video
![Page 51: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/51.jpg)
Method
General Procedures
•Baseline• No training was provided to teachers • Teachers were observed during a
scheduled 10 min observation daily (observation times were held constant from day to day)
![Page 52: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/52.jpg)
Method
General Procedures•Coaching• The coaching intervention consisted of
three components a)one pre-coaching meeting, b)at least one side-by side coaching
session, andc)at least one feedback meeting
![Page 53: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/53.jpg)
Method
General Procedures•Pre Coaching Meeting:• Coach provided the teacher with specific
feedback • The coach and the teacher planned the lesson for
the side-by-side coaching session • The coach modeled selected strategies for
targeted skills (such as the steps for providing reinforcement and error correction to students)• The coach supported the teacher by asking
guiding questions and providing feedback
![Page 54: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/54.jpg)
Method
General Procedures•Side by side coaching:a)Model appropriate reinforcement of student behavior b)Model the consequences for rule-violating behavior, including error correction c)Immediately after modeling each skill, prompt the teacher to demonstrate the same skill; d)Model ways to engage students in active student responding; e)Give specific praise to the teacher at least once per skill; f)Provide non-evaluative corrective feedback when neededg)Provide another opportunity for the teacher to implement the skill after error correction
![Page 55: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/55.jpg)
Method
General Procedures
•Post Coaching Meeting:
• Reinforce steps correctly implemented• Review steps where errors were made
![Page 56: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/56.jpg)
Method
Inter-observer Agreement (IOA)
•A second observer simultaneously observed at least 30% of sessions •Agreement was calculated using interval by interval method
Number of agreements x 100 Number of agreements + disagreements
![Page 57: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/57.jpg)
Method
Procedural Fidelity•The researcher used a checklist to collect data on the extent to which the coach adhered to the prescribed steps in the coaching process •Procedural fidelity was calculated by dividing the number of steps the researcher correctly performs by total number of steps
![Page 58: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/58.jpg)
Method
• IOA was conducted in 41.4% of sessions and averaged 91.0% (range 80% - 100%)
• Fidelity was conducted for in 33.3% of sessions and averaged 100%
![Page 59: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/59.jpg)
Method
Social Validity•Collected to assess the impact and feasibility of the coaching•Teachers were given a written questionnaire which included open-ended and closed (i.e., Likert) items evaluating each individual enhancement and training component•Coaches were provided a questionnaire regarding the impact and feasibility of coaching
![Page 60: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/60.jpg)
Results
![Page 61: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/61.jpg)
Teacher survey Results
![Page 62: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/62.jpg)
Coach survey Results
![Page 63: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/63.jpg)
Discussion
• There is a functional relationship between coaching and teacher’s improved performance on implementation checklists
• Data remained variable for most teachers throughout the study
![Page 64: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/64.jpg)
Discussion
Limitations
•Overlapping data points between baseline and intervention
•Variability throughout study
•Need for future replication
![Page 65: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/65.jpg)
Discussion
Implications for practice
•Inservice trainings continue to be insufficient to train teachers to implement SWPBS procedures
•Instructional coaches may be able to serve as behavioral coaches to train teachers to implement SWPBS plans
![Page 66: Keri S. Bethune, Ph.D., BCBA-D James Madison University](https://reader033.vdocuments.mx/reader033/viewer/2022061614/56815999550346895dc6e29e/html5/thumbnails/66.jpg)
Practical Concerns
• How do districts identify candidates for coaches?• Is side-by-side coaching the most effective
coaching procedure? • Would bug-in-ear or supervisory coaching be more
effective?
• We still need more data on coaching teachers to implement tier 1 and tier 3 interventions, and data is needed on coaching to increase fidelity of implementation of tier 2 interventions.