kellar instructional handheld data system (kihd … instructional handheld data system (kihd system)...
TRANSCRIPT
![Page 1: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/1.jpg)
Kellar Instructional Handheld data System (KIHd System)
3rd Advisory Board Members Meeting
Date: February 12th, 2007
![Page 2: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/2.jpg)
George Mason University Team Members
• Co-PI: Shuangbao Wang, PhD
• Co-PI: Yoosun Chung, PhD• Senior Researcher:
Michael Behrmann, EdD • Project Coordinator:
Heidi Graff• Research Assistants:
YouRi Shim, Kavita Mittapalli
![Page 3: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/3.jpg)
Reliability
• Accuracy (Formula calculation – Agreement / Disagreement * 100)
• Time period late October 2006- ongoing• Average three days/week
![Page 4: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/4.jpg)
Graph (accuracy)(October 31, 2006- January 31, 2007)
0
10
20
30
40
50
60
70
80
90
100
110
1 5 9 13 17 21 25 29 33 37 41Data sessions per month
October2006-January 2007
Accu
racy
per
cent
age
![Page 5: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/5.jpg)
Fidelity
• Purpose - To provide a way to record and evaluate if the program is following the protocol proposed earlier (as a reality check)- Internal validity- To record the day-to-day process of data collection by the researcher (when on-site) and teachers (in presence of researchers)- To record instances, if any, where technical assistance was needed by the teachers- To record the overall general attitude of the teachers towards technology, training and the data collection process- To record the efficiency and reliability of the technology
![Page 6: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/6.jpg)
Fidelity contd..• Instrument
- Paper based form used by the researcher each time s/he goes to collect data- Five open-ended questions- Additional two paper-based surveys to record teachers’perceptions on trainings received thus far (administered in October and December 2006)
• Fidelity data have been collected 4 out of 5 times a week (Number of days we collected fidelity check list/ how many possible days * 100) - 80%
![Page 7: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/7.jpg)
Logic model of fidelity criteria(Donabedian, 1982)
Structure(protocol for service delivery)
Process(How services are delivered)
Fidelity criteria includes- specification of the length, intensity, and durationof the service (or dosage); content, procedures, and activities over the length of the service; roles, responsibilities of staff/researchers and characteristics of target population (Kelly, Heckman, Stevenson, & Williams, 2000)
![Page 8: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/8.jpg)
References
Donabedian, A. (1982). The criteria and standards of quality. Ann Arbor, MI: Health Administration Press.
Kelly, J.A., Heckman, T.G., Stevenson, L.Y., & Williams, P.N. (2000).Transfer of research-based HIV prevention interventions to community service providers: Fidelity and adaptation. AIDS Education and Prevention, 12,87-98.
![Page 9: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/9.jpg)
System Modifications
• Ability to change labels & prompts• Add multiple treatment phases• Task is added to graph• Interactive graph to better meet single subject
design standards• PDA offline data collecting (standalone
application) will be tested in March
![Page 10: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/10.jpg)
Update of KIHd System Graph
• Task is added to the graph.
![Page 11: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/11.jpg)
Standalone Application
• PDA offline data collecting (standalone application) will be tested in March.
• The data collection procedure are:– Synchronizing PDA with database– Data collections– Send data back to database– System merge the data based on the time tag
and device id.
![Page 12: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/12.jpg)
Sites to visit
• KIHd System Project Websitehttp://kihdsystem.gmu.edu/stepstone/index.html• KIHd Systemhttp://kihdsystem.gmu.edu
![Page 13: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/13.jpg)
Advisory Board MembersTom Scruggs [email protected] Schepis [email protected] Mastropieri [email protected] Hasselbring [email protected] Snell [email protected] Romich [email protected] Takemoto [email protected] Zuckerman [email protected]
![Page 14: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/14.jpg)
Date to Remember
• Next Advisory Board Meeting– April 18th at 10:00am (will contact you if
changed)
![Page 15: Kellar Instructional Handheld data System (KIHd … Instructional Handheld data System (KIHd System) 3rd Advisory Board ... YouRi Shim, Kavita Mittapalli . Reliability](https://reader034.vdocuments.mx/reader034/viewer/2022051722/5aa53d0c7f8b9a1d728cd94d/html5/thumbnails/15.jpg)
Contact Information
Helen A. Kellar Institute for Human disAbilities
(703) 993-3670 (voice/TTY)(703) 993-3681 (fax)
http://kihd.gse.gmu.edu