distributed learning anita singh md, ccfp tamara bahr b.a, b.ed chi ming chow md, msc, frcpc
TRANSCRIPT
![Page 1: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/1.jpg)
Distributed Learning
Anita Singh MD, CCFP
Tamara Bahr B.A, B.Ed
Chi Ming Chow MD, MSc, FRCPC
![Page 2: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/2.jpg)
![Page 3: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/3.jpg)
Objectives
1. Define and describe the components of Distributed Learning
2. Describe the current evidence for the efficacy of Distributed Learning
3. Demonstrate some of different mediums for delivering educational material
![Page 4: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/4.jpg)
Objectives
4. Review the challenges and limitations of distributed learning
5. Look at opportunities in your own universities for distributed learning and for collaboration
![Page 5: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/5.jpg)
Distributed Learning
• Distributed learning is an instructional model that involves using various information technologies to help students learn. Also known as computer-mediated instruction, it encompasses technologies such as video or audio conferencing, satellite broadcasting, and Web-based multimedia formats.
![Page 6: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/6.jpg)
Distributed Learning
Distributed learning comes from the concept of
distributed resources.
![Page 7: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/7.jpg)
Terms Used:
• E-learning
• Distance learning
• Online learning
![Page 8: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/8.jpg)
![Page 9: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/9.jpg)
Is Distributed Learning better than traditional forms of
teaching??
![Page 10: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/10.jpg)
Efficacy of Distributed Learning
There is no significant difference in outcomes with traditional curriculum and
distributed learning
![Page 11: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/11.jpg)
So Why Do It??
Does Distributed Learning add value to the learning experience?
![Page 12: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/12.jpg)
Advantages
• Ease of access to and interrogation of high volumes of diverse, learning resources
![Page 13: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/13.jpg)
![Page 14: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/14.jpg)
Advantages
• Opportunities for working live or asynchronous in collaboration with others from any where in the world
![Page 15: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/15.jpg)
Advantages
• Choice of learning styles within the same package according to need of the learner
• Multiple levels of engagement to different depths of understanding
• Logging or tracking of activities
![Page 16: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/16.jpg)
Advantages
• Education transcends time and space barriers, and takes place at a pace set by the students themselves.
• Distributed learning gives learners greater responsibility for managing their own learning
![Page 17: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/17.jpg)
![Page 18: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/18.jpg)
Pedagogy should drive your technology
![Page 19: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/19.jpg)
7 Principles of PedagogyIMPLEMENTING THE SEVEN PRINCIPLES:
Technology as Lever
by Arthur W. Chickering and Stephen C. Ehrmann
![Page 20: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/20.jpg)
4. Provide Prompt Feedback
5. Emphasize time on task
6. Communicate High Expectations Expecting learners to perform well becomes a self-fulfilling prophecy
7. Respect diverse talents and ways of learning
![Page 21: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/21.jpg)
1. Encourage contact between learners and faculty
2. Develop reciprocity and cooperation among learners – “Learning is social – not competitive and isolated”
3. Use active learning techniques. Better information recall when student interacts with content
![Page 22: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/22.jpg)
Application of the Seven Principles of Pedagogy and
Technology
![Page 23: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/23.jpg)
Principle 1
Encourage contact between learners and faculty
![Page 24: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/24.jpg)
Technology/Strategies
Asynchronous
• Email, • Bulletin boards
Synchronous
• Live Chat• Skype,MSN Audio/Video Conferencing • Arranging for one-on-one communications • Note: Small class size or small groups helps this to be more successful
![Page 25: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/25.jpg)
Principle 1 Encourage contact between learners and faculty
• Engage in deeper dialogue over time • Accommodates different schedules/ places • Collective knowledge shared/ distributed • Increased opportunity for collaboration• More thoughtful contributions (Because users
are more conscious of their work)
Benefits
![Page 26: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/26.jpg)
Examples of Use
• Standard tools in LMS • No special software or skills necessary • Setback: Some students are hesitant to
post publicly• http://portal.utoronto.ca
![Page 27: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/27.jpg)
Principle 2
Develop reciprocity and cooperation among learners – “Learning is social – not
competitive and isolated”
![Page 28: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/28.jpg)
Technology/Strategies• Online Community Chat forums• Instant messaging• Blogging• Resource pooling/sharing • Online community sites and resources
Collaborative projects (web development, Community of Practice…)
![Page 29: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/29.jpg)
Benefits
• Learner to learner interaction
• Collaboration among students separated by geography and time is enhanced using Internet tools to create a sense of community
![Page 30: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/30.jpg)
Example of Use
• End of Life Care Distance Learning Program– http://icarus.med.utoronto.ca/eolCare/index.htm
![Page 31: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/31.jpg)
Principle 3
Use active learning techniques. Better information recall when student
interacts with content
![Page 32: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/32.jpg)
Technology/Strategies
Simulations and contextual anchoring
• Contextual anchoring – provide learner with realistic scenarios As in the Palliative Care E-Learning Program
• Require student interaction to generate outcomes
![Page 33: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/33.jpg)
Examples of Use
– http://palliative.utorontoeit.com/– http://palliative.utorontoeit.com/module2/06.htm– http://link.library.utoronto.ca/MyUTL/guides/
index.cfm?guide=palliativecare
![Page 34: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/34.jpg)
Principle 4
Provide Prompt Feedback
![Page 35: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/35.jpg)
Technology/Strategies
• **Provide immediate feedback via discussion boards (for discourse models)
• Rubrics - Learners need help in assessing their existing knowledge and competence
• Monitor academic progress - e-portfolio can be used for peer review, self assessment, and instructor graded
![Page 36: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/36.jpg)
Example of Use
• E-portfolio tool is built into many LMS’– http://portal.utoronto.ca
![Page 37: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/37.jpg)
Principle 5
Emphasize time on task
![Page 38: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/38.jpg)
Technology/Strategies
Flexible and Intuitive Course Design
• Provide completion timelines where possible• Keep units structured the same as much as
possible• Use course calendar tool• Course announcements
![Page 39: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/39.jpg)
Examples of Use
• Dynamic course calendar and announcements
• Structured modules
– http://portal.utoronto.ca
![Page 40: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/40.jpg)
Principle 6
Communicate High Expectations Expecting learners to perform well becomes a self-fulfilling
prophecy
![Page 41: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/41.jpg)
Technology/Strategies
Publishing for a Global Audience – Many learners 'feel stimulated by knowing
their finished work will be "published." If they know other learners will see their work, learners usually set higher goals for themselves.
![Page 42: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/42.jpg)
Examples of Use– Wiki sites http://www.wikimedia.org/– Blog sites http://blogspot.com– E-portfolio and peer review: tools are built into
many LMS’ and there are websites that facilitate this too
![Page 43: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/43.jpg)
Principle 7
Respect diverse talents and ways of learning
![Page 44: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/44.jpg)
Technology/ Strategies
• Multimedia Content: Video/ Audio • Learners prefer high media to text ratio• Encourages development of visual recognition/
auditory skills needed in clinical practice• Learn from modeling of professional behaviour• Provide alternative formats
![Page 45: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/45.jpg)
• Custom PowerPoint with audio• Flash objects
– http://www.edheads.org/activities/knee/• Learning Object Repositories
– HEAL www.healcentral.org/
– MERLOT http://www.merlot.org/merlot/index.htm
1. There are many rapid development tools on the market Captivate, Articulate, Producer, Flash to name a few. All come with a learning curve
Examples of Use
![Page 46: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/46.jpg)
Resources
1. IMPLEMENTING THE SEVEN PRINCIPLES: Technology as Lever http://www.tltgroup.org/programs/seven.html
2. Discovery Commons www.discoverycommons.ca
3. E-Learning in Palliative care– http://palliative.utorontoeit.com/– http://palliative.utorontoeit.com/module2/06.htm– http://link.library.utoronto.ca/MyUTL/guides/
index.cfm?guide=palliativecare
![Page 47: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/47.jpg)
References Continued
1. http://www.edheads.org/activities/knee2. Wikis http://www.wikimedia.org/3. Blogs http://blogspot.com4. Learning Objects
• Health Education Assets Library (HEAL) free digital resources for health sciences educators (peer reviewed) www.healcentral.org/
• Multimedia Educational Resource for Learning and Online Teaching MERLOT http://www.merlot.org/merlot/index.htm
![Page 48: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/48.jpg)
Tips On Doing This Successfully
1. Know your audience
2. Identify your learning outcomes
3. Identify What you can and can’t do
![Page 49: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/49.jpg)
Tips On Doing This Successfully
4. Know your technology and what is available
5. Pedagogy should drive technology
6. Know your limitations human and financial
![Page 50: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/50.jpg)
Challenges
• Time
• Money– Grants
• Expertise– i.e. Summer Student Project
![Page 51: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/51.jpg)
THE ENDTHE END
![Page 52: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/52.jpg)
Six-Year Trends In The Evaluation Outcomes Of Slice Of Life
Presentations (2001-2006) Using The Kirkpatrick’s Model For Summative
Evaluation
Department of Medicine, University of Toronto
![Page 53: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/53.jpg)
Background
• Evaluation of the outcomes and impact is an important component of the e-learning projects
• Over five hundred presentations were made in the last six annual SOL meetings (2001-6).
• However, little is known about:• Overall trends in the project types• Presence of evaluation description • Evaluation methods employed in these e-learning projects.
![Page 54: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/54.jpg)
Objective
We sought to retrospectively classify the presentations identify the trends in the evaluation outcomes of the E-learning projects presented over the past six years (2001-2006) using the
modified Kirkpatrick’s levels of evaluation
![Page 55: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/55.jpg)
Kirkpatrick’s Four Levels of Evaluation
![Page 56: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/56.jpg)
Kirkpatrick’s Four Levels of Evaluation
• For assessing training effectiveness
• Each successive evaluation level is built on information provided by the lower level (1994)
![Page 57: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/57.jpg)
• Measures how participants react to it•Did they like it?
• Was the material relevant to their work?
• “Smilesheet”, “Happiness factor”
• Positive reaction does not guarantee learning• Negative reaction reduce possibility
KP Level 1 Evaluation - Reactions
![Page 58: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/58.jpg)
KP Level 2 Evaluation - Learning
•Attempts to assess the extent students have advanced their skills, knowledge, or attitude
• Pre-test & post-test to determine amount learning that has occurred
![Page 59: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/59.jpg)
KP Level 3 Evaluation - Transfer
• Attempts to measure the transfer that has occurred in learners’ behaviour due to the training program
• Are the newly acquired skills, knowledge, or attitude being used in the everyday environment of the learner?
• Medical -> Change practice
![Page 60: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/60.jpg)
KP Level 4 Evaluation - Results
• Measures the effects on the business or environment resulting from the trainee’s performance
• For example,•increased production• Improved quality• Decreased costs•Increased sales •Higher profits or return on investment
![Page 61: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/61.jpg)
KP Level 4 Evaluation - Results
• In medical terms……does it change Patient/medical outcomes i.e.
• Reduce Death
• Reduce complication
• Lower cholesterol level
• Lower BP in practice population
![Page 62: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/62.jpg)
Methods
• Reviewed 509 published abstracts of the SOL meetings from 2001-2006
• Exclusion– Incomplete abstract descriptions– Abstracts that focused on describing general
educational theories or technological methods
![Page 63: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/63.jpg)
Methods
• Modified Kirkpatrick’s model for summative evaluation is used:
Level 1: Learner usage or satisfaction
Level 2: Learning outcomes
Level 3: Performance improvement
Level 4: Patient/health outcomes
![Page 64: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/64.jpg)
Results
509: abstracts were identified141: abstracts were excluded
(33.8%)337: abstracts were reviewed
(66.2%)
![Page 65: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/65.jpg)
Years
E-L
earn
ing P
roje
cts
Revie
wed
Number of E-Learning Projects at SOL by Year
![Page 66: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/66.jpg)
Num
ber
of
E-L
earn
ing
Pro
ject
sTrends in the Format Type of E-Learning Tools at
SOL
![Page 67: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/67.jpg)
Percentage of Projects With Evaluation Described
Perc
enta
ge o
f E-L
earn
ing
Pro
ject
s Evalu
ate
d (
%)
![Page 68: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/68.jpg)
Levels of Evaluation Using the Modified Kirkpatrick’s Model Among Projects
with Evaluation described
Perc
enta
ge o
f E-L
earn
ing P
roje
cts
(%)
![Page 69: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/69.jpg)
Limitations
Retrospective
Abstracts may not described the details of the evaluation that was subsequently done/presented
![Page 70: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/70.jpg)
Conclusion
Web-based program out-numbered PC-based program by 2:1.
Very few PDA-based programs
% of projects with evaluation increased over the years
![Page 71: Distributed Learning Anita Singh MD, CCFP Tamara Bahr B.A, B.Ed Chi Ming Chow MD, MSc, FRCPC](https://reader034.vdocuments.mx/reader034/viewer/2022051517/56649ef55503460f94c08c7f/html5/thumbnails/71.jpg)
Conclusion
Most projects described level 1 and 2 evaluation
Level 3 and 4 evaluation is rare
Highlight the need to examine in greater detail the nature and characteristics of e-learning projects that are most effective in enhancing practice change