incorporating simulation into medical education and …€¦ · incorporating simulation into...

41
Incorporating Simulation into Medical Education and Assessment Paul E. Phrampus, MD Director Peter M. Winter Institute for Simulation, Education and Research (WISER) University of Pittsburgh

Upload: hoangthuy

Post on 29-Jul-2018

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Incorporating Simulation into Medical

Education and AssessmentPaul E Phrampus MD

DirectorPeter M Winter Institute for Simulation

Education and Research (WISER)University of Pittsburgh

Learning OBJECTIVES

At the conclusion of this session you should be able to

bull Describe simulation-based education assessmentbull List opportunities that can be implemented with

simulation based education assessmentbull Identify barriers associated with the implementation of

simulation based education assessment programs

What is ldquosimulationrdquohellip Reallyhellip

ldquoSimulationrdquo amp Medicine

Simulation Definition

bull simmiddotumiddotlamiddottion

1 Imitation or enactment as of something anticipated or in testing

2 The act or process of pretending feigning 3 An assumption or imitation of a particular appearance or form

counterfeit sham 4 Psychiatry a conscious attempt to feign some mental or

physical disorder to escape punishment or to gain a desired objective

5 The representation of the behavior or characteristics of one system through the use of another system esp a computer program designed for the purpose

Overview of WISER

UPMC

WISER Missionndash Create a safer environment for patients by using simulation and other state of

the art educational technology in the training and assessment of the healthcare system professionals

ndash Serve as a laboratory to research the use of simulation and other advanced instructional technology in healthcare education and to publish the results

ndash Create simulation based education programs for primary education in various domains of the healthcare delivery system

ndash Develop and validate simulation based technology as a competency assessment evaluation tool for healthcare professionals

ndash Contribute to the education and mentorship of future generations of healthcare system educators and education researchers interested in creating or evaluating simulation based teaching methodologies

Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 2: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Learning OBJECTIVES

At the conclusion of this session you should be able to

bull Describe simulation-based education assessmentbull List opportunities that can be implemented with

simulation based education assessmentbull Identify barriers associated with the implementation of

simulation based education assessment programs

What is ldquosimulationrdquohellip Reallyhellip

ldquoSimulationrdquo amp Medicine

Simulation Definition

bull simmiddotumiddotlamiddottion

1 Imitation or enactment as of something anticipated or in testing

2 The act or process of pretending feigning 3 An assumption or imitation of a particular appearance or form

counterfeit sham 4 Psychiatry a conscious attempt to feign some mental or

physical disorder to escape punishment or to gain a desired objective

5 The representation of the behavior or characteristics of one system through the use of another system esp a computer program designed for the purpose

Overview of WISER

UPMC

WISER Missionndash Create a safer environment for patients by using simulation and other state of

the art educational technology in the training and assessment of the healthcare system professionals

ndash Serve as a laboratory to research the use of simulation and other advanced instructional technology in healthcare education and to publish the results

ndash Create simulation based education programs for primary education in various domains of the healthcare delivery system

ndash Develop and validate simulation based technology as a competency assessment evaluation tool for healthcare professionals

ndash Contribute to the education and mentorship of future generations of healthcare system educators and education researchers interested in creating or evaluating simulation based teaching methodologies

Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 3: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

What is ldquosimulationrdquohellip Reallyhellip

ldquoSimulationrdquo amp Medicine

Simulation Definition

bull simmiddotumiddotlamiddottion

1 Imitation or enactment as of something anticipated or in testing

2 The act or process of pretending feigning 3 An assumption or imitation of a particular appearance or form

counterfeit sham 4 Psychiatry a conscious attempt to feign some mental or

physical disorder to escape punishment or to gain a desired objective

5 The representation of the behavior or characteristics of one system through the use of another system esp a computer program designed for the purpose

Overview of WISER

UPMC

WISER Missionndash Create a safer environment for patients by using simulation and other state of

the art educational technology in the training and assessment of the healthcare system professionals

ndash Serve as a laboratory to research the use of simulation and other advanced instructional technology in healthcare education and to publish the results

ndash Create simulation based education programs for primary education in various domains of the healthcare delivery system

ndash Develop and validate simulation based technology as a competency assessment evaluation tool for healthcare professionals

ndash Contribute to the education and mentorship of future generations of healthcare system educators and education researchers interested in creating or evaluating simulation based teaching methodologies

Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 4: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

ldquoSimulationrdquo amp Medicine

Simulation Definition

bull simmiddotumiddotlamiddottion

1 Imitation or enactment as of something anticipated or in testing

2 The act or process of pretending feigning 3 An assumption or imitation of a particular appearance or form

counterfeit sham 4 Psychiatry a conscious attempt to feign some mental or

physical disorder to escape punishment or to gain a desired objective

5 The representation of the behavior or characteristics of one system through the use of another system esp a computer program designed for the purpose

Overview of WISER

UPMC

WISER Missionndash Create a safer environment for patients by using simulation and other state of

the art educational technology in the training and assessment of the healthcare system professionals

ndash Serve as a laboratory to research the use of simulation and other advanced instructional technology in healthcare education and to publish the results

ndash Create simulation based education programs for primary education in various domains of the healthcare delivery system

ndash Develop and validate simulation based technology as a competency assessment evaluation tool for healthcare professionals

ndash Contribute to the education and mentorship of future generations of healthcare system educators and education researchers interested in creating or evaluating simulation based teaching methodologies

Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 5: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Simulation Definition

bull simmiddotumiddotlamiddottion

1 Imitation or enactment as of something anticipated or in testing

2 The act or process of pretending feigning 3 An assumption or imitation of a particular appearance or form

counterfeit sham 4 Psychiatry a conscious attempt to feign some mental or

physical disorder to escape punishment or to gain a desired objective

5 The representation of the behavior or characteristics of one system through the use of another system esp a computer program designed for the purpose

Overview of WISER

UPMC

WISER Missionndash Create a safer environment for patients by using simulation and other state of

the art educational technology in the training and assessment of the healthcare system professionals

ndash Serve as a laboratory to research the use of simulation and other advanced instructional technology in healthcare education and to publish the results

ndash Create simulation based education programs for primary education in various domains of the healthcare delivery system

ndash Develop and validate simulation based technology as a competency assessment evaluation tool for healthcare professionals

ndash Contribute to the education and mentorship of future generations of healthcare system educators and education researchers interested in creating or evaluating simulation based teaching methodologies

Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 6: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Overview of WISER

UPMC

WISER Missionndash Create a safer environment for patients by using simulation and other state of

the art educational technology in the training and assessment of the healthcare system professionals

ndash Serve as a laboratory to research the use of simulation and other advanced instructional technology in healthcare education and to publish the results

ndash Create simulation based education programs for primary education in various domains of the healthcare delivery system

ndash Develop and validate simulation based technology as a competency assessment evaluation tool for healthcare professionals

ndash Contribute to the education and mentorship of future generations of healthcare system educators and education researchers interested in creating or evaluating simulation based teaching methodologies

Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 7: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

WISER Missionndash Create a safer environment for patients by using simulation and other state of

the art educational technology in the training and assessment of the healthcare system professionals

ndash Serve as a laboratory to research the use of simulation and other advanced instructional technology in healthcare education and to publish the results

ndash Create simulation based education programs for primary education in various domains of the healthcare delivery system

ndash Develop and validate simulation based technology as a competency assessment evaluation tool for healthcare professionals

ndash Contribute to the education and mentorship of future generations of healthcare system educators and education researchers interested in creating or evaluating simulation based teaching methodologies

Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 8: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 9: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

12000 square feet 16 training rooms 23 simulators many part task trainers

Physical Plant

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 10: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Demographics of Participantsbull Medicine

ndash Medical Students (MS 2-4)ndash Residents

bull Anesthesiology bull Emergency Medicinebull ENTbull Internal Medicinebull OBGYN (course work in development)bull Pediatricsbull Surgery

ndash Fellowsbull Critical Carebull Pediatric Intensivists

ndash Faculty Members and Community Physicians

bull Anesthesiologybull Critical Care Medicinebull Emergency Medicine

bull Nursingndash Undergraduate Nursing Studentsndash Practicing Nurses

bull Med Surgbull ICUbull OR

ndash Nurse Anesthetistsndash Student Nurse Anesthetists

Pharmacy Students

Paramedics EMTs Respiratory Therapists Other Simulation Centers

Educators Many Others

bull11000 simulation encounters last year

bull3000 unique individuals

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 11: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Who Does WISER Support

bull 75 Learning Systems (Courses)bull 55 Course Directorsbull 228 Facilitatorsbull University of Pittsburghbull UPMC

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 12: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

The Job of Healthcare EducatorsPsychomotor Skills

Communications Skills

Professionalism Skills

Decision MakingBase Knowledge

Teamwork Skills

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 13: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Whatrsquos the Goal

Expert Curriculum

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 14: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Which Tool

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 15: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

The Tool Box

PowerPoint

Case Study

Syllabus

On Line Learning

Chalk Board

Textbooks

Lectures

Simulation

EXPERT CurriculumSimulation

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 16: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Why Simulation Pyramid of Learning

and Retention

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 17: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

TESTING TEACHING

Why Simulation

Psychomotor SkillsDecision Making

Skills and Decisions

Individuals Teams

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 18: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Why Now

bull Residents Get to Sleepbull Residents Get to Go Homebull Residents have to have Mints on the

Pillowsbull Etc etc etc 20 hours per week x 50 weeks X 5 Years = 5000 less hours of training

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 19: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Why Not Simulation

bull Not Very Easybull Not Very Efficientbull Must Plan Aheadbull Difficult to Developbull Status Quo is Easier

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 20: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

What does WISER do

bull Lower the Barriers for Successfulndash Creationndash Implementationndash Sustainment

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 21: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Teaching Tools

Outcomes amp Impact

SIMS

Research

Simulation Based EducationSystems

Feedback

Internet-based Trainee

Performance Feedback

(including videos)

Curriculum

Assessment Tools

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 22: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

What do you think of first

Expert Curriculum

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 23: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Basic Components of Successful Simulation Program

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 24: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

WISER the EnablerSubject Matter

Experts

StudentsInstructors

WISER

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 25: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Goal Successful Programs

Domain 1

Domain 2

Domain 3

Domain 4

Simulation Help

(The tool Box)

SuccessfulProgram 1

SuccessfulProgram 2

SuccessfulProgram 3

SuccessfulProgram 4

Support

Rules

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 26: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Evaluation

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 27: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Evaluation bull Individual Trainee Evaluation

ndash Per episode performancendash Per class performance (group

of episodes)

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 28: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Evaluationbull Group Performance

ndash Validate Scenariosndash Validate Curriculum Deployment

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 29: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Evaluationbull Individual Instructor

Evaluationndash Feedback from Traineendash Performance by Trainees

ndash By Scenariondash By Class

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 30: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Evaluationbull Group Instructor Evaluation

ndash Assess Curriculum Deployment

ndash Reliability of Scenariosndash Interrater Reliability

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 31: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Data Examplesbull Evaluations

bull Pre Course

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 32: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Data Examplesbull Evaluations

bull Post Course

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 33: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Data Examplesbull Evaluations

bull Feedback on Instructors

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 34: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Select WISER Programs

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 35: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Difficult Airway Management

bull Anesthesiologybull Emergency Physicians

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 36: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Central Venous Cannulation Training

Substantial reduction of Related Infections

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 37: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Procedural Sedation for Pediatric Emergencies

bull Required Coursebull Pre-Course Contentbull Pre-Testbull Multiple Scenarios

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 38: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Health System Integration Crisis Team Training

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 39: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Position Task Completion

0

25

50

75

100

1 2 3

Session

Com

plet

ion

Perc

enta

ge

AirwayAirway AssistantChest compressionsFloor RNICU RN (Cart)Procedure MDRecorder ICURNTeam Leader

Improvement is rapid and measurable

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 40: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Chart1

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion
01111111111
04497354497
02632275132
03814814815
02166666667
02462962963
00888888889
01944444444
0837037037
07925925926
07657407407
07518518519
07592592593
06222222222
04388888889
06388888889
09333333333
0962962963
08412698413
08074074074
08685185185
08444444444
07777777778
08055555556

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
3 3 3 3 3 3 3 3
Page 41: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
Page 42: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
Page 43: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
Page 44: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Page 45: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Page 46: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Random Numbers

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 3 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 4
3 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 2 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
2 Grand Total 8 11 13 15 13 60
August Session 1 4 2
Session 2 5 5
Session 3 1 5
5
September Session 1 1 3
Session 2 4 1
Session 3 3 3
5
October Session 1 3 1
Session 2 4 3
Session 3 2 4
2
November Session 1 5 4
Session 2 2 5
Session 3 4 5
2
December Session 1 4 1
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Page 47: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

000

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

1 2 3

Session number

Mor

talit

y

Simulator ldquoMortalityrdquo

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Page 48: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Death rate by session

Simulator Mortality
Session number
Mortality

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
1
03333333333
01111111111
Page 49: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Tables

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
9 Classes 3 sessions per class
Deaths - Session vs Scenarios
Sum of Death Session Why averaging grouped by position differs from averaging each task
Scenario 1 2 3 Grand Total
1 4 1 5 Completed
2 4 2 0 6 Position 1 Task 1 Y Avg for Position = 50 Avg for Both Positions = 75
3 0 0 0 Task 2 Y
4 0 0 Task 3 N
5 1 0 1 2 Task 4 N
Grand Total 9 3 1 13 Position 2 Task 1 Y 100
Death Rate by Session 10000 3333 1111
of Y 3
of N 5 Average by position 75
Average Task Completion by Session by task 60 Average by task 60
Average of Total Completion Session
1 2 3 Grand Total
Total 2644 6967 8389 6000
Position Task Completions
Position 1 2 3
Airway 1111 8370 9333
Airway Assistant 4497 7926 9630
Chest compressions 2632 7657 8413
Floor RN 3815 7519 8074
ICU RN (Cart) 2167 7593 8685
Procedure MD 2463 6222 8444
Recorder ICURN 889 4389 7778
Team Leader 1944 6389 8056
Page 50: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Tables

Airway
Airway Assistant
Chest compressions
Floor RN
ICU RN (Cart)
Procedure MD
Recorder ICURN
Team Leader
Session
Completion Percentage
Position Task Completion

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
Page 51: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Data

lutzjwBold zeros (0) areCritical Incidents but Survive

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Code Team Training Compilation Data
Date Session Scenario Death Total Completion
10302 1 1 1 44
10302 2 4 0 60
10302 3 3 0 79
101402 1 2 1 27
101402 2 5 0 68
101402 3 3 0 97
112602 1 2 1 35
112602 2 3 0 62
112602 3 5 1 84
12302 1 2 1 10
12302 2 3 0 81
12302 3 5 0 91
12303 1 1 1 10
12303 2 2 1 67
12303 3 3 0 77
22503 1 1 1 30
22503 2 3 0 86
22503 3 5 0 60
31303 1 1 1 9
31303 2 2 1 66
31303 3 5 0 95
41503 1 5 1 37
41503 2 1 1 60
41503 3 2 0 92
52203 1 2 1 36
52203 2 3 0 77
52203 3 5 0 80
Page 52: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Position tables

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Average of Session 1 Average of Session 2 Average of Session 3
Position Total Position Total Position Total
Aide 2000 Aide 5000 Aide 10000
Airway 1111 Airway 8370 Airway 9333
Airway Assistant 4497 Airway Assistant 7926 Airway Assistant 9630
Chest compressions 2632 Chest compressions 7657 Chest compressions 8413
Floor RN 3815 Floor RN 7519 Floor RN 8074
ICU RN (Cart) 2167 ICU RN (Cart) 7593 ICU RN (Cart) 8685
Procedure MD 2463 Procedure MD 6222 Procedure MD 8444
Recorder ICURN 889 Recorder ICURN 4389 Recorder ICURN 7778
Team Leader 1944 Team Leader 6389 Team Leader 8056
Grand Total 2411 Grand Total 6902 Grand Total 8628
Page 53: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Data by Position

lutzjwNo 3 minute dataSession halted

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Code Team Training Task Completion By Position Percentages
Date Position Session 1 Session 2 Session 3
10302 Airway 0 100 100
10302 Airway Assistant 83 50 100
10302 Floor RN 40 100 100
10302 ICU RN (Cart) 75 80 80
10302 Team Leader 50 75 100
10302 Recorder ICURN 20 40 100
10302 Procedure MD 20 100 100
10302 Chest compressions 50 100 75
10302 Aide
101403 Airway 0 100 100
101403 Airway Assistant 33 67 100
101403 Floor RN 83 67 100
101403 ICU RN (Cart) 20 33 100
101403 Team Leader 25 75 100
101403 Recorder ICURN 0 60 100
101403 Procedure MD 50 80 100
101403 Chest compressions 29 75 100
101403 Aide 50 50 100
112603 Airway 60 80 100
112603 Airway Assistant 71 50 100
112603 Floor RN 33 100 83
112603 ICU RN (Cart) 0 100 75
112603 Team Leader 0 50 75
112603 Recorder ICURN 0 0 25
112603 Procedure MD 67 0 100
112603 Chest compressions 50 100 100
112603 Aide
12303 Airway 0 100 100
12303 Airway Assistant 17 100 100
12303 Floor RN 17 67 80
12303 ICU RN (Cart) 0 80 67
12303 Team Leader 0 100 100
12303 Recorder ICURN 20 60 60
12303 Procedure MD 0 67 100
12303 Chest compressions 13 88 100
12303 Aide 0 50 100
12303 Airway 0 80 100
12303 Airway Assistant 17 67 100
12303 Floor RN 33 83 67
12303 ICU RN (Cart) 0 80 80
12303 Team Leader 0 50 0
12303 Recorder ICURN 0 25 100
12303 Procedure MD 0 67 50
12303 Chest compressions 0 60 100
12303 Aide
22503 Airway 0 100 60
22503 Airway Assistant 33 100 67
22503 Floor RN 50 50 67
22503 ICU RN (Cart) 60 80 80
22503 Team Leader 75 50 75
22503 Recorder ICURN 0 100 75
22503 Procedure MD 0 100 50
22503 Chest compressions 33 100 25
22503 Aide 0 0
31303 Airway 0 100 100
31303 Airway Assistant 33 80 100
31303 Floor RN 33 60 80
31303 ICU RN (Cart) 0 100 100
31303 Team Leader 0 50 75
31303 Recorder ICURN 0 50 100
31303 Procedure MD 0 0 100
31303 Chest compressions 0 50 100
31303 Aide
41503 Airway 40 33 100
41503 Airway Assistant 83 100 100
41503 Floor RN 20 50 83
41503 ICU RN (Cart) 0 50 100
41503 Team Leader 0 50 100
41503 Recorder ICURN 0 20 60
41503 Procedure MD 60 80 100
41503 Chest compressions 63 50 100
41503 Aide 0 100 100
52203 Airway 0 60 80
52203 Airway Assistant 33 100 100
52203 Floor RN 33 100 67
52203 ICU RN (Cart) 40 80 100
52203 Team Leader 25 75 100
52203 Recorder ICURN 40 40 80
52203 Procedure MD 25 67 60
52203 Chest compressions 0 67 57
52203 Aide 50 100
Page 54: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Random Numbers

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41
Session Scenario
June Session 1 5 5 Count of Scenario Scenario
Session 2 4 1 Session 1 2 3 4 5 (blank) Grand Total
Session 3 2 3
5 Session 1 3 1 5 6 5 20
July Session 1 3 4 Session 2 3 5 4 5 3 20
Session 2 1 3 Session 3 2 5 4 4 5 20
Session 3 2 2 (blank)
3 Grand Total 8 11 13 15 13 60
August Session 1 4 4
Session 2 5 3
Session 3 1 1
5
September Session 1 1 4
Session 2 4 3
Session 3 3 4
5
October Session 1 3 4
Session 2 4 4
Session 3 2 3
3
November Session 1 5 1
Session 2 2 5
Session 3 4 4
2
December Session 1 4 4
Session 2 1 3
Session 3 3
January Session 1 3
Session 2 2
Session 3 4
February Session 1 4
Session 2 5
Session 3 3
March Session 1 1
Session 2 4
Session 3 5
April Session 1 5
Session 2 3
Session 3 1
May Session 1 4
Session 2 3
Session 3 2
June Session 1 4
Session 2 5
Session 3 3
July Session 1 3
Session 2 2
Session 3 4
August Session 1 4
Session 2 2
Session 3 5
September Session 1 5
Session 2 3
Session 3 4
October Session 1 3
Session 2 1
Session 3 5
November Session 1 1
Session 2 4
Session 3 2
December Session 1 2
Session 2 3
Session 3 5
January Session 1 5
Session 2 2
Session 3 5
Page 55: Incorporating Simulation into Medical Education and …€¦ · Incorporating Simulation into Medical Education and Assessment. Paul E. Phrampus, MD. Director. Peter M. Winter Institute

Discussion

wwwwiserpittedu

  • Slide Number 1
  • Learning OBJECTIVES
  • What is ldquosimulationrdquohellip Reallyhellip
  • ldquoSimulationrdquo amp Medicine
  • Simulation Definition
  • Overview of WISER
  • WISER Mission
  • Univ of Pitt Human Simulation Center--ldquoCirca 1994rdquo
  • Physical Plant
  • Demographics of Participants
  • Who Does WISER Support
  • The Job of Healthcare Educators
  • Whatrsquos the Goal
  • Which Tool
  • The Tool Box
  • Why Simulation
  • Slide Number 17
  • Why Now
  • Why Not Simulation
  • What does WISER do
  • Simulation Based EducationSystems
  • Slide Number 22
  • Slide Number 23
  • WISER the Enabler
  • Goal Successful Programs
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Evaluation
  • Data Examples
  • Data Examples
  • Data Examples
  • Select WISER Programs
  • Difficult Airway Management
  • Central Venous Cannulation Training
  • Procedural Sedation for Pediatric Emergencies
  • Health System Integration Crisis Team Training
  • Improvement is rapid and measurable
  • Simulator ldquoMortalityrdquo
  • Slide Number 41