using human factors in hospital technology procurement
TRANSCRIPT
![Page 1: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/1.jpg)
Using Human Factors in Hospital Technology Procurement
Svetlena Taneva, PhD
Healthcare Human Factors
University Health Network @healthcarehf
@SvetlenaTaneva
![Page 2: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/2.jpg)
WHAT IS HUMAN FACTORS?
![Page 3: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/3.jpg)
Buxton, W. (2001). Less is More (More or Less), in P. Denning (Ed.). The Invisible Future: The seamless integration of technology in everyday life. New York: McGraw Hill, 145-179.
What is Human Factors?
The application of the science of human
behaviour to the design of systems
Engineering for human efficiency and
effectiveness - accommodate the limits of
the human user.
![Page 4: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/4.jpg)
Bridging the gap between human
capability and demands of the task
![Page 5: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/5.jpg)
![Page 6: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/6.jpg)
210,000 - 400,000 US DEATHS
annually due to preventable medical error
James, J.T. (2013). A new, evidence-based estimate of patient harms associated with hospital care. Journal of Patient Safety, 9(3), 122-128
![Page 7: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/7.jpg)
17,300 – 23,000 CANADIAN DEATHS
annually due to preventable medical error
CIHI (2016). Measuring Patient Harm in Canadian Hospitals. Canadian Patient Safety Institute.
Baker, Norton, et al. (2004). The Canadian Adverse Events Study.
![Page 8: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/8.jpg)
![Page 9: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/9.jpg)
HEALTHCARE TECHNOLOGY PROCUREMENT
![Page 10: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/10.jpg)
![Page 11: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/11.jpg)
The Opportunity
Healthcare environments today:
— Volume of technology increasing
— Complexity of technology increasing
— Interdependency of technologies increasing
— Clinical staff busier
— Increasingly concerned with errors associated with
technology use
![Page 12: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/12.jpg)
Pitfalls of Traditional Procurement
• Cost and functionality
• Stakeholders: lack of front line users
• Vendor demos:
— Very slick
— Biased by how well the vendor is liked
— Biased by how well the vendor organizes the
demo
• Financial decisions are made early on
• Financial review often carries as much weight
as technical and clinical review
![Page 13: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/13.jpg)
HF goals in procurement
— Objective evidence to inform the procurement decision
— Identify risk and needed customizations to inform negotiations
— Inform implementation strategy
— Ensure best fit
![Page 14: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/14.jpg)
The test methodology calls for
intended users to perform
representative and high-risk tasks.
![Page 15: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/15.jpg)
Usability Testing/Simulations
Elements of a usability test:
— Representative users
— Representative environment (physical constraints)
— Representative tasks with contender products
— Realistic training, realistic use
— Distractions
— Record video and audio
— Qualitative and quantitative
— Semi-structured debrief
![Page 16: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/16.jpg)
Procurement process
![Page 17: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/17.jpg)
CASE STUDY: INFUSION PUMPS
![Page 18: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/18.jpg)
Pump A Pump B
Case Study: Large Volume Infusion Pumps
![Page 19: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/19.jpg)
Stakeholders
— Clinical representation
— Management
— Infection control
— Transportation
— Supply and purchasing
— Biomedical engineering
![Page 20: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/20.jpg)
HF Process
List of prioritized
tasks
• Stakeholder input via task survey
Shadowing builds
context
Draft scenarios
• Clinicians validate and provide example pt. cases
Refine based on heuristic evaluation
Pilot and refine
Usability Testing
![Page 21: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/21.jpg)
Usability Testing Protocol
— Training
— Setting up and programming the pump
— Modifying the pump settings and hitting a soft limit
— Modifying the pump settings and hitting a hard
limit
— Resolving an occlusion alarm
— Resolving an empty reservoir alarm
— Debrief and questionnaire
![Page 22: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/22.jpg)
Evaluation Criteria
— Task accuracy & error frequency
— Impact and severity of errors
— Task efficiency
— Number of requests for help
— User feedback and preferences
![Page 23: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/23.jpg)
Categorization of Usability Issues
Priority Definition
HighIssues that could have direct patient safety implications and/or prevent users from completing tasks
Medium
Issues that have a potential indirect patient safety impact and/or could result in considerable user frustration and inefficiencies
LowIssues that affect general usability and/or the user’s overall impression of the system
![Page 24: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/24.jpg)
Number of Usability Issues
Pump A
Pump B
![Page 25: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/25.jpg)
Task Efficiency
Number of Requests
Pump A 18
Pump B 10
Average Time (mm:ss)
Pump A 59:47
Pump B 56:35
Requests for guidance
Time to complete scenarios
![Page 26: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/26.jpg)
0 1 2 3 4
Easiesttouse
Bestmeetsmyclinicalneeds
Safest
NumberofParticipants
AdultAcuteCare- ExitSurvey
CardinalAlaris HospiraSymbiq
0 1 2 3 4
Easiesttouse
Bestmeetsmyclinicalneeds
Safest
NumberofParticipants
NICU- ExitSurvey
CardinalAlaris HospiraSymbiq
Questionnaires
Pump A Pump B Pump A Pump B
![Page 27: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/27.jpg)
Overall Comparison Score
Overall Comparison Score
Pump A 10.70
Pump B 18.99
![Page 28: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/28.jpg)
OTHER PROJECTS
![Page 29: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/29.jpg)
HF Informed Procurement Examples
Project
• Electronic medical records
Outcome
Current products on the market are not
easy to use, resulting in use-related
patient safety risks. Decision to
postpone purchase until better
technology is available.
HF value add
Saved close to $1 billion and
prevented introducing
preventable risk.
![Page 30: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/30.jpg)
HF Informed Procurement Examples
Project
• Anesthesia Gas Machines
Outcome
Large variability in performance among
the 4 products evaluated. Two
products stood out as being
significantly easier to use, with
minimal patient safety implications.
Investment made for the
system that is both safe and
best supports the specific
organization's users and
their workflows.
HF value add
![Page 31: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/31.jpg)
HF Informed Procurement Examples
Project
• Surgical Instrument
Management System
Outcome
Systems evaluated performed similarly
across assessment criteria, but one of
them demonstrated a significantly
lesser number of critical patient
safety and usability issues.
Informed the customization
negotiations, training
requirements, mitigations
and implementation
strategy for the chosen
product in order to prevent
any potential use-safety
risk.
HF value add
![Page 32: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/32.jpg)
HF Informed Procurement Examples
Project
• ABG syringes
Outcome
Users were not able to distinguish the
heparinized syringes from non-
heparinized syringes. Packaging,
plunger colour and labeling all
contributed to safety errors, which
perpetuated through supply stocking,
feeds preparation and administration.
The data was used to break
the contract with the
vendor.
HF value add
![Page 33: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/33.jpg)
Benefits: Human Factors Informed Procurement
— Objective evidence to inform the procurement decision
— Identify risks and push for needed customizations
— Improved adoption of technology
— Improved efficiency
— Decreased training
— Improved patient safety
![Page 34: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/34.jpg)
Conclusions
We cannot assume manufacturers test for safety
Simulation takes into consideration the complexity of real healthcare environments
Simulation uncovers system issues that may also be addressed through further simulation
![Page 35: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/35.jpg)
PROCUREMENT LANDSCAPE
![Page 36: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/36.jpg)
![Page 37: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/37.jpg)
![Page 38: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/38.jpg)
Value-Based Procurement
![Page 39: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/39.jpg)
![Page 40: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/40.jpg)
THANK YOU!
![Page 41: Using Human Factors in Hospital Technology Procurement](https://reader033.vdocuments.mx/reader033/viewer/2022052606/5a64be537f8b9a88148b4d39/html5/thumbnails/41.jpg)