D I A N E D O D D - M C C U E , D . B . A . A SS O C I AT E P R O F E SS O RV I R G I N I A C O M M O N W E A LT H U N I V E R S I T Y S C H O O L O F A L L I E D H E A LT H P R O F E SS I O N S D E PA RT M E N T O F PAT I E N T C O U N S E L I N G

THE ACHIEVING HEALTHCARE PROFESSIONALISM (AHP) APP

USING A MOBILE APP TO ENHANCE

ENTRY-TO-PROFESSION TRAINING

OVERVIEW

Evolution of mobile app from the conceptual to the practical

AHP APP development and current statusImplementation, usage, and contributions to

entry-to-profession students Hands on introduction to AHP APPA work in progress

AHP APP BACKGROUND

Professionalism emphasizes the values, attitudes, and behaviors reflective of effective communication skills, work ethic, appearance, and respect (Aguilar et al., 2011).

THE AHP APP BIRTH

WORD ON THE STREET

• Patient-centered care• Interdisciplinary care• Disruptive technology

OBSERVATIONS

• Professionalism as common core across disciplines

• SAHP and entry-to-profession training

• Value of goal setting and intrinsics in learning

IMPLIED ASSUMPTIONS

• Common core of professionalism identifiable

• Professionalism a foundation for interprofessionalism

• Shared professionalism can enhance performance

AHP APP AND DIALOGUE

Provides a shared framework and language for discussion

Provides a shared delivery mechanism

Framework and language relevant across health services disciplines

Promotes targeted dialogue between entry-to-profession students and clinical evaluators

Recognition of differences across clinical disciplines and SAHP departments

Flexibility in AHP APP introduction and usage across clinical disciplines and SAHP departments

SAHP Contributors SOE Contributors

Emily Hill, ABD - CLS Dr. Dianne Simons - OT Dr. Diane Dodd-McCue- PATC Lauren Felton

Dr. Dianne Pawluk, Bioengineering

Matt Standard David Parker

THE AHP APP TEAM

AHP APP PROJECT GOALS

Identify common indicators of professionalism

Develop a mobile app to convey professionalism content

Assess the effectiveness of the professionalism app

GOAL: IDENTIFYING COMMON INDICATORS OF PROFESSIONALISM

Addressed through mixed methods research across departments

Identified five categories and 57 indicators of professionalism

Confirmed categories through focus groups

Reviewed literature and professional codes of ethics from all SAHP departments

Validated the list and affirmed content generalizability with clinical evaluators

PROFESSIONALISM

PROFESSIONALATTRIBUTES

WORK ETHIC AND RESPONSIBILITY

RELATIONSHIPS,INTERPERSONAL

COMPETENCE

KNOWLEDGE , CRITICAL THINKING

INTERNALIZED VALUES, ETHICAL BEHAVIOR

AHP APP CONTENT

Content organized by five pre-identified areas

Revised wording and number of items with respect to display on mobile device

Continued refinement of items and wording throughout evaluation process

Consistent scaling throughout

AHP APP CONTENT: PROFESSIONALISM ATTRIBUTES

OVERVIEW Fourteen items Ratings: Below Expectations Slightly Below Expectations Meets Expectations Exceeds Expectations Not Assessed

EXAMPLE OF ITEMS Respect of patients/clients,

families, and caregivers Presentation of self to others

(appropriate/acceptable manner)

Non-verbal communication (appropriate affect, demeanor, body language)

Self-confidence

AHP APP CONTENT: WORK ETHIC AND RESPONSIBILITY

OVERVIEW Nine items Ratings: Below Expectations Slightly Below Expectations Meets Expectations Exceeds Expectations Not Assessed

EXAMPLE OF ITEMS Organization (time and

resources) Punctuality and timeliness Dependability/

Reliability/Follow through Accountability (acknowledges

mistakes, errors and corrects when possible

AHP APP CONTENT : RELATIONSHIPS AND INTERPERSONAL COMPETENCE

OVERVIEW Sixteen items Ratings: Below Expectations Slightly Below Expectations Meets Expectations Exceeds Expectations Not Assessed

EXAMPLE OF ITEMS Professional boundaries/

Appropriate therapeutic and work relationships

Listening and communication skills

Incorporates constructive feedback (modification of performance)

Conflict management and resolution skills

AHP APP CONTENT: KNOWLEDGE AND CRITICAL THINKING

OVERVIEW Six items Ratings: Below Expectations Slightly Below Expectations Meets Expectations Exceeds Expectations Not Assessed

EXAMPLE OF ITEMS Commitment to learning

(invested, willing to try) Problem determination

(finding) and solving Clinical reasoning (ability to

think and adapt plans, approaches ‘in the moment’

AHP APP CONTENT: INTERNALIZED VALUES AND ETHICAL BEHAVIOR

OVERVIEW Eleven items Ratings: Below Expectations Slightly Below Expectations Meets Expectations Exceeds Expectations Not Assessed

EXAMPLE OF ITEMS Honesty and integrity Cultural/ generational

sensitivity and respect for diversity

Respect for dignity, worth of others

Professional identify (ability to describe and present oneself as a healthcare provider)

GOAL: DEVELOPING A MOBILE APP TO CONVEY PROFESSIONALISM CONTENT

Developed through collaboration with the VCU’s Department of Biomedical Engineering

Android and Apple prototypes for survey delivery

Bluetooth for capture of survey responses

Android and Apple prototype piloted with students and clinical evaluators in CLS, OT, PATC

Revisions in design and user satisfaction identified by focus groups

Content evaluation using factor analysis in progress

Content evaluation using Delphi technique launch in Summer 2015

Apple and Android revisions with Bluetooth capability to be piloted in Fall 2015

Continued discussions with VCU Office of Research

THE AHP APP: WHY A MOBILE DEVICE

Mobile devices increasingly used in patient care

Novel, innovative option for tech-savvy population

Personal devices readily available

Easy one-touch access to professionalism survey

Synchronization of student self assessment and clinical evaluator assessment via Bluetooth

Electronic tracking of student assessments over time

GOAL: ASSESS EFFECTIVENESS OF MOBILE DEVICE

Mixed methods techniques

Qualitative methods: student and clinical evaluator surveys and interviews and focus groups

Quantitative methods: student and evaluator usage captured through the app website

Systems User Satisfaction(SUS) Survey

Collected qualitative data

on Android prototype in Fall 2013

Collecting data on Apple prototype in Summer 2014

IRB Status as quality improvement

FEEDBACK ON ANDROID PROTOTYPE

Good instruction

s

Heading bar hard to find

Content appropriate, usually

Content quantity

ok,usually

Colors too bright

User friendly

and convenient

Time to complete

reasonable

Not sure technology promotes reflection

Add more open

ended questions

AHP APP DISSEMINATION TO DATE

SAHP clinical evaluators meeting in Summer 2013, Summer 2014

VCU Office of Research- Intellectual Property

Poster session: 2013 ASAHP Conference; Poster session: 2014 Emswiller IPE Conference Poster session: VCU SOE Student Project Seminar Poster session: 2014 All Together Better Health Conference Workshop presentation: 2014 ACPE Conference Workshop presentation: 2015 Armstrong Interprofessional

Healthcare Summit Poster session: 2015 AOTA Conference

AHP APP DEVELOPMENTON-GOING INTERPROFESSIONAL

COLLABORATION

Core team of OT, Patient Counseling, Clinical Lab facultyContinued technical input from School of Engineering faculty

and studentsInvolvement of clinical educators/evaluators from diverse

clinical professions in content evaluationInvolvement of Biostatistics faculty and students in content

evaluationInvolvement of SAHP clinical educators/evaluators and

students in beta testingInvolvement of OT graduate students in app delivery

evaluation and literature updatesInvolvement of Office of Research professionals in copyright

and distribution activities

AHP APP: THE JOURNEY CONTINUES

AHP APP Apple prototype focusRefinement, refinement, refinementExpansion to other SAHP disciplines in 2014-

2015 academic yearIntellectual property protection pursuitContinued collaboration with SOE and funded

research

AHP APP: SNEAK PREVIEW OF CURRENT VERSION

Introductory Screen

Instructions Screen

Survey Launch Screen

Professionalism Dimension Screen

Future Use of Mobile App

Increase number of ratersReduce administrative staff time for data

analysis/inputInter-professional comparisons within SAHPPotential expansion to other health services

areas

AHP APP

Your comments and questions welcomed

Thank you for your interest!