oha np conference feb 19, 2001 von np project evaluation oha np conference feb 19, 2001 von np...
TRANSCRIPT
OHA NP Conference Feb 19, 2001
VON NP Project Evaluation
OHA NP Conference Feb 19, 2001
VON NP Project Evaluation
VON NP
Evaluation
Framework
Janet Helmer RN(EC)
Director of Standards and
QM
VON NP
Evaluation
Framework
Janet Helmer RN(EC)
Director of Standards and
QM
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
About VON Canada
• Charitable, not-for-profit health care organization
• Offers services in 1,300 communities across Canada
• More than 15,000 volunteers and 8,000 staff• Many programs respond to the needs of
disenfranchised, marginalized populations• Community health programs based on the
community development model
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
VON Nurse PractitionerPilot Projects:
• Grey Bruce - Clinic, Outreach• Porcupine - Clinic, Outreach• Brant County- 4 agency- VON BNF• Sudbury - Clinic, School, Outreach• Eastern Counties - Clinic• North Bay - partner - multi-agency
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
A Quality System
is one that can be
measured
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
DELIVERY SYSTEMOperationalization
- business plan - budget - work plans - best practices
PERFORMANCEMEASUREMENT
SYSTEM
QUALITYIMPROVEMENT
SYSTEMP
A DC
LEADERSHIP SYSTEM Mission Vision Strategic Planning Implementation Evaluation
HUMAN PERFORMANCESYSTEM
succession plan
retention HR planning
reward & recognition recruiting
evaluating hiring
training & educatio n orientation
RESEARCH & INNOVATION - customer input/feedback - academic literature - research activities - external best practices - experts in the field
(A)Performance Measures(indicators) in 3 spheres:structure, process,outcomei) Organizational level (BS)ii) Program level (PLM)iii) Team level (CVC)iv) Individual level (PA)
B) Accreditation
C) Benchmarking
D) Branch Self- Assessment & Peer Review
VONACCOUNTABILITYFRAMEWORK
Accfram2 (150800)
Legend:BS = balanced scorecardPLM = program logic modelCVC = clinical valve compassPA = performance appraisal
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
Accountability is where objective information is gathered, analyzed and shared so that all partners can be held
accountable for their actions….and…..
decisions are informed by facts: evidence-based decision making
(EBDM)
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
Why strive to develop a common VON Evaluation Framework?
* Create common approaches / tools* Ability to roll-up data* Supportive VON NP network* Address common issues/challenges* Learn form each other
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
Key Criteria for VON Evaluation Framework
1. Support/augment provincial NP data collection and reporting requirements
2. IT database to support reporting and analysis
3. User-friendly - NPs 4. Applicable across the breadth of
programs 5. Create IT/IM solution to support
program administrative functions6. Provide data to support individual
Branch pilot evaluations
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
Evaluation Components
• Client Encounter data collection tool
• Client Satisfaction tool
• Client Perception of Health - SF 12
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
Client Encounter Data Collection Tool
Development• Exploration of existing tools- paper based and software (Purkinje)
• Software solution eliminated -cost prohibitive although there were many potential benefits
• Client Data Collection tool (Mary Bear et al) utilized as basis (adaptation) for VON
tool development •VON tool Web-based application with
database currently being developed and tested
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
Strengths of the Client Encounter tool
• Database supports pilot-specific reporting• Breakdown of NP service- preventative care, episodic, management of chronic health problems•Supportive/Counseling Interventions: 3 broad areas of intervention
i) health information (cognitive)
ii) affect support
iii) goal setting
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
Client Satisfaction Tool
•Adapted from Mary Bear et al Client Satisfaction tool • Measures client perspective on quality dimensions such as accessibility, responsiveness, system competency, involvement in decision making, health information• limited to one-to-one encounters
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
Client’s Perception of HealthSF-12
- given permission to use tool
- ideally to be used at 2 points along the NPs continuum of care with a client
The VON NP Evaluation FrameworkThe VON NP Evaluation Framework
CHALLENGES with Evaluation of VON NP Projects
• Lack of funding for NP project administrative functions- NPs are required to multi-task
• Timing of program evaluation in connection with the pilot project start-up and data-collection methodology
• Lack of clarity for indicators which will ensure continuance of funding - non-pilot status