![Page 1: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/1.jpg)
Stronger health systems. Greater health impact.
Proximal, Distal and Everything In Between:
Measuring Organizational CapacityPresenter: Stephanie Calves, Dr. Reshma TrasiDate: March 7, 2014
![Page 2: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/2.jpg)
2Management Sciences for Health
Agenda
• Guiding principles and frameworks • Standardized organizational capacity assessment• Benchmarking • 5 steps for measuring organizational capacity
![Page 3: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/3.jpg)
3Management Sciences for Health
Is Capacity Building = the 500lb elephant with the blind men?
![Page 4: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/4.jpg)
4Management Sciences for Health
Click to edit Master title style
First, some guiding principles…
![Page 5: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/5.jpg)
5Management Sciences for Health
Principles for Measuring Capacity Development: The 7 Cs
Centrality
Complexity
Contextuality
Compre-hensiveness
Collaboration
Causality
Continuum
![Page 6: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/6.jpg)
6Management Sciences for Health
Click to edit Master title style
Multiple frameworks exist!
![Page 7: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/7.jpg)
7Management Sciences for Health
PEPFAR Framework
![Page 8: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/8.jpg)
8Management Sciences for Health
World Bank Framework
![Page 9: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/9.jpg)
9Management Sciences for Health
The Capabilities Framework
![Page 10: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/10.jpg)
10Management Sciences for Health
The Human and Institutional Capacity Development Framework
![Page 11: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/11.jpg)
11Management Sciences for Health
Capacity Development Cycle: Cyclical Process for Building Strong and Sustainable Organizations
ENGAGE
ASSESS
FORMULATEIMPLEMENT
EVALUATE
ENGAGE
ASSESS
FORMULATEIMPLEMENT
EVALUATE
ENGAGE
ASSESS
FORMIILATEIMPLEMENT
EVALUATE
Organizational CapacityWeak Strong
Org
aniz
atio
nal
Mat
uri
ty
Partner Lead, with External mentorshipExternally Lead and Supported
Sustainable Organization
![Page 12: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/12.jpg)
12Management Sciences for Health
The Seed-to-Tree Growth Model
![Page 13: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/13.jpg)
13Management Sciences for Health
…So, does this mean we need a standardized instrument
to measure capacity change over time?
…we’re glad you asked!
![Page 14: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/14.jpg)
14Management Sciences for Health
Agenda
• Guiding principles and frameworks • Standardized organizational capacity assessment• Benchmarking• 5 steps for measuring organizational capacity
![Page 15: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/15.jpg)
15Management Sciences for Health
MSH’s Standard Organizational Capacity Domains1. Governance and Leadership2. Resource Mobilization3. Financial Management and Operations4. Human Resource Management5. Grants and sub-grants Management6. Project/Program Management7. M&E, Communications, and Knowledge Management
Government 8. Coordination and Collaboration9. Service deliveryCSOs 10. Advocacy, Networking, and Alliance Building11. Service Delivery and Quality Assurance
![Page 16: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/16.jpg)
16Management Sciences for Health
Standard application and delivery
Facilitation Pre-assessment: Alignment Meeting and
Stakeholder Engagement Pre-assessment: Orientation of Internal and
External Facilitators Assessment and Consensus Building Reporting Development of a capacity development plan Coaching and mentoring Repeat organizational capacity assessment
![Page 17: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/17.jpg)
17Management Sciences for Health
Agenda
• Guiding principles and frameworks • Standardized organizational capacity assessment• Benchmarking• 5 steps for measuring organizational capacity
![Page 18: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/18.jpg)
18Management Sciences for Health
What are Capacity Benchmarks?
Benchmark Definition: A standard or point of reference against which things may be compared or assessed.
Outcomes and/or outputs which reflect capacity, leadership, management, and accountability for functions within the organization.
Benchmarks should be linked to the M&E Plan.
Capacity Development Plan activities should aim to achieve the benchmarks. Not necessarily a 1-1 relationship
![Page 19: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/19.jpg)
19Management Sciences for Health
Benchmarking Logic Model - Example
OWNERSHIP BENCHMARKS
TRANSITION OUTCOME
BENCHMARK
INDICATOR
INDICATOR
INDICATOR
BENCHMARK
INDICATOR
INDICATOR
INDICATOR
INDICATORSTransition
Outcome
ACTIVITIES
ACTIVITIES
![Page 20: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/20.jpg)
20Management Sciences for Health
Benchmarking Logic Model
OwnershipBenchmarks
CHMT manages an effective QI
program through direct
oversight of clinical sites
All QI trainings in district are led by
CHMT Trainers
% of CHMTs with qualified QI trainers
% of QI trainings led by CHMT Trainers
% of QI officers completing QI recertification after 2 years
CHMTs conduct DQAs on QI Data
in Districts
% of CHMTs QI staff trained in DQAs
% of Districts where CHMT conducted DQA during the year
% of districts with 3 consecutive years of annual DQAs conducted by CHMT
Indicators
1. TOT on QI for CHMT Trainers
2. Mentor and evaluate trainers
1. Develop DQA process2. Train CHMT point
persons on process3. Mentorship during
DQA implementation
Transition
Outcome
Activities
![Page 21: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/21.jpg)
21Management Sciences for Health
Agenda
• Guiding principles and frameworks • Standardizing organizational capacity
assessment: experience from 5 countries• Benchmarking: experience from Afghanistan• 5 steps for measuring organizational capacity
![Page 22: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/22.jpg)
22Management Sciences for Health
5 Steps to developing an M&E plan
1. What change do you want to measure? Logic Model Input, process, output, outcome measures
Skills, behaviors, competencies Application of skills, behaviors, competencies Organizational performance Service delivery improvements
Benchmarks/milestones Centrality of the organization’s desired outcomes
2. How do you want to measure change? Standard instrument, applied uniformly Mixed methods
![Page 23: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/23.jpg)
23Management Sciences for Health
5 Steps to developing an M&E plan
3. How often? For how long? Sustainable performance
4. How will the data be analyzed and used? Automation for immediate sharing and use
5. Review. Refine. Revise. Standardize.
![Page 24: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/24.jpg)
24Management Sciences for Health
Examples of Automation: Instant Results and Analysis
Governance
Planning & Resource Mobilisation
Financial Planning & Management
Grants Management
Human Resource Management
Communication
Project Management
Monitoring & Evaluation
4
3
4
4
3
3
3
3
![Page 25: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/25.jpg)
25Management Sciences for Health
Agenda
Guiding principles and frameworks Standardizing organizational capacity assessment:
experience from 5 countriesBenchmarking: experience from Afghanistan5 steps for measuring organizational capacity
![Page 26: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/26.jpg)
26Management Sciences for Health
Stronger health systems. Greater health impact.
![Page 27: Stronger health systems. Greater health impact. Proximal, Distal and Everything In Between: Measuring Organizational Capacity Presenter: Stephanie Calves,](https://reader035.vdocuments.mx/reader035/viewer/2022062620/551a0010550346ab0c8b4a55/html5/thumbnails/27.jpg)
The Closing Session will begin at4pm in the Grand Ballroom.
Closing remarks will be followed bya 30-minute social gathering
(refreshments will be served). Comemeet new people and discuss the
highlights of the day!
Please fill out an evaluation by going
to this session’s page on your mobile app OR by filling out a paper evaluation in the back of the
room.
Thank you!