inter-action epewg meeting
DESCRIPTION
Inter-Action EPEWG Meeting. “Measuring Agency-Level Results: Can it work, and does it matter?”. Tracking Beneficiaries and Services Delivered. Harry (“Hap”) Carr, Senior Technical Advisor for M&E Catholic Relief Services (CRS). April 10, 2013. - PowerPoint PPT PresentationTRANSCRIPT
Inter-Action EPEWG Meeting
Harry (“Hap”) Carr, Senior Technical Advisor for M&E
Catholic Relief Services (CRS)
Tracking Beneficiariesand
Services Delivered
April 10, 2013
“Measuring Agency-Level Results: Can it work, and does it matter?”
Beneficiary and Service Delivery Indicators (BSDI)
Measure Agency-wide Performance
CRS Fundamental Program Outputs
on
Services Deliveredand
Beneficiaries ServedInter-Action EPEWG Meeting Presentation
Types of Benefits in CRS Projects
Benefits / ServicesBenefits / Services
Direct Beneficiaries
Indirect Beneficiaries
Policy Advocacy
Environmental Protection
Institutional Strengthening
BSDI
Not BSDI
Inter-Action EPEWG Meeting Presentation
CRS Services and Benefits
Eight Current CRS Program Areas:
MicrofinanceAgricultureHealthHIV-AIDSEducationPeacebuildingWater and SanitationEmergency
Inter-Action EPEWG Meeting Presentation
Water and Sanitation
Inter-Action EPEWG Meeting Presentation
Emergency Services and Beneficiaries
Program Area
Sub-Program
Area
Service Means of Service
Delivery
Direct Beneficiary Definition
Indirect Beneficiary Definition
Emergency Shelter TransitionalShelter
Training
Individual household member
Technical Assistance
Assets(Shelter Kit)
Commodities Other
Illustrative Service Categories
Inter-Action EPEWG Meeting Presentation
BSDI Data Flow Map
Point of Service Delivery
Beneficiary and service delivery data are registered
Regional/Partner Office
Beneficiary and service delivery data are recorded and records
are updated
Project Management Office
Beneficiary and services delivery data are stored, maintained,
analyzed and reported
Data
Data
On-line AgencyDatabase (PIMS) Donor
ReportsData
Typically data are recorded on paper for individual beneficiary
Typically data are transcribed to Excel files
Typically data are stored in a project database
Digital Data
Inter-Action EPEWG Meeting Presentation
BSDI Performance Measurement Products
BSDI allows accurate, annual agency-wide tracking of CRS performance
“Number” and “% targeted” of direct beneficiaries served” bySub-program area service categoriesGeographic location (GPS) point of service deliveryGender and other beneficiary demographic characteristics
BSDI allows integrated technical and financial performance analysis
BSDI will track “double counted” beneficiaries in a multi-sector projects
“Costs per beneficiary by service”
Title II Project beneficiary of nutrition, agriculture and microfinance services
Inter-Action EPEWG Meeting Presentation
BSDI Actions in the Last Year
Field Validation VisitsWest Africa region projects – March 2012Latin America And Caribbean region projects – May 2012
Pilot Test of BSDI – June to December 2012CRS Emergency projects in the Sahel Crisis Area
Coordination with other CRS data management initiativesProject Information Management SystemEast Africa M&E/ICT initiativeData Stewardship Group
Inter-Action EPEWG Meeting Presentation
Comparison with Other AgenciesSave the Children “Beneficiary Reach”International Red Cross “People Reached Indicator”USAID/State Foreign Assistance Framework – Elements and Sub-Elements
BSDI Catapult
March 2013 CRS Board Meeting and
FY2012 CRS Annual Report
Inter-Action EPEWG Meeting Presentation
FY2012 Beneficiary Survey
FY2012 Beneficiary Survey
Inter-Action EPEWG Meeting Presentation
Short-fused request for FY12 beneficiary data:From CEO – so it was importantFinal data needed within 2 ½ months from requestData to include Direct and Indirect BeneficiariesBy major CRS program areasTo be submitted through the CRS financial data reporting system
On newly designed screens and procedures for data entryThree weeks were allowed for field data collection and reporting
Current CRS procedures for collecting beneficiary data: In the BSDI Catalogue of Services and Beneficiaries –
Service area categories had been largely formulatedMost Direct Beneficiary definitions had been formulatedFew Indirect Beneficiary definitions had bee n formulated
There were no common procedures for beneficiary data collection
Beneficiary Survey Lessons Learned
Lessons Learned… for the type and level of detail in guidance
Lessons Learned…regarding our reporting of beneficiaries:
How best to formulate guidance for data gathering and data entry
There were some problems with the eBudget software BUT
Data can be easily entered into the system
Common definitions of Indirect Beneficiaries for similar projects was difficult
Beneficiary data reported in the past were generally – Estimated from budget reports and wereOver-estimates
Inter-Action EPEWG Meeting Presentation
There is value in having accurate, timely beneficiary data
Output versus Outcome Indicators
There has been an on-going discussion at CRS – Not formally organized,Part of various data management efforts going onIn which the importance of measuring CRS results was paramount
We have tacitly settled on –
In the longer-term goal of Outcome Indicators
The primary importance of Beneficiary Data
…For selected selected program areas
Inter-Action EPEWG Meeting Presentation