social investment indonesia_program evaluation & measurement
DESCRIPTION
TRANSCRIPT
Pemantauan, Evaluasi & Pengukuran Program
Social Investment Indonesia www.socialinvestment-id.com
Pelatihan Pengembangan Investasi Sosial Strategis Surabaya, 16-17 Juli 2012
1. Social Impact Assessment 2. Metode Pemantauan dan
Evaluasi Program 3. SROI 4. Study Case
Agenda Sesi Ini
“Organiza)on impact: posi)ve or nega)ve change to society, economy or the environment, wholly or par)ally resul)ng from an organiza)on's past and present decisions and ac)vi)es” (ISO 26000)
1. Social Impact Assessment
Tipikal Isu dalam SIA • Demografik • Sosial Ekonomi • Kesehatan Lingkungan • Infrastruktur Sosial • Sumberdaya • Perubahan Aspek-Aspek
Komunitas • Properti Kultural
• Karakteris)k Investasi • Latar Belakang Sejarah Area • Screening Pendahulauan tentang Isu Sosial
• Tuntutan Legal • Objek)f Perusahaan • Iden)fikasi Pemangku Kepen)ngan
Cakupan dan Batasan
Variable Dalam Penilaian dampak sosial
• Populasi dan Demografik; pertumbuhan penduduk-migrasi, suku, agama, pendidikan dll
• Infrastuktur Sosial: Transportasi, Air Bersih, Energi, Telekomunikasi, Ekonomi, Pendidikan, Kesehatan dll
• Penyakit Sosial; Gangguan keamanan Domestik, Lokal, Perubahan Karakteristik, Prostitusi dll
• Kebiasaan dan Budaya; perubahan budaya keluarga, perubahan pola kehidupan ekonomi, penilaian akan aset, Perubahan Pola Institusi dll
• Keseimbangan Lingkungan; Lahan, Polutan, Keanekaragaman Hayati dan Fauna dll
Kebutuhan Akan Data MEMPENGARUHI VARIABLE
Transparansi dan Akunbilitas
Validasi dan Verifikasi
MONITORING & EVALUASI
Plan: Identifikasi dan Analisa permasalahan Do: Pengembangan dan alternatif Solusi. Check: Pengukuran efektivitas alternatif solusi dan analisa perbaikakan Act: Implementasi penuh solusi perbaikkan
2. Metode Pemantauan dan Evaluasi Program
. Kegunaan Pemantauan dan Evaluasi Program Investasi Sosial (CI) adalah menyediakan alat bagi pelaksana CI dalam pembelajaran atas kejadian masa lampau, meningkatkan kualitas, perencanaan dan alokasi sumberdaya dalam kegiatan CI
• Performance Indicators • The Logical Framework Approach • Theory-based Evaluation • Formal Survey • Rapid Appraisal Methods • Participatory Methods • Public Expenditure Tracking Survey • Impact Evaluation • Cost Benefit and Cost-effectiveness Analysis • Social Return of Investment (SROI) World Bank, 2002 Monitoring & Evaluation: Some Tools, Methods & Approaches
Pemantauan dan Evaluasi Program metode, pengukuran dan Pendekatan
Rapid Appraisal Methods
• Providing rapid information for management decision-making, especially at the project or program level
• Providing qualitative understanding of complex socioeconomic changes, highly interactive social situations, or people’s values, motivations, and reactions
• Providing context and interpretation for quantitative data collected by more formal methods
Rapid Appraisal Data Collection Key informant interview—a series of open-ended questions posed to individuals selected for their knowledge and experience in a topic of interest. Interviews are qualitative, in-depth, and semi-structured. Focus group discussion—a facilitated discussion among 8–12 carefully selected participants with similar backgrounds. Participants might be beneficiaries or program staff, for example. The facilitator uses a discussion guide. Note-takers record comments and observations. Community group interview—a series of questions and facilitated discussion in a meeting open to all community members and a carefully prepared questionnaire Direct observation—use of a detailed observation form to record what is seen and heard at a program site. The information may be about ongoing activities, processes, discussions, social interactions, and observable results. Mini-survey—a structured questionnaire with a limited number of close-ended questions that is administered to 50–75 people. Selection of respondents may be random or ‘purposive’
3. SROI Social Return on Investment (SROI) is a framework for measuring and accounting for this much broader concept of value; it seeks to reduce inequality and environmental degradation and improve wellbeing by incorporating social, environmental and economic costs and benefits. as a viable approach to measuring the extent to which social impacts are being achieved The calculation based on outcomes, inputs are applied to service activities to produce outputs, from which outcomes are derived, which result in impacts In those terms, the purpose of SROI is to examine the relationship between inputs and impact
TIPIKAL SROI
There are two types of SROI: •• Evaluative, which is conducted retrospectively and based on actual outcomes that have already taken place. •• Forecast, which predicts how much social value will be created if the activities meet their intended outcomes.
Prinsip SROI
•• Involve stakeholders. •• Understand what changes. •• Value the things that matter. •• Only include what is material. •• Do not over-claim. •• Be transparent. •• Verify the result.
The stages in SROI
1. Establishing scope and identifying key stakeholders.
2. Mapping outcomes. 3. Evidencing outcomes and giving
them a value. 4. Establishing impact. 5. Calculating the SROI. 6. Reporting, using and embedding
4. Study Case SROI Analysis
Suatu Perusahaan dalam CI Merencanakan program pemberdayaan masyarakat melalui kegiatan pelatihan peningkatan kualitas hasil karet
1. Identifikasi Stakeholder dan Cakupan Objektif Program
• Stakeholder Management Plan • Objektif Tanaman Karet • Cakupan Geografis dan Demografis • Alokasi Sumberdaya Internal dan External • Alignment Program • Timeframe
2. Mapping Outcomes Outcomes: Tujuan yang akan dicapai dari program pelatihan: 1. Peningkatan pendapatan petani karet 2. Peningkatan nilai jual hasil karet petani 3. Peningkatan kapasitas petani 4. Alih tepat guna
3. Evidencing outcomes and giving them a value������Pembuktian Outcomes dan memberikan Nilai yaitu dengan validasi dan verifikasi dari hasil mapping outcomes dalam pelatihan tersebut������1. Apakah pendapatan petani menjadi naik dari hasil karet?���2. Apakah ada peningkatan kapasitas dan alih teknologi tepat guna yang dipraktekkan keseharian oleh petani?������Berikan Value secara real angka-angka tersebut berdasarkan data verifikasi dan Validitas ������������������
4. Establishing Impact
Peningkatan Kesejateraan Keluarga Petani Karet
Meningkatkan kualitas hidup keluarga petani dari program CI
Memperbesar akses ke pendidikan lebih tinggi pada anak
Memperbesar akses ke kesehatan keluarga pada ibu
5. Calculating the SROI • Data Dasar 1. Pendapatan petani sebelum mengikuti program
pelatihan 2. Biaya Pelatihan 3. Biaya-Biaya dalam Pendidikan dan Kesehatan keluarga • Data Primer hasil verifikasi dan validasi 1. Total Present Value 2. Net Present Value 3. SROI
Ilustrasi: A. Total Input : 50juta B. Total Present Value: 100juta Net Present Value: Total Present Value – Total Input= 50juta C. SROI = Total Present Value/Total Input = 2 Dalam Pelatihan Tersebut: Ada nilai 2 Rupiah dari setiap 1 Rupiah yang di investasikan
Catatan SROI
1. SROI adalah penghitungan “Nilai” bukan dalam hitungan angka Rupiah
2. Masih floating bentuk panduan sehingga masih diperlukan pengembangan lebih lanjut
3. Butuh Uji lebih luas 4. Konsistensi antara batasan Outcomes dan
Impact 5. Masih memakai analisa Judgemental
Terima Kasih !������������
Social Investment Indonesia www.socialinvestment-id.com