end of grant evaluation report

119
2015 World Vision Typhoon Haiyan Response May 2015 End of Grant Evaluation Report

Upload: others

Post on 03-Oct-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: End of Grant Evaluation Report

2015

World Vision

Typhoon Haiyan Response

May 2015

End of Grant Evaluation Report

Page 2: End of Grant Evaluation Report

i | P a g e

Prepared by:

Page 3: End of Grant Evaluation Report

ii | P a g e

Table of contents

Acknowledgements ________________________________________________________ iii

List of tables ______________________________________________________________ v

List of figures _____________________________________________________________ vi

Executive summary________________________________________________________ vii

Purpose of the evaluation ___________________________________________________ 1

Summary of methods _______________________________________________________ 2

Overview of grant programmes ______________________________________________ 4

Evaluation criteria _________________________________________________________ 9

I. RELEVANCE _______________________________________________________________ 9

II. TIMELINESS ______________________________________________________________ 15

III. EFFICIENCY _____________________________________________________________ 18

IV. EFFECTIVENESS _________________________________________________________ 25 Outcome 1: Typhoon-affected families and communities have improved living conditions and access to

basic services _________________________________________________________________ 27 Outcome 2: Typhoon-affected families have restored affected livelihoods and increased capital and asset

base _______________________________________________________________________ 37 Outcome 4: Typhoon-affected communities, families including children are empowered to inform World

Vision Response programming ____________________________________________________ 43

Resilience ________________________________________________________________ 52

Conclusions and recommendations __________________________________________ 63

Annex A: Acronyms and abbreviations _______________________________________ 65

Annex B: Methodology ____________________________________________________ 66

Annex C: Supplemental tables and figures ____________________________________ 73

Annex D: Community validation notes _______________________________________ 86

Annex E: Household survey tool _____________________________________________ 98

Annex F: CL tool and focus group guidelines __________________________________ 98

Annex G: Response logframe _______________________________________________ 98

Page 4: End of Grant Evaluation Report

iii | P a g e

Acknowledgements

This report is the product of an internal-external evaluation team, including national office and global

centre technical support. Funding for the end of grant evaluation was provided by the four Typhoon

Haiyan Response grant programmes under evaluation. If anyone has been inadvertently left out of

this acknowledgement, we extend an apology and are so grateful for the support.

Evaluation team leader: Pat Ryan Gaid, Design, Monitoring & Evaluation (DME) Manager

Qualitative data collection & analysis: Rachel Bernu, Consultant, and Dexter Mancao, DME

Coordinator

Quantitative data collection: Pat Ryan Gaid, DME Manager

Quantitative analysis & report writing: Maryada Vallet, Research Associate with TANGO

International

The survey team wishes to thank Angel Theodora (Response Director), Sean Ng (Programmes

Director) and Josaias Dela Cruz (National Director) for their support to the grants evaluation

process. Gratitude also goes to the zonal managers and support staff in the zones where the survey

took place. At the global level, advising was provided by Jamo Huddle, Humanitarian and Emergency

Affairs (HEA) Director of H-Accountability & DME and Kathy Duryee, DME Specialist for HEA.

Thanks, too, to So Wan Suen and Dineen Tupa who took over as Programmes Director and

Response Director, respectively, in the later part of the evaluation process for their valuable inputs

in the review of this report.

The monumental efforts of Jennina June Leira Lanza and Aivon Guanco were also instrumental in

ensuring the EOG Evaluation was carried out with success. Yheleen Veso’s support in providing

needed information specific to the grants was also helpful.

We also thank the team leaders and survey staff who worked hard to collect the highest possible

quality of data:

Eastern Leyte:

Qualitative- Julie Ruth Martija (Team Leader), John Alvin Redona, Christopher Chu, and

Glenda Macabacyao

Quantitative- Christian Vie Baldonado (Team Leader), Philip Antoni, Reniel Mangampo,

Darwin Piamonte, Bridget Amplayo, Kenn Daniel Cale, Ginbert Cuaton, Jovany Damayo, Pia

Pascasio, Divine Tan, Hyrbe Tuazon

Western Leyte:

Qualitative- Pathy Rose Aborque (Team Leader), Jonel Chiu, Victoria Lasayda, Roswel Capin

and Mary Joy Seno

Quantitative- Fidelito Mariveles (Team Leader), Aldrin Abaracosso, Edelyn Apuya, Jojie

Arevalo, Roswell Capin, Manil Carlubos, Jeanive Casimong, Ana Marie Febra, Macgyver Ong,

Bryan Silao, Mark Yugo

North Cebu:

Qualitative- Ma. Carla Sinining (Team Leader), Ma. Era Santillan, Nikki Aroma, Sherwin

Manlunas, and Emman Castano

Quantitative- Meraldy Donoz (Team Leader), Fatima Boter, Sheramie Jimeno, Kristine Joyce

Juban, Mayet Tabunyag, Christian Lester Jayson, Reve Gracelle Estrella, Lucia Enguito, Carmelita

Wagas, Bon Jovi Cabanero, Em Em Emia

Page 5: End of Grant Evaluation Report

iv | P a g e

Panay:

Qualitative- Andy Cabading (Team Leader), Angela Marie Almalbis, Ma.Rachelle Diama, Klein

Pearl Deztreza, and Janine Abasiar

Quantitative- Lenie Tamayo (Team Leader), Dyna Calanza, Adrian Contillo, Maria Gina

Adremisin, Beth Alasa, Gennil Tribunsay, Rachelle Dillera, Joen Cerillo, Gerome Estores,

Princess Calanza, Ebony Parcia

Photo credit: Communications Team, Typhoon Haiyan Response

Most importantly we express our deepest gratitude to the girls, boys, men and women who spent

time with our survey teams to describe the impact of WV assistance on their lives since the

typhoon.

Page 6: End of Grant Evaluation Report

v | P a g e

List of tables Table 1: EOG evaluation community participation, by tool and zone _____________________________________ 3 Table 2: Grant programme overview, budget, timeframe, activity targets and outputs ________________________ 4 Table 3: Grant programme overview, disaggregated by surveyed barangay and grant _________________________ 5 Table 4: Priority problems in aftermath of Typhoon Haiyan ___________________________________________ 10 Table 5: Efficiency: relationship between NO and Response __________________________________________ 18 Table 6: Efficiency: EMS structure _____________________________________________________________ 19 Table 7: Efficiency: preparedness ______________________________________________________________ 20 Table 8: Efficiency: staffing __________________________________________________________________ 21 Table 9: Efficiency: programming ______________________________________________________________ 22 Table 10: Efficiency: external relations __________________________________________________________ 24 Table 11: Response outcomes and outputs for three EOG evaluation donors ______________________________ 25 Table 12: Types of suggestions to make reported activities more beneficial, by zone ________________________ 26 Table 13: Percent of Leyte HHs fully able to provide for their drinking water needs _________________________ 31 Table 14: Copies strategies index (CSI) score, by zone ______________________________________________ 60 Table 15: Coping strategies recalled by children and current CSI indicator used often/daily ____________________ 60 Table 16: EOG evaluation community participation, by tool and zone ___________________________________ 68 Table 17: Survey sampling, disaggregated by barangay and grant ______________________________________ 69 Table 18: Percent of HHs reporting assistance from WV THR, by zone __________________________________ 73 Table 19: HH perception of most useful activities, by zone ___________________________________________ 73 Table 20: Perceived benefits of reported projects, by zone ___________________________________________ 73 Table 21: Level of satisfaction with benefit of reported projects, by zone _________________________________ 74 Table 22: “Other” responses for improvement of benefits and frequency _________________________________ 74 Table 23: Beneficiaries of grant projects, by project type _____________________________________________ 75 Table 24: Level of satisfaction with beneficiary selection of reported projects, by zone _______________________ 75 Table 25: Full satisfaction with beneficiary selection of grant projects, by zone _____________________________ 75 Table 26: Reports of favours requested to be included in projects ______________________________________ 75 Table 27: Timeliness of reported projects, by zone _________________________________________________ 76 Table 28: Average number of meals eaten by adults and children reported by HH, by zone ___________________ 76 Table 29: HH main food sources in last 30 days, by zone ___________________________________________ 77 Table 30: Current HH stock of rice, by zone _____________________________________________________ 77 Table 31: HH coping strategies item scores, by zone _______________________________________________ 77 Table 32: HH methods for treating drinking water, by zone __________________________________________ 78 Table 33: HH access to improved sanitation facility, by zone _________________________________________ 78 Table 34: HH hand-washing practices, by zone ___________________________________________________ 78 Table 35: Soap used to wash hands in HHs, by zone _______________________________________________ 79 Table 36: Coping behaviour: HH member migration for food, by zone __________________________________ 79 Table 37: HH main income source during the last month, by zone _____________________________________ 79 Table 38: HH expenses, by zone ______________________________________________________________ 79 Table 39: HH ability to meet top expense, by zone ________________________________________________ 80 Table 40: WV projects helpful for HH to meet top expense, by zone ___________________________________ 80 Table 41: HH with outstanding loan, by zone _____________________________________________________ 80 Table 42: HH reasons for borrowing, by zone ____________________________________________________ 80 Table 43: HH main sources for loans, by zone ____________________________________________________ 81 Table 44: HH cash savings, by zone ___________________________________________________________ 81 Table 45: HH main sources for receiving information on WV projects, by zone ____________________________ 81 Table 46: HH methods used for providing feedback, by zone _________________________________________ 82 Table 47: Disasters since Typhoon Haiyan, by zone ________________________________________________ 82 Table 48: HH challenges in coping with disasters since Typhoon Haiyan, by zone __________________________ 82 Table 49: HH perceived preparedness for future disasters, by zone ____________________________________ 83 Table 50: Household demographics, by zone _____________________________________________________ 83

Page 7: End of Grant Evaluation Report

vi | P a g e

List of figures Figure 1: Country map indicating four EOG survey zones _____________________________________________ 2 Figure 2: Map of Response locations by zone and relief or recovery phase _________________________________ 6 Figure 3: Response sectors HHs benefited from/participated in (n=2956 projects1) __________________________ 7 Figure 4: Number of months HHs received assistance from projects (n=2958 projects1) ______________________ 8 Figure 5: Main beneficiaries of the projects named by households (n=2958 projects1) _______________________ 11 Figure 6: Percent of HHs that consider WV activities useful (n=1386)___________________________________ 12 Figure 7: Most useful WV projects (n=1291) _____________________________________________________ 13 Figure 8: Most useful activities done to address needs after typhoon from child FGDs (n=693 children’s votes) _____ 14 Figure 9: Top benefits from receiving WV assistance (n=2840 projects1) _________________________________ 26 Figure 10: HH recall of shelter at end of relief phase (n=5591)________________________________________ 28 Figure 11: HH drinking water needs met (n=1382) ________________________________________________ 31 Figure 12: HH main drinking water sources (n=1382) ______________________________________________ 32 Figure 13: HH primary toilet facility (n=1382) ____________________________________________________ 32 Figure 14: Hand-washing frequency of HH respondents (n=1381) _____________________________________ 33 Figure 15: HH to reduce expenditure on livelihood inputs to buy food in last 30 days, by zone (n=1382) _________ 38 Figure 16: HH main income sources during the last month, by zone (1382) ______________________________ 39 Figure 17: HH main expenses during the last month (n=1382) _______________________________________ 39 Figure 18: HH ability to “fully” meet top expenditure (n=1382) _______________________________________ 40 Figure 19: WV projects helpful for meeting HH expenses (n=1227) ____________________________________ 40 Figure 20: HH main reasons for borrowing money (n=732) __________________________________________ 41 Figure 21: HH cash savings (n=1382) __________________________________________________________ 42 Figure 22: HH fully satisfied with information received about WV and overall relief efforts (n=1382) ____________ 45 Figure 23: HH fully satisfied with mechanisms provided by WV to give input (n=1382) ______________________ 46 Figure 24: HH fully satisfied with how feedback/complaints were welcomed (n=1382) ______________________ 47 Figure 25: Methods available for providing feedback on WV projects (n=1382) ____________________________ 47 Figure 26: Why feedback method used was preferred (n=572) _______________________________________ 48 Figure 27: HH fully satisfied with WV Response to feedback and complaints (n=1382) ______________________ 49 Figure 28: Three capacities of resilience programming ______________________________________________ 52 Figure 29: Disasters communities have faced since Typhoon Haiyan (n=1353) ____________________________ 54 Figure 30: HH challenged to cope with subsequent disasters (n=1386) __________________________________ 54 Figure 31: HH better able to recover because of WV assistance (n=1009) _______________________________ 55 Figure 32: HH fully prepared to face another major disaster (n=1382) __________________________________ 56 Figure 33: HH needs to be prepared for future disaster (n=518) ______________________________________ 57 Figure 34: HH main food sources over last 30 days (n=1382) ________________________________________ 59 Figure 35: Food security coping behaviours in last 30 days (n=1382) ___________________________________ 61 Figure 36: Community leaders list interventions carried out by WV (n=40) _______________________________ 84 Figure 37: FGD priority problems in aftermath of Typhoon Haiyan _____________________________________ 84 Figure 38: Children recall the actors that addressed their priority needs __________________________________ 85 Figure 39: Children’s priority problems, recall from past and current ____________________________________ 58

Page 8: End of Grant Evaluation Report

vii | P a g e

Executive summary

Purpose and methods: The humanitarian community and governments swiftly responded to the

emergency needs of families and communities impacted by Typhoon Haiyan making landfall in the

Philippines on 8 November 2013. This report provides the results for the joint evaluation of four

major grant programmes from three donors that contributed substantially to the World Vision

Typhoon Haiyan Response (THR): Canadian Department of Foreign Affairs, Trade and Development

(DFATD, two programmes), Aktion Deutschland Hilft (ADH, Germany’s Relief Coalition) and

Samenwerkende Hulporganisaties (SHO, or Cooperating Aid Agencies of the Netherlands).

The purpose of this end-of-grant (EOG) evaluation is to understand how the four grant programmes

of the larger WV THR contributed to the recovery of the affected, target families and communities

in the relief (November 2013-April 2014) and recovery (February-December 2014) phases of the

Response. Of particular interest is how the grant programmes of the THR contributed to achieving

the Response outcomes in the four zones and achieving the goal of building resilience capacity, or

the ability to cope with and bounce back from a disaster.

The EOG evaluation was conducted in February 2015 across four survey zones: East Leyte, West

Leyte, North Cebu and Panay. A mixed methods approach was used with qualitative and quantitative

primary data sources. The sources include the household (HH) survey (n=1386), community leader

(CL) survey (n=40) and focus group discussions (FGD) with 231 girls and boys. Primary data

collected from WV staff through key informant interviews (KII) and other surveys are also presented

from a year prior to the EOG; note, this information informed the real-time evaluation following the

relief phase. A desk review of over 35 key Response documents also informed the evaluation. These

sources provided valuable insight into the contribution of the grant programmes to the outcomes

and goal of the larger WV Response.

OVERVIEW OF GRANTS

The activities of the four grant programmes spanned various Response sectors, phases and

geographic zones. DFATD 1 was implemented in three zones (East Leyte, North Cebu and Panay)

during the relief phase, and DFATD 2 provided funding from the same donor for recovery phase

activities that shifted focused in a different geographic zone, namely West Leyte. SHO was primarily

Page 9: End of Grant Evaluation Report

viii | P a g e

a relief phase contribution implemented in all four zones, with shelter toolkits that extended into the

recovery. ADH began mid-relief and extended through the recovery phase, focusing on East Leyte.

See the table that follows for an overview of the grant budget, timeframe, activities and zone. The

geographic focus narrowed for the recovery phase to the most severely impacted municipalities and

barangays, mostly in the Leyte zones.1 The programming continued in the remaining areas, and

Response offices were phased out in August 2014 for North Cebu and in March 2015 for Panay.

Grant Budget

(USD)

Timeframe

[phase] Activities1 Geographic

zone

DFATD 1

$1,749,216 Nov. 2013-

May 2014

relief

Shelter kits (emergency) East Leyte,

North Cebu,

Panay Non-food item (NFI) kit

distribution

Hygiene kit distribution

Solar lamp distribution

Child friendly spaces (CFS),

transitioned to temporary learning

spaces (TLS)

Women and young children spaces

(WAYCS)

DFATD 2

$2,989,472 Feb. 2014-

March 2015

(extended to

June 2015)

recovery

Shelter (A & B)

Cash for work (CFW)

Water systems

Latrines (Package A/B, PhATS) and

hygiene promotion

Livelihood trainings/ business start-

up/inputs

West Leyte

SHO

$851,935 Nov. 2013-

Feb. 2014

(extended to

July 2014)

relief

NFI distribution

Hygiene kit distribution

Shelter kits (emergency) plus

toolkits (extended to recovery)

Programme management support

East Leyte,

West Leyte,

North Cebu,

Panay

ADH

$4,728,334 Jan. 2014-

Dec. 2014

(extended to

March 2015)

mid-relief to

recovery

Shelter (A & B)

CFW

Latrines

Livelihood- livestock, agriculture,

community gardens

East Leyte

1 Activity kit/package descriptions:

Shelter kits: Two 4m x 6m tarpaulins and one 20m rope per HH, per SPHERE and IFRC standards

NFI kits: Blankets, mosquito nets, plastic mats and can openers

Hygiene kits: Bath soap, laundry soap, sanitary pads, and underwear (gender-sensitive); replenishment items:

bath and laundry soap, toothbrush, toothpaste, sanitary pads

Shelter Type A and B: Shelter construction materials (lumber, nails, paint, etc.) and toolkits; Type B includes

construction assistance for the most vulnerable HH.

Latrines Package A and B: Kits include three bags of cement, two floor grates, sets of piping, toilet bowl

and reinforcement bar/ Package B includes construction assistance for the most vulnerable HH

Due to delays (see timeliness discussion) the recovery shelter activities generally started May-June

and the livelihood activities from November 2014-January 2015 (note: livelihood activities were not

1 World Vision Typhoon Haiyan Response (WV THR). 90-day Report. March 2014.

Page 10: End of Grant Evaluation Report

ix | P a g e

completed at the time of the EOG survey). All completed grant activities have met or exceeded

output targets to date, but the attainment of outputs is not part of this evaluation. The evaluation

criteria used by World Vision’s Humanitarian and Emergency Affairs (HEA) includes discussion of

relevance, timeliness, efficiency and effectiveness. The four criteria, as they relate to achieving the

outcomes and goal of the Response, serve as the main framework for presenting the evaluation

findings.

RELEVANCE

Relevance addresses the following questions: How well did THR correspond to local needs and

priorities? How did WV target the most vulnerable populations, and what were the challenges of

reaching vulnerable, affected populations? Did the project address priority problems faced by the

target areas and communities and was the project consistent with policies of both donors and

recipient governments (or agencies)?

Key findings on relevance:

WV grant programmes (DFATD 1, DFATD 2, SHO, ADH) correspond to the

priority needs of adults and children: relief items, CFW to buy food, shelter,

and livelihoods, among others. WV Response staff and programme documents

confirm this alignment.

The THR, including the grant activities within the larger THR, built upon the

strong existing external relationships of WVDF, and aligned with strategies and

priorities of WV, donors, government, the international humanitarian

community and community partners. WV Response staff and Response

documents including the rapid assessment and other primary data confirm this

alignment.

While the Response faced some challenges related to geographic and strategic

targeting approaches, the grant programmes as part of the THR sought to

target the most vulnerable by identifying those families that lost their homes

using agreed criteria. The criteria were based on analysis of context and

humanitarian need, was recognised as good practice by partners, and was

aligned with government and accountability standards.

The vast majority of beneficiary households (94%) were satisfied with

beneficiary selection for the activities they reported benefitting from or

participating in, with little variation across zones. Households understood the

main beneficiaries to be everyone in the community or the poorest, or those

with destroyed homes. Still, some WV staff, community leaders and HHs

expressed concern regarding the Response’s ability to reach the most

vulnerable or all those perceived to be deserving of assistance.

The grant activities addressed the priority needs of beneficiaries, as shown

through the finding that 94% of all households reported the activities to be

useful or beneficial, with the highest percentage in Panay and lowest percentage

in North Cebu.

The most useful activities named by surveyed households and children were

those addressing the needs of food (and other basic necessities, i.e., NFI, which

is relevant to these grants), shelter (Type A and B) and livelihoods. These were

also the activities there could have been more of, as noted by the households

that suggested the Response could have been more useful.

Page 11: End of Grant Evaluation Report

x | P a g e

TIMELINESS

Timeliness is defined as: To what degree did THR implement timely Response activities? Did the

programme respond in a timely manner to the affected community’s needs? What affected timely

delivery of assistance (including coordination issues), and what measures were taken by WV to

address the issues?

Key findings on timeliness:

Nearly all WV projects (98%) were reported to be on-time by surveyed

households. About two-thirds of WV staff felt that WV responded to the needs

of target communities in a timely manner. Community validation participants

agreed that the timeliest WV activities (related to these grants) were hygiene kits,

WASH activities and CFW. CFW was important and timely as the income was

used for food needs—filling the gap after distributions ended, educational

expenses for children and to pay debts.

The small number of projects reported as late (approximately two percent) by

households contributed to their experience of hunger, lack of income and assets,

insecurity and ill health, and possibly their willingness to participate with WV in

the future. Children and community leaders also recalled their vulnerable state in

the aftermath of the disaster when relief distributions were reportedly delayed.

Those few late projects were relief distributions and shelter activities as cited as

by WV staff, children’s FGD and community leaders, and by some households

(see above point). Delays were due to procurement and logistics issues as noted

by WV staff and programme documents. Community validation participants also

confirmed the tardiness of some shelter distributions, and that because some

households had already started their repairs the materials were sold.

WV surveyed staff reported that learning from past disasters contributed to the

readiness of the Response strategy and staff deployment. Improvements were

suggested for the timing of shelter activities, pre-positioning goods and contracts,

and streamlining procurement and administrative processes.

Key programme reports discussed the delays associated with logistics and

procurement and the pro-active decisions made to address the processes causing

the issues. At 90-days, the THR addressed the need for expedited, decentralised

decision-making around distributions and developed a logistics information

database. At 6-months and one-year, the challenges involved finding qualified

procurement and technical staff and finding adequate sources/suppliers for

materials (particularly for shelter and livelihoods projects), which are problems

inherent to all large-scale humanitarian responses where numerous agencies are

present and competing for inputs.

There was recognition early in the Response of the need to turn “outwards”

from a focus on organisational functions (i.e., staffing and logistics) to increased

external coordination as an important shift for the recovery phase. This increased

partnering and coordination approach improved the connectedness,

contextualisation and communications around operations to the reality of various

stakeholders on the ground (e.g., UN and humanitarian agencies, target

communities and local government). This coordination thus had potentially

positive, though sometimes indirect, implications for the timeliness and efficiency

of activities. Yet, there were some difficulties with coordination, particularly with

school reconstruction, that resulted in delays in implementation.

Page 12: End of Grant Evaluation Report

xi | P a g e

EFFICIENCY

Efficiency is defined as: To what degree did THR provide efficient support for programme

implementation? Were inputs (staff, time, money, equipment, relief goods) procured and/or used in

the best possible way to achieve outputs and could implementation have improved? Which main

factors influenced the efficiency of implementation such as supply chains, and how did this affect the

delivery of aid?

Key findings on efficiency:

Overall, the THR supported efficient grant programme implementation through

coordination that was established early-on and at all levels. Nearly two-thirds of WV

Response staff (63%) reported that WV used resources effectively and the Response was

well-organised. Field-level collaboration faced some issues related to communication and

clarification of roles. THR staff reported some important lessons learnt, namely: to

streamline grant management across functions, to include and engage all departments (e.g.,

P&C and supply chain) that have a key role to play in the grant design process, and to

strengthen adaptive management by acting on staff and community input on crucial

programming changes based on context.

Relationship between NO and Response: Coordination among leadership of

the NO, RO and Response was strong and supported the efficient implementation

of the programme. Global to field-level collaboration was strained at times due to

perceived lack of communication or consultation in decision-making, and for

instance this led to the establishment of some parallel Response resources.

Emergency management system (EMS): EMS provided a coherent

organisational structure that strengthened efficiency from the start of the

Response; some issues arose around managerial roles (as zonal rather than

sectoral) and the geographic isolation of some areas.

The main factors (inputs/processes) that increased efficiency and contributed to the

achievement of outputs were:

Preparedness: Learning and adaptations made from previous responses allowed

the RO and NO to be ready in terms of strategy, deployable staff and assessments

(e.g., readiness of smartphones);

External relations: Existing NO partnerships with the national government and

other humanitarian actors (i.e., other non-governmental organisations, cluster

coordination), as well as community and local government relationships;

Staffing: Strong operations team, secondments and international deployments;

M&E and communications: Commendable assessment efforts that provided the

evidence-base for programming, and strong communications/media to broadcast

the results; and

Relationship between NO and Response/Management: Strategic decision-

making allowed for a good transition from emergency to recovery phases.

The main factors (inputs/processes) that hindered efficiency were: (As noted above in the

timeliness section, these efficiency issues were strongly perceived by staff as contributing to

delays in timely delivery of programming.)

Preparedness and logistics: Lack of pre-positioned goods and contracts (for

procurement of supplies and for staffing) led to delays (as discussed in the previous

section on timeliness) and hindered efficiency procurement and logistics processes;

Page 13: End of Grant Evaluation Report

xii | P a g e

Staffing: Staffing challenges caused by hiring delays and low retention, and gaps in

staff capacity particularly for technical roles; and

Communications within Response: Rapidly changing context combined with

sometimes lacking communication (and information sharing) between operations

and programmes effects the continuity and longer term visions of projects.

"The combination of NO, RO, and global staff was remarkable." ~WV staff

EFFECTIVENESS

Effectiveness discussion includes: To what extent did the Response activities meet their intended

purpose? Were outcomes achieved? What is the evidence of both the impacts of the Response as

well as the unintended positive and negatives effects on the affected population since the disaster?

Key findings on overall effectiveness:

Overall, the reported household benefits of receiving WV assistance included

improvements to food security (26%), household economic security (14%), shelter (11%),

hygiene (10%) and safety (10%), as well as improved well-being for children. Most staff

also believed the THR was leading to the planned positive changes.

Satisfaction with the project benefits was high (households were somewhat to

fully satisfied with 99% of the projects). Extending the length of the projects was

the most common suggestion for maximising benefits.

Examples of evidence of effectiveness by outcome and activity

Outcome 1: Typhoon-affected families and communities have improved living conditions and

access to basic services

The grant programmes contributed to achieving Outcome 1 from the relief to the recovery phases.

EOG evaluation findings show that living conditions improved, ultimately impacting the ability of

children to learn, preventing illness and safety issues and enabling health for families and

communities. The unintended effect of delayed timing and challenges with procuring adequate

materials for shelter interventions impacted the ability of some families to build back better.

Shelter: Four of five families (81%) that

received shelter assistance are satisfied.

Children agreed that shelter reconstruction

was the most useful for addressing their

priority shelter needs. Yet, the timing of

materials distributions and the quantity of

materials to households impacted the

effectiveness of the assistance for some

households, see the quote below from an

adult community validation participant from

Panay.

“The build back better principles were not adopted because the materials were lacking and quality of some

materials like the coco lumber were inferior (not mature enough).” ~ adult

“Many agencies came to help us, World Vision was one of them who gave us food and tarpaulins.”~ boy

Page 14: End of Grant Evaluation Report

xiii | P a g e

NFI distribution: Provision of relief goods (NFI and food) in the aftermath of the typhoon was a

key way to address the immediate needs of children and their families, as shown through children’s

FGD and programme documentation. The community validation process confirmed this finding;

Panay and North Cebu participants described how emergency relief distributions allowed them to

temporarily cope with household needs and to focus on finding shelter repair materials and clearing

Debris (see quote below).

“The people are very happy to have received the NFI because they were not expecting to have received that

kind of intervention. Families do not have the capacity to buy NFI items as their income is just enough for

expenses for food.” ~ adult

WATER, SANITATION & HYGIENE (WASH): Over four out of five households (83%) are

able to meet their needs for clean, safe drinking water. Just three percent of East Leyte and 15% of

West Leyte households report no toilet facility at EOG. All households reported at least one

instance when they wash their hands, with an average of three instances reported by households;

though North Cebu households reported fewer times when they wash their hands compared to all

other zones. East and West Leyte households, with WASH recovery activities supported by DFATD

2 and ADH, show improvements in access to clean water, sanitation facilities and hygiene practices

as generally compared to rehabilitation phase baseline results. During the community validation

process East Leyte participants confirmed the following finding: because of WV’s timely assistance,

community members have access to toilet facilities, they have access to safe water, and people also

have increased awareness of hygiene and sanitation practices for the prevention of disease for

children. In addition, West Leyte participants confirmed that WV’s provision of latrine materials

helped to improve sanitation in the community and to decrease open defecation; in terms of water

supply, child participants reported ongoing issues with access to a safe, reliable water source and

some households resort to buying bottled water.

Child protection/education and health: CFS and WAYCS supported the safety, health and

education of children and mothers and contributed to the improved well-being of families, as agreed

by children and caregiver beneficiaries, caregiver husbands and WV staff.

"Many children had been playing by the road side and begging, but after CFS, all the children were inside, being

listened to and playing.” ~ WV staff

Page 15: End of Grant Evaluation Report

xiv | P a g e

CASH FOR WORK/ASSETS: Children and community leaders recognised the benefits of CFW

for providing household employment opportunities, restoring community assets, and building upon

the community willingness to contribute to their own recovery. Key monitoring and programme

documents confirmed that most CFW beneficiaries were satisfied, and that the benefits extended to

environmental protection, disaster risk reduction, food security (e.g., providing families with an

income source to access food) and the well-being of communities. Community validation confirmed

the usefulness of the CFW in helping families recover and benefiting the community.

Outcome 2: Typhoon-affected families have restored affected livelihoods and increased

capital and asset base

While the grants may not have contributed directly to the aim of Outcome 2, or have just started,

the grant-funded Response activities have likely prevented families from further food insecurity as

well as loss of livelihood assets and capital—while there was not HH survey data directly related to

this, community validation provided some confirmation. Most households recognised WV assistance

as an important contributor to their ability to meet the top household expense, which is most often

food. Through the provision of relief goods and shelter reconstruction assistance, families can then

focus their limited income on household food needs and other priorities, such as health and

education. In addition, the tools and

materials provided through CFW, latrine

and shelter Type A and B assistance are

part of the household asset base.

Livelihoods: DFATD 2 and ADH

contributed to Outcome 2 interventions

through livelihoods support activities in East

and West Leyte zones in the recovery

phase. However, the livelihoods activities

just started at the time of the EOG survey.

Among households who are able to meet

their top expenses, most (84%) attribute

involvement in WV projects as helpful

either partially or fully in meeting that expense. Yet, for the vast majority of households (87%) staple

food is their top expense, as well as the primary reason for debt. A notable difference from post-

distribution monitoring reports is that shelter is no longer the second major expense for the EOG

households, but education and health costs instead. Casual labour continues to be the main income

source—though not enough for many households meet their top expense, nor to restore livelihood

assets; a finding that is reiterated in the community validation process. Over half of households

Page 16: End of Grant Evaluation Report

xv | P a g e

(53%) have debt, and food purchase is the primary reason for loans. Most households report no cash

savings (82%).

Children cite family separation as a consequence of destroyed livelihoods. Migration for work in the

month prior to the survey was reported by eight percent of households.

Outcome 4: Typhoon-affected communities, families including children are empowered to

inform World Vision Response programming

The grant programmes contributed to the achievement of Outcome 4. THR was designed to focus

on humanitarian accountability (HA) activities from the start of the relief phase through the recovery

strategy, and WV showed strong commitment and leadership in this area. Beneficiary and local

government perspectives were integrated into the management of programs. Overall, these HA

efforts to engage the target families and communities significantly contributed to improving the

programme activities.

Accountability: Outcome 4 activities were supported by all four grant programmes, and HA

measures were employed in the design and implementation of the programmes. WV staff named HA

as an area for continued improvement in both the short and long-term. From the community

leaders’ perspective, 78% would recommend WV to another community based on their experience

and most felt communications with WV were effective. Household satisfaction varies for the four

HA components, with a general trend of North Cebu households citing the highest rate of full

satisfaction and West Leyte the lowest:

Information provision: Most households (75%) are fully satisfied with the information

they received about World Vision and the relief programme. The barangay council or

barangay/community assembly were the most commonly cited sources of information across

zones, an important consideration in the structural-oriented follow-up phase in which there

is close coordination with local government structures for rehabilitation.

Participation and input: Two-thirds of households (67%) are fully satisfied with the

mechanisms provided by WV for them and their communities to give input on activities and

programmes. WV not only gathered input from children, families and communities for the

DME of programmes and response phases, but also returned to the communities to share

the key findings and asked for community validation (see quote below). WV staff suggested

that HA processes engage communities in project design and stay connected after response

activities have ended.

Feedback and complaints mechanisms: Just over half of households (54%) reported

they are fully satisfied with how feedback and complaints were welcomed. WV succeeded in

ensuring a help desk was present at every distribution and a feedback box in every target

community, yet households still reported they didn’t know what mechanisms were available.

The most common methods were reporting to community leaders (purok or barangay) or

assembly, and while one in five households was aware of the suggestion box, this method

was not among the top methods used by households, with a similar trend with the SMS/text

method.

Response to complaints: Approximately half of households (50%) are fully satisfied with

how WV responded to feedback and complaints provided by them and the community. The

HA team worked hard to close the feedback loop, providing responses to feedback to

beneficiaries and passing on the feedback to relevant sectors.

Community validation process participants from North Cebu and East Leyte confirmed their

satisfaction with the WV information provision and their preference for providing feedback. Panay

adult and child participants expressed gratitude for the Response efforts of WV as well as the

opportunity through the community validation process to learn more about WV assistance and to

voice their thoughts and concerns.

Page 17: End of Grant Evaluation Report

xvi | P a g e

“It is good that we are able to share our ideas on how WV could better provide assistance.

It is encouraging for us.” ~ adult

RESILIENCE

This section discusses evidence of WV achieving the overall programme goal through the support of

the grant programmes:

“To strengthen the resilience of typhoon-affected communities and families

including children.”

The Response Programme uses resilience capacities and vulnerabilities as the framework for

understanding how target populations have been affected by, are coping with and recovering from

Typhoon Haiyan. The relief phase aimed to reduce vulnerability, alleviate suffering, save lives and

promote human dignity by meeting the immediate needs of affected families. These relief phase

objectives were meant to facilitate recovery of target households and communities across the WV

zones. Findings are presented on household exposure and preparedness to future disasters, and the

accomplishments and challenges to building resilience through absorptive capacity. Building upon the

previous results this section will then describe children’s current priority problems and the food

security and coping behaviours reported by households at EOG as an indication of household

resilience.

Key findings on overall programme goal:

WV grant activities, namely living conditions achievements from Outcome 1 and

community empowerment from Outcome 4, have laid the foundation for building

resilience and improving well-being outcomes.

Overall, households show the motivation and determination to recover despite

setbacks from recurrent disasters, which WV assistance has supported. East

Leyte households in particular are resolved to cope with future shocks.

The following is evidence of the achievements and challenges experienced by households

in improving their ability to deal with shocks through strengthened absorptive resilience

capacity:

Exposure to subsequent shocks have set back many households,

particularly in East Leyte. Nearly all households (97%) have faced another

disaster since Typhoon Haiyan and four out of five households have faced

challenges in coping with these subsequent disasters. East Leyte households were

hit the hardest and are significantly more likely to face challenges in coping as

compared to North Cebu or Panay, and East Leyte adults and children were

eating significantly fewer daily meals at EOG compared to other zones.

WV assistance helped most households to be able to recover better.

The majority of households (83%) agreed they were better able to recover

either partially or fully as a result of WV assistance, though about one-third of

East and West Leyte households (35%) did not feel they were better able to

recover as a result of WV assistance. Children had a strong perception of family

and community-driven activities addressing most of their priority needs, with

WV assistance playing a part along with help from government and others.

Households hit the hardest by recent disasters have the strongest

perception of their preparedness for future shocks. About two-thirds of

households (67%) feel they are fully prepared to deal with the adverse effects of

a forthcoming major disaster, and notably, East Leyte households that have been

repeatedly hit the hardest by disasters have the highest Response rate of feeling

Page 18: End of Grant Evaluation Report

xvii | P a g e

fully prepared, though actual ability to be prepared is another factor considering

HH economics results for this zone.

Better preparedness involves stronger shelter, livelihoods, healthcare,

and early warning information. Of the households that were not fully

prepared for future disaster, their most common needs for becoming better

prepared are stronger, disaster-resistant shelter (80%), followed by livelihoods

and income, access to healthcare, and access to early warning and preparedness

information.

The priority problem for children has shifted to education, followed by

food and livelihoods. Household food security may show improvement

related to less negative coping. East Leyte households scored the highest in

the coping strategies index: 62.9, which is significantly higher than the other

zones and zonal average of 58.0. In all, while household members are not often

skipping meals or days without eating, nor are they foraging and eating rotten

foods, their food security situation is tenuous—as the fragility of meeting their

food needs depends on work trade, debt, and reducing investments in their

longer term well-being.

CONCLUSION

Overall, despite the challenges, this evaluation concludes the grant programmes were relevant,

timely, efficient and effective as significant components of the larger WV Response. Some delays and

inefficiencies were due to procurement and logistics issues, and mitigation measures were taken by

WV; though delays with shelter repair assistance may have impacted the effectiveness of those

activities for some households.

The grant programmes directly contributed to achievements of Outcomes 1 and 4, while

contributing to Outcome 2 by stabilising the emergency needs. Evaluation findings show that living

conditions have improved, ultimately impacting the ability of children to learn, preventing illness and

safety issues and enabling health for families and communities. The limited livelihoods activities that

took place, in tandem with the other response activities, likely prevented families from further food

insecurity and negative coping strategies that would hinder their future livelihoods. In addition, HA

was foundational for the activities, as WV worked hard to ensure that the needs and voices of

beneficiary families and communities were heard and responded to.

Finally, resilience capacity has been strengthened in target households and communities, evident by

their motivation and determination to prepare for and recover from future shocks. The gains in food

security, shelter, education and health must be protected through longer-term livelihood strategies,

and disaster risk reduction activities that continue to reinforce shelters and work with communities

for early warning and preparedness plans.

Recommendations: guiding questions

The following list is comprised of key questions for future Responses based on evaluation findings

and suggestions from the community validation process.

Relevance:

While WV’s beneficiary selection criteria process was commendable, are there refinements to the geographic

and strategic positioning issues that could be addressed before the next Response?

Page 19: End of Grant Evaluation Report

xviii | P a g e

Timeliness and efficiency:

How will WV build upon the learning from THR to further prepare, pre-position and make adjustments to

P&C processes, procurement and logistics prior to the next Response?

Effectiveness:

How will WV further connect shelter and livelihoods needs in the future, particularly to enable livelihoods

supports earlier in the Response and to a larger degree?

How can WV promote community ownership and utilisation of HA mechanisms, and how can mechanisms

be tailored to the type of feedback, activity, context, even zone? If HA continues to be elevated to a stand-

alone Response outcome, how can the reporting of output and outcome level indicators improve to show the

level of community involvement and empowerment and the number of complaints addressed by WV?

Resilience:

Related to the above question on livelihoods/shelter, how will WV further integrate shelter and livelihoods

issues (i.e., relief and recovery activities) to strengthening absorptive capacity? Can WV provide follow-up

support to households facing barriers to building back better and to implementing their learning from the

BBB workshop?

Page 20: End of Grant Evaluation Report

1 | P a g e

Purpose of the evaluation

The international and local humanitarian community and governments responded promptly to the

urgent needs of communities affected by Typhoon Haiyan that hit the Philippines on 8 November

2013. This report presents the results for the combined evaluation of four major grant programmes

from three donors that contributed significantly to the World Vision Typhoon Haiyan Response

(THR): Canadian Department of Foreign Affairs, Trade and Development (DFATD, two

programmes), Aktion Deutschland Hilft (ADH, Germany’s Relief Coalition) and Samenwerkende

Hulporganisaties (SHO, or Cooperating Aid Agencies of the Netherlands).

The purpose of this end-of-grant (EOG) evaluation is to understand how four grant programmes of

the larger World Vision THR contributed to the recovery of the affected, target populations in the

relief and recovery phases of the Response.2,3 Particularly, how the THR in the four zones

contributed to achieving the Response outcomes and the goal of building resilience capacity, i.e., the

ability to cope with and bounce back from a disaster.

The evaluation is based on the four specific evaluation criteria used by World Vision’s Humanitarian

and Emergency Affairs (HEA): relevance, timeliness, efficiency and effectiveness.4 The four criteria, as

they relate to achieving the outcomes and goal of the Response, serve as the main framework for

presenting the evaluation findings. These evaluation criteria are defined and agreed by WV and the

donors as the following:

1. Relevance- How well did THR correspond to local needs and priorities? How did WV target

the most vulnerable populations, and what were the challenges of reaching vulnerable, affected

populations? Did the project address priority problems faced by the target areas and

communities and was the project consistent with policies of both donors and recipient

governments (or agencies)?

2. Timeliness- To what degree did THR implement timely Response activities? Did the

programme respond in a timely manner to the affected community’s needs? What affected

timely delivery of assistance (including coordination issues), and what measures were taken by

WV to address the issues?

3. Efficiency- To what degree did THR provide efficient support for programme implementation?

Were inputs (staff, time, money, equipment, relief goods) procured and/or used in the best

possible way to achieve outputs and could implementation have improved? Which main factors

influenced the efficiency of implementation such as supply chains, and how did this affect the

delivery of aid?

4. Effectiveness- To what extent did the Response activities meet their intended purpose? Were

outcomes achieved? What is the evidence of both the impacts of the Response as well as the

unintended positive and negatives effects on the affected population since the disaster?

Resilience goal: This section discusses the evidence of WV meeting the overall programme goal to

strengthen the resilience of typhoon-affected communities. Findings are presented on household

exposure and preparedness to future disasters, and the accomplishments and challenges to building

resilience through absorptive capacity. Building upon the previous results this section will then

describe children’s current priority problems and the food security and coping behaviours reported

by households at EOG as an indication of household resilience.

2 Note the limitation of attributing impacts to grants in methodology section. 3 Per the WV THR 12-Month Report, the relief phase (9 Nov 2013-30 Apr 2014) overlapped the recovery

phase (1 Feb-30 Dec 2014) for three months to continue meeting the urgent needs of target communities. 4 These criteria are also aligned with OECD/DAC evaluation standards. Source: OECD. 1991. Development

Assistance Committee (DAC) Principles for Evaluation of Development Assistance.

Page 21: End of Grant Evaluation Report

2 | P a g e

Summary of methods

This section provides a summary of the mixed methods approach used for the EOG evaluation.

Refer to Annex B for a detailed description of the training, tools, sampling/participation, analysis

approach and limitations for the qualitative and quantitative primary data collection.

Fieldwork: Managed by the THR and World Vision (WV) Development Foundation (Philippines

national office, NO), fieldwork took place the beginning of February 2015 and occurred in four

distinct zones. Figure 1 shows the geographic locations of the four zones surveyed: East Leyte,

West Leyte, North Cebu, and Panay. Data analysis and compilation of quantitative and qualitative

reports were conducted from February through April 2015.

The fieldwork included the following qualitative and quantitative primary data collection methods:

Qualitative data

Focus group discussions (FGD) with children

Community leader (CL) survey

Key informant interviews (KII) with WV staff

(from real-time evaluation April/ May 2014)

Quantitative data

Household (HH) survey— designed for

statistically representative sample of WV

programme areas at the household level

Figure 1: Country map indicating four EOG survey zones

Map adapted from: WV THR. (Rehabilitation Phase) Baseline Survey Report. June 2014.

Panay

North Cebu

East

Leyte

West

Leyte

Page 22: End of Grant Evaluation Report

3 | P a g e

Participation: A total of 1,386 households participated in the quantitative survey, 40 in the CL

survey, and 231 children (ages 12-17) participated in 16 FGDs, which included a nearly even split of

girls (49%) and boys (51%). Table 1 provides a breakdown of participation by tool and by zone.

Table 1: EOG evaluation community participation, by tool and zone

Zone # HH surveyed

# CL

participants1

# FGD

participants girls boys

East Leyte 361 10 26 29

West Leyte 338 10 27 32

North Cebu 341 10 30 31

Panay 346 10 30 26

subtotals 1386 40 113 118

Total EOG survey participants 1386 40 231 1 CL tool did not capture gender of respondent, it is assumed most/all were male.

Mixed methods approach: This report triangulates data from primary and secondary sources. The

primary data are from three quantitative and qualitative sources (listed above) that provide information

from various beneficiary perspectives; the secondary data are drawn from previously collected KIIs and

other surveys with WV staff and a review of over 35 key programme documents (see Annex H for desk

review bibliography).

TANGO International compiled the HH survey findings, along with the findings identified by World

Vision in the CL, KII, FGD and community validation processes to produce this report. Survey data were

analysed using SPSS version 20.0. Point estimates for output which contains fewer than 30 observations

are not reported. In place of the point estimate in the tables the reader will find “N/A” (Not Available).

For analysis, cases are weighted to account for the differing population sizes in each of the four World

Vision zones. Therefore the reader should note that taking the “average” of the zone point estimates will

not equal the point estimate reported for the total sample. Unless otherwise noted, the data are

presented as whole numbers for proportions and to one decimal place for averages (means) and scores.

Data for currency values are reported to two decimal places. All data tables may be found in Annex C.

A strategy of triangulation was used by examining the agreement or disagreement of findings across the

various data sources and from different perspectives, adding a deeper level of understanding to the

results. The report also includes feedback from the community validation process, which adds

another layer of depth for interpreting the data and for discussing the contribution of the grant

programmes towards the recovery of the target communities. A total of 294 women, men, girls and boys

participated in the community validation of key evaluation findings across the four zones in April 2015.

See Annex D for the full results of the process.

Limitations: While not a reflection of the quality of the EOG data, there are several limitations to

consider when interpreting the findings: 1) Design: There were no baseline data for the relief phase and

no counterfactual at EOG with which to compare the evaluation findings, thus limiting the measurement

of effectiveness and the impact attributed to the grant programmes. As a result, the HH survey findings

are compared to other data sources wherever possible in order to further understand the effectiveness

and impact of the grant Response interventions. 2) Timing: The THR grant projects were short term in

nature (typically less than six months in duration). Many projects were completed up to nine or ten

months before the survey; conversely, some livelihoods and shelter interventions were still ongoing at

the time of the survey. In an effort to gather useful data, recall and perceived benefit data from children

and adults were collected. Triangulation with major trends or themes across data sources has been

necessary to further explain the HH data.

Page 23: End of Grant Evaluation Report

4 | P a g e

Overview of grant programmes

Table 2 summarises the four grant programmes in terms of total budget, start and end dates, activity

targets and outputs realised to-date. DFATD 1 was implemented during the relief phase and DFATD

2 provided funding from the same donor for recovery phase activities focused in a different

geographic zone. SHO was primarily a relief phase contribution, with shelter toolkits that extended

into the recovery, and ADH began mid-relief and extended through the recovery phase (phase I of

ADH included in this evaluation). The sum of the total budgets of these grant programmes

comprises approximately 23% of the total budget for the relief and recovery phase of the WV

Response.5 All completed activities show that outputs for the grants have been met or exceeded.6

Table 2: Grant programme overview, budget, timeframe, activity targets and outputs

Grant Budget

(USD)

Timeframe

[phase]

Activity targets1 Targets realised

DFATD 1 $1,749,216 Nov. 2013-

May 2014

[relief]

1.Shelter kits: 5000 HH 1. 6,000 HH

2.Non-food item (NFI) kits: 10000

HH

2. 17,202 HH

3.Hygiene kits: 10000 HH 3. 10,650 HH

4.Solar lamps: 14840 HH 4. 14,834 HH

5.Child-friendly space (CFS): 1820

girls/ boys

5. 3,355 girls/boys

6.Women and young children spaces

(WAYCS): 840 WAYC 6. 2,543 women/ 1,340 young

children

DFATD 2 $2,989,472 Feb. 2014-

Jan. 2015

[recovery]

1. Shelter (A & B): 2000 HH

2. Cash for work (CFW): 1,670 HH

3. Water systems: 2000 HH (or

10,000 people)

4. Latrines (Package A/B, PhATS):

2500 HH, hygiene promotion:

12500 people

5. Livelihood trainings/ business

start-up: 750 HH

1. 2005 HH (Type A: 1884/

B: 121)

2. 3383 HH/participants

3. 14,585 people (L1: 2824/

L2: 11,761)

4. 2521 HH (Package A: 986/

Package B: 185/ CLTS: 1350),

hygiene promotion: 12,605

5. 785 HH

SHO $851,935 Nov. 2013-

Feb. 2014

(extended to

July 2014)

[relief]

1. NFI: 4570 HH

2. Hygiene kits: 4570 HH

3. Shelter kits: 4570 HH

Additionally: Programme

management support

1. 5861 HH

2. 8443 HH

3. 4570 HH, plus 5389 shelter

tool kits (recovery)

ADH

(phase I)

$4,728,334 Jan. 2014-

Dec. 2014

(extended to

March 2015)

[mid-relief to

recovery]

1. Shelter (A & B): 4550 HH (Type

A: 4151/ B: 399)

2. CFW: 2850 HH

3. Latrines: 4550 HH (Package

A:4151/ B: 399)

4. Livelihood- livestock: 517 HH/

agriculture: 45 community gardens

(benefitting 2020 people)

1. 4530 HH (Type A: 4151/ B:

379)

2. 2850 participants

3. 4530 HH (Package A:4151/

B: 379)

4. 517 HH/ 45 community

gardens

5 $11,116,250/$48,812,299 USD, calculation by TANGO International. 6 WV THR. Evaluation Requirements. January 2015; other sources included the grant proposals. Note: this

evaluation scope does not discuss the budgetary process for accounting for exceeding output targets.

Page 24: End of Grant Evaluation Report

5 | P a g e

1 Activity kit/package descriptions:

Shelter kits: Two 4m x 6m tarpaulins and one 20m rope per HH, per SPHERE and IFRC standards

NFI kits: Blankets, mosquito nets, plastic mats and can openers

Hygiene kits: Bath soap, laundry soap, sanitary pads, and underwear (gender-sensitive); and replenishment items

Shelter Type A and B: Shelter construction materials (lumber, nails, paint, etc.) and toolkits; Type B includes construction

assistance for the most vulnerable HH

Latrines Package A and B: Kits include three bags of cement, two floor grates, sets of piping, toilet bowl and reinforcement bar/ Package B includes construction assistance for the most vulnerable HH

Geographic zones and sampling frame: DFATD 1 was implemented in all Response areas

except for the West Leyte zone, and the DFATD 2 was implemented only in West Leyte. The SHO

programme was implemented in all Response areas, and the ADH programming took place in East

Leyte only. Table 3 shows the sampling frame by barangay, grantor and sectors.

Table 3: Grant programme overview, disaggregated by surveyed barangay and grant

Zone Municipality Barangay Grant Relief & recovery sectors

East Leyte Tacloban Palanog DFATD1 Relief: Shelter kit, WASH (hygiene

kit), NFI, protection (solar lamps),

education (CFS, transitioned to

temporary learning spaces, TLS),

health (WAYCS), CFW

Recovery: Shelter (A&B), WASH,

livelihoods, CFW (community

infrastructure)

Sto Nino DFATD1

Alang-alang San Antonio ADH, DFATD1

Dagami Hitumnog ADH

Sawahon

Dulag Calipayan ADH

Salvacion

San Jose

Tabontabon Mercaduhay DFATD1

San Pablo SHO

West

Leyte

Albuera Damulaan SHO Relief: Shelter kit, WASH (hygiene

kit), NFI

Recovery: Shelter (A&B) and toolkits

in SHO locations, WASH

latrines/hygiene promotion and

systems, livelihoods, CFW

(community infrastructure)

Matag-ob Riverside DFATD2

Masaba

Merida Libjo Orm DFATD2

Lamanoc

Ormoc Camp Downes SHO

Donghol SHO

Patag SHO

Villaba Balite DFATD2

Suba

North

Cebu

Bogo Santa Rosario DFATD1 Relief: Shelter kit, WASH (hygiene

kit), NFI, protection (solar lamps),

education (CFS/ TLS), health

(WAYCS)

Recovery: Note: this office phased

out in March with shelter toolkit

distributions (SHO) to May,

transition completed Aug. 2014

Taytayan DFATD1

Medellin Caputatan North DFATD1, SHO

Gibitngil DFATD1, SHO

Sogod Pansoy DFATD1

Tabogon Camoboan DFATD1

Libjo Ceb DFATD1

Loong DFATD1, SHO

Manlagtang DFATD1

Sambag DFATD1

Panay Bingawan Poblacion DFATD1, SHO Relief: Shelter kit, WASH (hygiene

kit), NFI, protection (solar lamps),

education (CFS/ TLS), health

(WAYCS)

Recovery: Note: this office phased

out in March 2014 (SHO shelter

toolkits in recovery), and transition

process is ongoing with ADP and

Local Government Units (LGU)

Maayon Cabungahan DFATD1

Pilar Sinamongan DFATD1, SHO

Estancia Botongon DFATD1

Gogo DFATD1

Pa-on DFATD1, SHO

Batan (Aklan) Camaligan DFATD1, SHO

Camanci DFATD1

Magpagong DFATD1

Mambuquiao DFATD1, SHO

Page 25: End of Grant Evaluation Report

6 | P a g e

Relief to recovery phase targeting: The grant programmes fit within the targeting strategy of

the larger Response programme, thus, it is occasionally necessary to describe the THR as a whole

throughout this report. The THR relief phase (six months) ended in March 2014 with recovery

activities officially starting in April 2014. Due to procurement among other delays (see II. Timeliness

discussion) the recovery shelter activities generally started May-June and the livelihood activities

from November 2014-January 2015.

With the assistance of the Overview of Affected Municipalities (OAM) tool and the Barangay

Prioritisation Assessment Tool (BPAT) developed by the Information Management team, the

geographical focus for the recovery phase decreased from 44 municipalities to 12 of the most

severely impacted municipalities and barangays, mostly in the Leyte zones.7 The programming

continued in the remaining areas, and Response offices were phased out in North Cebu and Panay in

March 2014. The DFATD 2 shifted geographic focus to West Leyte (see the maps in Figure 2).

Figure 2: Map of Response locations by zone and relief or recovery phase

Source: WV THR, provided April 2015.

Targeting strategy: Emergency relief supplies (food and NFI) were blanket distributions in the

communities. THR sought to build an integrated Response based on the priority needs and reaching

7 WV THR. 90-day Report. March 2014.

Page 26: End of Grant Evaluation Report

7 | P a g e

the most vulnerable families, namely those with destroyed homes. For interventions beyond the

emergency relief distributions, such as shelter, WASH and livelihoods, WV selection criteria

involved severity of damage to the home, female-headed households, the elderly and people with

disabilities in both area development programme (ADP) and non-ADP communities.

Household demographics of target zones at EOG: The average household size across zones

is five members: two members under the age of 15, zero to one elderly member and two to three

adults. The survey respondent, an indication of the head of household, is typically male (77%) and

their average age is 48 years (see Table 50 in Annex C).

Household and community recognition of main Response projects: The surveyed

households were both direct (household level) and indirect (community level) beneficiaries of World

Vision assistance. Most households (92%) confirmed that they had benefited from World Vision

assistance after Typhoon Haiyan, including activities other than the four grant programmes (see

Table 18, Annex C), with an average of two activities per household.8 The main THR activities the

surveyed households benefited from or participated in directly are: 30% food distributions, 19% NFI

distributions, 17% shelter and 17% WASH (note: activities have been grouped by project)(Figure 3).

These indeed align with the main Response projects of the larger WV THR and, apart from food

distributions that are not covered by the four grant programmes, all other projects include the

activities of the grant programmes in the surveyed zones. Community leaders named 40 different

activities carried out by WV, the most common of which were: Food and NFI distributions, shelter

(Type A and B), latrines (Type A and B), CFW, hygiene kits, animal dispersal and livelihoods

trainings, among others, which also aligns with the WV THR projects (see Figure 37 in Annex C).

Figure 3: Types of WV Response activities that HHs benefited from/participated

in (n=13861)

1 This n represents the number of HHs, and the total number of activities named by the HHs is 2956.

The timeframe of the activities that households reported benefiting from/participating in shows that

most activities (64%) lasted six months or less, which corresponds with the timeframe of the relief

phase of the THR. One-third (33%) of the activities extended beyond six months or over one year,

which corresponds with the recovery project timeframes that followed the relief phase (Figure 4).

8 The households that answered “no” benefit (seven percent) or “don’t know” (one percent) were included in

analysis because they would have benefited indirectly at the community level, for instance from a community

asset restored through a WV cash for work project.

Page 27: End of Grant Evaluation Report

8 | P a g e

Figure 4: Average number of months that WV activities occurred (n=13861)

1 This n represents the number of HHs, and the total number of activities for which a timeframe

was provided is 2958.

With the limitation that most grant activities were completed months before the EOG evaluation,

these results suggest that the EOG evaluation sampled Response beneficiaries who still accurately

recall the WV assistance they received from the relief and recovery phases. For more discussion of

the timing limitations see Annex B: Methodology.

Page 28: End of Grant Evaluation Report

9 | P a g e

Evaluation criteria

I. RELEVANCE

Relevance to donor, government and WV strategy: The grant programmes fit within the larger

Response strategy that aligned with the policies and priorities of the donors, government and

humanitarian partners, and the NO, according to Response documents.9,10,11 Strategic alignment and

coordination with WVDF was a principal component of how the Response was managed, including

alignment of the Response strategy with the WV child well-being outcomes.12 Based on the long-

standing presence of WVDF and their partnerships with government, UN agencies and clusters,

donors, international non-governmental organisations (INGOs), churches and community based

organisations, the Response actively coordinated and engaged with these stakeholders to ensure

complementarity and congruence of efforts. The WV THR aligned with the key sectors of shelter,

WASH and livelihoods (emphasising quick impact projects like CFW) outlined by the Strategic

Response Plan (SRP) of the Humanitarian Country Team. THR participated in inter-agency

assessments and the clusters for shelter, health, protection, WASH, accountability and gender. WV

staff indicated in the real-time evaluation (RTE) that participation in clusters enabled WV to

influence other agencies, for example, improving standards for materials to be distributed and

prompting community engagement.13

THR engaged numerous government offices, including the Government of Philippines Department of

Health, Department of Education, Department of Social Welfare and Development (DSWD),

Department of Trade and Industry and the Department of Labour and Employment (for livelihoods

training coordination for ADH), and with LGUs. In some cases this meant heeding the call for

partnership where gaps in government capacity existed such as rehabilitating local water supply

systems and community hand pumps (pertaining to DFATD 2).

Relevance to needs: This section demonstrates that WV Response activities supported by the four

grant programmes and implemented in the weeks and months after Typhoon Haiyan were designed

to address the most urgent needs of the affected population. Based on those needs identified as

most urgent in the November 2013 rapid assessment, WV’s overall Response focused on food and

shelter, including NFI and relief items, with integrated programming also addressing livelihoods,

water, health, education and community infrastructure.14

The rapid assessment showed that the

priority problems for Cebu and Panay

Island were food and shelter, followed by

livelihoods/income, water, health and

education. The ranking of priority

problems in the rapid assessment

differed slightly for East and West Leyte,

where food was still the priority need,

followed by water, health and shelter.

These needs were confirmed again

during the focus groups with children

conducted during the EOG evaluation.

9 WV THR/WVDF. SHO Netherlands Final Report (Draft). 24 July 2014. 10 World Vision Canada. DFATD 2 Proposal. 2 January 2014. 11 World Vision Germany. ADH Proposal. 7 July 2014. 12 WV THR. Typhoon Haiyan Response Strategy. 9 October 2014. 13 WV THR/WVI. Real Time Evaluation, Final Report. May 2014. 14 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013.

Page 29: End of Grant Evaluation Report

10 | P a g e

Boys and girls were provided with findings from the rapid assessment conducted in the aftermath of

the typhoon and were asked to compare the problems identified as priorities by adults (i.e., in the

HH survey portion of the rapid assessment) to those they remembered during that time. The

children’s results matched those of the post-typhoon adult results, both of which pointed first to

hunger and food scarcity, followed by shelter and livelihoods as the most important problems they

faced in the early aftermath of the typhoon (Table 4). While both adults and children also mentioned

water and education as problems, children prioritised education over water and health,15 whereas

adults prioritised water and health (see Figure 38 in Annex C). Apart from food distributions, which

were conducted in partnership with World Food Programme (WFP), activities supported through

the grant programmes addressed these priority needs.

Table 4: Priority problems in aftermath of Typhoon Haiyan

Children (recall post-Haiyan)1 Adults (rapid assessment)2

Food scarcity/hunger Food scarcity/hunger

Shelter Shelter

Livelihoods/work/income Livelihoods/work/income

Education Water and health Source: THR EOG evaluation qualitative report, March 2015. 1 Children’s FGD of EOG evaluation, n=231 2 Adult respondents of HH survey of Nov/Dec 2013 rapid assessment, n=445

The vast majority (92%) of surveyed World Vision staff involved in the Response effort agreed that

the relief phase was appropriate to the priority needs of targeted people.16 At that time staff cited

targeting issues—both geographic and strategic—as impacting WV’s ability to meet the needs of

those affected by the disaster. Challenges included:

the time it took to geographically target the most vulnerable and those receiving less

assistance from other NGOs (e.g., establishing the THR in East and West Leyte);

the resource and time limitations in reaching the most vulnerable while also responding to

the needs of ADP communities where WV had prior investments in their well-being; and

addressing the issue that qualifying criteria for beneficiary selection (based on shelter

beneficiaries) may have excluded households with devastated livelihoods but less damaged

homes.17

At EOG, a few community leaders echoed the concerns of WV staff, commenting that Response

activities could have better addressed needs in their communities, possibly by better understanding

community needs prior to WV’s planning of the Response projects. Though, this is not further

elaborated by community leaders. WV indeed conducted needs assessments prior to project

planning.

Households were asked who they felt were the main beneficiaries for each of the WV typhoon-

Response activities in which a household reported participating (note: this includes food

distributions, which is not supported by the grant programmes). Figure 5 shows that 61% of the

typhoon-Response activities in which a household reported participating were perceived to benefit

everyone in the community. One-quarter were perceived to benefit poor households, while 19%

were perceived to benefit households with partially or totally damaged shelters.

15 Most children explained education problems related to damaged schools and school supplies. 16 SurveyMonkey® April 2014, n=39. 17 WV THR/WVI. Real Time Evaluation, Final Report. May 2014.

Page 30: End of Grant Evaluation Report

11 | P a g e

Figure 5: Main beneficiaries of WV THR activities (n=13861)

1 The n represents the total number of HHs, and with multiple responses the total project

beneficiaries reported by households is 3061.

* E.g., HH with WV sponsored children; child-headed HH; HH of community leaders ** Other responses: HH without latrines or electricity; HH who did not receive other assistance;

HH ready for livelihood support; HH without income or employment, etc.

The beneficiaries by project type supported by the grant programmes (as reported by the HH

survey) shows that the main beneficiaries of NFI were everyone in the community (75%), the

beneficiaries of shelter programmes were most often those with damaged homes (51%) and poor

households were the beneficiaries of CFW (50%) and livelihoods (55%) activities (see Table 23,

Annex C). The selection of beneficiaries was considered satisfactory for nearly all (94%) of the WV

typhoon-related activities listed by households, with little variation across zones. Dissatisfaction with

beneficiary selection resulted from a perception that deserving people were left out, undeserving

people were included, or that there was favouritism in the selection of beneficiaries (see Table 24 in

Annex C).18 Analysis of satisfaction with beneficiary selection by project and zone (and excluding

food) shows highest satisfaction with WASH and NFI (96% each) and lowest with CFW (85%);

within zones this pattern generally holds, expect for East Leyte that had lowest satisfaction with

livelihoods activities (78%) (see Table 25, Annex C). The high levels of satisfaction with beneficiary

selection for NFI and WASH may be related to the broad reach of those activities (refer back to

activity targets in Table 2), and the visible benefit to “everyone” in the community as perceived by

the households.

Overall, WV typhoon-Response activities were perceived by beneficiaries to be satisfactory in terms

of their targeting of beneficiaries, and their perceptions of who benefits generally align with WV’s

targeting strategy, which includes: Everyone in the community (with blanket emergency distributions

and repair of community assets such as water systems), as well as the most vulnerable households

(e.g., poor households, those with significantly damaged shelter, female-headed households, and

households with elderly, young children or people with disabilities). The humanitarian accountability

(HA) team led the beneficiary selection criteria development, which was aligned with the

government’s DSWD poor and vulnerability criteria. WV’s approach was considered best practice

by the Shelter Cluster, based on analysis of context and humanitarian needs.19,20

18 Few households (three percent) were aware of favours being requested in order to be included as a

beneficiary. Of those reporting being aware (n=39) that favours played a role in the selection process, the

most common favours reported were for a share of the benefits and for labour (see Table 26, Annex C). 19 WV THR. 12-Month Report. November 2014.

Page 31: End of Grant Evaluation Report

12 | P a g e

Usefulness of WV projects

The HH survey and FGDs further explored beneficiary perceptions of the utility of WV THR

activities showing that Response activities were appropriate for addressing the priority needs of

affected communities. As shown in Figure 6, the vast majority of households (94%) considered the

activities carried out by WV in their communities to be useful or beneficial. This ranged from nearly

all households (99%) in Panay zone considering the WV activities carried out in their communities

useful or beneficial to 88% in North Cebu. It should be noted that the grant activities ended in

North Cebu after the relief phase.

Figure 6: Percent of HHs that consider WV THR activities useful (n=1386)

*Note: Calculations of the WV EOG zone total or average cannot be done by hand because

the values across zones have been weighted.

Figure 7 shows that over one-half of the households surveyed (56%) named food distributions as the

most useful WV Response activity they benefited from, while all remaining activities were covered

by the grant programmes. This provides a glimpse of the

relevance of the grant programme activities to priority

needs and as part of the larger Response. Food

distribution was followed by the grant programme

activities of NFI distributions (31%) of solar lamps and

blankets, among other items, Type A shelter assistance

(28%) including materials and toolkit distributions, and

hygiene kits (17%). Not surprisingly, these items address

some of their basic, and most urgent needs. Indeed, the

post-distribution monitoring (PDM) of relief distributions

(including food packs, NFI, hygiene kits and shelter kits)

just weeks after the typhoon hit showed 90-95%

satisfaction by beneficiaries.21

The most useful recovery, grant-supported activity named

by benefitting households was Type B shelter assistance

(13%, shelter materials and reconstruction assistance),

followed by livelihoods support (11%), CFW (nine

20THR developed tools such as the Overview of Affected Municipalities (OAM) and the Barangay Prioritisation

Assessment Tool (BPAT) for equitable and transparent selection of target communities. Source: WV THR/

WVDF. SHO Netherlands Final Report (Draft). 24 July 2014. 21 WV THR. PDM Summary Report. 9 December 2013.

Main grant activities ordered by

beneficiaries reached:

NFI (23,063 HH)

Hygiene kits (19,093 HH)

Solar lamps (14,834 HH)

Shelter kits (10,570 HH)

Cash for work (6,233 HH)

Shelter A (6,035 HH)

Latrines A and B (5,701 HH)

Livelihoods (1,302 HH)

Shelter B (500 HH)

----

Water systems (14,585 people)

WAYCS (3,883 WAYC)

CFS (3,355 boys and girls)

Community gardens (45)

Source: Table 2. See table footnote for

kit/package descriptions.

Page 32: End of Grant Evaluation Report

13 | P a g e

percent, implemented in both phases), sanitation (eight and four percent) and education (three

percent) activities. Despite the relatively low number of beneficiaries reached by the grant

programme activities for livelihoods and Type B shelter, it is notable the level of usefulness of these

activities as perceived by households (refer to box above and chart below).

For the percentages of most useful activities by zone see Table 19 in Annex C.

Figure 7: HH perceptions of most useful WV Response activities (n=1286)

Colour code: Dark blue=relief / light blue=recovery / grey=both relief and recovery

*Categories collapsed by TANGO: Livelihoods (inputs, training and business start-up) and

Education activities (TLS; repair of classrooms; distribution of student/learner kits)

**Various other activities (recovery) each accounting for n=<30 (or <1%) include: Water systems, health facility repairs, medical supplies/equipment, COMSCA, advocacy

A small number of beneficiaries in the sample indicated an additional activity that could have been

implemented or improved to maximise their perceived household benefits, the sample size is too

small (only 39 HH) to provide meaningful proportional values or to allow for comparison across

zones. However, the following activities were most commonly named, all of which are grant

activities except for food distributions:

1) Shelter materials (Type A)

2) Shelter construction (Type B)

3) Food distribution

4) Livelihoods inputs and support (animals, fisheries, etc.)

The child FGD participants cast “most useful” votes for many WV activities that supported what

they perceived as their biggest problems (food, shelter, livelihoods, and electricity as related to

communication and water), again suggested appropriate alignment of Response activities, including

the grant activities, to need (Figure 8).

Page 33: End of Grant Evaluation Report

14 | P a g e

Figure 8: Children’s perceptions of the usefulness of WV THR activities

(n=693)

Source of chart data: THR EOG evaluation qualitative report, WV Philippines, March 2015.

WV activities that addressed food scarcity/hunger were considered the most useful by children

(37%), followed by shelter activities (34%) and livelihoods (22%). They also highlighted two activities

that involved their own contributions and were not necessarily connected to WV-supported

activities: cleaning and clearing roads, schools and homes, and washing dirtied clothing.

Community validation of relevance: Community validation process participants confirmed the

Response programming was relevant to post-typhoon priority problems. North Cebu community

validation participants explained that the low usefulness rating was related to the low quality of some

shelter materials and the inability of some households to begin repairs due to lack of financial

capacity to pay for labour.

Page 34: End of Grant Evaluation Report

15 | P a g e

II. TIMELINESS

As the implementation of the grant programme activities fit within the larger THR, the following

findings relate to the timeliness of all WV Response activities in the communities supported by the

grant programmes.

The households reported that nearly all (98%) projects or activities were on time, with little variance

across zones (see Table 27 in Annex C). For the small number of projects reported as late, the main

areas of impact were related to: hunger, lack of household income and increased debt, community

and household assets not restored, causing conflict or security issues, compromised health, or loss

of trust in WV and willingness to participate in the future. While not statistically representative due

to this small sub-sample, two project types stand out as not being carried out on time: shelter

materials distribution and some relief goods distributions.

Conversely, timeliness issues were perceived as significant among WV staff. Surveyed WV staff

reported timeliness issues, particularly for relief distributions, such as NFI and shelter kits relating to

the grant programmes. While relief distributions were cited as being well planned, and even ahead of

other agencies, some felt the distributions were too slow considering WV’s size, with some

distributions occurring at eight weeks instead for four weeks. There were also interviewee

comments on cash programming starting late and delayed implementation of recovery shelter (see

Table 9 on programming).22 A key informant from monitoring of the WAYCS commented that the

educational sessions for women and mothers were timely and extremely important in preventing

health problems for families at a time post-disaster with pervasive sanitation and health challenges.23

Some child FGD participants also commented that relief distributions were delayed in the immediate

aftermath of the disaster when food scarcity and hunger were most felt by families. Two (out of 40)

community leaders spoke to these same issues of shelter delays and relief project delays generally

(see quotes).

“The shelter interventions took long. It was already 2014 when the shelter interventions were provided while

other NGOs provided earlier.” ~ Community leader

The KII respondents commended deployment improvements made from past learnings, and also

brought up some underlying planning and logistics issues. They spoke positively to the readiness of

the NO with a Response strategy combined with trainings and learnings from the past, including

changed policies to allow for the fast deployment of 200 NO staff and pre-positioned smart phones.

The KII findings highlighted problems with logistics and the lack of prepositioned goods, contracts

and MOUs, which led to lost time. Some referred to WV as a “lumbering giant” not adaptive or

quick enough (e.g., tarps from Dubai) (see Table 7 on preparedness).24 The 90-day report discussed

challenges that arose in the first months of the response due to the rapid scale-up of operations,

handling over 520 metric tonnes of commodities, as well as various logistics “successes” including:

establishing an information database for logistics and achieving an average lead time of 9.2 days from

procurement to arrival at warehouse. The 90-day report also explains the efforts made to address

timeliness issues:

“Many key decisions were not made as quickly as desired by staff in the field, and this

disconnect led to numerous programme quality issues, including inconsistencies in

distributions. These issues were recognised and the Response is undergoing a process of

decentralising decision-making power, technical expertise and management staff out of the

22 WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014. 23 WV THR. Women and Young Children Spaces Report. May 2014. 24 WV THR EOG Evaluation KII Survey Findings, conducted by RTE. March 2014.

Page 35: End of Grant Evaluation Report

16 | P a g e

Cebu command centre to the Zonal Offices; following that, the Response will further

decentralise to fill in its Recovery Phase footprint with the relevant staffing and resources.”25

There were delays in distributions and the delayed commencement of livelihoods interventions were

related to procurement and logistical challenges that persisted after the first 90 days. Response

documents at six-months and one-year name the following main challenges: difficulties finding

qualified procurement staff to meet the needs of such a large-scale and technical humanitarian

Response; inadequate procurement planning including a sourcing strategy; and difficulties in finding

contractors and quality materials (particularly for shelter and livelihoods projects). Such are the

problems inherent to all large-scale humanitarian responses when numerous agencies are on the

ground and competing for inputs.26 27

At the end of the relief phase about one-third of World Vision staff surveyed (35%) stated

affirmatively that WV responded to the needs of people in a timely manner.28 The staff brought up

very similar challenges as the Response documents and suggested possible improvements to

Response timeliness, namely: earlier provision of shelter materials; the need to identify reliable

suppliers locally if possible with the capacity to meet material and timing requirements; and the need

to fast track interventions at all levels, including contracting and administrative processes.

As further discussed in the next

section on efficiency, early-on the

THR recognised the need to turn

“outwards” from a focus on

organisational functions (i.e., staffing

and logistics) to increased external

coordination as an important shift for

the recovery phase. This approach by

Response management sought to “be

a better partner” to the target

communities, the local governments

and the other humanitarian actors

present, thereby improving the

connectedness, contextualisation and

communication around operations to

the reality of various stakeholders on the ground.29 This coordination approach was cited as good

overall, and had potentially positive, though sometimes indirect, implications for the timeliness and

efficiency of activities.30

Community validation of timeliness: When evaluation findings were presented back to

communities for their validation, North Cebu participants of two barangays provided different

perspectives on their experience. The majority of participants in one barangay said the WV

assistance was indeed timely, and came at a time when their food supplies from another NGO were

running low in quantity. “Even if the food and NFI distribution happened a month after the typhoon

they gave more than other NGOs had given,” said a female participant. Participants of another

barangay agreed with the findings that identified timeliness issues, particularly in regards to shelter

materials, because families already started or completed their repairs when they received the

materials. Panay participants explained that due to the delay of receiving shelter materials after

repairs were already made, some households sold the materials for household income, and that

25 WV THR. 90-day Report. March 2014. 26 WV THR. 6-Month Report. April 2014. 27 WV THR. 12-Month Report. November 2014. 28 SurveyMonkey® April 2014, n=39 (Y/N/DK question). 29 WV THR. 90-day Report. March 2014. 30 WV THR. 12-Month Report. November 2014.

Page 36: End of Grant Evaluation Report

17 | P a g e

selling the materials enabled some to purchase more of similar/substitute materials but at a lower

price or to repay loans that were incurred to already start the repairs. Panay child participants also

mentioned families selling the materials in order to buy food, livelihood inputs, or for some vices

such as gambling.

West and East Leyte participants echoed the timeliness issues of shelter materials, yet, all agreed

that the timeliest WV activities were hygiene kits/WASH activities and CFW. CFW was important

and timely as the income was used for food needs—filling the gap after distributions ended,

educational expenses for children and to pay debts.

Page 37: End of Grant Evaluation Report

18 | P a g e

III. EFFICIENCY

As the implementation of the grant programme activities fit within the larger THR, the following

findings relate to the efficiency of all WV Response activities in the communities supported by the

grant programmes. It should be noted that the main efficiency challenges discussed below were

strongly perceived by staff as contributing to delays in timely delivery of programming, which has

also been covered in the timeliness section.

This section reflects findings from online and face to face interviews with dozens of WV staff across

various levels,31,32 as well as findings from the desk review of project documents triangulated with a

recent lessons learned activity of 2015 to show points of progress and recent staff feedback on

additional recommendations.33 While this section addresses many topics related to efficient

implementation of the programme, it is important to mention that several external factors beyond

WV’s control also affected implementation, cited by the staff as political issues and weather

conditions (including subsequent disasters).

Nearly two-thirds (63%) of the staff surveyed at the end of the relief phase stated affirmatively that

WV uses resources effectively and the Response is well organised. Dozens of staff, including global,

regional, support office and local response staff contributed their perceptions to the following

themes:34

1. Relationship between NO and Response

2. Emergency management system (EMS) structure

3. Preparedness

4. Staffing

5. Programming

6. External relations

7. Advocacy

1. Relationship between NO and Response

Most surveyed staff mentioned the positive relationship between the Response team and the NO,

which was a clearly stated goal from the outset of the Response. Many respondents noted the

particularly good relationship was attributed to the strong and committed regional leadership. Some

staff, particularly from NO and RO, mentioned tension with regards to the Response not respecting

and soliciting local knowledge and resources, or being surprised by decisions made by the GRRT.

The good collaboration between the NO and Response at the senior level did not always extend to

the field level, which explains varying responses to this issue.

Table 5: Efficiency: relationship between NO and Response

What worked: What didn’t work:

Commitment to collaboration from day one,

reinforced by regional leaders

Good resolution of issues

NO commitment to Response, willingness to deploy

Response alignment with NO strategy/contacts

Regional contribution for facilitation and support

Beneficiary selection, tensions between pre-existing

investment in ADP and Response to greatest need

(as previously discussed in relevance section)

Lack of utilisation of local knowledge and resources

in decision-making by GRRT

Lack of sharing NO resources (e.g., office) in some

instances (e.g.,Tacloban city where the office is

small), so Response established secondary assets Source: SurveyMonkey® April 2014, n=39; WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014.

31 SurveyMonkey® April 2014, n=39 32 WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014. 33 WV THR. Lessons Learnt Report: draft. January 2015. 34 KII findings compiled and analysed by the RTE, with editing and integration into EOG evaluation report done

by TANGO International.

Page 38: End of Grant Evaluation Report

19 | P a g e

"The combination of NO, RO, and global staff was remarkable." ~WV staff

"The Response team came to help us put the fire out in our house. Firemen may break your china and step

on your flowers but they are there to help." ~WV staff

Challenges and recommendations: Overall, an important challenge was to establish a working

relationship between the NO and Response at senior and field levels at the very onset of the

programme, which WV strived to address and indeed improved communication in the Response

phase. A recommended area of improvement was the following: Briefing the NO on/about GRRT

(though no further description is available).

The 2015 lessons learnt workshop provided the following recommendation points on organisational

expectation related to NO and Response relations:

Provide clarity for all employees when the global mandate will end and the changes to be

expected with the transition to WVDF. Likewise, organisational expectations and decisions, big

or small, should be shared down the line for ownership and effective delivery.

Work to align timelines and finance reports with the NO, and to ensure that progress made in

quality assurance, DME and accountability mechanisms can also be integrated.

2. EMS structure

Almost all surveyed staff mentioned EMS being a successful and helpful system that helped clarify

roles and provide a foundation for coherent organisational structure as it was put into place from

the very beginning. A few interviewees noted that the line management for zonal managers (rather

than sector managers) was confusing and inadequate for the situation.

Table 6: Efficiency: EMS structure

What worked: What didn’t work:

Establishing a functional EMS structure from the start

Familiarity with the system because it was generated

from the region

Regional staff trained in EMS material

EMS clarified roles, especially between ND and

Response Manager, for organisational structure

EMS structure brought up issues related to zonal

managers and technical specialists’ roles

Confusion on managerial roles and how that aligned

with recruitment

Some EMS functions were siloed due to geographical

context of working on different islands

Source: SurveyMonkey® April 2014, n=39; WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014.

"This Response validated that EMS works in this context." ~WV staff

"We are used to having strong sector managers under Operations, and the sectors are the ones

implementing. Here, we had zone managers responsible for specific areas…caused confusion; it was hard to

figure out." ~WV staff

Challenges and recommendations: The EMS structure may need some fine tuning, especially

around questions of line management and the roles of zonal managers and technical specialists.35

There is a need to invest in leadership.

The 2015 lessons learnt workshop provided the following recommendation points on adaptive

management:

Create a central repository for information management and identify a decision tracker for

major decisions that are made.

35 Update from WVDF: This challenge that arose during the RTE has since been addressed by management by

reiterating and clarifying the roles of zonal managers and sectoral advisors.

Page 39: End of Grant Evaluation Report

20 | P a g e

The Response Manager should urge senior management to be responsive to staff feedback (that

should be deliberately collected) on changes to programmes to better align with a changing

context.

Grant opportunities should be sought that can be adaptive to a complex context and the WV

strategy, and those managing grants should have a good understanding of the flexibility of the

terms, thus prepared to make changes to financial practices when possible based on the security

or financial context.

Conduct a session with the senior management team and staff focused on adaptive management.

Promote community-led input to design phase, and establish community-based monitoring to

feedback into the context analysis that informs adaptive changes.

The Program Coordinator and Zonal Manager should work closely, but with clarified roles, in

activity monitoring (grants commitments) and share information (reports, grants, etc.).

3. Preparedness

The topic of preparedness was mixed, with some negative reviews, especially at the NO level, and

with regards to prepositioning and logistics. Regarding the preparedness of staff, several respondents

noted the fast deployment of 200 NO staff. Capacity gaps were mentioned, such as gaps in technical

sectors and the delay in finding an operations manager, as well as timeliness issues around terms of

reference (ToR). With regards to the NO's pre-existing relationship with government (local and

national), other agencies, and faith-based organisations (FBOs), most staff gave positive comment,

noting the NO's excellent external relationships (see the topic below 6. on external relations).

Table 7: Efficiency: preparedness

What worked: What didn’t work:

Regional preparedness, including previous trainings

and simulations, promoted by regional leader

Pre-existing NO relationships, including with national

government, and active cluster participation

Good positioning with WFP and AFTA

NO readiness of Response strategy, and with ADPs,

regular Response-mode due to recurring disasters

Prepositioning of smart phones

Integration of action points from previous learning

events

Lack of prepositioned goods and contracts, difficulty

in receiving immediate supplies (as discussed in

previous section on timeliness)

Capacity gap with NO staff, such as emergency

capacity

Lack of shelter and WASH staff (discussed more

below on staffing)

Logistics problems

Lack of P&C preparedness, some staff deployed

without ToRs (discussed more below 4. on staffing)

Source: SurveyMonkey® April 2014, n=39; WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014.

Challenges and recommendations: The NO should plan for sufficient pre-positioned relief

goods.36

4. Staffing

Staffing arose as one of the most important issues in the Response, with the lack of technical

capacity (i.e., shelter, WASH) being by far the most mentioned problem. Programming was impacted

by the lack of capacity in World Vision's technical sectors and through slow

deployments/recruitments of technical and operations staff (and lack of ToRs), which hurt the

Response in the early stages. The THR People & Culture (P&C) sought to fill staffing and technical

capacity gaps through international staff deployments and hires, which totalled 139 at the one year

mark. P&C engaged with over 1300 total staff during the first year of the Response, put processes in

place for staff care and capacity development. P&C recognised the need for technical capacity

36 Update from WVDF: THR has since pre-positioned goods such as NFI, hygiene kits and tarps that were used

for the response to Typhoon Hagupit.

Page 40: End of Grant Evaluation Report

21 | P a g e

building among managers and the NO staff seconded to the Response, some of them for the first

time in those roles.37 At the time of the staff survey, the greatest concerns were around the

strategic and quick hiring of staff, retention for continuity and staff capacity.

Table 8: Efficiency: staffing

What worked: What didn’t work:

NO deployed 200 staff immediately

Regional staff were trained

Strong operations team was brought in, on the

ground/able to work in the context from the

beginning

Strong secondments, particularly in finance so they

had experience with WV systems

Global staff worked together

Improved deployment and recruitment due to past

learnings, 80% of permanent international staff placed

within three months

Technical capacity, concern that WV is lagging behind

other INGOs for programme of this size

Lack of enough appropriate and competent staff on

the ground quickly (e.g., GRRT, and initial

deployment of six weeks due to Christmas)

High staff turnover and staff fatigue

High demand on P&C for preparedness and capacity,

some key positions not filled quickly, including

programme management and operations, which

impacted implementation (noting the difficulty to fill

some positions related to unaccompanied/ one-year

contracts)

Some cultural sensitivity issues with international staff

Source: SurveyMonkey® April 2014, n=39; WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014.

Challenges and recommendations: WV faces the challenge of needing a technically strong team

and operations staff from the start of the Response and on a continuing basis. WV should invest

heavily in capacity, including technical capacity, and to improve staff retention to avoid loss of

continuity. This will require P&C planning, prepositioning of ToRs and some revised processes.

The 2015 lessons learnt workshop provided the following recommendation points on workforce

planning and recruitment:

P&C (and all functional departments) should be actively involved during the staffing plans and

budgeting for any new grant staffing needs, also to align budgets for staffing (salary and benefits)

and operational plans. Activate an early warning recruitment practices prior to the awarding of

any possible grant, as soon as the grant staffing plan is finalized.

Workforce plans should be reviewed with P&C where there are changes or delays in

implementation. Keep the staffing projections and plans alive and updated.

P&C should guide zonal managers and sector advisors on best P&C practices and policies,

including supporting staff understanding on the performance management systems. P&C should

also coach hiring managers on international hiring policies in coordination with regional

recruiters.

WVDF, GTRN and P&C Director should be updated on the workforce plans to enable effective

planning and timely approvals of long-term secondments or replacements. This also means

preparing a strategy to ensure that WV remains a competitive employer for key positions in a

Category III Response.

Do capacity building to strengthen staff capacities in place.

5. Programming

Nearly all surveyed staff agreed on the need to increase focus on livelihoods from the start of the

Response. There was also general agreement about needing stronger technical sectors, as well as

better communications between operations and programmes. Many interviewees agreed that WV

does well with its traditional forms of assistance (i.e., food, NFIs, basic CFS), but there is a need to

be more pro-active in newer forms of programming (i.e., children in emergencies (CIE), livelihoods,

37 WV THR. 12-Month Report. November 2014.

Page 41: End of Grant Evaluation Report

22 | P a g e

micro-finance). Respondents were generally enthusiastic about the recovery phase strategy, though

some noted a timing gap before recovery was discussed. Most respondents mentioned accountability

and the accountability framework, noting that communities were engaged with providing feedback

and the staff indicated satisfaction because of the beneficiary satisfaction.

Note: These sectoral programming issues also relate to the effectiveness of the activities, and are

further discussed in the next section.

"What we did was of good quality and well received." ~ WV Staff

Table 9: Efficiency: programming

What worked: What didn’t work:

NFI

Large distributions, well planned, ahead of other

agencies

NFI too slow for WV’s size (as discussed

previously in section on timeliness)

Child protection/education

Good programmes in first three months, including child

protection

CFS transitioned into TLS, helping children get back to

school in the relief phase

CFS not coordinated with the education system,

and education in emergencies could improve

CIE limited to CFS

Psychosocial needs not addressed systematically

Shelter

Transitional shelter just getting started, providing tools

and engineering support, cited as a good approach

Looking beyond shelter to livelihoods is a positive

strategy

Problems with no build zones

Lack of longer term vision beyond distributions

that could be supported by separate and future

funding

WASH

WASH programming implemented well Need for more on-site WASH staff

Cash programming, livelihoods

Technical support for cash programming, and

commendable information management

Cash programming: started late according to

some staff,38 could be integrated better with

other activities, and receive more focus

No activities in first 90 days for restoring

livelihoods

Accountability

Beneficiary selection and accountability report

Separate accountability team worked well

Frontline SMS

Community engagement

WV was a leader in this area

No comments

Other: Strategy, M&E

Strategic decision to unite WV management lines for a

stronger Response

Good transition between emergency and recovery

phases, strong recovery strategy

Assessment reports were elaborate resulting in strong

targeting criteria. Secondary data were used to

produce tools (OAM and BPAT) for evidence-based

programming.

Rapidly changing context made it difficult to

finalise the budget; locations and sectors were

changing, thus grants necessitating adjustments

Procurement and logistics needed a better

overall tracking system and there were some

information management issues

Source: SurveyMonkey® April 2014, n=39; WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014.

38 Note that community validation feedback suggested the cash income from CFW was indeed timely as it

occurred when food distributions were ending.

Page 42: End of Grant Evaluation Report

23 | P a g e

One of the main themes on programme efficiency that emerged from surveyed staff was the need

for cross-sector coordination among staff and for reporting, including integration of sectoral

interventions. Other long-term improvements involved consideration of how the ADP will integrate

learning from the THR into ongoing programming, and integrating cross-cutting themes such as

climate change adaptation and spirituality into programming.

Challenges and recommendations: Some cross-cutting challenges for improving future

responses included the following:

Child-focused programming: this must continue to be clearly defined for CiE and other sectors,

with priorities decided prior to the next emergency (though, no further explanation provided).

Early recovery: In a non-displacement context, supporting self-recovery is important, particularly

with distributing materials and advice on shelter. Earlier strategic thinking for rehabilitation phase

is needed, including how to move towards livelihood support activities (beyond cash transfers).

Note: livelihood activities were planned for as early as December 2014 with some seed

distributions taking place in February 2015, but delays and other challenges were faced, as

discussed in this section and previously in timeliness.

More technical capacity is needed, as discussed under staffing, both at national and global levels.

Enhanced tracking of goods and expenses is needed.

Internal communication and information management needs to be improved so that operations

and programming can work together more efficiently.

Further integrate/mainstream disaster risk reduction (DRR) into all programming.

The 2015 lessons learnt workshop provided the following recommendation points on inter-

departmental business processes that impact programming efficiency:

Conduct regular interdepartmental fora or create inter-departmental working groups per

location to review achievements, challenges, community feedback and complaints, and to discuss

gaps and inconsistencies in information and agreement on action plans. This meeting should

facilitate quick decisions on crucial issues, through consultation.

Improve monthly reporting between programmes, operations and the Response Director.

Streamline grant implementation and management systems across all functions.

Map business processes across departments to see what exists, where are the gaps, and how

business processes align between departments.

Include and engage all departments that have a key role to play in the grant design process: P&C,

supply chain, etc.

6. External Relations

Most respondents were very positive about the NO's external relations with government and other

international agencies, both in terms of preparedness and in actual Response (collaboration with UN

agencies on data sharing was cited a few times by KIIs, for example).

“External relations, this is where World Vision’s strength is." ~WV staff

Page 43: End of Grant Evaluation Report

24 | P a g e

Table 10: Efficiency: external relations

What worked: What didn’t work:

Strong cluster coordination and engagement,

continuity ensured by partnering NO and

international staff as leads

Senior staff served as liaisons

Good Response to donor opportunities

WV ability to leverage existing relationships, for

example, to use government warehouses and offices

WV recognised by government and invited to

conversations, integrated approach appreciated by

partners

Support Office (SO) visits

Difficult to have continuity in clusters with constantly

changing WV leads as representatives

Source: SurveyMonkey® April 2014, n=39; WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014.

Challenges and recommendations: Apart from the learnings with the consortium challenges,

the question of Christian Commitments (CC) arose regarding how WV is helping and partnering

with the local church while maintaining the humanitarian imperative. Another recommendation was

raised for enhancing local partnerships, suggesting improved coordination with local partners and

other NGO partners, as well as a strategy to capacitate the government and communities in a way

that minimises dependence on NGO leadership for development.

7. Advocacy

Generally speaking advocacy was not regarded as a critical issue by many surveyed staff; as one

respondent said, the "context didn't beg for a lot of advocacy," (i.e., neglect of children); though,

some mentioned good advocacy work that was done. The NO has good, longstanding advocacy

strategy, which was crucial as a pre-existing piece, even with no full-time advocacy staff at the

regional level. Children’s MIRA was cited as commendable, but with the question of whether WV

used it enough.

Surveyed WV staff provided the suggestion of advocacy efforts promoting the formation of people’s

organisations to mobilise or empower communities, particularly less organised and impoverished

communities.

Challenges and recommendations: The question should be explored on advocacy connecting to

CVA with longer term plans. Also, in the context of a strong democracy, WV may engage and

introduce advocacy issues in new ways.

Page 44: End of Grant Evaluation Report

25 | P a g e

IV. EFFECTIVENESS

As the implementation of the grant programme activities fit within the larger THR, the following

findings relate to the effectiveness of all WV Response activities in the communities supported by

the grant programmes.

This section addresses effectiveness of the grant programming through discussion of the impact on

households by programme sector, or activity. The evaluation findings for the sectors, some of which

include both relief and recovery phase grant-supported activities, are presented within the

framework of the Response Outcomes: 1, 2 and 4.39 Note that Outcome 3 is implemented for

recovery and rehabilitation phases and not included in the funding from the three EOG evaluation

donors. For the full Response logframe, see Annex G. For discussion of the contribution of project

outcomes towards achieving the goal, see the next section on resilience.

Table 11: Response outcomes and outputs for three EOG evaluation donors

Outcome 1: Typhoon-affected families and communities have improved living conditions

and access to basic services

Output 1.1 Shelter, NFI

Output 1.2 WASH

Output 1.3 Education/child protection

Output 1.4 Health

Output 1.5 CFW/Community assets repaired/rebuilt

Output 1.6 Food distribution (not included in grants)

Outcome 2: Typhoon-affected families have restored affected livelihoods and increased

capital and asset base1 (ADH and DFATD 2 only)

Output 2.1 Livelihoods: Agriculture/farming support

Output 2.2 Livelihoods: Fisheries support

Output 2.3 Livelihoods: Alternative livelihoods support

Outcome 4: Typhoon-affected communities, families including children are empowered

to inform World Vision Response programming

Output 4.1 Accountability: Information sharing

Output 4.2 Accountability: Consultation and participation

Output 4.3 Accountability: Feedback/complaints Response

Output 4.4 DME system Note: the restoration of community assets (e.g., building markets) has since been removed from Outcome 2,

which now focuses on the HH level, and community infrastructure repairs continue as part of Output 1.5.

Benefits of WV projects: Overall, the benefits of receiving WV assistance align with the WV

projects previously named as most useful. As a result of these activities, households described

improvements to their food security, household economic security, shelter, health, hygiene and

safety, including improved well-being for children (Figure 9). For the top four benefits the zone

percentage that exceeds the average across zones is shown, which demonstrates some variation in

perceived benefits of activities across zones: 28% of Panay activities provided the benefit of meeting

or augmenting the food needs of families. One in five activities (20%) reported by households of

West Leyte helped them to save money for other purposes. Twenty-two percent of East Leyte

activities provided the benefit of repairing or obtaining shelter, and North Cebu activities (21%)

provided increased security and personal safety (i.e., from theft or abuse)(see Table 20 in Annex C).

The vast majority of WV staff surveyed online (96%) as the relief activities were wrapping up

believed the THR was leading to planned positive changes.40

39 The differences between the relief and recovery phase logframes have been reconciled with the revised

logframe in the 12-month report. This evaluation has reviewed the previous logframe but has agreed with the

THR to report against the revised outcome indicators. 40 WV THR. EOG Evaluation KII Survey Findings, conducted by RTE. March 2014.

Page 45: End of Grant Evaluation Report

26 | P a g e

Figure 9: Top benefits of reported WV activities (n=13861)

1 2840 total activities reported by households. For all activities listed by HH, the HH were asked the benefit

of receiving WV assistance. This chart lists the top ten most commonly cited benefits.

Satisfaction with benefits: The households were satisfied with the benefits for nearly all reported

activities, 90% satisfied and 9% somewhat satisfied (see Table 21 in Annex C for zonal results). This

high level of satisfaction may be expected of a population with emergency needs, but also shows the

types of perceived benefits associated directly with WV assistance, thereby contributing to the

discussion on achieving outcomes.

As shown in Table 12 below, when asked ‘what could have been done better for the project/activity

to be beneficial?’ the households’ responses for the activities they benefited from centred around

two areas of improvement: extend the length (reported for 39% of activities) and increase the

quantity of materials (15%), while there were no suggestions for 34% of reported activities. It should

be noted that even households reporting satisfaction for all activities still provided feedback on what

could have been done better for the project to be beneficial.

Not surprisingly, the main suggestion for over half of activities (55%) named by North Cebu

households was to extend the length, as this Response office was closed by August 2014 (refer back

to Table 2) and this may explain why North Cebu showed the lowest level of project usefulness

(refer back to (Figure 6). Yet, over half of the West Leyte reported activities (52%) also had this

suggestion, even as West Leyte is a zone with a recovery focus for DFATD 2. These results indicate

that while WV’s approach was intensive and short in duration, it was highly beneficial for emergency

needs.

Table 12: Types of suggestions to make reported activities more beneficial, by zone

What could have been done better

for this project/ activities to be

beneficial for you? (n=1386)1

(% of reported activities)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Extend length of project 39.0 13.9 52.3 54.6 31.4

No suggestion 34.4 50.4 20.7 18.2 45.6

Increase quantity of materials 14.9 24.7 15.1 11.4 13.3

Use better quality materials 3.0 N/A N/A N/A 3.3

Page 46: End of Grant Evaluation Report

27 | P a g e

Table 12: Types of suggestions to make reported activities more beneficial, by zone

What could have been done better

for this project/ activities to be

beneficial for you? (n=1386)1

(% of reported activities)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Don’t know (DK) 2.8 N/A N/A 7.5 N/A

Others* 2.6 4.8 N/A 4.1 N/A

Increase cash amount 2.1 N/A N/A N/A 3.5

Include more participants 1.1 N/A N/A N/A N/A

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative, and line items with zone total <30 omitted. 1 3172 total activities and responses to ‘more beneficial’ question reported by households. For all activities listed by HH,

the HH were asked what could have been done better for this project/activity to be beneficial for you.

* Implement other interventions (shelter, livelihood, WASH, food); provide cash assistance to pay for labour (e.g., shelter

repair); improve beneficiary selection process; provide food, etc. For the translated listing of ‘other’ responses see Table

22 in Annex C.

Outcome 1: Typhoon-affected families and communities have improved living

conditions and access to basic services

Sectors: Shelter, NFI, WASH, child protection/education, health and CFW

All four grant programmes contributed to Outcome I achievements. The relevant Response sectors

for Outcome 1 include: Shelter, NFI, WASH, child protection/education, health and CFW. The EOG

evaluation survey focused on collecting household level data on the household living conditions

related to shelter and WASH. Evidence from other data sources such as the children’s FGD, CL

and staff surveys and programme documents are also integrated throughout to elaborate context or

provide confirmation of HH findings.

SHELTER

Shelter emergency kits were provided across all zones through the SHO and DFATD 1 grants. SHO

also provided shelter toolkits in the recovery phase to Panay, North Cebu and West Leyte zones.

Shelter Type A and B assistance was provided to West Leyte through DFATD 2 and East Leyte

through ADH (refer back to Table 2 and Table 3). WV shelter activities began with emergency

shelter kits (tarpaulins) in the relief phase, and then shelter Type A (some assistance started end of

relief phase) and Type B assistance continued through the recovery phase.

Typhoon Haiyan’s damage and destruction to homes was immense. Makeshift shelters were quickly

erected by families and communities to guard against rain, flooding and extreme weather; some

received tarpaulins and emergency shelter kits. The rapid assessment of November 2013 showed

76% of households were living in a house, but for most this was a makeshift tent made of salvaged

Page 47: End of Grant Evaluation Report

28 | P a g e

materials and with inadequate covering; the provision of tarps and ropes along with advocacy with

the government were their suggestions for addressing immediate shelter needs.41 Among households

that reported receiving shelter assistance, nearly half (48%) recall residing in their own homes in

March 2014 (Figure 10), which was at the end of the relief phase and when the shelter materials

distributions were just beginning. This may show that some households already attempted to repair

their homes when distributions began. WV staff surveyed at the end of the relief phase42 reported

that four months had passed and people were already attempting to rebuild their homes at their

expense, yet without knowing the standards of the Build Back Better (BBB) principles. The children

recalled sleeping in homes without roofs or doors in the aftermath of the disaster, and this impacted

their health and learning. They said that many families moved in with neighbours, relatives or to a

government shelter/community centre and that they asked for assistance, which is also shown in the

chart below with about half of the households recalling they were not able to live in their own

homes due to the extensive destruction. Families faced challenges with being able to repair their

homes and retrieve materials to do so, particularly with stronger materials (see FGD quotes below).

“Many agencies came to help us, World Vision was one of them who gave us food and tarpaulins.”~ boy

“We had the very worst situation. We just slept on the floor. If it rained, we all got wet and it was very cold. I

asked myself, “is this really happening?” ~ boy

“Our house was blown away by the strong winds during the typhoon. It was not sturdy enough against the

strength of the typhoon because it was only made of bamboo” ~ girl

“We cannot ask other people to help us repair our houses because we did not have money to pay for

carpenters who also needed money to repair their own houses.” ~ girl

Figure 10: HH recall of shelter at end of relief phase (n=5591)

1 Of households that report receiving shelter benefits.

After one year of recovery, four out of five (81%) shelter assistance beneficiaries were satisfied with

WV’s shelter interventions, particularly the quality of materials distributed, but some reported

conflict in the community due to families with partially damaged homes not selected to participate.43

The children clearly listed the WV-supported activities of rebuilding and repairing houses and

providing shelter materials as the most useful for addressing their priority shelter problem.44 The

41 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013. 42 SurveyMonkey® April 2014, n=39. 43 WV THR. 12-Month Report. November 2014.

Page 48: End of Grant Evaluation Report

29 | P a g e

shelter materials distribution and training (Type A) also built upon the top contributions of manual

labour and construction skills that households said they could make towards their own (and

community’s) recovery.45 Surveyed staff named shelter activities as providing the greatest benefit in

meeting the needs of children during the emergency, and for reasons related to child protection,

security, health/mental health and the ability to learn and have hope.46

As part of receiving the shelter materials, the households took part in a BBB workshop to receive

training on disaster-resistant and risk-reduction repairs. The PDM report for East Leyte zone (ADH

and DFATD 1 funded) showed that nearly three-quarters of surveyed shelter beneficiaries having

completed training reported knowledge on shelter repairs that would mitigate the risk or impact of

future typhoons, and of those with that knowledge, approximately half said they already enacted

certain measures in their repairs, including: laying of foundation, bracing and roofing. But for those

households that reported having the BBB knowledge yet not putting it into practice, they cited the

challenges of inadequate materials and the lack of capacity among able and working household

members to do the repairs or to pay for labour.47 This issue of inadequate materials came up

previously as a reason for dissatisfaction with the project benefits (refer back to Table 12), and was

further reiterated, among other challenges and feedback, through the community validation process

(see quotes below).

Community validation feedback on shelter (see Annex D for all quotes):

“Though some would say that the shelter project was somehow delayed, for me it was okay as it was

implemented.” ~ adult, East Leyte

“Whatever materials WV provided, I just tried to augment them.” ~ adult, Panay

“It was not able to serve its purpose. People needed money for their other needs to they sold the shelter

materials.” ~ adult, Panay

“The build back better principles were not adopted because the materials were lacking and quality of some

materials like the coco lumber were inferior (not mature enough).” ~ adult, Panay

“I think only the houses of the carpenters and the package B houses can be considered as disaster resistant

houses.” ~ adult, North Cebu

“We are capable of repairing our house but food and education is of higher priority.” ~ adult, West Leyte

NON-FOOD ITEMS

Households surveyed in the aftermath of the typhoon had listed the need for the following basic

household items: sleeping mats, clothing, blankets, cooking utensils and hygiene items.48 NFI kits

were provided across all zones through the SHO and DFATD 1 grants (refer back to Table 2 and

Table 3). NFI provided basic household goods that were lost in the typhoon. The kits contained

blankets, mosquito nets, plastic mats and a can opener. The PDM about one month after Typhoon

Haiyan hit showed that the vast majority of households (range of 90-95%) were satisfied with the

items received, with similarly high satisfaction with the registration and distribution processes.

Further, nearly all distributed items were reportedly used by the immediate household members,

while seven percent of Panay households reported sharing items with others. PDM respondents

suggested the distributions could be improved by providing more information about how to give

44 WV THR. EOG evaluation qualitative report. March 2015. 45 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013. 46 SurveyMonkey® April 2014, n=39. 47 WV THR. PDM Report: Shelter Materials Distribution Project (Package A) in East Leyte Zone. 1 August 2014. 48 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013.

Page 49: End of Grant Evaluation Report

30 | P a g e

feedback to World Vision; ensuring that everyone is registered and receives the same items; and

reducing the waiting time at distributions.49

The provision of relief goods (including NFI, water, hygiene kits and food items) was considered the

most useful activity for addressing the priority food need by child FGD participants.50 The

community validation further explained how provision of emergency relief items helped to ease the

tension of household needs in the aftermath of the typhoon (see quote below).

Community validation feedback on NFI (see Annex D for all quotes):

“The people are very happy to have received the NFI because they were not expecting to have received that

kind of intervention. Families do not have the capacity to buy NFI items as their income is just enough for

expenses for food.” ~ adult, North Cebu

WASH

The DFATD 2 and ADH grants provided latrine construction (Types A and B), hygiene promotion

and water systems repair across the East and West Leyte. WASH facilities (latrine repair kits, septic

tanks and latrine reconstruction for the most vulnerable) were provided at the household level in

coordination with shelter activities. At the community level, water systems (Level 1 and 2) and

public drainage were repaired

and reconstructed. At the start

of the recovery phase, CFW

repaired WASH facilities and

provided quick-impact income

support for target families, and

continued on with repairs to

schools and health facilities.

CLTS/PhATS trainings were

conducted to improve

community sanitation, hygiene

and basic health practices. Most

household level WASH activities

were completed at the one year

mark, while community level

activities were ongoing through

the recovery phase.51

The few children who reported water as their priority need after the typhoon noted the long

queues and discord in the community due to inadequate water supply, and that water supply was

impacted by loss of electricity (see FGD quotes below), among health issues from contamination.

Results from the rapid assessment of November 2013 showed that greater proportions of Leyte and

Panay (Iloilo) households cited water and health has pressing problems.52 At the end of the relief

phase World Vision staff named WASH activities as providing the greatest benefit in meeting the

needs of children during the emergency because of the benefits of preventing disease and improving

hygiene practices.53

49 WV THR. PDM Summary Report. 9 December 2013. 50 WV THR. EOG evaluation qualitative report. March 2015. 51 WV THR. 12-Month Report. November 2014. 52 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013. 53 SurveyMonkey® April 2014, n=39.

Page 50: End of Grant Evaluation Report

31 | P a g e

“After the typhoon, the water was dirty. A lot of people fought each other while waiting in line to fetch water

and it seemed like they would kill each other.” ~ boy

“We got water from a deep well and water pump. The water got dirty from flooding. There were faucets,

but we could not use them because there was no electricity. We just boiled water so that we had something

to drink.” ~ girl

More than four out of five households

surveyed (83%) are currently able to

meet their households’ needs for

clean, safe drinking water, and 17%

are partially able to meet their needs

(Figure 11).

The sampled populations from the

baseline study were not the same

(they did not include North Cebu), so

there cannot be a direct comparison;

nonetheless, this finding shows an

overall improvement from the

baseline where 70% of households in

WV zones were able to fully meet

their drinking water needs (baseline data collection in March 2014).54 With East and West Leyte the

focus for WASH recovery activities for DFATD 2 and ADH, Table 13 shows the ability of East Leyte

(81%) and West Leyte (83%) households to fully meet their drinking water needs at EOG. This also

shows general improvement from the March 2014 data as a comparison point of 68% and 71%,

respectively.

Water source: The vast majority of households rely upon improved or protected drinking water

sources,55 most commonly a public stand post or tap (35%), piped water into the house (15%) or

outside the house (14%), among other sources (Figure 12). The top two water sources, which

combined account for nearly half of the East and West Leyte households where grant activities for

water systems occurred, were public stand or tap (East Leyte: 41% and West Leyte: 21%) and piped

water to house (East Leyte: 18% and West Leyte: 24%).

Given that most households have access to safe drinking water, water treatment is not needed for

over half of the households (57%), and for households that use water treatment methods filtration

and boiling are most common (see Table 32 in Annex C).

54 WV THR. (Rehabilitation Phase) Baseline Report, TANGO International. June 2014. 55 WHO/UNICEF. Joint Monitoring Programme (JMP) for Water Supply and Sanitation. Accessed 23 March

2015 at: http://www.wssinfo.org/definitions-methods/watsan-categories/

Figure 11: HH drinking water needs met (n=1382)

Note: “Not at all” responses were less than one percent of cases.

Table 13: Percent of Leyte HHs fully able to provide for their drinking

water needs

How well is your HH currently able

to meet your needs for clean, safe

drinking water? (%)

World Vision

Zones

East

Leyte

West

Leyte

Fully 82.8 81.3 83.1

n (unweighted) 1382 361 338

Note: Calculations of the zone total cannot be done by hand because the values across zones

have been weighted.

Page 51: End of Grant Evaluation Report

32 | P a g e

Figure 12: HH main drinking water sources (n=1382)

Colour code: Dark blue=improved/protected water source / light blue=unimproved water source1

Note: Percentages do not add to 100 because the question allows multiple responses. 1 In some contexts water kiosk vendor and bottled water are considered unimproved, and can only

be considered improved only when the source of the bottles/kiosk is improved.

Sanitation facilities: The primary toilet facility used by households is flush/pour flush to sewage

system or septic tank (60%), which is considered an improved sanitation facility.56 The other most

commonly cited facilities are also improved: pit latrine with slab (nine percent) and ventilated pit

latrine (VIP, six percent). However, about one-quarter of households either do not have access to

any facility or utilise an unimproved toilet facility. These findings also show general improvement in

the zonal populations of the East and West Leyte where the grant programmes have focused, just

three percent of East Leyte and 15% of West Leyte households report no facility at EOG (see Table

33 in Annex C), which is lower compared to the March 2014 estimates of 21% and 22%,

respectively.57

Figure 13: HH primary toilet facility (n=1382)

Note: Percentages may not add to 100 due to rounding.

56 WHO/UNICEF. Joint Monitoring Programme (JMP) for Water Supply and Sanitation. Accessed 23 March

2015 at: http://www.wssinfo.org/definitions-methods/watsan-categories/ 57 WV THR. (Rehabilitation Phase) Baseline Report, TANGO International. June 2014.

Page 52: End of Grant Evaluation Report

33 | P a g e

Hygiene practices: The HH survey respondents most often wash their hands before eating (93%),

before food preparation (68%) and after defecation (56%)(Figure 14). Not a single HH across the

zones reported that they don’t wash hands. See Table 34 in Annex C for some variation in hand-

washing practices by zone, with an average of three instances reported by households. There is the

notable trend that North Cebu households reported fewer times when they wash their hands

compared to all other zones, which may suggest that the focus zones for the Response recovery are

putting in to practice the messages received through community hygiene promotion interventions.

Three-quarters of households regularly use soap to wash hands (76%) or detergent (22%); just three

percent only using water to wash hands (see Table 35 in Annex C).

Figure 14: Hand-washing frequency of HH respondents (n=1381)

*Other includes, for example: after cleaning the house; after working; after handling animals or farming, etc.

SUPPORT TO CHILDREN AND MOTHERS/CAREGIVERS

Includes sectors of child protection, education and health

Child protection, education and health of school-aged children, young children, mothers and

caregivers were supported through the establishment of CFS and WAYCS. CFS, which transitioned

to TLS in the relief phase, and WAYCS were funded through DFATD 1 in East Leyte, North Cebu

and Panay. Educational institutions were also repaired through CFW funded by DFATD 2 and ADH

in the East and West Leyte, which is discussed further in the next section on community assets.

Note: there are no HH survey results related to these sectors, and some there are some FGD

findings provided for education sector.

Child-friendly spaces: CFS provided safe places for children in the aftermath of the emergency. At

the end of the relief phase World Vision staff named those child protection and education activities

as providing critical benefits to the needs of children during the emergency.58 Monitoring of CFS

conducted in December 2013 reported that children across the three zones felt the CFS helped

them cope with post-disaster stress; adults agreed that CFS contributed to positive changes in

children’s attitudes, behaviours and motivation to learn.59

As was previously listed in the section on efficiency, some WV staff noted the need for

improvements in CiE activities related to expanding the scope and activities of CFS (e.g.,

psychosocial needs), particularly linking education in emergencies and CFS with the education system

(refer back to Table 9).

58 SurveyMonkey® April 2014, n=39. 59 WV THR. 12-Month Report. November 2014.

Page 53: End of Grant Evaluation Report

34 | P a g e

"Many children had been playing by the road side and begging, but after CFS, all the children were inside, being

listened to and playing.” ~ WV Staff

WAYCS: During the initial rapid

assessment, respondents reported

that Typhoon Haiyan caused

increased illness, injuries and

insufficient access to medicines;

they also described the need for

cleaned public facilities, supplies and

mobile clinics.60 Children noted the

injuries incurred during the disaster

for some community members and

the residual trauma children faced

(for instance, triggered during

subsequent rains). When presented

with the list of problems that adults

reported in the first couple of

weeks following the typhoon, all

the children agreed that health was

a problem, yet unlike some adults, none rated it as the most important problem for their family.

WAYCS provided a safe space for mothers and caregivers to care for their young children in the

aftermath of a disaster and served as a venue for basic health and nutrition education. It is an

effective space for education and health promotion, distribution of support items (e.g., breastfeeding

and infant kits), assessing children’s nutritional status and referrals to services, and capacity-building

of community health volunteers. Through DFATD 1 support, WV distributed the following

resources through WAYCS: 1,058 breastfeeding kits, 851 infant kits, 367 baby carriers and 590

delivery kits.61 Both mothers/caregivers who participated in the WAYCS (and their husbands)

observed improvements in their family’s health as a result of participation and practicing what they

had learned.62 WV staff reported that WAYCS provided important benefits to children by providing

debriefing and learning opportunities for mothers and supporting the health needs of families.63

Community validation confirmed the usefulness of the safe spaces and education supports.

COMMUNITY ASSETS THROUGH CASH FOR WORK

CFW was implemented in both the relief and recovery phases through the ADH and DFATD 2

grants in the East and West Leyte. Through DFATD 2, 1,704 community members participated in 66

CFW projects across three municipalities, which completed in September 2014.64 As of the end of

June 2014, a total of 1,548 participants engaged in 22 ADH-supported CFW projects for community

assets related to WASH, education, infrastructure, health and livelihoods.65 Some children in the

FGD cited CFW as an important WV contribution during the Response (see FGD quote below).66

The discussion of household income and livelihoods continues in the next section, Outcome 2.

60 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013. 61 WV Canada. DFATD 1 Final Report. 31 August 2014. 62 WV THR. Women and Young Children Spaces Report. May 2014. 63 SurveyMonkey® April 2014, n=39. 64 WVDF. Quarterly IHA Project Report: DFATD 2 Grant Agreement. July-September 2014. 65 WV Germany. ADH Interim Report. August 2014. 66 WV THR. EOG evaluation qualitative report. March 2015.

Page 54: End of Grant Evaluation Report

35 | P a g e

“Because of cash for work, we were able to buy food for the whole family” ~ girl

CFW was used as a quick-impact

support for household income and to

restore community assets. CFW also

built upon the top contributions

households said they could make

towards their own (and community’s)

recovery using their labour, skills and

tools.67 About half of the community

leaders surveyed reported that people

in their barangays had carried out WV

work projects resulting in new or

improved community assets. There

were a total of 38 projects reported

by community leaders across 19

barangays, such as water systems,

drainage, tree planting/ gardens, etc. One CL commented that WV could have provided more

working tools (shovels, pick axes, etc.) for the project implementation to be more effective.

The CFW PDM reports for the East and West Leyte described the impacts of the activities for

households and communities. At the household level the CFW provided temporary employment

opportunities, enhanced capacity of participants to meet the basic needs of their families, and

improved the ability of households to access credit and/ or pay debt. Benefits to communities

included rehabilitation of community assets and improved access to community services, improved

community sanitation and drainage, and increased social cohesion and coordination. The West Leyte

key informants reported that the restoration of community assets was linked to positive impacts on

the following areas– psychosocial well-being, child protection, environmental rehabilitation, DRR,

food security and community infrastructure budget. Four out of five (80%) of CFW participants in

East Leyte and 87% of West Leyte participants were satisfied with the interventions provided

through the CFW projects.68

Community validation confirmed the usefulness of the CFW in helping families recover and

benefiting the community (see quotes below). CFW was mentioned as particularly important and

timely as the intervention followed the food distributions so was a time when families needed

income for food and expenses.

Community validation feedback on CFW (see Annex D for all notes):

East Leyte: CFW was considered useful as the families were able to:

• buy food

• support children’s educational needs

• clean the community

• plant the provided seedlings in the community

• harvest seedlings for personal consumption

Overall, the grant programmes contributed to achieving Outcome 1. From the relief to the recovery

phases, living conditions gradually improved through shelter reconstruction, distribution of basic

67 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013. 68 WV THR. PDM Reports: CFW Project: East Leyte Zone (November 2014) / West Leyte Zone (October 2014).

Page 55: End of Grant Evaluation Report

36 | P a g e

household items, repair of water systems and sanitation facilities, hygiene promotion, employment

opportunities and restored community assets—including access to education and health facilities,

and through the improved safety and well-being of children and mothers. Ultimately, these improved

living conditions impacted the ability of children to learn, prevented illness and safety issues and

enabled health for families and communities. The unintended effect of timing and quantity of

materials issues for shelter interventions impacted the ability of some families to build back better.

The following photos show restored community assets through CFW: L1 water system and

community garden in East Leyte, among the many.

Summary of community validation of Outcome 1: Panay and North Cebu participants described

how emergency relief distributions allowed them to temporarily cope with household needs and to

focus on finding shelter repair materials and clearing debris. All zones echoed the importance of

shelter assistance, yet also the challenges of fully repairing their shelters with WV materials and in

line with disaster-resistant standards due to issues of: delayed material distributions, some issues

with inadequate quantity of materials, unaffordable hiring costs, land ownership problems, and the

necessity to shift the consumption priorities from shelter to other household needs.

In regards to WASH, East and West Leyte participants confirmed that because of WV’s timely

assistance, community members have access to safe water, and to toilet facilities that can be

comfortably utilised, which prevents open defecation; people also have increased awareness of

hygiene and sanitation practices and the prevention of disease for children. Some participants cited

follow-up issues with the water system and incomplete latrine construction. Children from West

Page 56: End of Grant Evaluation Report

37 | P a g e

Leyte reported current problems related to access to a safe and reliable water source, and that

households have had to purchase water bottle water.

The community validated the CFS as helpful for providing recreation, continued education and

leadership skills for children. CFW benefits to families and communities were confirmed.

Outcome 2: Typhoon-affected families have restored affected livelihoods and

increased capital and asset base

Sector: Livelihoods

DFATD 2 and ADH contributed to Outcome 2 interventions through livelihood activities in East and

West Leyte zones in the recovery phase. However, as mentioned in the section on timeliness, the

recovery phase livelihoods activities had just started at the time of the EOG survey. Thus,

interpretation of this data should consider that factor, meaning interviewed households were only

recalling how relief and recovery activities generally contributed to their household economic

situation, and for East and West Leyte this also entails the contribution of CFW for some

households. Thus, it should be noted that the impact of livelihood activities cannot be assessed here.

Findings from this section will be further explored through the frame of building resilience in the

subsequent section.

Context: The children recalled that the devastation of livelihoods meant that farmers and

agricultural workers had no employment opportunities as crops were lost, fishing livelihoods were

dramatically disrupted from loss of inputs and damage to the aquamarine life, and small business

owners suffered damage to their shops and loss of supplies. In some cases, the main income earners

of the family were injured or lost their lives. The children emphasised how they and their families

were resourceful and fully engaged in finding work to survive and recover. Casual labour and lower-

paid work was relied upon by many household members (see FGD quotes below). The children

cited support for livelihoods as important WV contributions during the Response.69

“The coconut trees and bananas are our main products. They were ruined by the typhoon so we could not

sell them. It will take months or years for the fields to produce yields again for us to sell.” ~ girl

“My father did anything he could for us. If someone asked him to do something, he immediately took the

work just to earn in order to provide for our needs.” ~ girl

“Our main sources of income which are farming and fishing were damaged. My father went out to look for

fish so we could buy food. Others engaged in casual labour like repairing houses to have money to buy food.”

~girl

At the end of the relief phase, the THR six-month report described significant challenges to

recovery due to the lack of long-term livelihood options. Affected households were dependent on

seasonal and unsustainable income sources such as non-agricultural casual labour, subsistence

farming and fishing, with a significant decrease in the sale of seafood, agricultural products and

livestock across all zones. Households also relied on income from migration remittances, NGO and

government aid, borrowing money, as well as food/CFW.70 The children FGD participants from the

current evaluation also reported that family separation was an impact of destroyed livelihoods, as

family members had to leave the community, even go abroad, to find employment. Eight percent of

households have had a member migrate either temporarily or permanently in the 30 days prior to

the survey to find work and support the household with their food needs, which was still occurring

most often in North Cebu households (14%)(see Table 36 in Annex C).

69 WV THR. EOG evaluation qualitative report. March 2015. 70 WV THR. 6-Month Report. April 2014.

Page 57: End of Grant Evaluation Report

38 | P a g e

The rehabilitation phase baseline study showed that the trend reported at six-months and that the

children recalled of casual labour taking the place of income sourced from pre-Haiyan fishing and

farming livelihoods continued through the recovery phase. This is also evident in the HH survey

findings that follow (see Figure 16). The Response activities that transitioned from CFW to restoring

livelihoods and assets were particularly relevant to this need for restored livelihoods.

At EOG, 30% of households report the coping behaviour of reducing expenditure on agriculture and

livelihood inputs in order to buy food: 40% of Panay households employ this behaviour, 30% of West

Leyte households, 26% of East Leyte households and 19% of North Cebu households. This indicates

that many households struggle to restore their livelihood assets because of the attempt to meet

their household food needs.

Figure 15: HH to reduce expenditure on livelihood inputs to buy food in

last 30 days, by zone (n=1382)

*Note: Calculations of the WV EOG zone total or average cannot be done by hand because

the values across zones have been weighted.

Page 58: End of Grant Evaluation Report

39 | P a g e

Household economics: In the month prior to the survey, non-farming casual labour (42%) was the

main income source for households, then farming labour (24%), which may indicate such households

rely on casual labour because their affected livelihoods have not been restored. East Leyte is the

only zone relying on farming labour (41%) more so than non-farming labour (28%)(Figure 16).

Formal employment was also a main source of income for all zones except Panay, where small

business such as a sari-sari store was the third most commonly reported source (18%)(see Table 37

in Annex C).

Figure 16: HH main income sources during the last month, by zone (n=1382)

*Note: Calculations of the WV EOG zone total or average cannot be done by hand because the values

across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative, and line items with zone total <30

omitted.

Households that received UCT in Panay and North Cebu within the first 90 days after the disaster

reported through PDM that casual labour was their main income source, and that their main

expense was definitively food, followed by shelter expenses.71 While the UCT PDM comprised a

different sample of barangays and UCT was not part of the grants, it provides a point of distinction

for the EOG evaluation in those two zones, where casual labour continues to be the main income

source—though not enough to restore livelihood assets when competing with food as the primary

need and expense. Notably, shelter is not the second major expense for the EOG households, but

education, health and other household repair costs instead.

As shown in Figure 17 below, the most important expenditure for households in the month before

the survey was the cost of staple food (87%), followed by educational costs such as fees or uniforms

(39%), health and medical costs (27%) and household expenses (i.e., repairs/appliances)(26%). This

corresponds to the findings presented in Figure 36 that other household expenditures related to

education, healthcare and livelihood inputs have been reduced in order to buy food. All zones named

staple food as their most important expense: East Leyte (97%), West Leyte (94%), North Cebu

(87%) and Panay (78%); followed by education and health expenses (see Table 38 in Annex C). For

East Leyte this result of staple food being the major expense for nearly all households may be

compounded by the impact of Typhoon Hagupit that hit the zone just weeks before EOG data were

collected, leaving markets devastated and families vulnerable to food insecurity.

Figure 17: HH main expenses during the last month (n=1382)

71 WV THR. PDM Report: Unconditional Cash Transfer. 23 January 2014.

Page 59: End of Grant Evaluation Report

40 | P a g e

Note: Percentages do not add to 100 due to multiple responses.

*Other responses (n=<30) include, for example: fuel, birthday/funeral/marriage, rent, clothing, etc.

Just over one in three households (35%) is able to fully meet their top expenditure, which is staple

food for most as shown above. At the zonal level, over half of North Cebu households are able to

fully meet their top expenditure (57%) compared to 40% in West Leyte, 24% in East Leyte and one

in five Panay households (21%)(Figure 18). Three-quarters of East Leyte households reported they

can partially meet their main expense, while one in ten households (10%) in both West Leyte and

Panay are not at all able to meet their top needs (see Table 39 in Annex C).

Figure 18: HH ability to “fully” meet top expenditure (n=1382)

*Note: Calculations of the WV EOG zone total or average cannot be done by hand because

the values across zones have been weighted.

Among households who are able to partially or fully meet their top expenses, most attribute

involvement in WV projects as helpful either partially (42%) or fully (42%) in meeting that expense

(Figure 19). For North Cebu households, about two-thirds (67%) fully agree that WV projects

helped them to meet their top household expense. Yet conversely, one-quarter of West Leyte

households (25%) do not at all agree that WV projects were helpful in that way (see Table 40 in

Annex C). Again, this may be due to the recent impact of yet another major typhoon in the region.

Figure 19: WV projects helpful for meeting HH expenses (n=1227)

Page 60: End of Grant Evaluation Report

41 | P a g e

Note: Percentages may not add up to 100 due to rounding.

More than half of the households (53%) reported that a household member holds an outstanding

loan. See Table 41 in Annex C for these results at the zonal level.

The main reasons for borrowing money (of the households that reported an outstanding loan) are

shown in Figure 20; not surprisingly, with staple food being the top expenditure it is also the reason

for debt for 70% of households, with the other reasons for borrowing aligned with the main

household expenditures (see Figure 17 above).

Food purchase is consistently the main reason for borrowing across zones, with variation at the

zonal level involving: Nearly one-third of Panay households (31%) also cited education costs as a

reason for borrowing, and about one-quarter of West Leyte households (26%) cited healthcare

costs (see Table 42 in Annex C). The main sources for the loans were a friend, relative or neighbour

(50%), bank or formal lending institution (19%), trader or grocer (14%) and money lender (13%),

among other less common sources (see Table 43 in Annex C).

It is notable that the reasons for borrowing were not related to shelter, water systems or latrine

repair, or to purchase of basic household items, which were the main activities of the grant

programmes. However, direct correlation of the activities to this indicator cannot be made through

this evaluation.

Figure 20: HH main reasons for borrowing money (n=732)

Page 61: End of Grant Evaluation Report

42 | P a g e

Note: Percentages do not add to 100 due to multiple responses.

*Other responses (n=<30) include, for example: to build a house, buy land, etc.

Most households did not report cash savings (82%), as shown in Figure 21, for zonal reports of any

savings see Table 44 in Annex C. The main reasons for saving correspond with both the main

household expenditures and reasons for loans previously discussed: Food purchases (44%), to

prepare for difficult times (39%), healthcare (37%) and education costs (32%).

Figure 21: HH cash savings (n=1382)

Note: Percentages may not add up to 100 due to rounding.

Overall, the relief and recovery activities of the grant programmes have likely prevented families

from further loss of livelihood assets and capital. Through the provision of relief goods and shelter

reconstruction assistance, families can then focus their limited income on household food needs and

other priorities, such as health and education. There is clearly the continued need for long-term

livelihood strategies linked to food security and the restoration of livelihoods, shifting away from

casual labour, migration or debt, particularly for consumptive needs. The livelihood activities of

DFATD 2 and ADH that started after the HH survey may show promise as to those shifts and thus

make direct contributions to Outcome 2.

Page 62: End of Grant Evaluation Report

43 | P a g e

Community validation of Outcome 2: Community members confirmed the livelihood challenges

they continue to face, namely through casual labour, because of livelihoods destroyed from the

typhoon and the link between their current insufficient income and inability to meet all household

needs—including the struggle to provide for food needs (discussed further in the section on

resilience). An adult from Sawahon said, “We were once dependent in coco farming yet those were

damaged during Typhoon Haiyan. At present, people here work in cutting lumber. Once cutting of lumber is

done, there will be a lot of jobless people.”

East Leyte participants report that because livelihood assets of the community were damaged and

there are limited livelihood opportunities, households are experiencing difficulty in supporting the

food need of family members. For those who had received WV livelihood assistance at EOG such as

animal distributions and trainings, they explained that the support allowed them meet daily needs

(e.g., buy rice and pay for school transportation), and in some cases to buy livelihood inputs, but

they were not able to begin saving (see Annex D for community validation notes).

Outcome 4: Typhoon-affected communities, families including children are

empowered to inform World Vision Response programming

Sector: Humanitarian Accountability (HA)

Outcome 4 activities were supported by all four grant programmes, and HA measures were

employed in the implementation of the programmes.

Most activities listed by child FGD participants to address their priority problems after Typhoon

Haiyan were considered by the children to be activities in which they, their families or their

communities had directly taken part.72 This concept of engagement with and alongside the

communities was more than a cross-cutting issue, but a core programme of the Response from the

start. Both the relief phase logframe and the recovery strategy name HA as a key outcome, making

THR the first Category III WV Response to do so.73

World Vision showed strong commitment and leadership to HA as a core sector in the first days of

the relief phase through the deployment of a senior HA focal point and quickly establishing a team to

implement HA activities at the first distributions as well as embed HA within the awareness of

sector staff. Most importantly, community input guided the design of the programme from the

beginning through multiple rounds of consultation and assessments in the first weeks following the

typhoon; for this WV was commended as a leader by the international humanitarian community.74

The HA activities initiated in the relief phase included the following:75

Information provision at distributions (banners and megaphones)

Registration of feedback and complaints (help desks and key staff contacts to receive phone

calls and texts)

Collection of HA data in assessments and Post Distribution Monitoring

Integration of HA commitments into grants

Approval of budget for HA activities

Endorsement of HA Team structure and appointment of HA Manager, Humanitarian

Accountability Officers (HAO), and Feedback Assistants (managing community feedback

database)

72 WV THR. EOG evaluation qualitative report. March 2015. 73 WV THR. 90-day Report. March 2014. 74 E.g., Accountability to Affected Population (AAP) working group co-lead and case studies presented at best

practices workshop (UNOCHA). 75 WV THR. 90-day Report. March 2014.

Page 63: End of Grant Evaluation Report

44 | P a g e

Translation of additional information material for communities

Orientation and sensitization of field and other Response staff to HA

Interagency engagement, training and influence

Engagement with First Response Radio to collaborate on broadcasting information to

disaster affected communities.

HA collected feedback from communities but also followed through with a feedback loop to

Response leaders and sectors that could inform programming and planning for the recovery phase.

The recovery phase expanded HA to: support the Response’s “structural-oriented” shift toward the

municipal level focus and coordination of the recovery, for instance, by working with the LGUs to

host inter-agency community transparency events;76 further integrate Complaints and Response

Mechanisms (CRM); establish Frontline SMS in every zone; develop Community Recovery

Committees (CRCs) in every barangay to assist with holding WV to meet HA standards; lead the

development of the beneficiary selection toolkit; and provide adequate messaging to communities on

the rationale for the recovery phase geographic prioritisation.77

The relief phase recommendations were to sensitise communities and train all deployable staff

before disaster hits, and to ensure all sector work plans include HA measures from the start of a

Response.78 Overall, from the community leaders’ perspective, 78% would recommend WV to

another community based on their experience (note: there was no further information collected to

elaborate this response).

The following results of the HH survey triangulated with other information are organised around:

information provision, participation, feedback and complaints mechanisms and response to

complaints.79

76 Note from NO: Structural-oriented follow-up phase refers to the work the THR will be doing with local

government in the rehabilitation phase, and how WV will apply lessons learned from working with programme

beneficiaries and government in previous phases to the rehabilitation phase. 77 WV THR. 90-day Report. March 2014. 78 WV THR. 90-day Report, WVDF (Philippines), March 2014. 79 Note: the Accountability Framework includes four pillars: information provision, promoting participation,

consulting communities, collecting and acting on feedback and complaints. Consultations were purposively not

a part of this evaluation and the focus shifted to feedback mechanisms and response as separate components.

Page 64: End of Grant Evaluation Report

45 | P a g e

Information provision: The THR aimed to provide beneficiaries with relevant programme and

disaster information such as through barangay general assemblies, translated banners, fliers and

direct communication with staff (as well as the DEC-funded Radio Abante). At the end of the relief

phase World Vision staff named HA as an area for continued improvement, and in the short-term,

the staff suggested better information provision to communities on when activities were scheduled

or changing.80

Most households (75%) are fully satisfied with the information they received about World Vision and

the relief programme.81 West Leyte households reported the lowest level of full satisfaction with

information received (57%)(Figure 22). The barangay council (49%) or barangay/community assembly

(41%), followed by from a neighbour or friend (24%), are the most commonly cited sources of

information across zones for receiving information on WV interventions (see Table 45 in Annex C).

These findings compare to 60% of households having received sufficient information on WV activities

in the immediate aftermath of the typhoon82 and about 88% at the 90-day mark.83 Community

leaders or local government (barangay) were consistently named as the preferred source of the

information by households surveyed immediately after the disaster, at 90-days and at EOG.

Figure 22: HH fully satisfied with information received about WV

and overall relief efforts (n=1382)

*Note: Calculations of the WV EOG zone total or average cannot be done by

hand because the values across zones have been weighted.

Various project monitoring reports have shown the widespread achievements of information

provision and the areas for improvement across Response projects. WAYCS’ participating

mothers/caregivers (and husbands) reported high awareness of WV and the purpose of WAYCS.

Information on beneficiary selection and operations could be better communicated by staff, such

gaps were noted in West Leyte early in the Response.84

Most community leaders (83%) agreed that communications with WV were effective. The following

are the suggestions of the community leaders for improved communication:

Provide more information about projects (n=4)

Visit the barangays, project sites more often (n=3)

80 SurveyMonkey® April 2014, n=39. 81 Satisfaction three-point scale (not at all, somewhat satisfied, fully satisfied) and option for DK, which for this

question included 11% of households and could have been used as a “not applicable” option. 82 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013. 83 WV THR. 90-day Report. March 2014. 84 WV THR. Women and Young Children Spaces Report. May 2014.

Page 65: End of Grant Evaluation Report

46 | P a g e

Show up when WV is expected to (n=1)

Participate in more community meetings (n=1)

Staff should not be disrespectful (n=1)

“It would have been better if we were informed of activities not a day before the activities themselves. For

example, livelihood training beneficiaries are told that training will be done on the 1st week of February. They

temporarily stop work because they are expecting for the training to happen.” ~Community leader

Participation and input: Two-thirds of households (67%) are fully satisfied with the mechanisms

provided by WV for them and their communities to give input on WV activities and programmes.85

The pattern at the zonal level is similar to that of receiving information (above) with about three-

quarters of North Cebu and Panay households reporting full satisfaction, 63% of East Leyte and 52%

of West Leyte households (Figure 23).

Figure 23: HH fully satisfied with mechanisms provided by WV to

give input (n=1382)

*Note: Calculations of the WV EOG zone total or average cannot be done by hand

because the values across zones have been weighted.

The THR aimed to promote the consultation and participation of community members throughout

the project cycle, such as through Frontline SMS, and the presence of help desks and feedback boxes

as standard procedure at every distribution point and community feedback boxes provided in the

location of every community project (also used as complaints mechanisms), from which the feedback

is consolidated as part of monthly reports.

The HA and DME teams worked diligently to collect input from target children, families and

communities for the DME of Response programmes from the relief to recovery and rehabilitation

phases. The key findings from such assessments, and as with this EOG evaluation, were shared with

the communities that participated in the surveys as a community validation process, empowering

community members with the information to hold WV accountable and guide their self-recovery

efforts. WV staff provided long-term suggestions for the continued improvement of HA, including

increased participation of communities in the design of projects and sustained working relationships

with affected communities beyond the THR.86

Feedback and complaints mechanisms: The THR aimed to establish/maintain CRM and

community committees and systems to support accountability processes.

85 Satisfaction three-point scale (not at all, somewhat satisfied, fully satisfied) and option for DK, which for this

question included 20% of households and could have been used as a “not applicable” option. 86 SurveyMonkey® April 2014, n=39.

Page 66: End of Grant Evaluation Report

47 | P a g e

Third in the series on satisfaction level, this question showed a similar trend across zones. Just over

half of households (54%) reported they are fully satisfied with how feedback and complaints were

welcomed,87 ranging from two-thirds of North Cebu households reporting satisfaction (66%) to 42%

of West Leyte households(Figure 24). One community leader commented that WV could have made

it more possible for the community to provide feedback and complaints. This generally compares to

a range of 76-89% of households at 90-days who had sufficient information about how to provide

feedback to WV.88

Figure 24: HH fully satisfied with how feedback/complaints were

welcomed (n=1382)

*Note: Calculations of the WV EOG zone total or average cannot be done by hand

because the values across zones have been weighted.

The most common response from households regarding methods for providing feedback is that they

“don’t know” what methods are available (38%). Methods that were known and reported by

households include: dropping a letter in the suggestion box (21%), directly talking to WV field staff

(15%), reporting feedback to the barangay chairman (14%), talking to the purok leader (13%),

attending barangay assembly (12%) or sending a text/SMS (11%), and multiple methods could be

reported (Figure 25).

Figure 25: Methods available for providing feedback on WV projects

(n=1382)

87 Satisfaction three-point scale (not at all, somewhat satisfied, fully satisfied) and option for DK, which for this

question included 36% of households and could have been used as a “not applicable” option. 88 WV THR. 90-day Report. March 2014.

Page 67: End of Grant Evaluation Report

48 | P a g e

Note: Percentages do not add to 100 due to multiple responses.

When asked about the feedback method their household used, the most common methods were

reporting to community leaders (purok, 18% or barangay chairman, 16%) or attending assembly

(16%). Notably, while one in five households was aware of the suggestion box for giving feedback,

this method was not among the top methods used by households (12%), which differs from the UCT

and shelter PDM results that suggestion boxes were a more preferred/utilised method (see next

paragraph). The method of sending a text dropped to four percent (see Table 46 in Annex C).

While UCT was not an activity of these grant programmes, it provides a reference point for

comparing the results; UCT PDM results show that about half of beneficiaries (52%) preferred to

share concerns through a help desk, 20% directly with WV staff, 17% with a suggestion box and 11%

with a text/call.89 For shelter Type A beneficiaries in East Leyte, 35% did not know of available CRM,

and if a method was used the suggestion box was most common; notably, while a quarter of shelter

beneficiaries were aware of the ability to text/call a concern, this method was not used.90

Of the households who cited using a feedback method, the most common reason for using their

selected method is that it was available and secured (63%); other common reasons are the methods

were located nearby their homes (21%), familiarity with the method (18%) or that it entailed no cost

(12%)(Figure 26).

Figure 26: Why feedback method used was preferred (n=572)

89 WV THR. PDM Report: Unconditional Cash Transfer. 23 January 2014. 90 WV THR. PDM Report: Shelter Materials Distribution Project (Package A) in East Leyte Zone. 1 August 2014.

Page 68: End of Grant Evaluation Report

49 | P a g e

Note: Percentages do not add to 100 due to multiple responses.

*Other responses included, for example: Ability to give feedback directly to WV and

ensure actions will be taken/immediate Response, preference for talking personally to

state message clearly, or preference for utilising the provided venue to express

concerns,

These mixed results on the preferred method for giving feedback may show that some types of

feedback mechanisms are more appropriate for different projects and different types of feedback

(i.e., complaints versus suggestions). It also shows that barangay assemblies (or talking with barangay

leaders) may be utilised more if there was wider awareness of the ability to access WV through the

local government; there is an overall trend of using methods of personal contact in order to receive

a direct response from WV staff, through a help desk or with community leaders. This is an

important consideration with the structural-oriented follow up phase, which means WV more

closely coordinates with local government.91

In addition, Frontline SMS is under-utilised even though beneficiaries may be aware of the method

and at 90-days said they ‘would’ use it.92 However, it may be perceived as a method that is not

personal, available or secure, and may be cost prohibitive. The Response has considered these

variations and tailored their assessment tool during the recent Typhoon Hagupit to ask about

preferred methods for both giving feedback and receiving project information.

WV responsiveness to feedback and complaints: This question received the lowest overall

reports of full satisfaction. Approximately half of households (50%) are fully satisfied with how WV

responded to feedback and complaints provided by them and the community, following a similar

trend at the zonal level as previously discussed (Figure 27).93

Figure 27: HH fully satisfied with WV response to feedback and

91 Note from NO: Structural-oriented follow-up phase refers to the work the THR will be doing with local

government in the rehabilitation phase, and how WV will apply lessons learned from working with programme

beneficiaries and government in previous phases to the rehabilitation phase. 92 Note from NO: The usage of Frontline SMS has steadily improved from March 2014 to 2015. 93 Satisfaction three-point scale (not at all, somewhat satisfied, fully satisfied) and option for DK, which for this

question included 40% of households and could have been used as a “not applicable” option.

Page 69: End of Grant Evaluation Report

50 | P a g e

complaints (n=1382)

*Note: Calculations of the WV EOG zone total or average cannot be done by hand

because the values across zones have been weighted.

The THR 12-month report explained how the feedback loop for CRM was enhanced, starting with

revising feedback templates in order to be most useful for presenting trends to the programmes and

operations teams. HA also produced a programme quality and accountability monthly report. The

HA team worked closely with sector and team leaders to appropriately respond to feedback and

complaints received, which included a feedback report (i.e., Feedback Registry and Resolution Status)

produced twice monthly to track feedback status, and to eventually inform the community of WV’s

response.94 Two examples of how this important community feedback impacted programming are:

Feedback received regarding the beneficiary selection for shelter with totally damaged houses as a

main criteria led to the inclusion of households with partially damaged houses in other interventions

such as livelihoods; and based on shelter Type A PDM results showing that households were

struggling to repair their homes due to lack of money to hire labour and inadequate materials, the

THR enacted a supplemental project to provide technical assistance, labour and cash.95 This system

for context monitoring (e.g., early establishment of CRM, etc.) that informs adaptive management of

programmes is cited by staff as an achievement of the Response.96

While providing feedback mechanisms and orientation to projects for beneficiaries is standard

operating practice at distributions, as is tracking and resolving feedback received as discussed above,

there appears to be discrepancy in how the data are reported, possibly reporting lower achievement

than the actual achievements towards this outcome. For instance, the one-year programme report

stated that just five percent of target community members had received programme information or

orientation on humanitarian standards, and that 13% of target community members were part of the

beneficiary selection process, coordinated community consultations or cluster/stakeholder

coordination.97 The reported output and outcome indicators many need to be reviewed to show a

more accurate picture of the HA achievements.

There is clearly a zonal trend of satisfaction with HA processes, and the differences in

implementation of HA mechanisms from North Cebu to West Leyte should be explored. Overall,

these HA efforts to engage the target families and communities significantly contributed to improving

the programme.

Community validation of Outcome 4: Participants from North Cebu and East Leyte confirmed

their satisfaction with the WV information provision and their preference for providing feedback,

94 WV THR. 12-Month Report. November 2014. 95 Note: these examples were provided by the THR DME team during finalisation of this evaluation. 96 WV THR. Lessons Learnt Report: draft. January 2015. 97 WV THR. 12-Month Report. November 2014.

Page 70: End of Grant Evaluation Report

51 | P a g e

particularly through barangay representatives and WV staff if an immediate response is desired, or

through a comments box because of the accessibility. SMS was cited as less preferred due to the

cost of sending a text. Panay adult and child participants expressed gratitude for the Response

efforts of WV as well as the opportunity through the community validation process to learn more

about WV assistance and to voice their thoughts and concerns (see Annex D for community

validation notes).

“It is good that we are able to share our ideas on how WV could better provide assistance. It is encouraging

for us.” ~ adult, Panay

Page 71: End of Grant Evaluation Report

52 | P a g e

Resilience

This section discusses the evidence of WV achieving their overall programme goal through the

support of the grant programmes:

to strengthen the resilience of typhoon-affected communities and families

including children.

The Response Programme uses resilience capacities and vulnerabilities as the framework for

understanding how target populations have been affected by, are coping with and recovering from

Typhoon Haiyan. The relief phase aimed to reduce vulnerability, alleviate suffering, save lives and

promote human dignity by meeting the immediate needs of affected families—e.g., basic household

items, hygiene and shelter kits, and safe spaces for women and children supported by the grant

programmes. These relief phase objectives intended to facilitate the recovery of households and

communities across the WV target geographic zones.98

World Vision understands that programming to build resilience capacity must be integrated, such as

in linking relief, rehabilitation and development (LRRD). This approach has guided the larger

Response strategy of layering sector interventions and connecting the Response with NO

development strategies. One Response document explains, “[WV] has transitioned from

distribution-focused relief activities which were necessary during the relief phase to meet the

immediate survival needs of impacted communities, to a more nuanced recovery programme that

continues to ensure that the basic needs of communities are met, while strengthening resilience and

supporting their self-recovery efforts.”99

Absorptive capacity: The relief and recovery phases also aimed to build absorptive capacity, that

is, the capacity of families and communities to bounce back from shocks (see Figure 28). World

Vision defines absorptive capacity as: families and households cope with shocks and stresses by

anticipating and preparing for disasters, and by bouncing back better and recovering quickly from

shocks. It can be thought of as the ability to manage, or cope with, shocks or stressors in the short

term. However, it is important to distinguish between positive and negative coping strategies for

dealing with shocks. Adaptive and transformative capacities are briefly discussed at the end of this

section.

Figure 28: Three capacities of resilience programming

Source: Béné, Wood, Newsham, & Davies, 2012.

98 World Vision Canada. DFATD 1 Final Report. 31 August 2014. 99 World Vision Germany. ADH Proposal. 7 July 2014.

Page 72: End of Grant Evaluation Report

53 | P a g e

This section builds upon the discussion of achieving outcomes and discusses findings on

preparedness to subsequent shocks, current priority problems of children and food security of

households as an indication of the resilience capacity of families. As shown in the previous section on

effectiveness, the major vulnerabilities around hunger, shelter, health and safety have been addressed

through WV assistance supported by the grant programmes and guided by community feedback.

However, challenges with restoring livelihoods (activities under these grants for which were just

launching as the survey was underway) and fully disaster-proofing and repairing homes combined

with the burden of providing for food needs through debt and unstable casual labour have affected

the ability of households to create an asset safety net and to move towards building their adaptive

capacity.100 Ongoing monitoring following livelihood interventions will be carefully implemented to

ensure these resilience factors improve.

The following are key elements of WV’s definition of absorptive capacity,101 which are developed as

an index score for the rehabilitation phase: people anticipate, prepare for and mitigate the effects of

shocks and stressors; people bounce back better and recover quickly from shocks, people safely

navigate their built environment, households create an asset safety net; and people have access to

(informal) social protection and community safety nets. This section discusses findings from the EOG

survey and other data sources for the first two components.

Absorptive capacity includes factors that assist households in minimising the extent of exposure to

shocks and recovering from them without using negative coping strategies. For this discussion the

following results provide evidence for the extent to which households have recovered from

Typhoon Haiyan, prepared for and mitigated future shocks:

Challenges in coping with shocks since Haiyan

Perceived recovery from shocks since Haiyan

Perceived preparedness for future shocks

Ultimately, increased resilience to shocks should improve the well-being outcomes of households. In

lieu of standard food security and nutrition outcome indicators,102 the household findings on food

security coping behaviours and the current problems described by children are discussed as evidence

of improved household resilience capacity.

EXPOSURE AND PREPAREDNESS TO FUTURE DISASTERS

In the Philippine’s context of recurrent natural disasters and shocks, it is not possible to stop

households from being exposed to shocks, but it is possible to improve their ability to withstand and

respond to shocks. A recent resilience study in Ethiopia showed that even while the exposure and

severity (as perceived by households) of shocks increases, and inevitably puts stress on household

food security, increased resilience capacity helps to reduce the negative impacts of the shocks.103

Nearly all households (97%) have faced another shock or disaster since Typhoon Haiyan. Panay

households were least likely to face another shock compared to the other zones (see Table 47 in

Annex C).104 Most households (98%) experienced Typhoon Hagupit in early December 2014 and

100 Adaptive capacity involves making proactive and informed choices about alternative livelihood strategies

based on changing conditions. Source: Frankenberger, T. 2015. Measuring Resilience. Presentation for Feed the

Future FEEDBACK. TANGO International. 21 January. 101 WV THR. (Rehabilitation Phase) Baseline Report, TANGO International. June 2014. 102 E.g., Household Food Insecurity Access Scale (HFIAS) and the Household Hunger Scale (HHS). 103 Smith, L. et al. 2014. Baseline Report for the Impact Evaluation of the Pastoralist Areas Resilience

Improvement and Market Expansion (PRIME) Project Ethiopia. TANGO International. 104 Panay households (93%) were less likely to have faced a disaster since Haiyan compared to all other zones,

a difference that is statistically significant at p=<0.05 (F=14.670, df=3, Tukey HSD/Sig=.000).

Page 73: End of Grant Evaluation Report

54 | P a g e

about half (52%) experienced Typhoon Jangmi (52%) just weeks later (Figure 29).105 At the zonal

level, 24% of West Leyte households also report experiencing the July 2014 Typhoon Rammasun

(Glenda)106 (see Table 47 in Annex C).

Figure 29: Shocks and disasters communities have faced since Typhoon

Haiyan (n=1353)

Note: Percentages do not add to 100 due to multiple responses.

*Other responses for natural disasters: Earthquake, landslide and fire (collapsed into

category by TANGO).

Four out of five households (80%) surveyed indicated they faced challenges in coping with these

additional shocks after Typhoon Haiyan. At the zonal level, significantly more households in East

Leyte (90%) faced challenges in coping with subsequent shocks after Typhoon Haiyan (as those who

also faced more subsequent disasters) compared to North Cebu (79%) or Panay (72%). Fewer

households in Panay (72%) reported facing challenges in coping with subsequent shocks than in all

other zones (Figure 30). This suggests that the WV geographic focus for the recovery phase indeed

aligns with the vulnerabilities of the zones.

Figure 30: HH challenged to cope with subsequent disasters

(n=1386)

*Note: Calculations of the WV EOG zone total or average cannot be done by

hand because the values across zones have been weighted. a-d Statistically significant difference across zones at p=<0.05.

105 Accessed 25/3/15: http://gulfnews.com/news/asia/philippines/as-typhoon-jangmi-death-toll-hits-55-

philippines-defends-Response-1.1435461 106 Accessed 25/3/15: http://www.gov.ph/crisis-Response/storm-glenda-2014/

Page 74: End of Grant Evaluation Report

55 | P a g e

The main challenges that hindered the ability of households to cope with these subsequent shocks

were lost access to livelihoods (48%) and lack of money for home, business or land repairs (45%),

among labour constraints, which reiterate the findings from the discussion on Outcome 2. The

households faced various other challenges, including:

Lack of food and water (related to destroyed crops, access to money and market, or food

price increases);

Inability to cope with trauma, anguish or distress;

House damaged/destroyed again and inability to repair (related to adequate shelter from

flood/rain and security of family and belongings); and

Family members sick or injured (see Table 48 in Annex C).

As shown in Figure 31, households rated their ability to recover as a result of assistance from WV

during the THR on a three-point scale (fully, partially and not at all) based on the following question:

As a result of participation in any of World Vision's projects, was your HH better able to face or

recover from this disaster? Overall, the majority of households (83%) agreed they were better able

to recover from subsequent shocks after Typhoon Haiyan either partially or fully as a result of WV

assistance. Notably, over one-half (58%) of North Cebu households reported being able to fully face

or recover from subsequent shocks due to WV’s Response. Three-quarters (74%) of Panay

households reported being able to at least partially face or recover from subsequent shocks due to

WV assistance. One in ten East Leyte (11%) households and 24% of West Leyte households

reported WV assistance did not improve their ability to face or recover from shocks post-Haiyan.

Figure 31: HH better able to recover because of WV assistance (n=1009)

*Note: Calculations of the WV EOG zone total or average cannot be done by hand because the

values across zones have been weighted.

DK (n=59) responses at five percent of HH were omitted from this chart.

N/A= Small sample size (n=<30) is not statistically representative.

To further elucidate household results regarding the role of WV assistance in helping families

recover after shocks, children were asked about their priority needs after Haiyan, whether they

were met and by whom. Children had a strong perception of family and community-driven activities

addressing their priority needs (76% of activities regarded by children as useful to address priority

needs were community-driven). Of the external support (24%) that children indicated helped meet

their priority needs, WV activities contributed over one-half (13%), with the remaining support

(11%) from government and other organisations (see Figure 39 in Annex C). The following quotes

Page 75: End of Grant Evaluation Report

56 | P a g e

from children describe how they themselves, their families, communities and humanitarian agencies

collaborated and contributed to relief and recovery:

‘‘We just built a temporary shelter. We salvaged corrugated sheets. We used amakan (bamboo strips) for

walls.’’ ~ boy

‘‘The people in our village worked together to build a common shelter to protect us from the elements. A lot

of families stayed there. We made adjustments accordingly to accommodate more.” ~ girl

“There was a feeding programme in the village for the typhoon-affected families.” ~ boy

“Two days after the typhoon, we helped clean our school grounds but we were not able to finish the work

because we also helped our parents in repairing our house.” ~ boy

Approximately two-thirds of households (67%) feel they are fully prepared to deal with the adverse

effects of a future typhoon or major disaster, 24% are not fully prepared and nine percent do not

know (Figure 32).107 The perception of feeling fully prepared is different than actually having the

capacity to prepare, as will be discussed below.

Figure 32: HH fully prepared to face another major disaster (n=1382)

Note: Percentages may not add up to 100 due to rounding.

Of the households that did not feel they were fully prepared to deal with a future typhoon or major

disaster, 80% reported needing stronger, disaster-resistant shelter in order to be better prepared,

which was consistently the top need across zones. Households also reported needing livelihoods and

income (30%), better health among household members including access to healthcare (18%) and

better access to early warning and preparedness information (10%), as contributing to better

preparedness for dealing with a future typhoon or major disaster, among other needs (Figure 33).

107 Notably, more households in East Leyte (79%) feel fully prepared to deal with a future typhoon or major

disaster compared to the other zones (77% in Panay, 60% in North Cebu and 52% in West Leyte), despite East

Leyte being hit the hardest by both Typhoon Haiyan and Typhoon Hagupit (see Table 49 in Annex C). This

determination exhibited by East Leyte households was also shown through the Ladder of Life measure in the

rehabilitation phase baseline, where more households in East Leyte ranked their lives as thriving and less as

suffering as compared to the other zones.

Page 76: End of Grant Evaluation Report

57 | P a g e

Figure 33: HH needs to be prepared for future disaster (n=518)

Note: Percentages do not add to 100 due to multiple responses.

*Other responses most common: adequate supply of food; improved water sources; improved community

DRR infrastructure (e.g., drainage, evacuation centres, etc.).

Community validation feedback confirmed that households feel better prepared to deal with another

major disaster because of increased awareness of how to mitigate the impacts gained through WV’s

BBB seminars (see examples below).

Community validation feedback on DRR (see Annex D for all notes):

Participants shared awareness of the following disaster preparedness measures:

ideal location for building houses and carpentry techniques for strengthening repairs

stock medicines, food, rice, clothes and lights prior to the typhoon

identify sources of information about the typhoon, e.g., TV, radio, barangay officials, WV

develop early warning system and barangay DRR system

go to a safe evacuation centre (if available)

tying down houses

CURRENT PROBLEMS AND FOOD SECURITY

During the FGDs, children were asked to describe the single most important problem they were

currently facing, how those problems impact them, and what can be done to improve or resolve the

problem. Education (46%) was now the most frequently identified current problem for FGD boys

and girls, followed by food (19%) and livelihoods (11%). This contrasts with problems identified by

children in the immediate aftermath of the typhoon (Figure 34). While access to food, livelihoods

and adequate shelter remain as current problems, there is a shift in priorities by boys and girls

compared to the start of the Response. As reflected in previous sections, this is likely due to the

efforts made by communities and WV with the support of the grant programmes to address these

key issues. With basic needs being met for more families, education is emerging strongly as the most

pressing issue for children.108

108 WV THR. EOG evaluation qualitative report. March 2015.

Page 77: End of Grant Evaluation Report

58 | P a g e

Figure 34: Children’s priority problems, recall from past and current

Source: THR EOG evaluation qualitative report, WV Philippines, March 2015.

It is notable that many children linked their current problems to lack of adequate household

livelihoods and income while also expressing deep concerns about their future. Concerns regarding

their futures resulted primarily from not being able to finish their studies due to financial constraints

(e.g., difficulty finding decent jobs), as well as a concern about continuing food scarcity in their

homes. Children’s suggested solutions emphasised family economics, including addressing debt and

lack of income. Children overwhelmingly described self-reliant ways to resolve the issues they face,

as well as policy-related solutions where advocacy could play a key role.109

Households and community leaders surveyed just weeks after Typhoon Haiyan hit described how

accessing food was the major issue they faced, due to massive devastation to livelihoods along with

increases in food and transportation prices.110 Children’s descriptions of food scarcity and hunger

within their households following Typhoon Haiyan shows that communities helped one another, and

how the massive destruction continues to impact household food access and expenditures in the

recovery phase. Crops, household food supplies, and basic livelihood tools were damaged and

destroyed by the typhoon and subsequent flooding. The children said the impact was that family

members fell ill, and were hungry, and some children recalled their households seeking assistance

from the government or NGOs. Child FGD participants considered the provision of relief goods

(including food items), as provided through the grant programmes, the most useful activity for

addressing the priority food need.111

Improved food security, based on a shift in children’s and family’s priorities away from food to other

priority needs, can be considered as a measure of ‘bouncing back’. The following discussion

describes the food security situation of households as a glimpse of improved well-being outcomes.

Food sources: Children described the challenges their families’ faced in accessing food soon after

Typhoon Haiyan hit. Food and transit (to market) costs became prohibitively expensive while home

savings and earning potential were lost. Many shops and markets were also closed. Households

shared reserve supplies with neighbours and family, but this also depleted any food stock, which was

minimal in many households to begin with. Although progress has been made to address food access,

challenges remain.

109 WV THR. EOG evaluation qualitative report. March 2015. 110 WV THR/WVDF. Rapid Assessment Report Typhoon Haiyan (Yolanda). November 2013. 111 WV THR. EOG evaluation qualitative report. March 2015.

Page 78: End of Grant Evaluation Report

59 | P a g e

The main source of food for households in the 30 days prior to the survey was through purchase

(83%)(Figure 35), showing that shops and markets are once again functioning and households have

some cash flow for food. In contrast, just after Typhoon Haiyan hit, food was reportedly accessed

through foraging, asking for help from relatives or eating relatives’ commercial supply, and receiving

food aid. It is also a positive signal that one-quarter of households (25%) rely on their own harvest as

their main food source, indicating that farming has resumed—or possibly household gardening, an

activity supported by the grant programmes. See Table 29 in Annex C for food sources by zone.

Figure 35: HH main food sources over last 30 days (n=1382)

While the January 2014 PDM comprised a different sample of barangays in Panay and North Cebu

than the EOG survey, it provides a general comparison for the EOG evaluation in those two zones,

where about one-half of unconditional cash transfer (UCT) beneficiaries surveyed sourced their food

from purchase at that time.112

Average meals per day: According to the HH survey, adult and child household members ate an

average of three meals the day prior to the survey, yet, East Leyte adults and children were eating

significantly fewer daily meals at the time of EOG as compared to other zones (see Table 28 in

Annex C).

Adult and child household members also recalled eating an average of three meals per day for the 30

days prior to the survey, which was also three, though the food source for these meals may have

shifted as discussed above.113 This suggests that access to and availability of meals eaten by

household members may have stabilised in the month prior to the survey. The PDM report of

January 2014 also reported that adults and children in Panay and North Cebu were eating an average

of three daily meals.114

Coping strategies: The coping strategies index (CSI) is an index to measure household food

security and changes in behaviour when households experience problems accessing sufficient

foods.115 See Annex B for the CSI weights. The mean CSI score for all households is 58.0, ranging

112 WV THR. PDM Report: Unconditional Cash Transfer. 23 January 2014. 113 The mean difference is not statistically significant from meals eaten 30 days prior to yesterday for adults

(t=.221, df=1367, SEM=.009, sig=.825) and children (t=.593, df=1155, SEM=.008, sig=.553). 114Note: the barangay sample differs from that of the EOG evaluation, and thus serves as a general comparison.

Source: WV THR. PDM Report: Unconditional Cash Transfer. 23 January 2014. 115 The CSI is formulated by assigning weights to the frequency of the various coping behaviours based on the

intensity and potential impact of the action on the household. For instance, skipping days without meals is

given a higher weight than resorting to less expensive or less preferred foods. Source: Maxwell, D., & Caldwell,

Page 79: End of Grant Evaluation Report

60 | P a g e

from 56.5 to 62.9 across the zones.116 The East Leyte CSI score (62.9) is significantly higher than all

other zones, which is consistent with the finding above that household members are also eating

fewer meals and indicating higher vulnerability around food security; this is consistent with other

findings such as their limited ability to meet important monthly expenses, but poses an interesting

juxtaposition around their high reports of preparedness against a future disaster (Table 14).117 118

Table 14: Copies strategies index (CSI) score, by zone

Zone Mean Median Std. Deviation Range n (unweighted)

East Leyte 62.9abc 62.1 15.0 34.6-110.5 361

West Leyte 58.2a 55.1 14.0 34.6-112.1 338

North Cebu 56.7b 55.8 14.9 34.6-102.1 337

Panay 56.5c 52.9 14.5 34.6-112.2 346

World Vision zones 58.0 55.8 14.7 34.6-112.2 1382

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. a-c The mean difference is significant at the p=<0.05 level.

While there is not a relief baseline CSI score from which to compare an improvement in coping

strategies (i.e., a lower score), children’s descriptions of the ways their families coped with food

scarcity after the typhoon hit were similar to the coping strategies comprising the CSI. Table 15

shows how children’s recall aligns with various indicators used in the CSI and suggests some

similarity in coping strategies employed in the aftermath of the typhoon with those employed at the

time of EOG evaluation. Despite the CSI involving negative strategies, a somewhat positive finding is

that the coping strategies that continue often or daily at EOG are less severe in their immediate or

detrimental effect on children than skipping entire days without eating, for instance, compared to:

relying on less expensive or preferred foods, using casual labour for food as payment and limiting

portion sizes.

Table 15: Coping strategies recalled by children and current CSI indicator used often/daily

Children’s recall of coping with food

scarcity in typhoon aftermath (similar) CSI indicator

% of HH to use

often/ daily1

Some searched far and foraged for wild

food

Gather unusual types/amounts of wild food

or hunt N/A

Harvest immature crops/consume seeds 6%

Some ate damaged/rotten food, some

bought food from other villages

Rely on less expensive or less preferred

foods 35%

Families and children shared food and

relied on neighbours, friends for food

Borrow food or rely on help from a friend or

relative 3%

Families and children traded labour for

food or money

Rely on casual labour for food as payment

26%

Many skipped meals Reduce number of meals per day 9%

R. 2008. The coping Strategies Index Field Methods Manual. Second Editon. CARE with Feinstein International

Center, TANGO International, WFP and USAID. 116 The indices that were not applicable for some HH (e.g., reduce consumption by adults so children can eat

more, if HH report no child members) were included in the index as “never” responses. This analysis

compared to that of recoding N/A responses as zero varies slightly in final values but trends are similar. 117 A higher CSI score indicates more household food insecurity. As a CSI score alone does not mean much, it

should be interpreted within an analysis of trends. This EOG evaluation score is comparable to that of the

recent THR rehabilitation phase baseline (conducted in March 2014) with CSI of 61.8 (range across zones:

57.6-73.9), but there are zonal differences (see next footnote). 118 East Leyte CSI score in March 2014 was 57.6, the lowest across the rehabilitation phase baseline zones, but also a

time when many NGOs were still providing relief. It is notable that East Leyte at EOG evaluation now scores the

highest CSI, which may be explained by coping employed to face more recent disasters, including Typhoon Hagupit.

Page 80: End of Grant Evaluation Report

61 | P a g e

Table 15: Coping strategies recalled by children and current CSI indicator used often/daily

Children’s recall of coping with food

scarcity in typhoon aftermath (similar) CSI indicator

% of HH to use

often/ daily1

Limit portion size 17%

Restrict consumption by adults so children

can eat more 8%

Skip entire days without food N/A

Families ate the commercial supply of

other family member’s shops

Send household members to eat elsewhere N/A

[While the children do not recall

borrowing in the aftermath, they

mentioned debt as a current problem,

see livelihoods section.]

Purchase food on credit, take a loan or

borrow money to purchase food 8%

1 Often is defined as three or more times per week (n=1386).

N/A= Small sample size (n=<30) is not statistically representative, and line items with zone total <30 omitted.

Households were asked what, if any, coping strategies they had employed specifically to access food

during the last 30 days prior to the survey. As shown in Figure 36, over one-half (59%) of

households reduced their expenditures on health care in order to purchase food. Forty-four percent

reduced their education expenditures and one-third spent less on inputs in order to purchase food

instead. Very few households stopped sending their children to school (i.e., so they could work

instead), had a family member migrate or sent a child/children to live with another family member or

relative. That is, households tended to employ coping behaviours that prioritised household income

for consumptive needs over other longer-term investments related to household well-being.

Figure 36: Food security coping behaviours in last 30 days (n=1382)

Note: See sections below on education and health (and livelihoods in Outcome 2) for more figures

showing the results of these coping behaviours by zone.

In all, the motivation and determination of households to face and recover from shocks is a positive

finding, and clearly WV assistance, supported by the grant programmes, has contributed to the

recovery and resilience capacity of target households. While household members are not often

skipping meals or days without eating, or eating rotten foods, their food security situation is

tenuous—particularly for East Leyte—household members are restricting their food choices and

portion sizes and the fragility of meeting their food needs depends on work trade, debt, and

reducing investments in their longer term well-being.

Adaptive and transformative capacity: In addition, the grant programmes as part of the larger

THR have laid the foundation for building adaptive and transformative capacity of households and

communities. The livelihoods activities of the recovery phase contribute to adaptive capacity by

Page 81: End of Grant Evaluation Report

62 | P a g e

strengthening the ability of households and communities to make active and informed choices to

diversify their livelihood strategies based on a changing risk context. The collaboration with

government partners and other humanitarian actors to create system-level changes and supports for

affected communities enables transformative capacity.

Community validation of resilience: Participants explain that they feel prepared to face another

major disaster because they have increased awareness of how to mitigate the impact, namely

through WV’s BBB trainings. Yet, participants also voiced the challenge of putting that preparedness

knowledge into practice due to constraints with fully repairing and strengthening their houses, and in

East Leyte there are concerns of not being able to access a safe evacuation centre.

East and West Leyte households confirmed the main sources of food and agreed on the coping

behaviours of eating less preferred foods, smaller portions and fewer meals, as well as reducing

expenditures on other important investments to buy food. East Leyte households explain the

difficulty of providing for their food needs because of limited livelihood opportunities and low

income. According to participants they are suffering from financial crisis, and some families eat just

twice a day and have planted root crops to compensate for lack of rice. A West Leyte participant

explained:

“We in our family only eat two times a day because my income as a casual labourer is too small. How much

is one hundred pesos in a day? We still have to save money so we could pay for a carpenter to repair our

house.” ~ adult

Page 82: End of Grant Evaluation Report

63 | P a g e

Conclusions

The report concludes with discussion of the overall contribution of the grant programmes to the

current status of affected populations, and with conclusions from the community validation process.

Overall, despite the challenges, this evaluation concludes the grant programmes were relevant,

timely, efficient and effective as significant components of the larger WV Response. The grant

programmes were designed to clearly align with the policies and strategies of WV and external

stakeholders and to the priority needs of affected communities. Targeting was based on analysis of

the context and humanitarian need, which was largely recognised by partners and beneficiaries as

good practice. Most activities were delivered on time, as reported by beneficiaries, and resources

were largely utilised and organised effectively, as reported by WV staff. Some delays and

inefficiencies were due to procurement and logistics issues, and mitigation measures were taken by

WV; though delays with shelter repair assistance may have impacted the effectiveness of those

activities for some households.

The grant programmes directly contributed to achievements of Outcomes 1 and 4, while

contributing to Outcome 2 by stabilising the emergency needs. The impacts of the livelihoods

activities are still to be seen. Evaluation findings show that living conditions have improved, ultimately

impacting the ability of children to learn, preventing illness and safety issues and enabling health for

families and communities. The limited livelihoods activities that took place, in tandem with the other

response activities, likely prevented families from further food insecurity and negative coping

strategies that would hinder their future livelihoods, which indirectly supports Outcome 2 and the

eventual restoration of household livelihoods and assets. In addition, HA was foundational for the

activities, as WV worked hard to ensure that the needs and voices of beneficiary families and

communities were heard and responded to.

Finally, resilience capacity has been strengthened in target households and communities, evident by

their motivation and determination to prepare for and recover from future shocks. The gains in food

security, shelter, education and health must be protected through longer-term livelihood strategies,

and DRR activities that continue to reinforce shelters and work with communities for early warning

and preparedness plans.

Recommendations: guiding questions

The following list is comprised of suggestions from the community validation process that echoed

issues that arose through the evaluation findings. Each issue is combined with a key question for

consideration for future responses.

Relevance: Community validation participants suggested that targeting, particularly for livelihoods

supports, is extended to households with partially damaged shelters. This issue was also raised by

WV staff (see relevance section).

While WV’s beneficiary selection criteria process was commendable, are there refinements to the geographic

and strategic positioning issues that could be addressed before the next Response?

Timeliness and efficiency: Community validation participants suggested that Response offices are

pre-established where the typhoon is expected to hit and that goods are also pre-positioned, with

some relief items even distributed just prior to the landfall of the storm. WV staff and programme

documents provided similar suggestions, as discussed in the timeliness and efficiency sections.

How will WV build upon the learning from THR to further prepare, pre-position and make adjustments to

P&C processes, procurement and logistics prior to the next Response?

Page 83: End of Grant Evaluation Report

64 | P a g e

Effectiveness: For livelihoods, community validation participants suggested alternative livelihoods

and business management projects, along with more careful consideration of matching skills and

interests of communities with livelihoods trainings and consideration of the quality/type of inputs

provided. They also suggested providing cash for shelter materials to avoid hauling costs and to

allow communities to buy locally-desired materials. These issues with the timing, quality and quantity

of shelter and livelihoods inputs impacting the effectiveness of these activities were raised in the

effectiveness section.

How will WV further connect shelter and livelihoods needs in the future, particularly to enable livelihoods

supports earlier in the Response and to a larger degree?

For HA, community validation participants voiced appreciation for the opportunity to share their

ideas and concerns with WV. A concern was raised regarding the ability of communities to be the

“eyes and ears” of WV activities without adequate information about the activities and preparation

for such monitoring. While WV was truly a leader in the integration of HA in the THR, similar issues

were discussed under Outcome 4, indicating that HA mechanisms could be further tailored to the

preferences of beneficiaries (e.g., methods for giving comments versus complaints) and differences in

satisfaction across zones should be explored—particularly for West Leyte. WV staff also raised

areas of improvement including community involvement in the design phase and more information

provision on activities. The programme documentation reporting the output and outcome indicators

for HA may not be adequately portraying the full achievements of this sector.

How can WV promote community ownership and utilisation of HA mechanisms, and how can mechanisms

be tailored to the type of feedback, activity, context, even zone? If HA continues to be elevated to a stand-

alone Response outcome, how can the reporting of output and outcome level indicators improve to show the

level of community involvement and empowerment and the number of complaints addressed by WV?

Resilience: Finally, community validation participants raised the issue of not being able to be fully

prepared for the next disaster due to incomplete shelter repairs along with the inability to comply

with BBB guidelines due to household income and livelihoods issues. These suggestions echo

household survey findings (also see Table 22) with recommendations for further integration of

activities and follow-up assistance/maintenance with shelter, livelihoods and other community assets

projects.

Related to the above question on livelihoods/shelter, how will WV further integrate shelter and livelihoods

issues (i.e., relief and recovery activities) to strengthening absorptive capacity? Can WV provide supplemental

support to households facing barriers to building back better and to implementing their learning from the

BBB workshop?

Page 84: End of Grant Evaluation Report

65 | P a g e

Annex A: Acronyms and abbreviations

ADH Aktion Deutschland Hilft, Germany

ADP area development programme

CFS Child-Friendly Space

CFW/A cash for work/assets

CiE Children in emergencies

CSI Coping Strategies Index

DFATD Department of Foreign Affairs, Trade and Development, Canada

DME design, monitoring & evaluation

DRR disaster risk reduction

DSWD Department of Social Welfare and Development

FGD focus group discussion

HA Humanitarian Accountability

HAO Humanitarian Accountability Officer

HEA Humanitarian Emergency Affairs

HH household

HHH head of household

LGU local government unit

NFI non-food items

NGO non-governmental organisation

NO national office

PDM post-distribution monitoring

PPS probability proportional to size

RTE real-time evaluation

SHO Samenwerkende Hulporganisaties, the Netherlands

THR Typhoon Haiyan Response

TLS Temporary Learning Space

UN OCHA United Nations Office for the Coordination of Humanitarian Affairs

USD United States dollar

WASH water, sanitation and hygiene sector

WAYCS Women and Young Child Space

WFP World Food Programme

WV(I) World Vision (International)

WVDF World Vision Development Foundation (Philippines)

Page 85: End of Grant Evaluation Report

66 | P a g e

Annex B: Methodology

Training and fieldwork

The EOG evaluation training took place the week before data collection (3-7 February), from 27-30

January 2015 in Tacloban City (East Leyte). Teams to cover each of the four survey zones were

comprised of:

HH survey teams were comprised of 10 members and one team leader

FGD teams were comprised of four team members and one team leader

CL survey conducted by DME Officers assigned as survey team leaders for each zone

HH survey teams learned the sampling technique and interviewing protocols, including how to probe

for better accuracy, how to verify data, and how to carry out questionnaires using smart phones.

FGD teams learned techniques such as facilitation, the use of different roles (e.g., note taker and

observer) and the process of analysis. During the four-day training, all teams carried out field tests

and made necessary adjustments to ensure data collection tools and team member skills were ready

for quantitative and qualitative survey implementation. The CL tool orientation was integrated with

the HH survey training in which enumerators were also oriented to the CL tool. During the

fieldwork, the CL survey was carried out by DME Officers, who also acted as team leaders assigned

in each zone.

Tools

The three survey tools for interviewing children, families and community members were translated into

four languages (Bisaya, Waray, Akeanon and Hiligaynon) to collect primary data from key populations:

adults/families, community leaders and children, respectively. The tools were designed to support and

complement each other for effective triangulation of findings.

HH questionnaire: The tool comprised approximately 80 questions119 and took about 30-45

minutes to complete. The survey sought to understand the current status of households related

to the Response sectors and their satisfaction with WV assistance related to the evaluation

criteria of relevance, timeliness, efficiency and effectiveness. The main sections of the tool were

the following (see Annex E for the full survey tool):

demographics

HH food security/consumption

coping strategies

HH economics

WASH

disaster risk reduction

accountability: information, complaints,

feedback, beneficiary selection

project participation and benefits/utility

project timeliness

FGD guidelines for children: The FGD tool was designed to complement the household and

community leader surveys with children’s perspectives for triangulation of findings on post-

disaster and present “problems, impacts and solutions”. The FGD guidelines for children aimed

to explore their priority problems and needs in the days and weeks immediately following the

typhoon (based on recall), the initiatives conducted by different entities to address problems,

including by themselves and their families, and the initiatives the children found most useful. The

FGD also explored the current (EOG) most pressing issues for children and their effects, and

ideas to improve or address such issues.

119 Note: The total number of questions varied by HH as some questions were asked multiple times (e.g.,

benefiting from multiple project types, describing the benefits of each) and some questions were skipped based

on previous responses.

Page 86: End of Grant Evaluation Report

67 | P a g e

CL survey: The tool comprised 12 closed-ended questions (including effectiveness ratings on a

five-point scale: very effective; somewhat effective; effective in some areas/not effective in

others; somewhat ineffective or very ineffective) related to their experience of how WV

activities were carried out in their communities. The main themes of the interview were

communications, planning and implementation process, functionality of the assets built/restored

(including enumerator direct observation of the asset) (see Annex F for the CL survey tool).

Additionally, data from the key informant interviews conducted with WV staff in April/May 2014

for the RTE were used as a key secondary data source.120 The KII with senior level management

were conducted in-person and over Skype by the RTE team. The KII aimed to provide understanding

on how efficiently (e.g., categories of: working, not working, challenges and recommendation) the

Response was managed, covering the following range of topics:

Relationship between NO and Response

EMS Structure

Preparedness

Staffing

Programming

External Relations

Advocacy

Sampling and participation

HH survey sampling: The sampling methodology utilised by World Vision included one main level

of stratification and a two-step process. First, the World Vision grant operational areas were divided

into four geographical zones, or strata— East Leyte, West Leyte, North Cebu, and Panay—reflecting

the distinct geographic areas where the Response programme operated. The rehabilitation

programme baseline survey (June 2014) showed that stratification by region captures significant

variation, particularly compared to East Leyte, since these zones were affected by the typhoon to

varying degrees. The design is based on sampling an equal number of clusters (i.e., 10 barangays) and

households (i.e., 35 per barangay) across the four zones (cluster design: 40x35). The clusters were

selected using probability proportional to size (PPS) sampling based on the number of households in

each cluster and total strata. To identify the specific respondents within the selected clusters, a

random walk exercise was implemented in each selected cluster.

Sample size calculations were based on ensuring the ability to compare proportion variables

between the four zones. The formula [n = deff [(Za + Zb)2 * (P1 (1 – P1) + P2 (1 – P2) )/(P2 – P1)2]

was used to calculate the sample size for household interviews in each strata. However, without a

baseline value for the relief efforts from which to detect change for an indicator, the estimate was

instead based on the percentage of the population heavily affected (e.g., percentage of the population

homeless from the typhoon as a proxy) (P1=0.21)121 and the percentage of population reached by

Typhoon Haiyan in the relief phase (P2=0.08).122 The “standard” values for a 95 percent confidence

level and 95 percent power were used (Za and Zb =1.645), and a design effect (deff) of 2.2.123 The

calculated sample size for the evaluation was 332 households per strata. For reasons of logistical

ease and to provide a cushion for non-Response of five percent, the strata sample was increased to

350 households per zone for a total estimated sample size of 1400. The final n=1,386 represents a

99% Response rate. Table 1contains the actual number of interviews completed in each stratum.

120 WV THR/WVI. Real-Time Evaluation of World Vision’s Response to Typhoon Haiyan. May 2014. 121 Total homes destroyed (average HH size of five) out of total affected population. Source: OCHA. Nov.

2013. http://www.unocha.org/top-stories/all-stories/philippines-concern-growing-people-cut-super-typhoon-

haiyan 122 WV beneficiaries reached out of total estimated Visayas population. Source: WV THR. 12-Month Report.

November 2014. 123 Magnani, R. 1999. FANTA III Project Sampling Guide. USAID. December, Washington, D.C.

Page 87: End of Grant Evaluation Report

68 | P a g e

FGD sampling: Villages for FGDs were selected from the sampling frame developed for the

household survey. Villages were purposively selected from among those where projects were

implemented from the relief phase to the current recovery phase of the Response, which spans a

period of one year. One of the criteria was geographic location (i.e., upland, coastal). Two barangays

were selected in each zone wherein two separate FGDs were conducted- one each for girls and

boys. The target number of participants for each FGD was 15 children with ages ranging from 12 to

17 years. Participants were to be randomly selected by doing a village walk wherein a ballpoint pen is

tossed in a random point in the barangay and then whichever way the pen points to, that is where

the households with children will be selected. This was, however, not followed in some of the

barangays as explained in the section below on limitations.

CL survey sampling: Community leaders (one leader per each village) were identified in each

village or barangay where the HH survey was implemented. Given the Philippine context, most of

the village leaders were male, however, the tool did not capture the respondent gender.

KII sampling: KIIs were collected from 13 senior management staff (three from national office

(NO), two from the global rapid Response team (GRRT), three global centre (GC) and five from

regional office (RO) of the 19 senior management staff targeted for KII.124

As part of the RTE,125 two online staff surveys were conducted in April 2014 separately with Haiyan

local staff and across various levels of WV.126 For the latter, 39 people across WV responded to the

survey. (Support Office (SO): seven, National Office (NO): eight, Regional Office (RO): eleven,

Global Centre (GC): three, Global Rapid Response Team (GRRT) nine. It should be noted that there

may be overlap among staff who participated in both the KII and the SurveyMonkey® survey. While

these data were used to develop the RTE report, they are also integrated in this report and

compared against the KII with senior staff; the rationale was to maximise the primary data from staff

previously collected, especially around the topics of efficiency and effectiveness, in order to save on

costs as well as staff time who were responding to the most recent typhoon of December 2014.

Participation: A total of 1,386 respondents participated in the HH survey, 40 CL participated in

the survey, and 231 child participants engaged in 16 FGDs, which included a nearly even split of girls

(49%) and boys (51%). Table 1 provides a breakdown of participation by tool and by zone.

Table 16: EOG evaluation community participation, by tool and zone

Zone # HH surveyed

# CL

participants1

# FGD

participants girls boys

East Leyte 361 10 26 29

West Leyte 338 10 27 32

North Cebu 341 10 30 31

Panay 346 10 30 26

subtotals 1386 40 113 118

Total EOG survey participants 1386 40 231 1 CL tool did not capture gender of respondent, it is assumed most/all were male.

Table 17 on the next page provides a detailed version of HH survey participants disaggregated by

province and barangay.

124 The NO notes that difficult timing, more than self-selection bias, affected the WV management participation. 125 WV THR/WVI. Real-Time Evaluation of World Vision’s Response to Typhoon Haiyan. May 2014. 126 The online survey data with local staff (n=78) are not used in this report.

Page 88: End of Grant Evaluation Report

69 | P a g e

Table 17: Survey sampling, disaggregated by barangay and grant

Zone Municipality1 Barangay # HH Grant Relief & recovery sectors

East Leyte

(n=361)

Tacloban (n=53) Palanog 23 DFATD1 Relief: Shelter kit, WASH

(hygiene kit), NFI, protection

(solar lamps), education (CFS,

transitioned to temporary

learning spaces, TLS), health

(WAYCS), CFW

Recovery: Shelter (A&B),

WASH, livelihoods, CFW

(community infrastructure)

Sto Nino 30 DFATD1

Alang-alang

(n=36)

San Antonio 36 ADH, DFATD1

Dagami (n=61) Hitumnog 33 ADH

Sawahon 28

Dulag (n=128) Calipayan 43 ADH

Salvacion 42

San Jose 43

Tabontabon

(n=83)

Mercaduhay 38 DFATD1

San Pablo 45 SHO

West

Leyte

(n=338)

Albuera (n=35) Damulaan 35 SHO Relief: Shelter kit, WASH

(hygiene kit), NFI

Recovery: Shelter (A&B) and

toolkits in SHO locations,

WASH latrines/hygiene

promotion and systems,

livelihoods, CFW (community

infrastructure)

Matag-ob (n=54) Riverside 19 DFATD2

Masaba 35

Merida (n=83) Libjo Orm 33 DFATD2

Lamanoc 50

Ormoc (n=100) Camp Downes 34 SHO

Donghol 32 SHO

Patag 34 SHO

Villaba (n=66) Balite 29 DFATD2

Suba 37

North

Cebu

(n=341)

Bogo (n=68) Santa Rosario 32 DFATD1 Relief: Shelter kit, WASH

(hygiene kit), NFI, protection

(solar lamps), education (CFS/

TLS), health (WAYCS)

Recovery: Note: this office

phased out in March with

shelter toolkit distributions

(SHO) to May, transition

completed Aug. 2014

Taytayan 36 DFATD1

Medellin (n=75) Caputatan North 36 DFATD1, SHO

Gibitngil 39 DFATD1, SHO

Sogod (n=36) Pansoy 36 DFATD1

Tabogon

(n=162)

Camoboan 35 DFATD1

Libjo Ceb 33 DFATD1

Loong 22 DFATD1, SHO

Manlagtang 37 DFATD1

Sambag 35 DFATD1

Panay

(n=346)

Bingawan

(n=35)

Poblacion 35 DFATD1, SHO Relief: Shelter kit, WASH

(hygiene kit), NFI, protection

(solar lamps), education (CFS/

TLS), health (WAYCS)

Recovery: Note: this office

phased out in March 2014 (SHO

shelter toolkits as the recovery

activity), and the transition

process is ongoing with NO

ADP and LGU

Maayon (n=34) Cabungahan 34 DFATD1

Pilar (n=35) Sinamongan 35 DFATD1, SHO

Estancia (n=105) Botongon 35 DFATD1

Gogo 35 DFATD1

Pa-on 35 DFATD1, SHO

Batan (Aklan)

(n=137)

Camaligan 33 DFATD1, SHO

Camanci 36 DFATD1

Magpagong 36 DFATD1

Mambuquiao 32 DFATD1, SHO

Total # EOG evaluation survey participants 1386 1 Light blue shading in municipality column indicates a municipality also surveyed for the Rapid Assessment of November 2013,

though barangays may differ from EOG evaluation. This difference in sampling should be considered when rapid assessment

results are reported in the narrative of this evaluation.

Page 89: End of Grant Evaluation Report

70 | P a g e

Analysis

Mixed methods approach: This report comprises triangulation of data from primary and

secondary sources. The primary data are from three quantitative and qualitative sources that

provide information from various beneficiary perspectives; the secondary data are drawn from KII

and surveys with WV staff and key programme documents:

1. HH survey (adults)– quantitative, designed for statistically representative data at the

household level

2. FGD (children) – qualitative exercises and discussion

3. CL survey (adults) – qualitative survey

4. KII and SurveyMonkey® (WV staff) – qualitative surveys (April/May 2014)

5. Desk review – 35 programme documents

6. Community validation feedback (described below)

Household survey teams collected questionnaire data on smart phones using Open Data Kit

(ODK).127 The data were uploaded to the WV server on a daily basis and cleaned by team leaders

(DME Officers) assigned to each zone. Upon completion of daily fieldwork, the FGD teams analysed

and consolidated the key FGD points, and the analysis results were submitted to the qualitative data

supervisors for review and feedback before subsequent FGDs. An emerging themes workshop was

then held 10-14 February in Tacloban City for the FGD team leaders, DME officers and qualitative

data supervisors to conduct analysis and provide outputs for the report.128 The CL survey findings

were compiled by Pat Ryan Gaid of WV Philippines. TANGO International compiled the HH survey

findings, along with the findings identified by World Vision in the CL, KII and FGD processes, to

produce this report.

The desk review consisted of 35 secondary data sources provided by WVDF. The documents

included: Response programme reports; monitoring and assessment reports; grant proposals,

budgets and quarterly reports; programme logframe and strategy documents. See Annex H for a

bibliography of the desk review documents.

Data analysis: Household survey data were analysed by consultants from TANGO International.

The HH survey results presented in this report are primarily descriptive in nature. In some instances

significance tests were conducted to test the difference in point estimates between each zone. The

analysis of the survey data was conducted using SPSS version 20.0. The original and final data, along

with the associated syntax is provided for transparency purposes.

Point estimates for output which contains fewer than 30 observations are not reported. In place of

the point estimate in the tables the reader will find “N/A” (Not Available). For analysis, cases are

weighted to account for the differing population sizes in each of the four World Vision zones.

Therefore the reader should note that taking the “average” of the zone point estimates will not equal

the point estimate reported for the total sample. Unless otherwise noted, the data are presented as

whole numbers for proportions and to one decimal place for averages (means) and scores. Data for

currency values are reported to two decimal places. All data tables developed from the analysis in

addition to those in the main report may be found in Annex C.

A strategy of triangulation was used by examining the agreement or disagreement of findings across

the various data sources and from different perspectives, adding a deeper level of understanding to

the results.

Community validation: The report includes feedback from the community validation process that

took place in April 2015, which adds another layer of depth for interpreting the data and for

127 An android app called Field Task functioned with ODK and was developed by SMAP (www.smap.com.au). 128 For the full report, see: WV THR EOG evaluation qualitative report. March 2015 (compiled by Rachel

Bernu, Consultant; Dexter Mancao, DME Coordinator World Vision).

Page 90: End of Grant Evaluation Report

71 | P a g e

discussing the contribution of the grant programmes towards the recovery of the target

communities. A total of 103 women, 73 men, 72 girls and 46 boys across the four regions took part

in the validation of key evaluation findings. See Annex D for the full results of the community

validation process.

Weighting charts

Coping strategies weighted score129

Freq. Limit

portion

Reduce

meals Skip days

Borrow

food

Less exp/

pref

Purchase on

credit

Wild

food

Eat

seeds

Send to

eat

Send to

beg

Adults

eat less

Labour for

food

1 2.3 2.9 3.7 2.3 3 2.3 3.1 3.1 3 3.5 3.1 2.3

2 4.6 5.8 7.4 4.6 6 4.6 6.2 6.2 6 7 6.2 4.6

3 6.9 8.7 11.1 6.9 9 6.9 9.3 9.3 9 10.5 9.3 6.9

4 9.2 11.6 14.8 9.2 12 9.2 12.4 12.4 12 14 12.4 9.2

5 11.5 14.5 18.5 11.5 15 11.5 15.5 15.5 15 17.5 15.5 11.5

Formula for household survey population adjustment weights

Household Survey Weight (Normalised HH Weight used in data analysis):

General limitations

While not a reflection of data quality, it should be noted that the presented HH survey data are

representative of WV programming areas only, not the entire population of listed barangays,

provinces and zones.

Limit to quantifying effectiveness: The main design limitation was no baseline data for the relief

phase with which to compare the evaluation findings. This is not a major limitation for the evaluation

criteria of relevance, efficiency, and timeliness, but for the effectiveness criteria, this is a significant

limitation. As a result, the HH survey evaluation findings are compared to other types of data

wherever possible in order to further understand the effectiveness of the grant Response

interventions.

In addition, several sectors (e.g., health, education) discussed in the effectiveness section do not

include EOG evaluation quantitative findings, and only brief findings from other primary data sources;

thus, the discussion on effectiveness is limited to secondary data (e.g., project reports) and feedback

from the community validation process.

Limit to attributing impact to grants: Another limitation of the design is that the HH results

cannot be attributed directly to the grant programmes or specific donors. The causal link between

the interventions and the impact is not clearly established without an experimental or comparative

case study design that would include a counterfactual with which to compare the results of

beneficiaries. In the post-disaster context such a type of study design (and the ability to isolate a

causal link) is not realistic. Thus, methodological rigor in this case aims to use the triangulation of

data from multiple sources and time points to provide a glimpse of the larger systems, interactions

129 WVI. Coping Strategies Questionnaire. Humanitarian and Emergency Affairs. 2008.

Page 91: End of Grant Evaluation Report

72 | P a g e

and causal mechanisms that contribute to change, with the inferences to be made about the role of

the intervention as part of that larger dynamic.130

Timing: The THR grant projects were short term in nature (typically up to six months in duration)

and many projects were completed up to nine or ten months before the survey. In an effort to

gather useful data, recall data from children and adults were collected yet adds the possibility of

inaccurate recall. Triangulation with major trends or themes from other data sources has been

necessary to mitigate and further explain the HH data.

Also related to timing, the livelihoods interventions were delayed and implementation started just at

the end of 2014 with activities ongoing at the time of the survey (see II. Timeliness section for this

discussion). Thus, the benefits to household income and livelihoods may not have been fully realised

at the time of the survey, which has implications for the findings on the impacts of livelihood

projects.

FGD venue and time constraints: Limitations from the FGD data collection related to venue

and time constraints. In one barangay, the open venue for the FGD meant that outside noise

sometimes drowned out participants’ voices, and if they were too timid to repeat themselves, some

of the information could not be fully captured, which is an important learning to consider for future

discussions. Secondly, due to time constraints the school principals selected the girl FGD

participants in North Cebu and the boy participants in West Leyte; thus the sample was not

randomised in those two locations.

130 Ebrahim, A. and V.K. Rangan. 2010. The Limits of Nonprofit Impact: A Contingency Framework for

Measuring Social Performance, Working Paper 10-099. Harvard Business School, Cambridge.

Page 92: End of Grant Evaluation Report

73 | P a g e

Annex C: Supplemental tables and figures

Annex tables

Table 18: Percent of HHs reporting assistance from WV THR, by zone

Did you or any member of your

household benefit from World Vision

project since Haiyan? (% HH,

weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

No 6.9 N/A N/A 15.7 N/A

Yes 91.8 91.3 92.7 82.5 97.9

DK N/A N/A N/A N/A N/A

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. N/A= Small sample size (n=<30) is not statistically representative.

Table 19: HH perception of most useful activities, by zone

Which was the most useful

activity? (% HH, weighted)

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Food distribution 55.9 28.9 57.2 44.3 74.0

NFI distribution (solar lamp,

blankets, mosquito nets, cleaning/

kitchen kits)

30.7 20.5 N/A 49.3 42.1

Shelter materials (Type A) 27.5 44.2 42.8 16.2 16.7

Distribution of hygiene kits 16.6 N/A 21.6 19.9 15.8

Shelter construction (Type B) 13.1 10.2 30.7 N/A N/A

Shelter (emergency kits & toolkits) 10.8 9.6 N/A 25.7 N/A

CFW / UCT 8.5 N/A 13.7 N/A 10.8

Latrine distribution (Type A) 8.1 N/A 13.7 N/A N/A

Animal dispersal (pigs, chickens, etc.) 6.5 N/A 14.4 N/A N/A

Latrine construction (type B) 3.9 N/A N/A N/A N/A

n (unweighted) 1286 342 306 296 342

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative, and line items with zone total <30 omitted.

Table 20: Perceived benefits of reported projects, by zone

Perceived benefits as reported by

benefitting HHs (n=1386)1(% of

reported activities, weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Met food needs of family 25.8 21.7 26.2 22.7 28.4

Saved money 14.3 11.8 20.1 10.1 13.6

Improved HH hygiene 11.1 8.1 12.5 13.4 10.1

Repaired/obtained shelter 9.9 21.8 11.4 8.1 6.1

Increased security/personal safety 9.7 5.5 N/A 20.7 10.1

Earned cash income (CFW) 3.9 6.8 3.9 N/A 4.8

Prevented water/vector-borne disease 3.7 N/A N/A N/A 5.2

Strengthened health to prevent illness 3.5 3.9 6.7 N/A N/A

Promoted child protection and well-being 3.4 N/A N/A 5.7 4.3

Repaired/obtained latrines 3.2 4.4 4.7 N/A N/A

Page 93: End of Grant Evaluation Report

74 | P a g e

Discouraged migration of HH members to

look for work 2.1 N/A N/A 5.0 N/A

Increased capacity to gain additional/

sustainable income 1.7 N/A N/A N/A N/A

Facilitated/helped HH members cope with

trauma / anguish / distress 1.5 N/A N/A N/A N/A

Provided privacy 1.4 N/A N/A N/A N/A

Gained/increased knowledge and improved

skills 1.1 N/A N/A N/A N/A

Obtained learning materials/supplies for

students 1.0 N/A N/A N/A N/A

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. 1 This n represents the number of households but the total number of multiple responses was 3745.

N/A= Small sample size (n=<30) is not statistically representative.

Table 21: Level of satisfaction with benefit of reported projects, by zone

Average satisfaction with benefits

across reported activities (n=1386)1(%

of reported activities, weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Not satisfied N/A N/A N/A N/A N/A

Somewhat satisfied 8.9 14.0 12.4 5.0 7.5

Satisfied 89.7 82.6 87.1 93.8 91.1

DK N/A N/A N/A N/A N/A

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. 1 This n represents the number of households but the total number of multiple responses was 2932.

N/A= Small sample size (n=<30) is not statistically representative.

Table 22: “Other” responses for improvement of benefits and frequency

What could have been done better for this project/activities to be beneficial for you?

“Other” responses (translated by WVDF DME):

Frequency

Assistance should have been provided earlier 2

Better quality and more quantity of feeds; include medicines and vitamins for pigs 3

CFW projects should have focused on building construction, such as Day Care Centre

construction. The surroundings were clean but in succeeding weeks, it just became dirty again.

1

CGI sheets should have been given 2

Community facilities should have been the focus for CFW 1

Decision should have been consistent 1

Implement other intervention (shelter, livelihood, WASH, food) 38

Improve selection process of beneficiaries 5

Increase quantity of rice 1

Install roofing to constructed hand pump as has been promised during the seminar 1

Intervention given should be appropriate 1

It would be good if a nearby water source would be installed to houses who received latrine

kits, because the tendency is that they did not use the CR because water source is far

1

Job opportunities for those who finished trainings 1

Lacking tools (wire, grinder, etc.) 1

Monitor status of livestock provided 1

Only water metre is lacking, so house-to-house connections will be made 1

Outputs of the CFW projects were not maintained, such as clearing of roads 1

Payout/cash entitlement should be done immediately (because we tend to be at debt before we

receive the cash/ It took long before payout, but it's ok now)

2

Provide cash assistance to pay for labour (shelter repair) 16

Provide food 6

Provide more vitamins in schools 1

Provide quality livestock (esp. chickens & ducks) 4

Provide quality rice 1

Page 94: End of Grant Evaluation Report

75 | P a g e

Support provided already enough so that people will not be dependent on aid 1

Tool kit was not enough. It would have been good if there was hair clipper/razor 1

We were informed that the wage was 400/day, yet only 260/day was given 1

Table 23: Beneficiaries of grant projects, by project type

Perception of (select) beneficiary

types for reported activities (of

grants only)1 (% of reported

activities, weighted) Everyone Poor HH

Shelter

damage

HH

HH w/

elderly

Larger

HH

Shelter (n=560) 25.4 34.3 50.8 19.2 8.5

WASH (n=524) 58.9 22.4 15.8 8.4 6.4

Education (n=33) N/A N/A N/A N/A N/A

CFW (n=189) 30.7 55.4 26.5 N/A N/A

NFI (n=570) 74.5 18.9 10.8 7.3 N/A

Livelihoods (n=163) 21.0 49.8 26.4 13.4 N/A

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative. 1 This table excludes food distribution projects because this is not part of the four grant programmes.

Table 24: Level of satisfaction with beneficiary selection of reported projects, by zone

Average satisfaction levels of the way

people and families were selected for

this activity across reported activities

(n=1386)(% of reported activities,

weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Not satisfied N/A N/A N/A N/A N/A

Somewhat satisfied 4.2 5.0 6.5 N/A N/A

Satisfied 94.2 91.6 92.5 96.0 94.9

DK N/A N/A N/A N/A N/A

Reasons for dissatisfaction (n=155): (%)

Deserving people were left out 36.5

Undeserving people included 26.7

Favouritism in the selection 18.8

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 25: Full satisfaction with beneficiary selection of grant projects, by zone

Average of HHs reporting full

satisfaction with beneficiary selection

of reported activities (of grants only)1

(% of reported activities, weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Shelter (n=560) 91.4 89.3 87.0 95.1 93.1

WASH (n=524) 95.7 97.1 93.5 97.2 96.5

Education (n=33) 87.8 N/A N/A N/A N/A

CFW (n=189) 84.8 81.4 82.4 N/A 87.4

NFI (n=570) 96.3 96.5 N/A 96.3 95.8

Livelihoods (n=163) 89.2 77.8 91.8 N/A 91.0

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative. 1 This table excludes food distribution projects because this is not part of the four grant programmes.

Table 26: Reports of favours requested to be included in projects

Page 95: End of Grant Evaluation Report

76 | P a g e

Are you aware of any people who

were asked to give favours to be

included in the project? n (unweighted) % HH

No 1343 97.2

Yes 39 2.8

Project favours requested

Part of the benefits received 12 N/A

Money 2 N/A

Labour 10 N/A

DK 15 N/A

Total 39 100.0

N/A= Small sample size (n=<30) is not statistically representative.

Table 27: Timeliness of reported projects, by zone

In your opinion, were these activities

carried out on time? (n=1386) (% HH,

weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

No 1.4 N/A N/A N/A N/A

Yes 97.9 96.6 96.2 97.9 99.1

DK N/A N/A N/A N/A N/A

Impacts when not carried out on time (n=47 projects)1:

Hunger 12 reports

HH lack of income/increased debt 11 reports

Community/HH assets not restored 10 reports

Loss trust in WV/willingness to participate 8 reports

Created conflict/compromised safety 8 reports

Compromised health/too weak 6 reports

Other: (e.g.,) crops failed; housing materials already sold; emergency tarp as roof not functioning; cash and

other distributions late- some due to weather conditions, etc. Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative. 1 The impact responses have been collapsed into general categories by TANGO. Percentage estimates are not provided for

the total or zones due to small Response size (n=<30).

Table 28: Average number of meals eaten by adults and children reported by HH, by zone

Mean number of meals (weighted):

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay Adults*

What was the number of meals eaten by

adult household members yesterday? 2.9 2.8ab 3.0a 3.0b 2.9

n (unweighted) 1381 361 338 336 346

What was the number of meals normally

eaten per day by adults in your household

over the last 30 days?

2.9

2.8 3.0 3.0 2.9

n (unweighted) 1371 360 336 336 339

Children*

What was the number of meals eaten by

child household members yesterday? 3.0 2.8abc 3.1a 3.1b 3.0c

n (unweighted) 1166 315 251 303 397

Page 96: End of Grant Evaluation Report

77 | P a g e

What was the number of meals normally

eaten per day by children in your

household over the last 30 days?

3.0 2.8 3.1 3.1 3.0

n (unweighted) 1163 315 251 300 397

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

* Mean number of meals eaten by adults and children “yesterday” and “last 30 days” not statistically significant at the

p=<.05 level (testing across rows) a-c The mean difference is significant at the p=<0.05 level: Adults (F=7.333, df=3, Sig=.000) and Children (F=10.354, df=3,

Sig=.000) and post-hoc between groups Tukey HSD, 0.000-0.001(testing across columns)

Table 29: HH main food sources in last 30 days, by zone

What are your HH”s sources of food

over the last 30 days? (% HH, weighted)

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Purchase 82.8 93.1 85.2 83.7 75.7

Harvest 24.6 20.2 16.6 16.3 38.4

Work trade 11.3 N/A 11.5 9.2 15.3

Borrow/loan 6.4 9.1 N/A 8.9 N/A

Gift from friends/relatives 4.9 N/A N/A N/A N/A

Food aid 2.8 N/A N/A N/A N/A

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 30: Current HH stock of rice, by zone

Zone Mean (kg) Median (kg) Std. Deviation Range (kg) n (unweighted)

East Leyte 5.7 2.0 16.5 0-250 361

West Leyte 5.4a 2.0 12.3 0-150 338

North Cebu 6.7 5.0 7.7 0-50 337

Panay 7.6a 4.0 12.9 0-100 346

World Vision zones 6.5 3.0 12.4 0-250 1382

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. a The mean difference is significant at the p=<0.05 level (Tukey HSD, 0.04)

Table 31: HH coping strategies item scores, by zone

Copies strategies index: item scores

(weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Limit portion size at meal times 5.1 6.2 5.4 4.0 5.3

Reduce number of meals per day 5.3 6.1 5.0 4.7 5.6

Borrow food or rely on help from a friend

or relative 4.2 4.4 4.4 3.7 4.3

Rely on less expensive or less preferred

foods 8.7 9.2 9.4 8.8 7.9

Purchase food on credit, take a loan or

borrow money to purchase food 5.0 5.5 5.1 4.5 5.0

Gather unusual types/amounts of wild foods

or hunt 3.5 3.9 3.5 3.4 3.3

Send household members to eat at relatives 3.3 4.0 3.3 3.2 3.2

Restrict consumption by adults so children

can eat more 5.3 7.1 4.6 4.7 5.4

Rely on casual labour for food as payment 5.4 5.3 5.2 6.3 5.1

Page 97: End of Grant Evaluation Report

78 | P a g e

Skip entire days without eating 4.0 4.1 4.0 4.0 4.0

Consume immature crops/crop seeds 4.7 3.7 4.9 6.0 4.1

Send household members to beg 3.5 3.5 3.5 3.5 3.5

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

Table 32: HH methods for treating drinking water, by zone

How do you treat your drinking water?

(% HH, weighted)

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

None 57.3 60.1 62.0 59.1 51.2

Filtration 24.6 N/A 16.3 34.4 33.2

Boiling 17.0 21.1 21.1 11.6 15.9

Chlorination 4.6 16.9 N/A N/A N/A

n (unweighted) 1381 361 337 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 33: HH access to improved sanitation facility, by zone

What is the primary toilet facility

your household uses? (% HH,

weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

None (Bush, field or no facility) 15.9 3.2(N/A) 15.2 43.5 N/A

Flush/pour flush to sewage system/

septic tank 59.7 56.9 77.2 44.4 58.4

Ventilated improved pit latrine (VIP) 6.2 N/A N/A N/A 16.2

Pit latrine with slab 8.5 13.8 N/A N/A 11.8

Composting toilet N/A N/A N/A N/A N/A

Pit latrine without slab/open pit 1.6 N/A N/A N/A N/A

Bucket 3.0 N/A N/A N/A N/A

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. N/A=

Small sample size (n=<30) is not statistically representative.

Table 34: HH hand-washing practices, by zone

HH hand-washing practices

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Average number of reported hand washing

instances (from total of six listed below) 2.8 3.0a 3.0b 2.2abc 2.9c

When do you wash your hands? (% HH, weighted)

Before food preparation 68.4 72.9 69.5 57.0 73.3

Before eating 93.1 90.9 94.1 87.5 97.4

Before feeding children 31.4 23.8 30.8 27.9 37.7

After defecation 55.6 66.2 69.5 27.0 60.3

After cleaning babies bottoms 17.8 21.9 21.6 15.4 14.8

Other1 12.5 28.8 15.7 N/A N/A

n (unweighted) 1381 361 338 337 345

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. 1 “Other” common responses included: After working on the farm or garden; after eating; whenever hands are dirty.

N/A= Small sample size (n=<30) is not statistically representative.

Page 98: End of Grant Evaluation Report

79 | P a g e

a-c The mean difference is significant at the p=<0.05 level (F=33.152, df=3, Sig=.000, Tukey HSD, 0.000)

Table 35: Soap used to wash hands in HHs, by zone

What do you usually use to

wash your hands with? (% HH,

weighted)

World Vision

Zones

East

Leyte West Leyte

North

Cebu Panay

Soap 75.5 74.9 85.4 58.6 80.0

Washing up liquid/laundry detergent 21.8 21.9 10.9 37.5 19.1

Only water 2.7 N/A N/A N/A N/A

n (unweighted) 1381 360 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 36: Coping behaviour: HH member migration for food, by zone

In the past 30 days has your

household had any members

temporarily or permanently migrate

to find food? (% HH)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

No 89.9 93.2 92.7 80.1 93.3

Yes 7.9 N/A N/A 13.6 N/A

DK 2.2 N/A N/A N/A N/A

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 37: HH main income source during the last month, by zone

What was the main source of income

for your household in last month?

(% HH, weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Casual labour (not farming) 41.8 28.3 40.7 42.3 48.3

Casual labour (farming) 24.1 40.6 20.8 23.9 19.1

Small business (Sari-sari store) 10.0 N/A N/A N/A 17.6

Formal employment 9.3 9.1 11.2 15.1 N/A

Local remittance 3.8 N/A N/A N/A N/A

Others* 3.3 N/A N/A N/A N/A

Petty trade (candles, ice, small goods) 2.9 N/A N/A N/A N/A

Crop, vegetable/fruit sales 2.1 N/A N/A N/A N/A

Various other income sources (n=<30): animal sales; government or NGO CFW; begging, etc.

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative, and line items with zone total <30 omitted.

*Other most common responses include: fishing; pension; self-employed (e.g., driver, carpenter)

Table 38: HH expenses, by zone

During the past month, what

expenditure(s) did your HH spend most

on? (% HH, weighted)

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Staple food 87.3 97.2 93.5 86.9 78.3

Education fees/uniforms 39.0 34.9 37.9 27.0 50.0

Health and medical 26.7 18.0 27.2 19.9 35.0

HH expenses/repairs 26.2 18.3 29.3 20.8 31.2

Page 99: End of Grant Evaluation Report

80 | P a g e

Non-staple food 10.4 N/A 10.9 N/A 15.3

Agriculture, livestock inputs 8.5 N/A N/A N/A 13.3

Travel, transportation 3.6 N/A N/A N/A N/A

Loan payments 3.6 N/A N/A N/A N/A

Others 0.9 N/A N/A N/A N/A

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. N/A= Small sample size (n=<30) is not statistically representative.

Table 39: HH ability to meet top expense, by zone

Do you think your HH is able to meet

your top expenditure? (% HH)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Fully 35.0 24.3 39.9 57.0 21.1

Partially 57.7 73.4 49.7 39.7 68.8

Not at all 7.1 N/A 10.4 N/A 10.1

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 40: WV projects helpful for HH to meet top expense, by zone

Was your household's involvement

with any of the World Vision projects

helpful to any degree in allowing you

to meet that expense? (% HH)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Fully 42.8 38.2 34.3 67.1 34.3

Partially 41.6 48.2 35.9 12.3 63.1

Not at all 10.6 N/A 24.7 N/A N/A

DK 5.0 N/A N/A 12.0 N/A

n (unweighted) 1227 328 295 298 306

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 41: HH with outstanding loan, by zone

Does anyone in your household have

an outstanding loan? (% HH)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

No 45.1 35.2 54.5 58.0 33.6

Yes 53.0 64.4 44.9 35.0 66.2

DK N/A N/A N/A N/A N/A

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 42: HH reasons for borrowing, by zone

What are the main reasons for

borrowing money? (% HH that

reported loans, weighted)

World

Vision Zones

East

Leyte

West

Leyte

North

Cebu Panay

Food purchases 69.6 74.7 65.8 67.8 69.9

Education costs 22.1 16.7 N/A N/A 31.0

Healthcare 20.0 N/A 25.7 N/A 20.5

Page 100: End of Grant Evaluation Report

81 | P a g e

Repair house 12.7 N/A N/A N/A N/A

Inputs (farming, livestock, etc.) 12.4 13.3 N/A N/A 15.7

Start, expand business 10.1 N/A N/A N/A N/A

Buy household goods 7.5 N/A N/A N/A N/A

Other* (build house, buy land, etc.) 4.2 N/A N/A N/A N/A

n (unweighted) 732 233 152 118 229

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. N/A= Small sample size (n=<30) is not statistically representative.

*Other category collapsed by TANGO to include other responses (utilities, loan payments, etc.), build house and buy land.

Table 43: HH main sources for loans, by zone

Who was the money borrowed from? (%

HH that reported loans, weighted)

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Friend, relative, neighbour 50.0 62.7 52.0 25.4 52.4

Bank/ formal lender 18.8 N/A N/A 28.8 22.7

Trader/ grocer 14.0 14.6 N/A N/A N/A

Money lender 12.9 N/A N/A N/A N/A

Informal savings group 5.6 N/A N/A N/A N/A

Others* 6.0 N/A N/A N/A N/A

n (unweighted) 732 259 162 123 245

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

*Other category collapsed by TANGO to include other responses (employer, cooperative, etc.), NGO/CBO and

government.

Table 44: HH cash savings, by zone

Does any member of your HH have

any cash savings? (% HH, weighted)

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

No 82.1 90.0 89.1 72.5 80.0

Yes 16.1 9.6 9.8 22.1 19.7

DK N/A N/A N/A N/A N/A

n (unweighted) 1382 361 338 337 346

Reasons for savings (n=210): (% HH that reported savings, weighted)

Food purchases 44.0

To prepare for difficult times 38.7

Healthcare 37.2

Education costs 32.4

Other: (n=<30) in case of emergency, loan payments, utilities, repair house, inputs, buy household goods, etc. Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 45: HH main sources for receiving information on WV projects, by zone

Where do you usually get information

about the interventions of World Vision

in your community? (% HH, weighted)

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Barangay council 48.8 70.9 31.4 43.0 55.8

Barangay/community assembly 40.6 13.9 43.2 50.4 44.2

By a friend/relative/neighbour 23.8 24.7 29.9 18.7 22.5

Page 101: End of Grant Evaluation Report

82 | P a g e

WV staff 8.1 8.9 N/A N/A 11.0

Other* 5.4 N/A 11.8 N/A N/A

n (unweighted) 1382 361 338 337 346 Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

*Other responses included, for example: Did not receive disseminated information, DK, volunteers, community

committees, etc.

Table 46: HH methods used for providing feedback, by zone

Which method did you use to provide

feedback? (% HH that gave feedback)

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Did not use any 33.9 60.8 24.0 19.4 38.2

Talk to purok leader 18.4 N/A 21.8 32.5 13.8

Report to barangay chairman 15.8 N/A 16.8 17.5 19.1

Attend barangay assembly 15.6 N/A N/A N/A 24.0

Directly talk to WV field staff 12.7 16.7 25.1 13.6 N/A

Drop letter in suggestion box 11.6 N/A 19.6 N/A N/A

Send a text/call Frontline SMS 3.7 N/A N/A N/A N/A

n (unweighted) 853 204 179 206 246 Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

Table 47: Disasters since Typhoon Haiyan, by zone

Has your community faced a disaster

after Haiyan? (% HH, weighted)

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Yes 97.3 99.1a 99.2b 99.7c 93.3abc

n (unweighted) 1386 361 338 341 346

(Of HH that faced a disaster…)

What disasters has your community faced after Haiyan? (% HH, weighted)

Typhoon Hagupit (Ruby) 97.9 97.8 98.8 97.9 97.2

Typhoon Jangmi (Seniang) 51.6 81.6 75.2 43.0 24.5

Heavy winds or rain 11.7 N/A 14.9 22.0 N/A

Floods 10.6 54.7 N/A N/A N/A

Typhoon Glenda 7.5 N/A 23.9 N/A N/A

Other (typhoons) 2.7 N/A N/A N/A N/A

Other: Earthquake, landslide or fire* 2.3 N/A N/A N/A N/A

n (unweighted) 1353 358 335 337 323 Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative. a-c Statistically significant difference (Tukey HSD) at p=<0.05.

* Other responses for natural disasters collapsed into one category by TANGO.

Table 48: HH challenges in coping with disasters since Typhoon Haiyan, by zone

Have you faced challenges in coping with

these disasters (% HH, weighted)?

World

Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Yes 79.9 89.5ad 85.2b 79.4cd 72.0abc

n (unweighted) 1386 361 338 341 346

(Of HH that faced challenges…)

What were the challenges that you faced in coping with these disasters?

Page 102: End of Grant Evaluation Report

83 | P a g e

Lost access to livelihood 48.2 41.2 52.8 49.4 46.9

Lack of money for home, business or

land repairs 45.0

36.9 50.7 30.1 57.1

Others* 20.9 43.1 20.3 24.2 N/A

Labour constraints 16.7 23.4 12.9 14.5 18.1

Family members away from home 3.0 N/A N/A N/A N/A

*Other most common responses: Lack of food/hunger and water (121+ responses) with further

corresponding challenges of destroyed crops or food price increases; Inability to cope with trauma,

anguish or distress (52+ responses); House damaged/destroyed again and inability to repair (43+

responses) corresponding to the challenges of sleeping areas flooded and security of family and belongings;

Family members sick or injured (26+ responses).

n (unweighted) 1101 320 286 269 226 Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative. a-d Statistically significant difference (Tukey HSD) at p=<0.05 (F=12.815, df=3, Sig=.000).

Table 49: HH perceived preparedness for future disasters, by zone

If another typhoon or major disaster

occurs, do you feel your household is

fully prepared to deal with its adverse

effects? (% HH, weighted)*

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

No 24.0 19.2 28.3 23.9 22.9

Yes 66.8 78.5 52.1 60.0 77.1

DK 9.2 N/A 19.6 16.1 N/A

n (unweighted) 1382 361 338 337 346

Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted.

N/A= Small sample size (n=<30) is not statistically representative.

* Statistically significant difference across zones (X2 =.000).

Table 50: Household demographics, by zone

Demographics

World Vision

Zones

East

Leyte

West

Leyte

North

Cebu Panay

Gender and age of head of household (HHH)

Male (% HH) 77.2 81.2 81.7 74.5 71.4

Female (% HH) 22.8 18.8 18.3 25.5 28.6

Average age of HHH (weighted mean) 47.7 46.5 48.0 46.0 49.2

n (unweighted) 1386 361 338 341 346

Household members

Average HH size (weighted mean) 5.1 4.9 5.4 5.4 5.0

Average number of children U5 in HH

(weighted mean) 0.7

0.7 0.6 0.9 0.6

Average number of children 6-15

years in HH (weighted mean) 1.5

1.7 1.2 1.5 1.5

Average number of children <15 years

in HH (weighted mean) 2.2

2.4 1.9 2.4 2.2

Average number of elderly in HH

(weighted mean) 0.5

0.3 0.6 0.5 0.5

Average number of adults in HH

(weighted mean) 2.6

2.2 3.1 2.7 2.3

HH Dependency Ratio 1.3 1.3 1.0a 1.5a

1.3

n (unweighted) 1386 361 338 341 346 Note: Calculations of the zone total cannot be done by hand because the values across zones have been weighted. a Statistically significant difference between groups (ANOVA) at p=<0.05 (F=3.477, df=3, Sig=.016).

Page 103: End of Grant Evaluation Report

84 | P a g e

Annex figures

Note: The following figures were developed by WV Philippines; analysis was not

conducted by TANGO International.

Figure 37: Community leaders list interventions carried out by WV (n=40)

*Other Interventions: Distribution of student kits, learner’s kits and teachers kits, Augmentation of medical supplies and

equipment, Advocacy (CVA), Repair of health facilities, COMSCA, Fisheries support (assets, equipment), DRR (Mangrove

Planting, GIS), Micro Finance & Loans

**Trainings include: hog raising, duck raising, fish processing, cosmetology, hair dressing/cutting, welding, masonry,

reflexology, carpentry, electrical wiring

Source: EOG evaluation community leader findings, WV Philippines, March 2015.

Figure 38: FGD priority problems in aftermath of Typhoon Haiyan

Source: THR EOG evaluation qualitative report, WV Philippines, March 2015.

Page 104: End of Grant Evaluation Report

85 | P a g e

Figure 39: Children recall the actors that addressed their priority needs

Source: THR EOG evaluation qualitative report, WV Philippines, March 2015.

Page 105: End of Grant Evaluation Report

86 | P a g e

Annex D: Community validation notes

End of Grant Evaluation

Community Validation Process: April 2015

Four Zones: North Cebu, Panay, East and West Leyte

Participants:

Zone Brgys Boys Girls Male Female

Panay Gogo, Estancia, Iloilo 5 17 8 13

Botongon, Estancia, Iloilo 4 6 6 17

East Leyte Calipayan, Dulag 6 8 7 9

Sawahon, Dagami 0 11 11 11

West Leyte Libjo, Merida 7 6 21 12

Donghol, Ormoc 6 8 6 11

North Cebu Caputatatan Norte, Medellin 9 8 4 19

Camoboan, Tabogon 9 8 10 11

TOTAL 46 72 73 103

Findings/ Theme

Community Input Additional Observations/Notes from facilitation team Quotes from the participants

Do the findings align with their reality? Does this represent families gauge of the evaluation criteria?

Do communities have any additional inputs in relation to Eval criteria? Yes/ No. Provide Explanations what does the community say. Disagreements?

Major issues that come up?

Relevance All participants agreed on the presentation regarding relevance of

the project.

Typhoon problems

Current Problems

Beneficiary of the project

NORTH CEBU

On usefulness rating, participants justified low usefulness rating for the

reason that some materials were not used for house repair due to

quality issues. Participants estimated around 10% of the HH whom have

received shelter materials still have not started repair due to financial

capacity to pay for labour

Page 106: End of Grant Evaluation Report

87 | P a g e

Timeliness NORTH CEBU

(Caputatan Norte) Participants agreed that Response not timely. Where provision of the intervention was delayed specifically with

the provision of shelter materials where families have started to or

have completed shelter repair.

(Camoboan) Majority of participants disagreed to the timeliness

results. Provision of assistance came when they are about to run

out of food supplies given by other NGOs.

NORTH CEBU

“Even if the food and NFI

distribution happened a month

after the typhoon they gave more

than other NGOs had given.”-

female participant

Effectiveness How have the WV activities identified as most useful been helpful to your household and community?

NORTH CEBU (No livelihood intervention implemented)

Assistance for alternative livelihood project was suggested as all participants mentioned that not all families had fully recovered from

the aftermath of the typhoon. Farms had no good yield since

Yolanda.

NORTH CEBU (No livelihood

intervention implemented)

“Since there are no classes we (all of

family members) all go to the

sugarcane plantation to have

additional income.”-female

participant.”

“It would have been good if WV

would give us livelihood trainings and

alternative livelihood for female HH

member so they also can help earning

income for our family.” male

participant

Food

What could have been done differently, in terms of the assistance received in the first 6-8 months that might have changed how they are doing now related to their food security and overall well-being status? How has WV’s food distribution been helpful?

PANAY

Had been helpful since people were hungry the time the assistance arrived, and all households have availed.

It helped ease the tension among people who were worried about food. Having received food assistance, people were able to focus on other things like repairing their houses and clearing debris.

Provided sufficient food stock for several days and allowed them to eat thrice a day. Some children mentioned that it could have been more helpful had the food assistance came a week after the typhoon.

EAST LEYTE (note: only applies to adult in Sawahon as there were no food distribution in Calipayan, Dulag)

EAST LEYTE Participants claimed that the community people find it hard to access food due to limited livelihood opportunities and low income. According to them, they are suffering from financial crisis, thus, some families eat just twice a day while some planted root crops to compensate rice.

PANAY “Other families did not make it to the list of beneficiaries and they got angry”- male

EAST LEYTE Some of the families here eat only twice a day while some has it only once a day. This happens due to limited livelihood opportunities. We were once dependent in coco farming yet those were damaged during typhoon Yolanda. At present, people here works in

Page 107: End of Grant Evaluation Report

88 | P a g e

Livelihood opportunities of the community people were damaged, thus, households finds it difficult to support food need of its member.

Current source of food of the families are from:

Purchase

Labour

livestock and poultry raising

own production (sweet potato production)

Food distribution was considered a useful activity as families have access to food right after the typhoon

Participants disclosed that the assistance had come just right on time that it was needed.

NORTH CEBU

Camoboan- Participants mentioned that food provided helped them temporarily cope with the worries from looking for livelihood/sources of food to feed for their families. As an effect they were able to focus on the gathering salvaged materials for house repair.

They suggested that WV to set up Response offices near areas where typhoon will hit prior to landfall with pre-positioned goods ready. May also provide relief items to areas of possible landfall before typhoon hits.

WEST LEYTE

Participants agreed that their main source of food is the same with the evaluation findings.

Children and adults are able to eat three times a day.

Have to engage in casual labour to by food needs and to eat three times a day.

Families have insufficient income to meet all their basic needs.

Families still lack money to buy food because they do not have livelihoods.

Families resort to eating less preferred food.

cutting lumbers. Once cutting of lumbers is done, there will be a lot of jobless”- adult, Sawahon WEST LEYTE “Even those who have work have a hard time meeting their food needs, more so for me who has no source of income. So we just eat porridge, sweet potato and salted fish for us to be able to eat three times a day.” “We, in our family we only eat two times a day because my income as a casual labourer is too small. How much is one hundred pesos in a day? We still have to save money so we could pay for a carpenter to repair our house.”

Page 108: End of Grant Evaluation Report

89 | P a g e

Families tend to reduce number of meals taken per day to be

able to address other household priorities. Children agreed that food was a top issue right after

typhoon. They described it as no access to food due to closed markets.

Prices of vegetables increased.

To meet food needs children were forced to stop schooling and find work.

Parents have to find work in other places.

Parents have to look for ways to get income despite limitations(e.g. disabilities)

Feeding programs were implemented by INGOs

Shelter

What is their current shelter situation? We don't have a lot of data on this (and 80% who are not fully prepared, say they need stronger, more disaster resistant shelter to cope with future disasters).

PANAY Although generally lacking, the distribution of shelter materials has been helpful, the quality was good. There were some who were not able to do repair. They have also received materials from another NGO (Union Church of Manila or UCM) . These were used together with those received from WV. Situation is better now with people already have roof over their head. The problem now is land. Landowners before signed a document giving go signal for the repair/construction of shelter but talks have it that they are selling their land and that demolition will be carried out which makes the households worried. The distribution of shelter materials was delayed so some people sold them. People have started doing repair even before the distribution so in effect, their shelters are not disaster-resilient. Some sold the shelter materials they received from WV and bought similar or substitute materials that were of lesser price so they can buy more. The same was also mentioned in the FGD with children. Some have already borrowed money to repair their house so when they received the shelter materials, they sold them to repay the loaned amount. They could sleep better, no longer get wet when it rains. Some sold materials to buy food, necessary materials for livelihood (e.g. fishing nets), while others used the proceeds to buy liquor and for gambling. In one FGD with the children, they said that based on their observation,

EAST LEYTE Some families were able to rebuild their houses while some though had started with the house construction, were still not able to finish it due to unavailability of money to pay for labour and to purchase additional materials. Furthermore, participants prioritize food over shelter repair Participants not sure if the houses built by World Vision or even their houses utilising materials from WV could withstand typhoon as strong as Yolanda.

PANAY “Whatever materials WV provided, I just tried to augment them”- Female “it was not able to serve its purpose. People needed money for their other needs to they sold the shelter materials”- male

“The labour and hauling cost millions. If only money was given to people so they can buy the materials they needed since these were available locally, the assistance could have gone a long way”- male “The build back better principles were not adopted because the materials were lacking and quality of some materials like the coco lumber were inferior (not mature enough)”. - Male “Some did not make it to the list of the beneficiaries because the community leaders did not like them… The members of the rehabilitation committee should have been selected through a general assembly. This was to ensure that they have the confidence and trust of the people”-

Page 109: End of Grant Evaluation Report

90 | P a g e

7 out of 10 recipients of shelter materials were able to do repair while the rest sold the items.

EAST LEYTE

Families were able to receive shelter type A and B project of World Vision.

The project was considered a useful activity as it had provided the following benefits:

o Families no longer spent amount to purchase

shelter materials and had only pay for labour. o people were able to build houses and were able

to comfortably stay in a place where they are protected from rain and sun.

The shelter project implementation was also considered on time, or was implemented at the time that it was most needed.

NORTH CEBU Caputatan Norte – participants said that around 80% had

completed the repair but had not used the build back better

principles, making houses not disaster resistant. 10% have applied

BBB techniques. Participants think that Families whom have not

received shelter materials assistance remains vulnerable to future

disaster as houses were not strong. Repair of the house was not

taken with full supervision or repair of houses was rushed-(no

planning and BBB techniques application) as the priority of the male

HH member is mainly on earning for a living.

Camoboan- all of participants said that none of them have rebuild

their houses that could withstand calamities due to financial

incapacity of families in the community.(no shelter intervention)

WEST LEYTE Helpful since families no longer need to buy shelter materials

however they were unable to pay for the repair.

HHs were able to save money intended for shelter. They were able to buy food, able to pay labour for shelter repair, able to pay for education expenses.

27 out of 36 participants are living in their own home but unable

male

“We have to be honest. We sold the shelter materials we received because we needed the money for the education of my brother”- boy

“Since WV provided the shelter materials, they should have been the ones to do the repair as well. Some families do not have someone who can do the repair and they did not have money to pay for the labour”- girl

EAST LEYTE “We are not sure if our shelter could withstand typhoon as strong as Yolanda as our house is only made of coco lumbers. Just like what happened on Typhoon Ruby, the flat bars used for type B houses were slightly bent”- adult Sawahon “Though some would say that the shelter project was somehow delayed, for me it was okay as it was implemented”- adult, Sawahon

NORTH CEBU “The marine plywood have holes and

substandard. It breaks easily.”- male

participant

“I think only the houses of the

carpenters and the package B houses

can be considered as disaster resistant

houses ”- female participant

WEST LEYTE “We are capable of repairing our

house but food and education is of higher priority.”

Page 110: End of Grant Evaluation Report

91 | P a g e

fully repair.

9 out of 36 are living with host families.

Since household income is just enough for food needs, family is unable to pay for labour to repair house so they just live in their comfort room.

Challenges encountered: 1.) prioritised lot mortgage over shelter repair. 2.) Unable to pay labour for shelter repair. 3.) Lack of shelter materials. 4.) Incurred debts. 5.) Did some shelter repair but since did not receive any shelter assistance house is still in poor condition.6.) land ownership(family has to live with relatives because they are not allowed to go back to their house since they do not own the house)

Families are not fully prepared of future disaster due to all challenges to shelter. Have a hard time looking for job and food.

There are emergencies that come up like health concerns that would take up HH budget instead spending it for preparation purposes.

“Just like what we did during typhoon Ruby we tied our roofs with ropes as a preparation so it will not be blown away.” “We are not ready for future disaster due to financial problem. People here usually earn a hundred pesos a day- we still have to spend for fare, and then we still have children to feed.”

NFI NORTH CEBU “The people are very happy to have

received the NFI items because they

were not expecting to have received

that kind of intervention. Families do

not have the capacity to buy NFI items

as their income is just enough for

expenses for food.”-male participant

WASH EAST LEYTE After the typhoon, some households had no access to toilet facility, thus, others are into open defecation. But, because of WV’s intervention, people are now provided with proper toilet facility. Latrine project of WV was considered useful as had:

people have access to latrines and could comfortably use it.

People including children are prevented in doing open defecation.

People have heightened awareness about hygiene and sanitation practices

Have access to water used for bathing, washing dishes, cooking and laundry.

Children were also safe against diseases brought by open defecation.

EAST LEYTE The participants claimed that the water system near the waiting shed is not safe for drinking. Not all latrine facilities are completely constructed

Page 111: End of Grant Evaluation Report

92 | P a g e

Participants also disclosed that the project was implemented in a timely manner.

CIE/Protection PANAY CFS was cited as helpful as it further developed the children’s leadership skills and allowed them to have fun. Thankful for the classrooms. However, it was mentioned that they should have been consulted on the repair that was necessary. Eased the difficulty of children (e.g. holding classes under the tree before), now have faucets to get water from so do not have to fetch water outside the school. The money that was intended to buy school materials was spent for food instead.

PANAY “Those engaged in the school repair were not the ones who availed the trainings but relatives and neighbors of the engineers… We were made to understand that we were the eyes and ears of WV while the school repair was being done. But we were not aware of the scope of work and bill of materials. So what will be our reference in keeping track?”- Male “Only very small repair was done to some of the classrooms but still they were included in the count”- Male “Having received the school supplies, it gave us something to write on and also a bag to put our school materials in”- boy

CFW/Community Assets PANAY Some of the children said that the money received from the CFW was used for livelihood (e.g. sari-sari store) and to cover household expenses.

EAST LEYTE According to the participants, cash for work project had helped the recovery of the community and had benefitted the households. CFW was considered useful as the families were able to:

buy food (rice and viand)

support children’s educational needs (school fees, transportation fee)

The community was cleaned because of the project.

Were provided with seedlings to plant

Were able to harvest seedlings for personal consumption The project was timely as it was implemented right after the food distribution in which people do not have money to pay for food.

Page 112: End of Grant Evaluation Report

93 | P a g e

Livelihoods

What do they feel the impact was (if any) of livelihoods and shelter (Type A and B) assistance starting 6 months after the disaster, versus starting sooner perhaps? Similarly, what is their current situation in terms of recovering assets that were lost in Haiyan?

PANAY According to the participants, assistance was limited, not all households were able to receive. Some have received although not that affected by the typhoon. Selection criteria were set and there were community representatives in the committee but they gave preference to their relatives. They all agreed that those who received livestock (particularly piglets) benefitted as the proceeds from selling the pigs helped cover some household expenses. They were not certain though if some amount was left/used for buying new piglets to be raised thus doubting the sustainability of this livelihood scheme. Some participants said they sold the pigs and bought another to be raised. Recipients of chickens did not sell all and retained a few (egg layers). Some beneficiaries sold their feeds not long after they have received them so when they run out of feeds, they were forced to sell their livelstock (e.g. ducks) It was noted that some sari-sari stores remain in business. However, since there is no other source of income, household expenses (e.g. education) eat up on the capital so such endeavor being able to carry on was doubted. The same observation was shared by the children. Seaweeds- it was described as “failure” altogether since these were infested. Looking back, the participants said that beneficiaries should have been consulted as to the type of sapling since the one provided by WV was not suitable to the local condition. It was mentioned that the beneficiaries provided feedback but were allegedly told that procurement process has already been completed. It was also noted that the saplings were in bad shape when they arrived. Support for fishing- the nylon easily snapped. It was smaller than the one they were using before. The fishnets’s eyes were too big and not appropriate for the kind of fish they were catching. They were only able to use the led that are attached to the nets. In the other barangay where the FGD was held, the participants said though that the fishing materials have been useful and helped them earn a living to buy food. It was mentioned that more effort should have been exerted to make the people really understand the intention of the project particularly on sustaining their livelihoods. Some were questioning why others made it to the list of the recipients- some of the latter were even surprised themselves. The participants agreed that the skills trainings have been helpful as

EAST LEYTE The project implementation was considered as somehow delayed but this was attributed to the beneficiary selection done by Red Cross in which beneficiaries were listed to avail livelihood assistance. With this, during the beneficiary selection of WV, those listed in Red Cross were no longer included in the list of the beneficiaries in WV to avoid duplication. However, Red Cross did not continue with the project implementation, thus, numbers of families were not able to receive livelihood assistance. Some of the broilers provided got sick, thus, are used by beneficiaries for personal consumption.

PANAY “The piglets were given together with 4 sacks of feeds. Some sold portion of the feeds so when they ran out, they had to sell the pigs”- male

“The nets provided by WV that had big “eyes” would have been useful if we were catching dolphins”- female “Others who received a net were not fishermen. Some fishermen received a net but how can they use it when they have no boat?”- male “I am a fisherman but I did not receive assistance for fishing so I just joined the training on carpentry. I am somehow earning income as a carpenter now”- Male

“The skills training (carpentry) helped. I learned some techniques which improved the quality of my work. Since I have availed of the training, I am being considered to be hired for a project of the National Housing Authority”- Male

“I am able to earn extra income (from body massage). There is no need for capital, just your energy”- female

“After my father sold the pigs, he used the earnings for my and my siblings’ school feels and supplies”. Girl

Page 113: End of Grant Evaluation Report

94 | P a g e

those who have undergone them are earning now. They agreed that the gains from this particular initiative are likely to be sustained. It was mentioned that participants of the skills training gained additional knowledge which helped in making them more confident in doing their work. As to improvement, they said that livelihood assistance even lesser in scale, should have been extended, too to those whose houses were partially damaged . More careful consideration to skills matching or interest/preference to better ensure that the training is effective. The earnings from livestock were used to buy food, clothing and to pay debts. Some were able to buy piglets again after selling the ones they received from WV. Some sold chickens but retained a few of them (e.g. egg layer). According to the children, some of those who have undergone the skills training have opened beauty parlors, and those who were trained in carpentry repaired their and others houses. They added though that after the training and getting the money for attending such, others became idle again. They estimated that about half of those who participated the trainings have the same situation. They recommended for improvement WV’s providing basics on managing a business to include information on how to promote their products and services; and that WV should provide or facilitate for the training participants to acquire work/employment.

EAST LEYTE Livelihood activities of the community people were disrupted (e.g. crops were lost, coconut trees which is a major source of income of the community people were damaged) In Response, World Vision had provided livelihood assistance in a form of sari-sari store, livestock and chickens. Some were also trained to be carpenters to construct houses supported by WV. Support of livelihood projects by WV was just enough for families buy rice and helped children with transportation needs, thus, families were not able to set aside amount for saving Livelihood project of WV was considered useful as families were able to:

To buy rice seeds for the farmers.

Page 114: End of Grant Evaluation Report

95 | P a g e

given an opportunity to establish business

able to support their daily needs (purchase of food)

could somehow provide the school needs of children ( transportation and school fees)

The projected was considered timely by those who were able to receive it yet considered delayed for those who were still not able to receive it

Accountability

What do you suggest to WV concerning giving back information to your community? (e.g. validation of evaluation results) For children: What have you learned about WV as an organisation? Where did you learn this information? What kind of things do you know about WV?

PANAY WV help people recover from the typhoon by providing relief goods, shelter materials, schools supplies, livelihood and school repair. It is concerned about those who are affected. It also provides knowedge on how to be better prepared when a disaster comes. WV also helps the poor. The children learned about WV from their barangay captain, barangay health workers, from their parents, teachers, beneficiaries WV could be more helpful to children if it provided scholarships, did feeding programs and distributed vitamins. Happy with the validation process because they were able to learn more about how WV was able to help and address the needs of people

NORTH CEBU Participants find information useful for them to give feedback and

let WV know the real situation of the community. WV to continue

such process.

A mention of setting up Accountability and CRM with ADP and

ABK3 was recommended by the participants.

Participants are satisfied on the process on how they receive information and how feeback were addressed.(Information flow:

WV-Brgy Officials-BHW-HH)

EAST LEYTE The community people are aware of the feedback mechanisms in place. They have shared that they mostly prefer talking directly to WV staff as a mechanism as it provides immediate answers. In addition, they also prefer feedback box as it is accessible. However, they less prefers to use SMS as it entails cost. Libjo, Merida:

Note: The session with children for this topic used the body map method wherein children had to answer questions corresponding to a body part (ie. head, eyes, mouth, hands, feet and heart)

PANAY “These made the children happy. WV is kind- they do a lot of things for us”- girl

“ It is good that we are able to share our ideas on how WV could better provide assistance. It is encouraging for us”. –Male “I am happy just being able to voice out my thoughts and concerns”.- Female

Page 115: End of Grant Evaluation Report

96 | P a g e

- Information were provided during relief effort was enough (e.g. tarpaulins were posted in distribution site)

- Accountability mechanism during the distribution was the community leaders themselves who were able to resolve issues raised.

Donghol, Ormoc: - Those who are late in attending general assembly, unable to receive

any World Vision assistance are those who do not know about World Vision projects.

- There are orientations, general assemblies and coordination to barangay officials conducted and comics were distributed as guide.

RECOMMENDATION: Information dissemination should be by purok.

DRR/Resilience

For DRR What do they think about the findings on ability to cope with future disasters (for instance 80% are challenged to cope with future disasters). What are families doing differently now to cope with disasters/stresses by anticipating and preparing for disasters?

PANAY According to the adult FGD participants, they felt they are better prepared now thus they did not have to evacuate during the recent typhoon (Hagupit). They said they used the learning from the build back better (BBB) seminars provided by WV. UCM, another NGO, mobilised their own carpenter to do shelter repairs. When they were done, house owners did some work to further strengthen their houses. According to the children, the trainings (build-back-better) made people aware about the ideal location for putting up houses. It was mentioned that the trainings provided by WV helped in making them better prepared as they already learned about what to do before, during and after a disaster. Some of those who were living in danger zones like along the shore have transferred.

EAST LEYTE Most of the participants feel fully prepared to deal with a major disaster as they now know on what and how to prepare for incoming typhoon. People declared that though they are not sure if their houses could withstand typhoon as strong as Yolanda, they think that they are somehow ready now for incoming typhoon than before. People know the following preparations:

Medicines, food, rice, clothes, lights prior to the typhoon.

Identification sources of information about typhoon such as TV, Radio, barangay Officials and even WV.

However, participants disclosed not having any safe evacuation center, thus, some of them had built hole which according to them are safe enough against typhoon.

Page 116: End of Grant Evaluation Report

97 | P a g e

NORTH CEBU Participants said that they are really challenged to cope with future

disaster due to their house condition, however, they have mention

some disaster preparedness measures to at least mitigate risk of

impact of damage. (e.g. tying down houses, food stock ready, early

warning system from brgy, evacuation center readiness, set up

barangay DRR system) which was applied during typhoon Hagupit.

Page 117: End of Grant Evaluation Report

98 | P a g e

Annex E: Household survey tool

EOG_Eval_HH_Questi

onnaire_Feb3_final.pdf

Annex F: CL tool and focus group guidelines

Haiyan Evaluation CL

KII_01072015.pdf

Haiyan FGD

Guidelines_01072015.pdf

Annex G: Response logframe

Typhoon Haiyan

Response Logframe.xlsx

Page 118: End of Grant Evaluation Report

99 | P a g e

Annex H: Desk Review Chronological Bibliography Typhoon Haiyan Response. Lessons Learnt: draft, 19-20 January 2015.

THR. Basic Information Sheet: Evaluation (DFATD, ADH & SHO), December 2014.

THR. Typhoon Haiyan Response 12-Month Report: 8th November 2013 – 31st October 2014, November

2014.

THR. Post-Distribution Monitoring (PDM) Report Cash for Work Project: East Leyte Zone, November 2014.

Typhoon Haiyan Emergency Response Team. WVI Typhoon Haiyan Response Strategy, revised 9 October

2014.

THR. Logframe, updated 21 October 2014.

THR. Post Distribution Monitoring (PDM) Report Cash for Work Project: West Leyte Zone, October 2014.

(DFATD)

World Vision Canada (WVC) and World Vision Development Foundation-Philippines (WVDF). DFATD 2

Revision Summary/and Budget Revision, 18 September 2014. (DFATD II)

WVDF. DFATD 2 Quarter #2 Project Report, Final Draft, 1 July – 30 September 2014. (DFATD II)

THR. Post Distribution Monitoring Report – Shelter Material Distribution Project (Package A), East Leyte

Zone, 1 August 2014.

World Vision Germany. World Vision Typhoon Haiyan Response – East Leyte (1 January 2014 – 31 December

2014) Project Interim Report and Financial Report to ADH, 8 August 2014.

WVC. Typhoon Haiyan (Yolanda) Emergency and Recovery Response: Final Report. Submitted to International

Humanitarian Assistance Directorate (IHA), 31 August 2014. (DFATD I)

Typhoon Haiyan Emergency Response Team. Typhoon Haiyan Response 6-Month Report, August 2014.

WVDF. SHO Netherlands Report/ and Financial Report, 11 November 2013 – 31 July 2014. (SHO)

World Vision Germany. World Vision Typhoon Haiyan Response – East Leyte (1 January 2014 – 31 December

2014) Project Proposal to ADH: Proposal Narrative, Budget and Cashflow, Logframe, and ADH Regulations,

July 2014.

WVDF. SHO Budget Revision, 24 June 2014. (SHO)

WVDF. DFATD 2 Quarter #1 Project Report/ and Financial Report, June 2014. (DFATD II)

RTE Team. Real Time Evaluation (RTE): World Vision’s Response To Typhoon Haiyan Final Report, May

2014.

THR. Women and Young Children Spaces (WAYCS): Supporting women and their children in the Relief Phase

of Typhoon Haiyan Response in the Philippines, May 2014. (DFATD)

WVC and WVDF. DFATD I Final Transaction Report, draft II, November 2013-May 2014. (DFATD I)

WVC and WVDF. DFATD I Final Distribution Report, N.D. (DFATD I)

WVC and WVDF. DFATD 2 Grant Rationale for Budget Revision/and Cash Flow Revision, 24 April 2014.

(DFATD II)

WVDF. SHO Financial Report, April 2014. (SHO)

WVC and IHA. Grant Agreement, signed 11 March 2014. (DFATD II)

Typhoon Haiyan Emergency Response Team. Typhoon Haiyan Emergency Response 90-Day Report, March

2014.

Child-Friendly Spaces (CFS) Evaluation Report- Typhoon Haiyan Response in the Philippines, March 2014.

(Donors: DFAT, DFATD)

WVC. Integrated Early Recovery Project in WASH, Shelter, and Livelihoods: Proposal /Budget (Original USD).

Submitted to DFATD/IHA, 2 January 2014. (DFATD II)

THR. Post Distribution Monitoring Report – Unconditional Cash Transfer, 23 January 2014.

Page 119: End of Grant Evaluation Report

100 | P a g e

THR. Post Distribution Monitoring Summary Report, 9 December 2013.

World Vision Netherlands and WVDF. Memorandum of Understanding for the implementation of SHO funds.

18 December 2013. (SHO)

WVC and WVDF. Implementation Agreement, 16 December 2013. (DFATD I)

WVC and WVDF. DFATD I Performance Measurment Framework (Logframe), N.D. (DFATD I)

WVC and WVDF. Typhoon Haiyan DFATD US$ Budget Final, N.D. (DFATD I)

WVDF. SHO Proposal-Haiyan Emergency Response-draft, 5 December 2013.

WVC. Typhoon Haiyan (Yolanda) Emergency And Recovery Response: Concept Paper. Submitted to

DFATD/IHA, 12 November 2013. (DFATD I)

WVDF. Rapid Assessment Report and One-Pager: Typhoon Haiyan (Yolanda), November 2013.