inception report - tzdpg.or.tz report: water sector development programme, tanzania - evaluation of...

27
1 st March 2013 Inception Report Water Sector Development Programme, Tanzania Evaluation of Phase I

Upload: phungbao

Post on 28-Mar-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

1st March 2013

Inception Report

Water Sector Development Programme, Tanzania

Evaluation of Phase I

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

This assessment is being carried out by Oxford Policy Management. The project manager is Ian Ross. The remaining team members are Jeremy Colin, Richard Carter, Anne Thomson, Eke Mwaipopo and Ben Taylor. For further information contact Ian Ross at [email protected]

The contact point for the client is Takanori Obayashi at JICA in Tanzania - [email protected]

Oxford Policy Management Limited 6 St Aldates Courtyard Tel +44 (0) 1865 207300

38 St Aldates Fax +44 (0) 1865 207301

Oxford OX1 1BN Email [email protected]

Registered in England: 3122495 United Kingdom Website www.opml.co.uk

© Oxford Policy Management i

Table of Contents

1 Introduction

2 Approach and Methodology

3 Work plan

Annexe A Evaluation matrix

Annexe B Key informants and organisations

Annexe C Schedule of deliverables

Annexe D Updated Terms of Reference

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 2

1 Introduction

The Water Sector Development Programme (WSDP) in Tanzania is a large and complex sector programme with four specialist sub-components and an overarching management structure headed by the Ministry of Water (MOW). It has multi-donor funding totalling USD 1,299 in Phase I and operates as a SWAp whereby the bulk of external support is channelled through government structures, with some additional stand-alone externally-funded projects. OPM has been contracted to undertake a review of WSDP Phase I which began in 2007 and is due to end in June 2014. The overall objective of the assignment is to critically review the performance of Phase I of WSDP implementation in achieving its objective, and to provide an assessment of key areas that will require strengthening or changes and establish inputs for Phase II of the Programme. Overall then, the evaluation is principally forward-looking and formative, rather than focusing primarily on programme outcomes and impacts. The focus of the assignment is to undertake a formative evaluation to answer the following key questions: i. Has the Programme been in line with the upper policies? Is the Programme design including

the rationale for Programme components, outputs, indicators and priorities relevant to the development objective and the revised targets?

ii. How effective is the Programme to achieve its intended goal, objectives, outcomes and impact?

iii. How efficient is the Programme? Is it on track to achieve its intended outcomes? Are the costs of the various activities comparable to similar activities in other countries?

iv. To what extent has the Programme addressed equity and sustainability in service delivery? v. What impact have capacity building initiatives had at various levels? To what extent do

capacity building efforts contribute to Programme efficiency and effectiveness in delivery of results?

vi. From the experience of Phase I of the WSDP implementation, what worked well and what did not work? What are the key lessons learnt and what should change or be done differently going forward?

The programme will be assessed according to the criteria of effectiveness, efficiency, relevance, impact and sustainability. Following this introduction, the Inception Report presents in section 2 our approach to the evaluation and methodology. Section 3 contains a workplan which is provisional and subject to the agreement of, and logistical support from, JICA and government partners. We also identify the next steps for the evaluation. The annexes contain the evaluation matrix, a proposed list of key informants based on information received so far, the schedule of deliverables and updated ToR for the review. This report has been written at the start of the assignment and before a desk review has been undertaken. After reviewing programme documentation, key issues and challenges relevant to the review should become clearer and this may necessitate some adjustment to the workplan and/or methodology. Additional documents beyond those listed in the ToR may also be needed and if so, we will contact JICA to request these before the mission begins. The Programme is government-led with systems in place for close government-development partner (DP) co-ordination and progress monitoring including Joint Annual Sector Reviews and regular Joint Supervision Missions. A Sector Management Information System has also been introduced. We are conscious that the programme has already been subject to a range of reviews and assessments, both internal and external, including a Mid-Term Review in 2010 which prompted the re-structuring of the programme in 2011. There is an extensive amount of documentation available and the evaluation will at the outset take note of lessons that have already

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 3

been learned, plus issues and challenges that have already been identified and are well known to programme partners, rather than treating the programme as a ‘blank sheet’. This will help to ensure that the review does not only look back but gives sufficient attention to the way forward for WSDP as it approaches the end of its first phase. It would in any case be impossible in the space of a short evaluation to identify from first principles all the achievements and challenges of a programme on this scale.

.

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 4

2 Approach and Methodology

In this section, we elaborate on the proposed approach and methodology outlined in our Technical Proposal for the evaluation of WSDP Phase I. We include further details of our proposed approach to the overall evaluation and the review of each Sub-Component.

2.1 Approach

We understand that the purpose of the evaluation is to assess the performance of the Programme in meeting its objectives, to identify any changes or actions needed to improve performance in the remainder of Phase I, and to draw out lessons to inform the design of Phase II. The assignment will evaluate the program in terms of its relevance, effectiveness, efficiency and impact. We note that these evaluation criteria are in line with OECD/DAC criteria for evaluating development assistance.1 Since the evaluation concerns the effectiveness of an ongoing programme, there will be a heavy emphasis on qualitative issues relating to programme structure and processes, but there will also be some quantitative assessments, where relevant data is available. The overall approach will be first to develop an understanding of national programme structure, strategy, financing and operational processes and then assess how, within this framework, each of the four Sub-Components (Water Resources Management; Urban Water Supply and Sewerage; Rural Water Supply and Sanitation; and Capacity Building) has performed with reference to its particular outputs and targets. Investigations of each sub-component will shed light on the key questions set out in the ToR, most of which relate to the programme as whole. The evaluation will comprise a desk review of available documentation, meetings and interviews with key stakeholders at national, regional, district and community level, and field visits to assess ground realities at regional, town, LGA and community level in three regions. A key challenge of the evaluation will be to ensure that the analysis of the different programme components can be aggregated to answer the questions on the overall performance of WSDP. In order to address this challenge, as shown in Table 1 below, we have scheduled the review of overall programme structure and functions at national level to be carried out first, so that initial findings can feed into the reviews of the four components and specific relevant questions can be integrated into these reviews.

2.2 Methodology

In order to meet the objectives of this assignment, the assignment will include the following key activities: 1 - Review of literature and available documentation 2 - Meetings and interviews with programme stakeholders 3 - Field visits 4 - Quantitative analysis 5 - Analysis of findings and report writing

2.2.1 – Review of literature and available documentation (desk-based)

A desk review will be conducted in the UK prior to the country visit, the first priority being to review the documents listed in the Annex to the ToR. The Mid-Term Review of 2010 is also highly

1 DAC Principles for the Evaluation of Development Assistance, OECD (1991)

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 5

relevant since it provided the basis for programme re-structuring in 2011, and it would be useful in addition to receive some information on the sanitation and hygiene component which now functions as part of the National Sanitation Campaign. It is likely, of course, that other relevant documents will come to light during the evaluation mission and these will be reviewed in-country. We now have the MTR but would be grateful if MoW / JICA could forward to us electronic versions of any other key documents listed in the TOR which are not already available on the DPG website.

2.2.2 - Meetings and interviews with programme stakeholders

The team has developed a draft evaluation matrix for this assignment (see Annexe 1), based on the questions set out in the ToR. The questions are grouped into relevance, efficiency, effectiveness, impact and sustainability and we have also identified the sources of evidence and some external factors/ assumptions. This matrix will be updated following the desk review, by which time we should know more specifically which documents are relevant to which questions. It will then be adjusted as necessary throughout the assignment and will form the basis for the analytical work of the evaluation team. In practical terms, we propose that in the first week the mission begins with a briefing presentation from GOT (and perhaps key DPs) on the overall structure of the programme; strategy and priorities; financing arrangements; achievements to date; key issues and challenges for the programme; and expectations from the evaluation. While some of this information will be gleaned from the desk review, it will be important to get the most recent update from the people involved. This session would include time for questions and plenary discussion and would be followed up with separate focussed interviews with key respondents. A series of smaller meetings could then be held during the week with key players from each of the four Sub-Components, again in the format of a briefing presentation plus a question and answer session, with separate interviews to follow as necessary. Dates and timings for this initial briefing and-subcomponent briefings should be arranged by MoW/JICA as soon as possible, before we arrive in Tanzania, so that all required attendees are available. It is important that these meetings and interviews encompass not only government partners and DPs and NGOs from the relevant Technical Working Group plus (where relevant) NGO/CSO WASH networks, consultants (for example the Programme Management Consultant supporting the rural component) and private sector representatives. We have produced a provisional list of key stakeholders and institutions to interview (see Annex 2) but would appreciate any further suggestions on key persons or organisations that we should meet, so that we can finalise the list. The team will then use the evaluation matrix to develop semi-structured questionnaires for each of the main stakeholder groups to be consulted at national, regional and local level.

2.2.3 - Field visits

The challenge for the field work will be to gain sufficient insights into all four programme components in the limited time available. We propose visiting three regions and within each, meeting the support teams operating under the Regional Secretariat; the BWO; the Urban WSS utility and two LGAs. In addition we would aim to make field visits to both urban and rural project sites. Since Tanzania is a large and diverse country, we feel that visits to three locations is appropriate, as any less would not provide an adequate reflection of different regional contexts. We very much hope that for each region visited, a representative from central government will accompany the team to help us to put local findings in the context of programme operations overall. We would welcome the identification of these people at the earliest possible opportunity, to ensure their availability.

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 6

We would welcome further guidance from GOT and/or JICA on suitable locations for the field visits, and would also request GOT assistance in contacting the relevant parties at regional and LGA level to ensure that we are able to meet the appropriate people, and have useful and relevant field visits, in each location. We will then make the necessary arrangements in terms of transport and accommodation.

2.2.4 - Quantitative analysis

As discussed above, this is a formative evaluation only part-way through phase 1 of the WSDP,

and there is limited time available. Therefore, much more weight will be placed on reviewing

processes and outputs, rather than outcomes. There are several areas of this evaluation which will

need quantitative approaches.

The quality of these analyses will be dependent on the availability and reliability of the data on which they are based. Some data sources will become apparent during the desk review, but we also propose an early in-country meeting between the team economist (Ian Ross) and a data specialist nominated by MoW/JICA (who might be from any government institution or DP), to discuss data needs for carrying out the quantitative analysis effectively.

It will be necessary to gauge the quality of different data sources, and identify ways of getting hold of the data in soft copy at the earliest possible opportunity. It is sometimes the case that data originally thought to be useful turns out to be lower quality than expected. In order to make best use of time and avoid preparing unworkable methodologies, the full methodology for quantitative approaches will not be decided until relevant data are secured. However, it will of course be based on the analytical tools outlined in our technical proposal. More data is also likely to become available during fieldwork. Therefore, much of the quantitative analysis will take place after the team has returned to the UK.

2.2.5 - Analysis of findings and report writing

An interim report will be submitted at the beginning of week 6 as required by the ToR. Since field visits will still be ongoing at this time, the report will cover only the findings of the desk review and meetings and interviews in Dar. On returning to Dar we will review and organise the results of the desk-based review, meetings and interviews in Dar. This will enable us to draw out key findings and recommendations that will provide the ‘headlines’ for the final report and for a powerpoint presentation to WSDP stakeholders on the last working day of the mission. This will also constitute the first step towards synthesising the findings from the overall programme review and that of the individual components. A draft final report will be submitted in week 8 and presented to government and partners via a skype conference, yet to be arranged.

A period of 12 days has been scheduled for the receipt of comments from government and sector

stakeholders. We will then amend the report as appropriate and submit a final version by the end

of week 10.

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 7

3 Workplan

3.1 Outputs

Regarding the outputs, we will submit an interim report in-country as requested, but it is important

to highlight that the delivery date for this falls during the field visits. As a result the interim report

will cover only the preliminary findings of the desk review and interaction in Dar, not the overall

findings and recommendations, which will be in the final report.

3.2 Provisional programme

A provisional programme for the country visit is set out in Table 1 below. This is very provisional at this stage and we will amend and refine it on receipt of further advice from JICA and GOT following the proposed skype conference in week 3. Four consultants will undertake fieldwork, but Richard Carter will only be in Tanzania from 17th-22nd March. Therefore, the key interviews on WRM will be scheduled while he is in Dar on 18th-19th March. Richard will accompany the rest of the team to the first fieldwork site. With 3 or 4 consultants available, we will split into two groups in order to cover all the interviews, with groupings to be decided based on specialisms. In the red cells below where two interviewees are indicated, each will be interviewed by one of the two groups of consultants. Some time could be made available on 28th-29th March for any interviews which were unable to be scheduled earlier. Current interviews times are indicative and interviewees are inserted in order to demonstrate that enough time is available to identify all relevant people as long as their schedules permit. Actual interview times shall be arranged in collaboration with MoW / JICA. The key for interpreting the colour-coding is below:

group briefings all consultants attend - preferable if all listed in brackets attend

individual interviews consultants split into two groups to cover more ground

Free currently free for some consultants, available for missed interviews

fieldwork interviews exact interviewees TBC

Table 1 – work plan and schedule

c.08:30 c.10:30 c.14:00 c.16:00

Sun 10 JC / IR arrive

Mon 11 08:30 - consultant

team meeting, 09:30 - Meet JICA, MOW

10:30 - WSDP General Briefing

(MOWI-PMU, PMO-RALG, MOH, DPs,

NGOs)

Head of DRWS

Head of DAHR

Head of DUWS

DPP

Tue 12 DPMU

DPCU

10:00 Component 2 Briefing (a): RWS

(MOW, PMO-RALG, Programme

Management Consultant, TWG)

14:00 Component 2 Briefing (b):

Sanitation and Hygiene (MOH,

TWG).

HICTU

CIA

Wed 13

MOF (Mr Mpanda),

Director of Sector Coordination (PMO-

RALG)

10.00 Component 3 Briefing: Urban WSS

(MOW, TWG)

14.00 Component 4 Briefing: Capacity

Building (host TBA)

Permanent Secretary,

Deputy Permanent

Secretary

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 8

Thur 14

Programme Management Consultant

FREE

DAWASA CEO,

DAWASA Technical Services

WaterAid,

ADME (the former HPCT)

World Bank-WSP

DAWASCO

Fri 15

Mr. Pascal Karomba (former WSDP-PCU

Accountant),

Hon. Deputy Minister of Water

10:00 DPG

TAWASANET,

Hon. Minister of Water

Private sector (Service providers,

contractors, consultants),

Director of Water

Supply and Sewerage – EWURA

Sat 16 Collate findings /

prepare for fieldwork Collate findings /

prepare for fieldwork Collate findings /

prepare for fieldwork Collate findings /

prepare for fieldwork

Sun 17 RC arrives in Dar Begin interim report Begin interim report Begin interim report

Mon 18

School WASH Coordinator (Ministry of Education)

FREE

10.00 Component 1 briefing: WRM (MOW, TWG)

Head of DWR

Assistant Director- Preventive Services

(MOH)

Deputy Permanent Secretary (Ministry

of Agriculture)

FREE

Tue 19

Director of Irrigation, Ministry of Agriculture

FREE

Fly Dar - Mbeya 11:20 – 13:10

Mbeya interviews Mbeya interviews

Wed 20 Mbeya interviews Mbeya interviews Mbeya interviews Mbeya interviews

Thur 21 Mbeya interviews Mbeya interviews Fly Mbeya - Dar

13:40 - 15:30 Collate findings

Fri 22 RC leaves, others fly Dar - Dodoma 07:00

– 08:30 Dodoma interviews Dodoma interviews Dodoma interviews

Sat 23 Dodoma interviews Dodoma interviews Dodoma interviews Dodoma interviews

Sun 24 Drive to Tabora Drive to Tabora finalise interim

report finalise interim report

Mon 25 Tabora interviews Tabora interviews Tabora interviews Tabora interviews

Tue 26 Tabora interviews Tabora interviews Tabora interviews Tabora interviews

Wed 27 Drive back to

Dodoma Drive back to

Dodoma Dodoma interviews Dodoma interviews

Thur 28 Collate findings Fly Dodoma – Dar

11:05 – 12:35

Prepare wrap-up presentation or any missed interviews

Prepare wrap-up presentation or any missed interviews

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 9

Fri 29

09:00 - Present preliminary fieldwork findings to MoWI /

JICA

Discussion on fieldwork

presentation

Collate findings,or any missed interviews

Collate findings,or any missed interviews

Sat 30 IR/JC depart

3.3 Support requested from GOT / JICA

Give the size and scope of the programme and the range of questions to be addressed, it is vital that the available time in-country is used efficiently. We believe that the proposed presentations from government and partners are the best way to achieve this in Dar as they will not only bring the team up to speed on progress and facilitate interaction with a range of stakeholders, but also enable us to appreciate at an early stage the key concerns of government and other stakeholders in preparing for WSDP Phase II. We very much hope, therefore, that GOT could prioritise these briefing sessions and make preparations accordingly. We also request that JICA take responsibility to collect comments from government and other stakeholders on the interim and draft final reports and submit them to the consultants as single packages. This will enable us to respond to comments efficiently and ensure the final report is delivered on time. To summarise, we would be grateful if JICA and GOT could assist with the following before the country visit: 1. Provide soft copies of key documents mentioned in TOR but not available on the DPG website. 2. Propose locations for the field visits, based on the outline programme, and make appointments

with the parties concerned. 3. Propose key individuals and departments / organisations that we should meet, beyond those

already listed in the draft programme. 4. Organise the proposed briefing sessions (we hope that each of these will include presentations

from government on the status of the sub-component) and meetings outlined in the draft programme.

At the time of writing we are already in touch with Mr. Obayashi regarding the field work and hope that we can finalise an itinerary during the proposed skype conference on 7th March, if not before.

3.4 Next steps

Ahead of the skype conference on March 7th we will work on the desk review and logistical

arrangements in consultation with Mr. Obayashi and others.

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 10

Annexe A Evaluation matrix

Main evaluation question Detailed questions Sources of information and analytical approach

2

External factors / Assumptions

Overall questions

A. Has the Programme been in line with the upper policies?

A1. Is the Programme design including the rationale for Programme components, outputs, indicators and priorities relevant to the development objective and the revised targets?

Desk review of national development policy, NAWAPO, WSDP Programme Document and Re-structuring Plan

All relevant documentation will be shared with us, or is otherwise accessible.

B. How effective is the Programme to achieve its intended goal, objectives, outcomes and impact?

See G below

C. How efficient is the Programme?

C1. Is it on track to achieve its intended outcomes? C2. Are the costs of the various activities comparable to similar activities in other countries?

Desk review of relevant documentation and information from MOW and others Briefings from , and in-depth interviews discussions with, key actors and stakeholders Review of available data from MIS, EPICOR and other reporting systems Field visits to confirm real situation on the ground Comparison with relevant programmes in the region

All relevant documentation will be shared with us, or is otherwise accessible. Component managers and/or TWG members make detailed briefing presentations to the team Key stakeholders are willing to be open, realistic and transparent. Field visits provide a fair representation of progress across different components and regions Sufficient relevant and reliable financial data is available for assessing and comparing costs

D. To what extent has the Programme addressed equity and sustainability in service delivery?

On sustainability – see K below

E. What impact have capacity building initiatives had at various levels?

E1. To what extent do capacity building efforts contribute to Programme efficiency and effectiveness in delivery of results?

Desk review of capacity building component strategy and activity reports, any independent reviews and other related documentation Review of data and other information from MIS, EPICOR and other programme monitoring systems

All relevant documentation will be shared with us, or is otherwise accessible. Component managers and/or TWG members make detailed briefing presentations to the team Key stakeholders are willing

2 Specific information sources will be added following the desk review

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 11

In-depth interviews and discussions with key actors and stakeholders at national, regional and local levels

to be open, realistic and transparent. Field visits provide a fair representation of progress across different components and regions

F. From the experience of Phase I of the WSDP implementation, what worked well and what did not work?

F1. What are the key lessons learnt and what should change or be done differently going forward?

Findings of evaluation and of Joint Annual reviews

Effectiveness

G. To what extent have programme objectives been achieved by the outputs, in both qualitative and quantitative terms?

G1. Is there a causal relationship between the output of implemented activities and the achievement of programme objectives? G2. How effective are current institutional arrangements for Programme management? G3. How effective are programme funding mechanisms and fund utilisation? G4. To what extent do programme systems including the MIS, accounting system (EPICOR) and LGA Planning / Reporting System (Plan-rep) support implementation, and how could they be used more effectively? G5. How effective are monitoring, reporting and feedback mechanisms across sector levels including the client service charters? G6. How effective are technical and administrative monitoring and audits (internal and external) in improving the quality of water services, internal controls, public expenditure, vfm and accountability to beneficiaries? G7. To what extent have participatory monitoring instruments including scorecards been used to measure beneficiary satisfaction, enhance social accountability and include users in decision-making and sustaining services? G8. How effective are institutional arrangements at regional level for technical support and backstopping to LGAs, BWOs, Small Towns and UWSSAs. (To include a specific review of institutional arrangements for rural water supply)

Analysis of underlying logic of programme Institutional analysis based on organorgams, desk review of relevant documentation, stakeholder interviews Stakeholder interviews, budgets, financial and other Programme reports Stakeholder interviews, relevant documentation. Review of data and other information from MIS, EPICOR and other programme monitoring systems M&E reports, stakeholder interviews, field visits to confirm real situation on the ground Desk review of relevant documentation and information from MOW and others, including audit reports. Stakeholder interviews, field visits Desk reviews of relevant documentation, Briefings from, and in-depth interviews and discussions with, key actors and stakeholders. Field visits to confirm real situation on the ground. Institutional analysis, desk reviews of relevant documentation, field visits to confirm real situation on the ground

All relevant documentation will be shared with us, or is otherwise accessible. M&E systems in place and operating Component managers and/or TWG members make detailed briefing presentations to the team Key stakeholders are willing to be open, realistic and transparent. Field visits provide a fair representation of progress across different components and regions

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 12

G9. Considering what worked/did not work, and why, what key changes/improvements are required (policy incentives, institutional and operational arrangements, funding mechanism, other incentives for those involved in running or executing Programme interventions etc.) a) to increase potential for achieving the Programme development objective in the next 5 years? b) to improve implementation processes in Phase II?

Based on previous analysis

G. To what extent have programme objectives been achieved by the outputs, in both qualitative and quantitative terms?

G1. Is there a causal relationship between the output of implemented activities and the achievement of programme objectives? G2. How effective are current institutional arrangements for Programme management? G3. How effective are programme funding mechanisms and fund utilisation? G4. To what extent do programme systems including the MIS, accounting system (EPICOR) and LGA Planning / Reporting System (Plan-rep) support implementation, and how could they be used more effectively? G5. How effective are monitoring, reporting and feedback mechanisms across sector levels including the client service charters? G6. How effective are technical and administrative monitoring and audits (internal and external) in improving the quality of water services, internal controls, public expenditure, vfm and accountability to beneficiaries? G7. To what extent have participatory monitoring instruments including scorecards been used to measure beneficiary satisfaction, enhance social accountability and include users in decision-making and sustaining services? G8. How effective are institutional arrangements at regional level for technical support and backstopping to LGAs, BWOs, Small Towns and UWSSAs. (To include a specific review of institutional arrangements for rural water supply) G9. Considering what worked/did not work, and why,

Analysis of underlying logic of programme Institutional analysis based on organorgams, desk review of relevant documentation, stakeholder interviews Stakeholder interviews, budgets Stakeholder interviews, relevant documentation. Review of data and other information from MIS, EPICOR and other programme monitoring systems M&E reports, stakeholder interviews, field visits to confirm real situation on the ground Desk review of relevant documentation and information from MOW and others, including audit reports. Stakeholder interviews, field visits Desk reviews of relevant documentation, Briefings from , and in-depth interviews discussions with, key actors and stakeholders. Field visits to confirm real situation on the ground. Institutional analysis, desk reviews of relevant documentation, field visits to confirm real situation on the ground Based on previous analysis

All relevant documentation will be shared with us, or is otherwise accessible. M&E systems in place and operating Component managers and/or TWG members make detailed briefing presentations to the team Key stakeholders are willing to be open, realistic and transparent. Field visits provide a fair representation of progress across different components and regions

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 13

what key changes/improvements are required (policy incentives, institutional and operational arrangements, funding mechanism, other incentives for those involved in running or executing Programme interventions etc.) a) to increase potential for achieving the Programme development objective in the next 5 years? b) to improve implementation processes in Phase II?

Efficiency

H. How productive has the implementation process been in converting Programme inputs into outputs?

H1. What is the cost of the Programme per achieved change in output

3 across the various components?

H2. a) How effective has the capacity building component been in supporting achievement of the intended outcome? b) Should an alternative arrangement be considered on the basis of good value for money?

MIS data, sector reports, budget data, financial reports for Programme components and individual projects Interviews with providers and recipients of capacity building support Annual sector reports an d MIS data Review of Capacity Building Strategy and Action Plan, and other related documents Field visits to confirm real situation on the ground

Appropriate output data and sufficiently detailed budget data are available Vfm analysis can be carried out Key stakeholders are willing to be open, realistic and transparent. Field visits provide a fair representation of progress across different components and regions

Relevance

I. Are Programme objectives consistent with overall Programme goals? (Considering policy direction / stability, stakeholder demand and resources, economic context, etc.)

I1. How relevant is Programme design in terms of the rationale for each component, development objective, outputs, outcomes, targets, indicators and priorities and how could it be optimised? I2. How relevant are the structural and technical arrangements for Programme implementation and what opportunities are there for further improvement? I3. a) To what extent has formula-based allocation for RWS been applied, particularly as the basis for fund transfers to LGAs? If it was not used, what was the barrier? b) Should it be considered for Phase II, and what could be the associated policy incentives? I4. What key internal and external factors have facilitated or impeded progress, including policy and institutional aspects, and how have they influenced implementation?

Desk review of relevant documentation and information from MOW and others Analysis of underlying logic of programme Desk review of documentation Briefings from , and in-depth interviews discussions with, key actors and stakeholders Stakeholder interviews. Review of data and other information from MIS, EPICOR and other programme monitoring systems. Interviews in the field with LGAs Desk review of documentation, stakeholder interviews

All relevant documentation will be shared with us, or is otherwise accessible. Component managers and/or TWG members make detailed briefing presentations to the team Key stakeholders are willing to be open, realistic and transparent. Field visits provide a fair representation of progress across different components and regions

Impacts

J. What have been the impacts of J1 a) What clues on Programme impact on morbidity Desk review of relevant All relevant documentation

3 It would not be possible to assess costs per outcome at this stage of the programme, but it may be possible to assess costs per output

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 14

the Programme (positive and negative, direct and indirect) and what unforeseen influences and effects have there been?

and water collection time can be found in national data sources including the Household Budget Survey 2007; DHS 2010, National Panel Surveys 2009 and 2011; Census of 2012? J1 b) What has been the impact on the health, education and environment sectors? J2. What has been the impact of routine monitoring (water quality, financial management) and service delivery/client satisfaction surveys in improving delivery of WSS services, vfm and service provider accountability to customers?

documentation and information from MOW and others. Quantitative analysis where possible Briefings from , and in-depth interviews discussions with, key actors and stakeholders Review of data and other information from MIS, EPICOR and other programme monitoring systems. Analysis of M&E systems as indicated above. Field visits to confirm real situation on the ground

will be shared with us, or is otherwise accessible. Disaggregated data exist in appropriate format. Sufficient time has passed since activities for impact to show Key stakeholders are willing to be open, realistic and transparent. Field visits provide a fair representation of progress across different components and regions

Sustainability

K. What are the prospects for the sustainability of Programme benefits in the widest sense, taking into account policy, institutional, economic , financial, social and environmental impacts, etc. ?

K1. To what extent was sustainability taken into account in the design and implementation of all Programme components, and how could this aspect be improved in future? K2. What risks are there to the sustainability of Phase 1 achievements and what mitigation measures are recommended? (including behaviour change amongst target groups) K3. To what extent are advocacy (software) processes helping to ensure the sustainability of benefits, and how could they be improved? K4. What lessons can be learned from Programme design and implementation, and from other similar programmes in developing countries, to enhance sustainability in WSDP?

Desk review of relevant documentation and information from MOW and others. Stakeholder interviews Briefings from , and in-depth interviews discussions with, key actors and stakeholders Stakeholder interviews. Field visits to confirm real situation on the ground. Based on previous analysis

All relevant documentation will be shared with us, or is otherwise accessible. Component managers and/or TWG members make detailed briefing presentations to the team Key stakeholders are willing to be open, realistic and transparent. Field visits provide a fair representation of progress across different components and regions

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 15

Annexe B Key informants and organisations (TBC)

Organisation Designation Name

National level

Government

Ministry of Water and Irrigation

Honorable Minister (and Deputy)

Permanent Secretary (and Deputy)

Director Water Resources (DWR)

Director Rural Water Supply (DWRS)

Director Urban Water Supply and Sewerage (DUWSS)

Director Administration and Human Resources (DAHR)

Asst. Director M+E (ADME, former Head PCT)

Head Information Communication Technology Unit (HICTU)

Chief Internal Auditor (CIA)

Head, Division of Policy and Planning (DPP)

Head, Division of Procurement Management Unit (DPMU)

MOW-PCU Head

Accountant

Former Accountant Mr. Pascal Karomba

WRM Specialists

Urban WSS Specialists

Rural WSS Specialists

Capacity Building Specialists

M&E Specialist

Communications Specialist

Programme Management Consultant (RWSS)

Working Groups Chair and Co-Chairs, Water Sector Working Group

Chair and Co-Chairs, WRM TWG

Chair and Co-Chairs RWSS TWG

Chair and Co-chairs, UWSS TWG

Chair and Co-Chairs, Capacity Building TWG

EWURA (Regulator) Director of Water Supply and Sewerage

Ministry of Health Assistant Director- Preventive Services Mr. E. Chinamo

Members of Sanitation and Hygiene team

PMO-RALG Director of Sector Co-ordination

Ministry of Finance and Econ. Aff.

Budget Officer for Water Sector Mr. Mpanda

Ministry of Agriculture, Food Security and Cooperatives

Deputy Permanent Secretary Eng. Mbogo Futakamba

Director of Irrigation

Development Partners

DPG Water Members

AfDB

DFID

JICA

World Bank

World Bank-WSP

Other

Other

Other

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 16

NGOs

WaterAid

TAWASNET

Other

Other

Regional level Regional Secretariat Technical support teams

Urban WSS Authority [Incl. CEO, Director Technical Services, DAWASA]

Urban WSS Utility [Including CEO-DAWASCO]

Basin Water Office

District level LGA Chief Officer

Treasurer.

District Programme Management Unit

District Project Co-ordination Unit

Service Provider

Community level COWSO / WSS Committee

Members

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 17

Annexe C Schedule of deliverables

Deliverable Description Date

1 Inception report and work plan “within one week after signing the contract”

2 Draft interim report “before the last day of the 5th week from commencement of the assignment”

3 Draft final report “not later than 49 days from commencement of assignment”

4 Final report “not later than 65 days from commencement of the assignment”

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 18

Annexe D Updated Terms of Reference

UNITED REPUBLIC OF TANZANIA

MINISTRY OF WATER

TERMS OF REFERENCE FOR THE EVALUATION OF WSDP PHASE 1 (2007-2013)

1. INTRODUCTION

1.1 Background Information

The Government of Tanzania, through the Ministry of Water is implementing the Water Sector

Development Programme (WSDP), for the period 2006–2025. The Programme has four

components, namely: (i) Water Resources Management; (ii) Rural Water Supply and Sanitation;

(iii) Urban Water Supply and Sewerage; and (iv) Institutional Development and Capacity Building,

the later component for strengthening and building capacity of sector institutions to effectively

support implementation of the WSDP. The WSDP follows a Sector Wide Approach to Planning

(SWAP), with an intention to eliminate overlaps and duplication of efforts in water resources

management and in the delivery of water supply and sanitation services. Unlike the past, where

water sector activities were implemented through discrete projects and sub-programmes in selected

areas, the new Programme is simultaneously implemented in Local Government Authorities

(LGAs), Basin Water Offices (BWOs), and Water Supply and Sanitation Authorities

(UWSAs/DUWSSs) throughout the country.

The Programme development objective is to strengthen sector institutions for integrated water

resources management and improve access to water supply and sanitation services. By the end of

the project, the GoT would have met its MKUKUTA sector targets and be well on the way to

meeting the MDGs for improved water supply and sanitation coverage across all segments of the

population, as well as have in place a sustainable regulatory framework for comprehensive water

resources management and development. Within the MKUKUTA framework, specific targets that

were to be achieved by 2010 include:

i) 6 out of 9 water basin institutions strengthened and fully operational and have integrated basin

plans approved by basin stakeholders;

ii) Increased proportion of rural population with access to clean and safe water from 54% in 2003

to 65% in 2010;

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 19

iii) Increased proportion of urban population with access to clean and safe water from 73% in 2003

to 90% and access to improved sewerage facilities from 17% in 2003 to 30% in 2010; and

iv) 95% of people with access to basic sanitation by 2010 and 100% of schools to have adequate

sanitary facilities by 2010.

The first phase of WSDP started in July 2007 and was to be accomplished in June 2012. However,

the Mid Term Review (MTR) of April 2010 noted that a number of important consultancies and

schemes under construction needed more time to completion and that the Programme was not on

track in relation to its targets due to several challenges including: insufficient systemic planning,

monitoring and reporting; inadequate capacity at all levels; delays in flow of funds; delays in

procurement processing; higher unit costs per capita that affected outputs; delayed completion of

designs and use of the sector MIS that were causing several challenges in ensuring effective

financial management and reporting. . Consequently, at mid-term, it was agreed to restructure the

WSDP, adjust targets and extend Phase I completion date to June 2014.

The restructuring plan with realistic revised targets, financing plan, work plan, procurement plan,

and disbursement projections was approved in June 2011. Also, the results-framework and

performance indicators were revised based on re-prioritized interventions and activities within the

available financial envelope. As a result of this review, implementation arrangement, including the

dialogue mechanisms, as well as the Programme Implementation Manual (PIM), also were revised.

The restructured plan also separated out the sanitation sub-component, for coordination by the

Ministry of Health and Social Welfare under the National Sanitation Campaign (NSCs). The revised

targets included the following:

i) The National Water Board and all Basin Water Boards launched and other basin institutions

strengthened and fully operational by 2012;

ii) Increased proportion of rural population with access to clean and safe water from 55.7 % in

2006 to 60.5% in 2012;

iii) Increased proportion of urban population with access to clean and safe water from 78% in 2006

to 88% in 2012; and access to improved sewerage facilities from 18% in 2006 to 22% in 2012;

iv) Water Quality Management and pollution control mechanism in place by 2012; and

v) 95% of the population with access to basic sanitation and 60% of the population with access to

improved sanitation facilities in program areas by 2012.

Major aims of the restructured WSDP were to address capacity constraints of the implementing

entities; strengthening the planning, budgeting and procurement processes; and addressing quality,

timeliness and accuracy of Programme reporting. The progress in addressing the challenges include

installation of the Sector Management Information System (MIS) which became operational in

2011, the urban water supply database (MajIs) have been improved, Water Point Mapping is being

finalized, purchase and distribution of working tools for improvement of work environment,

strengthening the basin boards operational capacity, functioning of the national water board,

establishment of Community owned Water Supply and Sanitation Organizations (COWSOs) and

Water User Associations (WUAs), enactment of the Water Resources Management Act (WRMA)

and the Water Supply and Sanitation Act (WSSA) in 2009, and preparation of regulations, which is

still in progress.

1.2 Financing

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 20

The collaborative efforts between the Government and the DPs have by June 2012, attracted to the

water sector total commitments of about USD 1,299 million, an increase of USD 348 million,

equivalent to 36% of the initial planned investment portfolio of the Phase I Programme of USD 951

million. In the same period, the actual disbursements have reached USD 789 million, which is

equivalent to financial performance of about 61%. The Programme is being implemented using

pooled (basket) financing arrangements which are guided by the Memorandum of Understanding

(MoU) that clarifies areas of compliance to both DPs and the Government as well as earmarked

financing of specific projects governed by specific bilateral financing agreements..

1.3 Justification for the Evaluation

So far six Annual Joint Water Sector Reviews (JWSRs) have been held to assess WSDP

implementation progress and performance in generating relevant outputs/outcomes towards

realization of the Programme objectives. The annual JWSRs have been comprehensive in reviewing

sector performance and has been providing guidance for further improvements through annual

agreed undertakings. Through the annual JWSRs, it has been possible to address outstanding

challenges, making re-prioritizations including documentation of good practices.

In addition to the six JWSRs, nine Joint Supervision Missions (JSMs) have been conducted to

review and monitor Programme implementation. Agreed actions formulated out of these joint

missions have been helpful in addressing the operational challenges observed during field visits and

through review of key documents from IAs.. Findings of the nine JSMs have been summarized in

aide memoires, which provide a trend of what has been happening in the field, in terms of

achievements, challenges and actions for improving implementation performance.

Several capacity enhancement activities have been undertaken to address specific challenges and

enhance staff skills in areas such as planning, budgeting, financial management, procurement,

reporting, use of MIS and specific expert skills to some technical staff. These have led to

improvements in financial management and the quality of reports produced such as the IFRs and

physical progress reports.

Over the period of implementation, annual reviews, technical audit, special audit and financial

audits have been undertaken and these have provided information on the performance of WSDP

over the past six years. As we approach the end of Phase I and start planning for Phase II, a

thorough evaluation of Phase I is required to provide a comprehensive understanding of the

Programme challenges and achievements in terms of implementation performance to achieve

development objectives.

The assignment will therefore focus on undertaking an in-depth evaluation of WSDP Phase I

performance since its inception specifically assessing the extent to which the Programme has

succeeded in achieving the targets during the six years of implementation. The evaluation will

provide to WSDP stakeholders, an indication of the extent to which progress has been made

towards achieving the Programme objectives and the findings of the evaluation will inform the

design of WSDP Phase II (2014/2015-2018/2019).

2. OBJECTIVES OF THE ASSIGNMENT

The overall objective of the assignment is to critically review the performance of Phase I of WSDP

implementation in achieving its objective, and to provide an assessment of key areas that will

require strengthening or changes and establish inputs for phase II of the Programme.

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 21

The focus of the assignment would therefore be to undertake a formative evaluation to answer the

following key questions:

i. Has the Programme been in line with the upper policies? Is the Programme design including

the rationale for Programme components, outputs, indicators and priorities relevant to the

development objective and the revised targets?

ii. How effective is the Programme to achieve its intended goal, objectives, outcomes and

impact?

iii. How efficient is the Programme? Is it on track to achieve its intended outcomes? Are the

costs of the various activities comparable to similar activities in other countries?

iv. To what extent has the Programme addressed equity and sustainability in service delivery?

v. What impact have capacity building initiatives had at various levels? To what extent do

capacity building efforts contribute to Programme efficiency and effectiveness in delivery of

results?

vi. From the experience of Phase I of the WSDP implementation, what worked well and what

did not work? What are the key lessons learnt and what should change or be done differently

going forward?

2.1 Tasks of the Consultants

The consultant will perform the following tasks:

(a) Effectiveness

Assessing “Effectiveness” will entail ascertainment of the extent to which the Programme objectives

have been achieved by Programme outputs. This will involve analyzing the relationship between

outputs from implemented activities and the level of accomplishment for the Programme objectives.

i) Review institutional arrangements for the implementation of the WSDP, paying attention to

effectiveness and efficiency of the overall Programme management such as the role of the

Steering Committee in providing strategic guidance and accountability; the role of Technical

Working Groups in guiding day to day Programme implementation, and the role of

Implementing Agencies in effective implementation of planned activities. This will also

entail reviewing the dialogue mechanism as a whole and effectiveness of agreed actions (in

JSMs), undertakings (in JWSRs) and compliance to the WSDP MoU;

ii) Assess the effectiveness of the funding mechanism, financial resource flow and its

utilization as agreed in the in the Programme Appraisal Document (PAD) , including in-

depth analysis of economic returns and value for money of the WSDP investments;

iii) Assess the effectiveness of the Programme supporting systems (Water Sector MIS, the

Governments Financial Accounting System (EPICOR), the Planning and Reporting System

for Local Governments (Plan-rep), etc) to determine the extent at which they supported

Programme implementation, what are the bottlenecks for their effective utilization; what

were the results and draw up feasible recommendations;

iv) Assess effectiveness of the monitoring, reporting and the overall WSDP feedback

mechanism across sector levels including the client service charters;

v) Assess effectiveness of water quality monitoring, technical audits, external audits, internal

audits and regular and ad-hoc monitoring activities in improving the quality of water

services, internal controls, public expenditure, value for money and improvements in

accountability to beneficiaries.

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 22

vi) Review the extent to which the planned community participatory monitoring instruments

including the use of scorecards were used to measure beneficiary satisfaction, enhance

social accountability and governance; and as a means to include the voice of people in

decision-making and sustainability of services;

vii) Review the effectiveness of the sector technical capacity and mandate at regional level in

supporting the supervision, monitoring and technical backstopping to LGAs (especially

reviewing the adequacy of the institutional arrangement for component two), BWOs, Small

Towns and Urban Water Supply and Sanitation Authorities (UWSSAs). This will also entail

reviewing the institutional arrangements for all WSDP components, which cuts across

several line ministries and involves various implementing entities. Specifically review the

adequacy of institutional arrangements for rural water supply delivery and its supporting

structures;

viii) Carry out both quantitative and qualitative assessment of the achievements of WSDP

objectives and provide specific recommendations – indicating clearly (i) what worked and

what did not work and why; (ii) key implementation lessons towards achievement of the

Programme development objective; and (iii) changes required to improve implementation

processes so as to achieve Programme objectives and targets of WSDP phase II;

ix) Propose key practical changes/improvements required (policy incentives, institutional and

operational arrangements, funding mechanism, other incentives for those involved in

running or executing Programme interventions etc) to increase potential for achieving the

Programme objective in the next 5 years.

(b) Efficiency

Analysis of “Efficiency” will entail assessing the level of productivity in the Programme

implementation process. This will involve a thorough study of the ration of inputs (implemented

activities) converted into outputs.

i) Assess the cost of the Programmeme per achieved change in outcome across the various

components;

ii) Review the efficacy of the capacity building support component in achieving the intended

outcome. Determine if an alternative arrangement should be considered on the basis of good

value for money.

(c) Relevance

Assessment of “Relevance” entails reviewing the consistency of the Programme objectives with

overall Programme goals. This requires the consultant to look into the stability of the policy

direction, the demand, resources, economic conditions, etc. of stakeholders involved in WSDP.

i) Review the relevance of the structural and technical arrangements for Programme

implementation to determine further opportunities for improvements;

ii) Review the relevance of the overall Programme design including the rationale for

Programme components, the Programme development objective, outputs, outcomes, targets,

indicators and priorities to determine and recommend optimal Programme design solutions;

iii) Examine the extent to which formula based allocation for rural water supply has been applied.

In particular, review whether performance based funding allocation was used as the basis for

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 23

funds transfer to LGAs. If not used, what was the barrier? Assess whether this should be

considered for Phase II and establish its associated policy incentives.

iv) Identify key internal and external factors that have facilitated or impeded progress towards

achieving Programme objectives, including policy and institutional setup that have taken

place in the sector and analyze their influence on the implementation of the Programme;

(d) Impacts

Analysis of “Impacts” includes assessing direct and indirect, positive and negative effects of the

Programme implementation and influences and effects not foreseen during Programme design.

i) Review various available documentation including the Household Budget Survey (2007),

the Tanzania Demographic and Health Survey (2010), the National Panel Surveys (2009 and

2011), and the National Housing and Population Census of 2012 to determine clues of

Programme impacts on reduction of water related and water borne diseases, reduction of

time taken to fetch water and its impacts in improving the health, education and

environment sectors;

ii) Assess the impacts of routine monitoring (water quality, financial management) and regular

service delivery/client satisfaction surveys in improving delivery of water and sanitation

services, improving value for money and holding water supply and sanitation services

providers accountable to beneficiaries.

(e) Sustainability

Whether or not the benefits from the implementation of the Programme will continue accruing after

this current phase of WSDP ends is examined as “Sustainability” with wider viewpoints such as

policies, technologies, environment, society & culture, organization & institutions, economy &

finance, etc.

i) Assess the extent to which the Programme design and implementation have taken issues of

sustainability into account across all components water -resources management, urban and

rural water supply and sanitation and propose improvements for future;

ii) For the rural water component in particular examine whether the LGAs have capacity in

place to support maintenance of the schemes going forward in terms of financial capacity,

human resources and technical knowledge. What support should be considered in the future

to keep results sustainable?

iii) Identify and assess any risks to the sustainability of achievements gained under phase 1 and

propose mitigation measures for any identified risks (including behavior changes amongst

target groups);

iv) Review software advocacy processes for the sector, identify measures for ensuring their

sustainability in relation to sustainability of outcomes;

v) Review lessons learned from all aspects of the Programme including formulation,

implementation, management, coordination, fiduciary arrangements, dialogue mechanism

etc, including drawing up lessons from other similar Programmes in developing countries

that can inform sustainable and more feasible way forward for WSDP.

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 24

3. SCOPE OF THE ASSIGNMENT

For the purpose of this evaluation, scope of work will hinge mainly on assessing the effectiveness

and efficiency of the structures and interventions of WSDP phase I since its commencement so far

(2007/08 – 2011/12); and to determine the relevance of Programme execution processes towards

achieving the intended Programme objectives, impacts and sustainability. The assignment will also

review and analyze sustainability of outputs during WSDP phase I so as to inform any possible

changes for next phases of Programme implementation. The assignment will propose what needs to

be changed or strengthened in moving forward to the WSDP phase II. The deskwork and outreach

scope will involve the following:

i) The evaluation will use combination of approaches including (a) desk review of

available information/reports such as JSM Aide Memoires; JWSR proceedings; WSDP

quarterly, semiannual and annual progress reports, technical studies done in WSDP

components, WSDP performance assessments reports, Monitoring reports, MTEFs,

budget performance and expenditure reports, Public Expenditure Review reports etc and

(b) structured and unstructured interviews of key stakeholders in the sector at national

(Government Ministries, Development Partners, Private Sector, Civil Societies, etc) and

local level (LGA; COWSOs, UWSAs, Basin Water Offices; private service providers

and others). This will entail extensive field visits to selected areas.

ii) The Consultant(s) should devote ample time to collect/consolidate and analyze available

information, as well as findings from stakeholders’ interviews. The evaluation should

include both qualitative and quantitative analysis of Programme performance based on

outcome and impact indicators.

iii) The Consultant(s) will interact with the Ministries responsible for WSDP

implementation (MoW, PMO-RALG, MoF, MoHSW and MoEVT), WSDP component

directorates, Local Government Authorities (LGAs), UWSAs, Basin Water Boards and

other stakeholders.

4. QUALIFICATIONS OF THE CONSULTANT

A consulting firm that will field a team of not less than 3 consultants, including the team leader who

must have international experience in water sector, will carry out the assignment. The idea of 3

consultants lies mainly in comprehensively covering water resources, water supply and sanitation

technical areas. The skill mix for at least two (2) consultants is Masters Degree level in Water

Resources (Hydrology, Hydrogeology or Engineering), Water Supply (Civil or Water Engineering)

and Sanitation (Sanitary or Environmental Engineering); and for other consultant(s) is Masters

Degree in economics, institutional/organizational management and financial analysis.

While emphasis is at Master Degree level, PhD in the relevant field will be added advantage. The

Team Leader will be responsible for providing strategic guidance to the evaluation team and overall

coordination of the assignment and its outputs The Team Leader must have experience of at least

ten (10) years in execution of similar assignments in developing countries; and other consultants

must have the experience of not less than 5 years in conducting similar assignments.

Time Schedule

It is anticipated that this assignment will be undertaken during the period of mid February 2013 –

mid April 2013; and will require a total Consultants’ input of about 200 staff-days. . A detailed

time schedule/work plan will be developed by the consultants and discussed with the client.

5. EXPECTED OUTPUT

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 25

5.1 The main output

The main output is a comprehensive evaluation report addressing the TORs. The final report should

not exceed 50 pages excluding annexes, with an informative executive summary of not more than

10 pages. The deliverables will be as follows:

(i) An inception report will be presented to the joint management of MoW and DPs within

one week after signing the contract. It will specify detailed approach and methodology to

the used in the evaluation as well as proposed work plan and time schedule;

(ii) Desk study – 1.5 weeks

(iii) Interviews – 1.5 weeks

(iv) Field study – two weeks

(v) Drafting of the report – 4 days

(vi) The Draft Interim Report will be presented to Technical Working Group 4 (TWG 4)

before the last day of the 5th

week since commencement of the assignment.

(vii) The Draft Final Report will be presented to the Water Sector Working Group

(stakeholder forum) meeting for comments before finalization not later than 49 days

from commencement of assignment; and

(viii) The final report will be submitted to the PS MoW not later than 65 days from

commencement of the assignment.

All deliverables should be submitted in both hard (15 copies) and softcopy in MS-word and

tables and charts in MS-Excel.

5.2 Payment Schedule and Durations:

The payments to the consultant will be made upon submission of acceptable reports as summaries

in Item 5.1 above:

(i) 15 percent of the lump-sum amount shall be paid upon acceptance of the Inception

Report by the Joint MoW-DPs management meeting.

(ii) 30 percent of the lump-sum amount shall be paid upon acceptance of the Draft Interim

Report by the TWG 4.

(iii) 30 percent of the lump-sum amount shall be paid upon acceptance of the Draft Final

Report by the Water Sector Working Group.

(iv) 25 percent of the lump-sum amount shall be paid upon submission of the Final Report.

6. REPORTING AND OBLIGATIONS

6.1 Institutional and Organization Arrangements and Client’s obligations

The consultant will report directly to Japan International Cooperation Agency (JICA) and the

Ministry of Water (MoW) through the Director of Policy and Planning (DPP) who will be the

contact person for this assignment. The MoW will ensure smooth execution of the consultant’s

activities. However, the Consultant will be responsible for all organizational and logistical

Inception Report: Water Sector Development Programme, Tanzania - Evaluation of Phase I

© Oxford Policy Management 26

arrangements during his assignment. On written request, the MoW will provide support to the

Consultant with regard to getting access to the required documents/information. In addition, the MoW

will provide a written letter of introduction of the Consultant to the various implementing entities and

Development Partners and will facilitate appointments on consultant’s request. In case of any

difficulties regarding the timely execution of the assignment, the Consultant will inform JICA and the

MoW without any delay and will propose appropriate measures for resolving the difficulties.

The Team Leader will be responsible for maintaining effective communication with JICA and the

MoW during execution of the assignment and timely delivery of outputs.

6.2 Relevant documents and reports to be reviewed

The MoW shall provide relevant documents not limited but including the following; some of which

are available online at http://www.tzdpg.or.tz/index.php?id=221

Programme Implementation Manual including the related volumes and annexes;

WSDP 2006-2025: main Document,

Programme/Project Appraisal Document PAD

WSDP Technical Audit report for the three fiscal year FY 2007/08, 2008/09and 2009/10

and all its Annexes

Memorandum of Understanding for WSDP between the Government of the United

Republic of Tanzania and Basket Development Partners

WSDP reports (Quarterly, Semi Annual, Annual);

Aide Memoires;

A complete list of water sector projects and activities financed individually by DPs and/or

GoT outside the water sector basket funding (if not included in the WSDP progress

report);

The National Water Policy

The National Water Sector Development Strategy (NWSDS 2006-2015)

The WSDP Revised Procurement Plan (FY 2010/2011 and FY2007 to 2013)

A list of signed contracts with the contract price (including addenda), amount paid and

balance yet to be paid;

Work-plan (FY 2010/2011 and 2011/2012)

CAG Special Audit Report and other WSDP Audit reports (internal audit reports as well

as external audit reports)

Water Sector Performance Reports (2010/2011);

Complete list of Districts /Wards/Villages, UWSAs, EAs and BWOs which have benefited

from the WSDP financing;

ESMF and RPF

A list of category A projects

ESIAs/ESMPs and RAPs for sampled sub-projects

WSDP MIS online access or printed reports

WSDP Restructuring Plan Document

HBS 2007

TDHS 2010

NPS 2009 and 2011

Any other available report, data and information deemed relevant to this assignment.