smart stove selection: using performance frameworks in … · wb stove performance support profile...
TRANSCRIPT
SMART STOVE SELECTION:Using Performance
Frameworks in the World Bank ACCES and UNHCR
Initiatives
ETHOS 2015January 25 2015
Berkeley Air Monitoring Group
Relevant Sector Tools for Selecting Stoves
• ISO IWA– Defines metrics– Guidance on test
methods– Framework for
comparison• Clean Cooking Catalog
– Listings of available stoves (+ fuels)– Test data– Market intelligence
Current Gaps
– How good is good enough?– What are the components of quality?– How do we balance the current reality with
the aspirational goals?– ISO process underway but the outcome is
uncertain.
Missing link between testing and dissemination
Whether market-based or humanitarian, programs want to support the best stove, the right stove
African Clean Cooking Energy Solutions Initiative (ACCES)
Mission • Promote enterprise-based,
large-scale dissemination of clean cooking solutions in Sub-Saharan Africa
• Increase “access” to modern technologies and cleaner fuels
• Alleviate the adverse health, environment, and socio-economic impacts of traditional cooking practices
• Open, adaptable framework focusing on: – delivering products – activating customers– managing quality
• test methods & capacity
• performance thresholds
• technical assistance• National-level partners• 3 focus countries
5
Overview of Performance Threshold Approach
Selected indicators that best correspond to key objectives: indoor emissions, efficiency, and safety.
Identified stoves in each location to represent baseline and aspirational stove choices for each country
Landscape performance testing conducted at RKTC and at CSU
Recommended country-specific thresholds
6
Stove Selection and Landscape Testing• QA&TS team visited all three
locations in September 2013 and again in March 2014
• Cookstoves were selected for testing through– Discussions with testing
centers in each country – Observations by the team
during field visits• Stoves selected include:
– Traditional and improved designs
– Locally produced and imported
– Charcoal and wood
Uganda DRC Senegal Wood Three Stone Fire Three Stone Fire Three Stone Fire Rocket stoves (2 models) Rocket stoves (2 models) Rocket stoves (2 models) Fan stove Fan stove Fan stove Artisanal Top-Lit Updraft (TLUD)
Charcoal* Industrial Industrial Industrial Semi-Industrial (2 models) Congolese Traditional Metal Malagasi Traditional Metal Jambar Traditional Ceramic
7
Stove Selection and Landscape Testing
• Each cookstove was tested using the Water Boiling Test and the Biomass Stove Safety Protocol
• Testing was done through a collaboration between CSU and CERER in Senegal, CREEC in Uganda, and CERER-K in DRC
• The results were anonymized and plotted against IWA 11:2012 interim performance guidelines.
• The objective was to show the spectrum of available cooking technology types in each country rather than to draw attention to any particular product.
8
Figure 4: Stove performance landscape in focus countries.
Red points are wood stoves, blue are charcoal, and green is LPG.
Uganda DRC Senegal
9
Efficiency Results Senegal
Red points are wood stoves, blue are charcoal, and green is LPG.
10
Indoor Emissions Results Senegal
Red points are wood stoves, blue are charcoal, and green is LPG.
11
Safety Results Senegal
Red points are wood stoves, blue are charcoal, and green is LPG.
12
Results-Based Performance Thresholds
• For each country, performance thresholds were recommended for efficiency, indoor emissions, and safety
• Evolving over three time periods – 2014-16; 2017-2019; and 2020 and beyond -- to drive improvement– Traditional stoves were used as a proxy for a business-as-usual
scenario, and the minimum threshold was set approximately one tier above that point.
– Traditional stoves typically in the Tier 0-1 range, and the thresholds for the first time period were set in the Tiers 1 & 2.
– Each time frame has a blended requirement so that the ACCES initiative can support a mix of conventional and cutting-edge technologies and incent performance improvement
• For safety performance, a minimum Tier 3 threshold is set for all stoves regardless of time period.
13
Recommended Minimum Performance Thresholds Senegal (alternative presentation)
- Minimum thresholds specify how well a stove must perform, in terms of fuel efficiency, emissions, and safety in order to qualify for ACCES support.
2014 - 2016 2017 - 2019 2020 +
Tier 2+
with at least 25% of support going to Tier 3+
Tier 3+
with at least 50% of support going to Tier 4
Tier 3+
With at least 75% of support going to Tier 4
Tier 1+
with at least 50% of support going to Tier 2+
Tier 2+
with at least 50% of support going to Tier 3+
Tier 3+
with at least 75% of support going to Tier 4
Tier 3+ Tier 3+ Tier 3+
14
World Bank stove performance support profiles for Senegal
50%
75%
25%
50%
25%
75%
0%
25%
50%
75%
100%
2014-2016 2017-2019 2020+
WB
sto
ve p
erf
orm
ance
su
pp
ort
pro
file
Tier 4 Tier 3 Tier 2 Tier 1
75%
50%
25%
50%
50%50%
0%
25%
50%
75%
100%
2014-2016 2017-2019 2020+
WB
sto
ve p
erf
orm
ance
su
pp
ort
pro
file
Tier 4 Tier 3 Tier 2 Tier 1
Percentages represent the lower thresholds of performance for a given year.
Figure 7. Stove performance support profiles for Senegal.
15
Cookstove Quality Assessment Tool• Performance thresholds for indicators
matched to World Bank goals important• But quality is not only about performance• ACCES team also developed a companion
Quality Assessment Scorecard for cookstove manufacturers– Covers product design, manufacturing and
distribution topics as well as performance– Pinpoints quality weaknesses and target
rigorous technical support
UNHCR Cookstove Procurement • Working with GACC to improve access to
clean, safe, and efficient cooking in humanitarian settings
• As needed, stoves are selected from a menu of options pre-vetted during a competitive bidding process
• This year adding quality and performance specifications
UNHCR Cookstove Procurement • Conducting rapid needs assessment to
understand other dimensions of quality in humanitarian context.
• Develop additional evaluation frameworks, such as– User characteristic and preferences– Cooking practices– Production and distribution scenarios
• Currently seeking input …
Field Monitoring and Evaluation• Completes quality improvement cycle• Answers to key questions about what
really happened provides rich learnings– How and how much was the new stove used?– Did the stove perform as expected?– What improvements could be made to the
program and to the process for setting quality specifications?
• Feed back field results into thresholds, specs, clean cooking catalog, etc.
