workshop on information systems for performance indicators · 2010-10-12 · workshop on...
TRANSCRIPT
![Page 1: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/1.jpg)
Workshop on Information Systems for Performance Indicators
October 4, 9:00 a.m.
Sanford Berg
Director of Water Studies
![Page 2: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/2.jpg)
Some Thoughts
Spare us from cowardice that shrinks from new truths;
Spare us from laziness that is content with half-truths; and
Spare us from arrogance in thinking that we know all truth.
![Page 3: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/3.jpg)
Public Utility Research Center
Research Expanding the body of knowledge in public utility regulation, market reform, and infrastructure operations (e.g. benchmarking studies of Peru, Uganda, Brazil, Japan, and Central America)
Education Teaching the principles and practices that support effective utility policy and regulation (e.g. PURC/World Bank International Training Program on Utility Regulation and Strategy, January 2011)
Service Engaging in outreach activities that provide ongoing professional development and promote improved regulatory policy and infrastructure management (e.g. in-country training and university collaborations)
www.purc.ufl.edu
![Page 4: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/4.jpg)
Information Systems for Performance Indicators
Thank UNHabitat, CWWA, and CBWMP
Establish baseline information for EU Proposal
Data Coordinators from Sixteen Utilities
Preliminary Results (29 items)
Primarily Water, future: Wastewater
Workshop for Prioritizing and Refining Data Collection
Workshop for Sharing information system expertise
Eight Illustrative Charts—Very Preliminary
![Page 5: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/5.jpg)
0
50,000
100,000
150,000
200,000
250,000
300,000
350,000
400,000
450,000
1. Total number of customers
![Page 6: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/6.jpg)
0.00
2.00
4.00
6.00
8.00
10.00
12.00
14.00
2. Workers per 1000 connections
![Page 7: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/7.jpg)
Antigua
Bahamas
Barbados
Belize
BVI
Cayman
Curacao
Jamaica
Nevis
0
2
4
6
8
10
12
0 5,000,000,000 10,000,000,000 15,000,000,000 20,000,000,000 25,000,000,000
3. Workers per 1000 connections per total water delivered
![Page 8: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/8.jpg)
0.00%
50.00%
100.00%
150.00%
200.00%
250.00%
300.00%
350.00%
400.00%
4. Ratio total cost / total revenues
![Page 9: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/9.jpg)
Bahamas
BelizeBVI
Cayman
Jamaica
Nevis0
20,000,000
40,000,000
60,000,000
80,000,000
100,000,000
120,000,000
140,000,000
160,000,000
0 5,000,000,000 10,000,000,000 15,000,000,000 20,000,000,000 25,000,000,000
5. Total operating costs / total water delivered
![Page 10: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/10.jpg)
Bahamas
Barbados
BVI
Cayman
Curacao
Jamaica
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
0 5,000,000,000 10,000,000,00015,000,000,00020,000,000,00025,000,000,00030,000,000,000
6. Coverage / Total Water delivered
![Page 11: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/11.jpg)
AntiguaBahamas
Barbados
BVI
Cayman Curacao
Dominica
Jamaica
MartiniqueNevis
St Lucia
St Marteen
Trinidad & Tobago
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
0 50,000 100,000 150,000 200,000 250,000 300,000 350,000 400,000 450,000
7. Percentage residential customers per total / total customers
![Page 12: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/12.jpg)
Antigua
Bahamas
Barbados
BVI
Cayman
Curacao
Jamaica
Nevis0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
0 5,000,000,000 10,000,000,000 15,000,000,000 20,000,000,000 25,000,000,000
8. Percentage desalinated water / total water delivered
![Page 13: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/13.jpg)
Future Data Collection
Expand the number of Utilities
Prioritize Data Collection
Unaccounted for Water
Rate Structures– Cross Subsidization?
– Financial Sustainability?
– Encourage Conservation?
Service Quality
Wastewater
Internal Governance
![Page 14: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/14.jpg)
GovernanceInstitutional Arrangements: Water and Sanitation Sector
(World Bank Working Paper 58, 2005)
Private Independent Policy that tariffs Participation Regulation should cover costs
Antigua &Barbuda N N NDominica N N YGrenada N N NSt. Kitts N N NSt. Lucia N Y YSt. Vincent N N NBarbados N Y YDominican Republic Y N NGuyana Y Y NJamaica N Y YTrinidad &Tobago N Y N
(The reader is referred to the original report for footnotes regarding the categories)
![Page 15: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/15.jpg)
Lessons from Coordinators
1. Data Manager Commitment (strategic value, tool for company & regulator)
2. Data Manager Continuity (formalize role, support IBNET, capacity building--CariWOPs)
3. Centralized vs. Decentralized Systems (avoid Information Empires)
4. Benefits of Detailed Data (trends, incentives)
5. Data Definitions and Benchmarking Objectives
![Page 16: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/16.jpg)
Lessons Continued
6. Operational Data (manage what you measure)
7. Other Data Sources (water resources, social statistics, local conditions: density, topology)
8. Information Technology and Management (IT necessary but not sufficient; supply chain)
9. Transparency and Public Policy (comparisons create pressures, promote reform)
10. Methodologies and Capacity-Building: beyond Key Performance Indicators (KPIs)
![Page 17: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/17.jpg)
Consumers of Information
Regulatory Commissions (responsible for policy implementation in the sector: internal consensus?)
Government Sector Ministries (charged with policy development)
Government Treasuries (addressing fiscal issues)
International Investors (bond, equity, and strategic management teams)
Service Providers (state-owned enterprise or privately owned)
Un-served Citizens (rural and urban poor)
Current and Future Customers (trade-offs)
Multilaterals, donors, and NGOs (as a potential infrastructure project donors/funding agencies)
![Page 18: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/18.jpg)
Observations It is better to have an approximation of the “right” performance
indicator than a precise calculation of an irrelevant number: benchmarking is an art and a science.
The CariWOPs Platform represents an valuable resource for the Caribbean.
The EU Proposal is an important catalyst for change.
“Believing is seeing.” Data collection, analysis, interpretation, and dissemination are key activities within utilities, so continued capacity-building is essential.
“If we are not changing the way we work, we could end up just where we are going.” (Chinese Proverb)
![Page 19: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/19.jpg)
Extensions: Information, Conflict, and Sector Performance
1.Authority Conflicts: lack of clarity of roles
2.Cognitive (Factual) Conflicts: disagreements regarding current or historical facts and causal linkages
3.Value Conflicts: conflicting priorities and different weights on outcomes
4.Interest Conflicts: stakeholders benefit differentially from decisions
(from Shabman, 2005)
![Page 20: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/20.jpg)
Context for Sector Leadership: Resolving Conflict and Making Choices
Utility will spend $700,000 in OPEX.
With $300,000 in CAPEX,
the utility claims it can provide
3000 new connections OR
Produce an increase of “six points”
in the water quality index, OR
Be at another point on the Frontier
(A, B, or C).
Change in Index of Water Quality
Number
Of New
Connections
5000
4000
3000
2000
1000
1 2 3 4 5 6 7 8 9
A
B
CX
![Page 21: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/21.jpg)
1 Authority Conflict
“Authority” conflicts” reflect different views regarding where
decisions will or ought to be made.
Who decides?
Jurisdiction may not yet be assigned or the issue might be addressed by multiple agencies.
Stakeholders will go jurisdiction-shopping—selecting the agency or the level of government most likely to support its interests in policy design and implementation.
Appeals procedures within the judicial system can delay implementation. In such situations, benefits delayed are (effectively) benefits denied.
Issues include: Finance Ministry vs. Water Ministry, Environmental Regulator vs. Sector Regulator
![Page 22: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/22.jpg)
Authority Issues Facing Managers and Policy-makers
Who decides where to expand networks?
Who funds network expansion?
Who determines when prices are financially
sustainable?
Who monitors water quality?
Who sets water quality standards?
Who decides environmental requirements?
Who makes water resource allocation
decisions?
Change in Index of Water Quality
Number
Of New
Connections
5000
4000
3000
2000
1000
1 2 3 4 5 6 7 8 9
![Page 23: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/23.jpg)
Conflict Resolution:Authority and Governance
Clarify Governance: Seek Changes in the Law—legal clarity
Promote Cooperation among Sister Agencies: avoid turf wars and limit political interference (short term versus long term perspectives)
Establish Task Forces to Address Issues
Educate the Courts and Promote Transparency
Improve Appeals Procedures
Encourage Citizen Awareness
![Page 24: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/24.jpg)
2. Cognitive Conflicts
“Cognitive” conflicts are disputes over facts: “What is?”
For example, How many new connections can be made with $300,000?
Technical disagreements reflect cognitive conflicts. Such conflicts can be reduced through comprehensive data collection and analysis.
Information Systems for Performance Improvement Plans
![Page 25: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/25.jpg)
Factual Issues
With $300,000 in CAPEX,
NGO claims the utility can provide
5000 new connections
OR
Produce an increase of “10 points”
in the water quality index,
OR
Be at another point on the Frontier
(D, E or F).
Change in Index of Water Quality
Number
Of New
Connections
5000
4000
3000
2000
1000
1 2 3 4 5 6 7 8 9
A
B
C
D
E
F
![Page 26: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/26.jpg)
Conflict Resolution--Facts
Benchmarking Studies:
– Input Data (physical and monetary)
– Output Data (connections, water delivered, continuity, quality)
– Performance Indicators (trends, comparisons, targets)
Financial Sustainability Studies
– Income Statements
– Balance Sheets
– Cash Flow Statements
Examine Incentives and Estimate time to reach “the” frontier
![Page 27: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/27.jpg)
3. Values Conflicts
“Values” conflicts are more ideological in nature, reflecting the different preferences or values of groups.
What should be?
Is there a political consensus over the weight assigned to particular outcomes, especially outcomes involving non-monetary impacts?
Targets: Preferred outcomes depend on citizen attitudes.
![Page 28: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/28.jpg)
Values Issues
Once the utility is on the Frontier . . .
Should more than $300,000 be invested?
Which Target: D? E? F?
Does meeting the target promote
social justice?
How should we prioritize
environmental objectives?
Change in Index of Water Quality
Number
Of New
Connections
5000
4000
3000
2000
1000
1 2 3 4 5 6 7 8 9
D
E
F
![Page 29: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/29.jpg)
Conflict Resolution--Values
Public Education
– Publish Performance Comparisons
– Identify Trade-offs
– Reports to the Legislature
Promote Citizen Participation
– Regular Updates
– Citizen Advisory Boards
Limit the Rhetoric: Articulate a Vision
Facts Provide the Context
![Page 30: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/30.jpg)
4. Interest Conflicts
“Interest” conflicts reflect the differential impacts of policies on various stakeholder groups: “Who benefits from the policy?”
If the situation is actually a zero-sum game, one group benefits at another’s expense (unless there is compensation).
Special Interests: when the beneficiaries of a particular policy are concentrated (and per capita benefits are high) the beneficiaries will lobby.
If losers are diffuse (and the per capita damages are low), the result is a policy that benefits well-organized stakeholders—even when the costs to the losers outweigh the benefits to the winners.
![Page 31: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/31.jpg)
Special Interest Issues
Pipe suppliers want to sell pipe.
IT providers want to sell systems.
Unions seek particular work rules.
Should more than $300,000 be invested?
What should prices be to different groups?
Un-served citizens want “D”
Current Customers want “F”
Which Group has Political Power?
Would some recommendations lead
to being inside the “frontier”?
Change in Index of Water Quality
Number
Of New
Connections
5000
4000
3000
2000
1000
1 2 3 4 5 6 7 8 9
D
E
F
![Page 32: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/32.jpg)
Conflict Resolution--Interests
Do not pretend there are no conflicts
– View from the Balcony—step back from stakeholders
Take a Leadership Role in Identifying Benefits and Costs
Eg. OFWAT and EU Environmental Standards
– Collected compliance cost information from utilities
– Presented costs of meeting targets: current deadline vs. delay
Politicians make Final Decision (Accountability)
Companies and Other Groups can provide Leadership in Conflict Resolution
![Page 33: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/33.jpg)
Conflict Resolution Matrix
Conflict Over
Facts
Conflict Over
Distribution of
Gains & Costs
Conflict Over
What is important
Conflict Over
Jurisdiction or
Authority
Addressed
By Research
And Negotiation
Addressed
By Research
Addressed by
Engaging
People with
Adaptive
Challenges
in Research
And Dialogue
Technical
Work
Adaptive
Work
From Mark Jamison
![Page 34: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/34.jpg)
Additional Observations
Water problems are managed . . . Not solved.
“Everyone is entitled to their own opinions, but not to their own facts.” (Alan Greenspan)
Evidence-based decision-making is grounded in reality rather than fantasy or rhetoric.
A danger of quantitative studies: “If you torture the data enough, it will confess.”
Therefore: “Experts should be on tap, not on top.” (Winston Churchill)
![Page 35: Workshop on Information Systems for Performance Indicators · 2010-10-12 · Workshop on Information Systems for Performance Indicators October 4, 9:00 a.m. Sanford Berg Director](https://reader033.vdocuments.mx/reader033/viewer/2022060413/5f1190864bf4be25f4210bc6/html5/thumbnails/35.jpg)
Point your browser to http://www.regulationbodyofknowledge.org.