water quality metrics - australian national university
TRANSCRIPT
![Page 1: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/1.jpg)
Measuring and evaluating water quality improvements in Great
Barrier Reef catchments
John Rolfe
![Page 2: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/2.jpg)
The problem being addressed
• Governments regularly provide a range of support mechanisms and incentives to stimulate better environmental outcomes from private decisions– How can the environmental outcomes be
evaluated?– What is the best way of selecting between
different initiatives and projects?• These types of evaluations require some
form of assessment - Metrics
![Page 3: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/3.jpg)
The case study: Great Barrier Reef
![Page 4: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/4.jpg)
The problem – poor water quality from agriculture
Pollutants move out from catchments
‐Sediments ‐ Nutrients
‐ Nitrogen‐ Phosphorus
‐Pesticides ‐ Causes reef damage
![Page 5: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/5.jpg)
What governments have been doing
• Several major funding programs to reduce emissions from agriculture – Diversity of catchments, climate & agriculture
• Previous NHT and NAP funding rounds• New ‘Reef Rescue’ program ($200 M)• Funding allocated through NRM and industry
groups • Focus on
– fixed grants – Supplying inputs – Maximising participation
![Page 6: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/6.jpg)
Searching for the economics
• New investments and regulations have significant public and private opportunity costs
• But allocations and targets appear to be set with little consideration of economic tradeoffs
• Little attempt to justify current investments for protection as being:• Efficient (benefits outweigh costs)• Effective (lowest cost options selected)
![Page 7: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/7.jpg)
Three key issues
• Limited knowledge about tradeoffs between farm management and water quality outcomes
• Significant variation in the cost-effectiveness of different proposals – Some are not effective, and others are high
cost• Some mechanisms are very poor at
selecting the most cost-effective projects
![Page 8: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/8.jpg)
First big problem – Can not quantify environmental benefits
• NRM groups have tended to focus on assessing actions and inputs – Blind faith that doing something will generate
benefits • Better to at least predict change in outputs
– Change in emissions generated on-farm, or– Change in emissions reaching stream or GBR
lagoon• Best to predict changes in outcomes
– Change in GBR health caused by change in emissions
![Page 9: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/9.jpg)
The links between farm management and water quality
Changed management practice on a farm
Change in amount of pollutant that is released
Proportion of pollutant that leaves the farm
Proportion of pollutant that moves through waterways to GBR lagoon
Damage that is done to GBR ecosystems
Varies by:‐Different industries ‐Several pollutants‐Different management actions
Varies by:Location in GBR lagoonTiming and type of eventGBR ecosystemsResilience levels
![Page 10: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/10.jpg)
Missing information requirements
• To evaluate funding proposals accurately, need to compare costs against environmental benefits
• Major information gaps exist– Difficult to predict change in emissions on-farm– Rate of pollution transport is poorly understood
• Both on-farm and in-stream– Few comprehensive damage or recovery
functions exist• Needed to link change in pollutants with health in
GBR
![Page 11: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/11.jpg)
Second big problem – large variation in costs to achieve outcomes
• Many programs with landholders involve fixed rate payments or similar– Implicit assumptions that:
• Opportunity costs are similar between landholders• Benefits of actions are similar between landholders
• Most grant schemes and other engagement mechanisms do not reveal the real information about costs
• Little understanding that cost functions are non-linear
![Page 12: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/12.jpg)
Water quality tenders reveals information about opportunity costs
• Some NRM groups have trialled water quality tenders – A type of auction of government support for water
quality improvements – Prices vary, in contrast to fixed rates in grants
scheme• Results show large variation in opportunity
costs – Between farmers – Between different industries – Between different regions
![Page 13: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/13.jpg)
Tenders reveal large variation in opportunity costs
• Example from a tender run in the Burdekin region with grazing and sugarcane industry– 10 most highly ranked projects cost $180,574
• were modelled to capture 47,510 kgs of Nitrogen ($1.70/kg), 51.6 kgs of Pesticide ($1,579/kg), and 29.8 tons of Sediment ($117.4/ton).
– 10 lowest ranked projects would have cost $495,808
• were modelled to capture 870 kgs of Nitrogen ($290.78/kg), no Pesticides and 18 tons of Sediment ($13,480/ton
![Page 14: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/14.jpg)
Phosphorus reduction costs
0
10
20
30
40
50
60
70
80
0 5 10 15 20 25 30 35
Cumulative cost ($1
000)
Cumulative P reduction (tons)
Burnett Mary: Dairy
Burnett Mary: Horticulture
Mackay: Cane
![Page 15: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/15.jpg)
Third big problem – many project selection methods are flawed
• If NRM groups and government don’t collect information about cost effectiveness, how do they select projects for funding?
• ????• First come, first served • Assessment panels (expert knowledge)• Scoring systems
![Page 16: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/16.jpg)
A comparison between two selection methods
• Two different methods developed to select projects in the same case study
– Target: Reducing emissions from sugar cane farms in the Burdekin region– Method 1: Scorecard developed by local
industry and agencies – Method 2: Cost-effective metric developed by
economists
![Page 17: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/17.jpg)
How a scorecard works
• Scorecard is a common approach in the allocation of public funds in large programs– Multi-criteria analysis (MCA) is example of more
technical approach– Stakeholders develop list of criteria for evaluation– Criteria are scored in iterative rounds to develop a
system of weightings – In each project assessment, scores are given for
different criteria, and weighting system generates overall outcome
– Outcome scores used to rank projects for funding
![Page 18: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/18.jpg)
How a cost-effectiveness approach works
• Each proposal is assessed in terms of the environmental benefits (outputs) that will be generated
• The different types of environmental benefits are combined into an Environmental Benefits Score (EBS)
• The EBS for each proposal is divided by project cost to generate EBS/$
• These relative cost-effectiveness measures are then used to rank projects
![Page 19: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/19.jpg)
Variation in selection between an output-based measure (metric) and an input based measure (BMP)
0
5
10
15
20
25
30
35
40
1 5 9 13 17 21 25 29 33 37 41 45 49 53 57 61 65 69 73 77
Metric score (EBS/$)
Projects
Metric scores
BMP selected
![Page 20: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/20.jpg)
Comparative cost of nitrogen reductions
0
50
100
150
200
250
300
0 100 200 300 400 500 600
Cost ($/kg N re
duction)
Cumulative cost ($1000s)
Metric
BMP Score
![Page 21: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/21.jpg)
Summary: Problems with allocations of public funds to date
– Projects are rarely assessed in terms of changed outputs, or better, changed outcomes
• Necessary information to assess cost-effectiveness– Projects do not generate information about real
opportunity costs of participation• Necessary to assess relative cost-effectiveness• Only a tiny fraction of public funds for GBR has been
properly analysed in terms of cost effectiveness– Project selection methods that rely on scoring
systems for inputs may be badly flawed
![Page 22: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/22.jpg)
Recommendations for the future
• Assess projects by outputs or outcomes– Focus more science effort at predicting relationships
between management changes and environmental outcomes
• Identify the opportunity costs of change – Bioeconomic modelling – Tenders or other market-like approaches
• Use efficient project selection methods – Some level of assessment of benefits over costs– Increase the use of tenders over fixed grant schemes– Better justification of funding allocations across
industries and catchments
![Page 23: Water quality metrics - Australian National University](https://reader031.vdocuments.mx/reader031/viewer/2022021405/620937012150c728cb22acad/html5/thumbnails/23.jpg)