probabilistic seasonal water supply forecasting in

31
Probabilistic seasonal water supply forecasting in an operational environment: the USDA-NRCS Perspective Tom Pagano [email protected] 503 414 3010 Natural Resources Conservation Service

Upload: noreen

Post on 14-Jan-2016

57 views

Category:

Documents


1 download

DESCRIPTION

Probabilistic seasonal water supply forecasting in an operational environment: the USDA-NRCS Perspective Tom Pagano [email protected] 503 414 3010 Natural Resources Conservation Service. Existing water supply forecasts Statistical forecasting methods - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Probabilistic seasonal water supply forecasting in

Probabilistic seasonal water supply forecasting in an operational environment: the USDA-NRCS Perspective

Tom Pagano [email protected] 503 414 3010Natural Resources Conservation Service

Page 2: Probabilistic seasonal water supply forecasting in

Existing water supply forecasts

Statistical forecasting methods

“Routing” and “mixed-past” forecasts

Simulation modeling

Forecast coordination

Communicating uncertainty

Page 3: Probabilistic seasonal water supply forecasting in

Location

Page 4: Probabilistic seasonal water supply forecasting in

Location

Time Period

Historical Average

Page 5: Probabilistic seasonal water supply forecasting in

Location

Time Period

“Most Probable”Water Volume

Historical Average

Error Bounds

Page 6: Probabilistic seasonal water supply forecasting in

Location

Time Period

“Most Probable”Water Volume

Historical Average

Error Bounds

Forecasts are coordinated with the National Weather Service (NWS).Both agencies publish identical numbers.

Page 7: Probabilistic seasonal water supply forecasting in

Sources of predictability 1950-99 VIC model skillExplained variance in predicting Apr-July runoff

Blue – SnowpackGreen – Soil MoistureRed – El Nino

Darker colors- more important

(courtesy of M Dettinger, Scripps)

Page 8: Probabilistic seasonal water supply forecasting in

Apr-Sept StreamflowStehekin R at Stehekin, WA

Apr 1 Rainy Pass Snow Water (inches)

R = 0.91

Str

eam

flo

w (

k ac

-ft)

Regression equations relating point measurements vs flow:

1. Snow water equivalent2. Antecedent precipitation3. Antecedent streamflow

4. Climate indices (e.g. El Nino)

Y-variable can be transformedfor non-linear forecasting

e.g. sqrt(streamflow) = a * snow + b

Page 9: Probabilistic seasonal water supply forecasting in

Calculating forecast probabilities

1. Jackknife standard error (JSE) stdev(Fcst-Obs)/sqrt(n)

2. T-statistic : TINV(2*(1-Prob),DF) 90% non-exceedence with 30 degrees of freedom (DF) TINV(2*(1-0.9),30) = 1.31

Page 10: Probabilistic seasonal water supply forecasting in

Calculating forecast probabilities

1. Jackknife standard error (JSE) stdev(Fcst-Obs)/sqrt(n)

2. T-statistic : TINV(2*(1-Prob),DF) 90% non-exceedence with 30 degrees of freedom (DF) TINV(2*(1-0.9),30) = 1.31

3. 90% non-exceed = 50% non-exceed + 1.31 * JSE 500 kac-ft + 1.31 * 76 = 600 kac-ft

10% non-exceed = 50% non-exceed – 1.31 * JSE 500 kac-ft - 1.31 * 76 = 400 kac-ft

4. Untransform if non-linear equation e.g. Y’ = exp(Y), Y2, Y3

Page 11: Probabilistic seasonal water supply forecasting in

“Routing”How to keep downstream forecasts

(and distribution widths and shapes)consistent with upstream forecasts?

“Mixed-Past”How to reflect changed uncertainty

when part of your target period is in the past?e.g. April-July forecast issued June 1

and Apr-May is “known” (or is it?)

Other technical issues

Page 12: Probabilistic seasonal water supply forecasting in

Simulation modeling

(e.g. a watershed model forced with daily weather data producing ensemble hydrographs)

Data uncertainty: Quality control, Representativeness

Model uncertainty: Processes, Scales

Page 13: Probabilistic seasonal water supply forecasting in

Simulation modeling

(e.g. a watershed model forced with daily weather data producing ensemble hydrographs)

Data uncertainty: Quality control, Representativeness

Model uncertainty: Processes, Scales

Calibration uncertainty: Probabilistic parameters

State uncertainty: Manual adjustment, Data assimilation

Page 14: Probabilistic seasonal water supply forecasting in

Simulation modeling

(e.g. a watershed model forced with daily weather data producing ensemble hydrographs)

Data uncertainty: Quality control, Representativeness

Model uncertainty: Processes, Scales

Calibration uncertainty: Probabilistic parameters

State uncertainty: Manual adjustment, Data assimilation

Future weather uncertainty: Historical resampling (ESP), Trace weighting, Weather model preprocessing

Output uncertainty: Post processing, Bias adjustment

Page 15: Probabilistic seasonal water supply forecasting in

What effect does coordination have on probability distributions?

Volume

Probabilityof non-

exceedence

10090

70

50

30

100

NRCS – raw equation output

Dry Wet

NrcsNwsConsensus

Page 16: Probabilistic seasonal water supply forecasting in

What effect does coordination have on probability distributions?

Volume

Probabilityof non-

exceedence

10090

70

50

30

100

NRCS – raw equation outputNRCS – subjective assessment

Dry Wet

NrcsNwsConsensus

Page 17: Probabilistic seasonal water supply forecasting in

What effect does coordination have on probability distributions?

Volume

Probabilityof non-

exceedence

10090

70

50

30

100

NRCS – raw equation outputNRCS – subjective assessmentNWS – raw equation output

Dry Wet

NrcsNwsConsensus

Page 18: Probabilistic seasonal water supply forecasting in

What effect does coordination have on probability distributions?

Volume

Probabilityof non-

exceedence

10090

70

50

30

100

NRCS – raw equation outputNRCS – subjective assessmentNWS – raw equation outputNWS – raw ESPNWS – bias adjusted ESP

Dry Wet

NrcsNwsConsensus

Page 19: Probabilistic seasonal water supply forecasting in

What effect does coordination have on probability distributions?

Volume

Probabilityof non-

exceedence

10090

70

50

30

100

NRCS – raw equation outputNRCS – subjective assessmentNWS – raw equation outputNWS – raw ESPNWS – bias adjusted ESPNWS – subjective assessment

Dry Wet

NrcsNwsConsensus

Page 20: Probabilistic seasonal water supply forecasting in

What effect does coordination have on probability distributions?

Volume

Probabilityof non-

exceedence

10090

70

50

30

100

NRCS – raw equation outputNRCS – subjective assessmentNWS – raw equation outputNWS – raw ESPNWS – bias adjusted ESPNWS – subjective assessmentNRCS-NWS – Consensus forecast (Official forecast)

Dry Wet

NrcsNwsConsensus

Page 21: Probabilistic seasonal water supply forecasting in

What effect does coordination have on probability distributions?

Volume

Probabilityof non-

exceedence

10090

70

50

30

100

NRCS – raw equation outputNRCS – subjective assessmentNWS – raw equation outputNWS – raw ESPNWS – bias adjusted ESPNWS – subjective assessmentNRCS-NWS – Consensus forecast (Official Forecast)

Dry Wet

NrcsNwsConsensus

Bounds shifted from objective guidance.

No bound narrowing implies no skill added.

Page 22: Probabilistic seasonal water supply forecasting in

Communication of forecasts

Within NRCS, almost 50 years of deterministic forecasts until advent of NRCS-NWS coordination in 1980s

Early NRCS bounds ambiguous, approximations at best

Since 1990, probability forecasts technically soundbut communication remains an issue

Users seem to gravitate towards scenarios, analogues(but analogues have their own baggage)

No good spatial visualizations of uncertainty have ever existed

Page 23: Probabilistic seasonal water supply forecasting in

If statistical seasonal water supply forecasting is the Blue Square of communicating uncertainty

Simulation Modeling is the Black Diamond, a special challenge

obs

predictedensemble

median ofpredicted

Page 24: Probabilistic seasonal water supply forecasting in

If statistical seasonal water supply forecasting is the Blue Square of communicating uncertainty

Simulation Modeling is the Black Diamond, a special challenge

obs

predictedensemble

median ofpredicted

Peak of median

Page 25: Probabilistic seasonal water supply forecasting in

If statistical seasonal water supply forecasting is the Blue Square of communicating uncertainty

Simulation Modeling is the Black Diamond, a special challenge

obs

predictedensemble

median ofpredicted

Peak of median does not equal

Median of peaks

Page 26: Probabilistic seasonal water supply forecasting in

The “cone of uncertainty”

National Weather Service graph from 1949! 58 years later…

Page 27: Probabilistic seasonal water supply forecasting in
Page 28: Probabilistic seasonal water supply forecasting in

A deterministic product that ignores uncertainty…

But does it need to be something else?

Page 29: Probabilistic seasonal water supply forecasting in

A deterministic product that ignores uncertainty…

But does it need to be something else?

Is it OK to give the “casual user”

“incomplete” information?

Page 30: Probabilistic seasonal water supply forecasting in

Is there a way to express forecast confidence better?And is that different than forecast uncertainty?

Confidence

V. High

High

Moderate

High

Page 31: Probabilistic seasonal water supply forecasting in

NRCS produces seasonal water supply outlooks

Probabilistic aspects derived from statistical tool performance

Many scientific and technical issues remain re probabilistic forecasts from simulation models

Communication of uncertainty a criticalbut largely under-researched topic

END