mesoscale probabilistic prediction over the northwest: an overview cliff mass adrian raftery, susan...

42
Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Upload: jairo-lack

Post on 16-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Mesoscale Probabilistic Prediction over the Northwest:

An Overview

Cliff Mass

Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others

University of Washington

Page 2: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

University of Washington Probabilistic Prediction Effort

• An attempt to create an end-to-end probabilistic prediction system.

• An interdisciplinary effort of the UW Departments of Statistics, Atmospheric Sciences and Psychology, as well as the Applied Physic Lab.

• Now going for ten years.

Page 3: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Support

• Key financial support from DOD MURI and JEFS program, and NWS CSTAR program

Page 4: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Major Elements

• Two mesoscale ensemble systems with 36-12 km grid spacing: UWME (15 members) and EnKF (80 members).

• Sophisticated post-processing to reduce model bias and enhance reliability and sharpness of resulting probability density functions (PDFs).

• Stand-alone bias correction

• Bayesian Model Averaging (BMA)

• Ensemble MOS (EMOS)

Page 5: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Major Elements

• Psychological research to determine the best approaches for presenting uncertainty information.

• Creation of next-generation display products providing probabilistic information to a lay audience. Example: Probcast.

• Ensemble-based data assimilation (EnKF) of 12 and 4km grid spacing

Page 6: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Inexpensive Commodity Clusters

• This effort has demonstrated the viability of doing such work on inexpensive Linux clusters.

• Proven to be highly reliable

Page 7: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

All of this has been available in real-time for years

http://www.atmos.washington.edu/mm5rt/

Page 8: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Mesoscale Ensembles at the UW

Page 9: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

UWMECore Members

• 8 members, 00 and 12Z• Each uses different synoptic scale initial and boundary

conditions from major international centers• All use same physics• MM5 model, will be switching to WRF.• 72-h forecasts

Page 10: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Resolution (~ @ 45 N ) ObjectiveAbbreviation/Model/Source Type Computational Distributed Analysis

avn, Global Forecast System (GFS), Spectral T254 / L64 1.0 / L14 SSINational Centers for Environmental Prediction ~55 km ~80 km 3D Var cmcg, Global Environmental Multi-scale (GEM), Finite 0.90.9/L28 1.25 / L11 3D VarCanadian Meteorological Centre Diff ~70 km ~100 km eta, limited-area mesoscale model, Finite 32 km / L45 90 km / L37 SSINational Centers for Environmental Prediction Diff. 3D Var gasp, Global AnalysiS and Prediction model, Spectral T239 / L29 1.0 / L11 3D VarAustralian Bureau of Meteorology ~60 km ~80 km

jma, Global Spectral Model (GSM), Spectral T106 / L21 1.25 / L13 OIJapan Meteorological Agency ~135 km ~100 km ngps, Navy Operational Global Atmos. Pred. System, Spectral T239 / L30 1.0 / L14 OIFleet Numerical Meteorological & Oceanographic Cntr. ~60 km ~80 km

tcwb, Global Forecast System, Spectral T79 / L18 1.0 / L11 OITaiwan Central Weather Bureau ~180 km ~80 km ukmo, Unified Model, Finite 5/65/9/L30 same / L12 3D VarUnited Kingdom Meteorological Office Diff. ~60 km

“Native” Models/Analyses Available

Page 11: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

UWME– Physics Members

• 8 members, 00Z only• Each uses different synoptic scale initial and

boundary conditions• Each uses different physics• Each uses different SST perturbations• Each uses different land surface characteristic

perturbations

– Centroid, 00 and 12Z• Average of 8 core members used for initial

and boundary conditions

Page 12: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

36 and 12-km domains

Page 13: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 14: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 15: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 16: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 17: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

EnKF Ensemble Configuration

D1 (36km)

D2 (12km)

D3 (4km)

Page 18: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

EnKF Ensemble Configuration

• WRF model• 38 vertical levels• 80 ensemble members• 6-hour update cycle• Observations:

• Surface temperature, wind, altimeter• ACARS aircraft winds, temperature• Cloud-track winds• Radiosonde wind, temperature, relative humidity

Page 19: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Post-Processing

• Post-processing is a critical and necessary step to get useful PDFs from ensemble systems.

• The UW has spent and is spending a great deal of effort to perfect various approaches that are applicable on the mesoscale.

Page 20: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Post-Processing• Major Efforts Include

– Development of grid-based bias correction– Successful development of Bayesian Model

Averaging (BMA) postprocessing for temperature, precipitation, and wind

– Development of both global and local BMA– Development of ensemble MOS (EMOS)

Page 21: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Grid-Based Bias Correction

Page 22: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 23: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

-0.1

0.0

0.1

0.2

0.3

0.4

0.5

0.6

00 03 06 09 12 15 18 21 24 27 30 33 36 39 42 45 48

BSS

-0.1

0.0

0.1

0.2

0.3

0.4

0.5

0.6

00 03 06 09 12 15 18 21 24 27 30 33 36 39 42 45 48

*ACMEcoreACMEcore*ACMEcore+ACMEcore+Uncertainty

*UW Basic Ensemble with bias correction

UW Basic Ensemble, no bias correction

*UW Enhanced Ensemble with bias cor.

UW Enhanced Ensemble without bias cor

Skill forProbability of T2 < 0°C

BSS: Brier Skill Score

Profoundly positive effects of bias correction

Page 24: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

BMA

Page 25: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 26: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 27: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

BMA

• Testing both global BMA (same weights over entire domain) and local BMA (ensemble weights vary spatially).

Page 28: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

EMOS

Page 29: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

EMOS Test

Page 30: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

EMOS Verification

Page 31: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Communication and Display

• Considerable work by Susan Joslyn and others in psychology and APL to examine how forecasters and others process forecast information and particularly probabilistic information.

• One example has been their study of the interpretation of weather forecast icons.

Page 32: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 33: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 34: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

The Winner

Page 35: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

PROBCASTProbcast

Page 36: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington
Page 37: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

UW EnKF Data Assimilation

Page 38: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

EnKF 12km Surface Observations

Page 39: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

EnKF 12-km vs. GFS, NAM, RUC

RMS analysis errors

GFS 2.38 m/s 2.28 KNAMRUCEnKF 12km

Wind Temperature

2.30 m/s2.13 m/s1.85 m/s

2.54 K2.35 K1.67 K

Page 40: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

UW EnKF System Upgrades

• 4km domain

• 3-hr cycle

• Soon 1-h cycle

Page 41: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

Summary

• The UW has attempted to build a multi-faced end-to-end ensemble prediction system

• Based on extensive research effort of several UW investigators

Page 42: Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington

The END