adms-airport: model inter-comparisons and model validation · heathrow airport study: introduction...

15
CERC ADMS-Airport: Model Inter-Comparisons and Model Validation David Carruthers, Christine McHugh, Stephanie Church, Mark Jackson, Matt Williams, Catheryn Price, Chetan Lad and Amy Stidworthy CERC 12 th International Conference on Harmonisation within Atmospheric Dispersion Modelling for Regulatory Purposes 6 th -9 th October 2008, Cavtat, Croatia

Upload: others

Post on 23-Aug-2020

19 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

ADMS-Airport: Model Inter-Comparisons and Model Validation

David Carruthers, Christine McHugh, Stephanie Church, Mark Jackson, Matt

Williams, Catheryn Price, Chetan Lad and Amy Stidworthy

CERC

12th International Conference on Harmonisation within Atmospheric Dispersion Modelling for

Regulatory Purposes6th-9th October 2008, Cavtat, Croatia

Page 2: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

Introduction

• Development of ADMS-Airport previously presented at Harmo11

• This presentation focuses on further evaluation of ADMS-Airport

• Overview of presentation- Brief description of ADMS-Airport

- Comparison of ADMS-Airport predictions with monitored data at Heathrow Airport

- Assessment of ADMS-Airport’s ability to be used for CAEP (ICAO’s Committee on Environmental Aviation Protection) local air quality assessments, including comparisons with other candidate models

Page 3: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

ADMS-Airport

• ADMS-Airport is an air quality model designed to model pollutant concentrations in the vicinity of an airport.

• ADMS-Airport is an extension of the well-known ADMS-Urban system for modelling urban air quality

• Distinguishing feature is treatment of jet engine emissions during take-off and landing as moving jet sources, not as volume sources as is the case in some other models.

Page 4: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

Heathrow Airport Study: Introduction

• ADMS-Airport was used in the assessment of the air quality impacts of the possible development of Heathrow Airport to allow for runway operation in ‘mixed mode’ or the operation of a third runway

• Study comprised 2002 Base Case study and nine future scenarios

• Full report published in CERC (2007): ‘Air Quality Studies for Heathrow: Base Case, Segregated Mode, Mixed Mode and Third Runway Scenarios modelled using ADMS-Airport’. DfT Publications 78APD02904CERC and http://www.dft.gov.uk/consultations/closed/heathrowconsultation/technicalreports/airquality.pdf

• Here we present some examples of validation of the model from the base case study

Page 5: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

Heathrow Airport Study: Summary of emission data and model set-up

• Airport source emission data supplied by AEA Technology• Traffic data for major roads supplied by Hyder Consulting• Other inventory data taken from London Atmospheric

Emissions Inventory (GLA, 2005) and the National Atmospheric Emissions Inventory (NAEI) for the area to the west of Heathrow

• Meteorological data (standard hourly sequential data) from the measuring site at the airport

• Background concentrations of NOX, NO2, PM10 and O3 obtained from the relevant upstream rural monitoring sites for the prevailing meteorological conditions

Page 6: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

!

!

! !

!

!!

!

!!!! !

!

!

!!!

LHR8

LHR7

LHR6

LHR5LHR4

LHR3

LHR2LHR20

LHR19

LHR18

LHR17

LHR16

LHR15LHR14

LHR13

LHR12LHR11

LHR10

!!

!

!

!

!!

!

!

!

!

!

!

LHR8

LHR7

LHR5

LHR4

LHR2

LHR20

LHR19

LHR18

LHR15

LHR13

LHR12

LHR11

Page 7: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

2002: Modelled total NOX concentration (μg/m3)

5 0 3 0 0 0 5 0 4 0 0 0 5 0 5 0 0 0 5 0 6 0 0 0 5 0 7 0 0 0 5 0 8 0 0 0 5 0 9 0 0 0 5 1 0 0 0 0 5 1 1 0 0 0 5 1 2 0 0 0

E a s t i n g ( m e t r e s )

1 7 3 0 0 0

1 7 4 0 0 0

1 7 5 0 0 0

1 7 6 0 0 0

1 7 7 0 0 0

1 7 8 0 0 0

1 7 9 0 0 0

1 8 0 0 0 0

1 8 1 0 0 0

No

rth

ing

(met

res)

1

2

5

1 0

2 0

3 0

4 0

5 0

7 5

1 0 0

1 2 5

1 5 0

1 7 5

2 0 0

0 2 0 0 0 4 0 0 0 6 0 0 0 8 0 0 0

Page 8: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

Heathrow Airport Study: Comparison of model predictions with monitored data

• Hourly model predictions of NOX and NO2 compared with hourly measured data from 9 automatic monitoring sites

• Hours were excluded where either modelled or monitoring data were missing

+0.0180.840.68NO2

(averaged over all 9 sites)

+0.0130.770.61NOX

(averaged over all 9 sites)

Fractional bias (Monitored=0)

Fraction within a factor of 2 (Monitored=1)

Correlation (Monitored=1)

Page 9: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

Heathrow Airport Study: Scatter plots of annual average NOX and NO2

• Modelled and monitored annual average NOX and NO2 calculated from hourly values:

NOXNO2

Page 10: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

Heathrow Airport Study: Detailed analysis of monitoring site LHR2

• Monitoring site LHR2 is located just north of the eastern end of the northern runway

• LHR2 records a strong signature from aircraft take-off when the northern runway is operational with take-off to the west

• Chart compares modelled and measured NOX concentrations at LHR2 for hours when there are take-offs to the west (D) on the northern runway and hours when there are landings to the west (A) on the northern runway

• Diurnal variation as well as the difference between departures and arrivals is well-captured by ADMS-Airport

0

20

40

60

80

100

120

140

160

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

Hour of the day

NO

x c

on

cen

tra

tio

n (

ug

/m3)

D LHR2-LHR8 Measured

D LHR2-LHR8 Modelled

A LHR2-LHR8 Measured

A LHR2-LHR8 Modelled

Page 11: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

CAEP model inter-comparison study: Introduction

• Purpose of study: to provide CAEP with side-by-side comparison of the 4 local air quality models (ADMS-Airport, AEDT/EDMS, ALAQS and LASPORT) currently being proposed for CAEP assessments of emissions and pollutant concentrations in the vicinity of airports, NOT a validation exercise

• CAEP requires a generic approach applicable to all airports, therefore a mock airport ‘CAEPport’ was designed to test the candidate models regarding basic functionality of- Emission source characterisation- Pollutant dispersion modelling according to a common set of parameters, a shared set

of meteorological data and a uniform array of downwind receptors

• Emissions sources considered:- Aircraft main engines (LTO cycle and start-up)- Auxiliary power units (APU)- Ground support equipment (GSE)- Landside surface transportation equipment and parking facilities- Stationary sources- Fuel storage and handling activities- Training fires

Page 12: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

CAEP model inter-comparison study: CAEPport

Airside roads

Taxiways

Airport perimeter

Runway

Landside roads

Fuel farm

Fire training ground

Power plant

ApronEngine run-up

bay

Page 13: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

CAEP model inter-comparison study: Emissions inventory variations

• The intention of the CAEPport model inter-comparison study was to provide a common set of data inputs to all models, leaving each model the freedom to make use of its particular functionality and ability to apply these data

• Models used different emissions calculators, resulting in different total emissions

• For example, below are the standard deviations of the average aircraft result from all four candidate models for NOX:

11%35%11%67%67%31%8%51%42%NOX

TotalTotal

Taxi

Taxi

Out

Taxi

In

ApproachAP+Taxi InTO+COClimb

Out

Take

Off

Pollutant

Page 14: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

CAEP model inter-comparison study: NOX annual mean concentration

• Plots demonstrate differences/similarities in model performance, not absolute accuracy

• Extent to which dispersion model affects concentrations and spatial distribution can broadly be determined

• Significant differences are apparent between 4 models

Inventory: 351.9 Mg/annum Inventory: 360.3 Mg/annum

Inventory: 372.7 Mg/annum Inventory: 394.4 Mg/annum

Page 15: ADMS-Airport: Model Inter-Comparisons and Model Validation · Heathrow Airport Study: Introduction • ADMS-Airport was used in the assessment of the air quality impacts of the possible

CERC

Summary and Conclusions

• Modelling air quality around airports is important to- those assessing local developments, and

- international bodies such as CAEP, who require tools for source apportionment and assessment of relative impacts

• This requires tools for modelling air quality around airports to be ‘fit for purpose’ as judged against different criteria

• ADMS-Airport has recently been involved in evaluation exercises for both purposes:- In assessing a model for use studying local impacts against EU air quality

standards, comparison with monitored data is important; ADMS-Airport predictions have been compared with monitored data at Heathrow.

- CAEPport exercise not concerned with monitored data or air quality standards. Models have been judged on their ability to use input data in the given format, to calculate emissions, and to output air quality in a given format. Results give insight into the fitness for purpose of models put forward for use in the CAEP/8 Work Programme.