* now working @ eumetsat€¦ · * now working @ eumetsat. study partly funded by eumetsat....
TRANSCRIPT
![Page 1: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/1.jpg)
Anton Kaifel, Martin Felder, Frank Senke, Roger Huckle*
Center for
Solar Energy and Hydrogen
Research (ZSW)
Towards a NNORSY Synergistic GOME-2/IASI
Ozone Profile ECV
-METOP
* now
working
@ EUMETSAT
Study partly funded by Eumetsat
![Page 2: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/2.jpg)
Outline
1.
NNORSY Overview
2.
Co-registration of METOP data and clouds
3.
NNORSY-METOP Version 3
4.
Learn-O-Matic: NNORSY-METOP Version 4 and channel selection
5.
Conclusions
![Page 3: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/3.jpg)
NNORSY-METOP Processing Overview
![Page 4: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/4.jpg)
GOME-2 FOV used as base grid for retrieval
Collocation GOME-2 & IASI Collocation GOME-2 & AVHRR Collocation IASI & AVHRR
Co-registration and Clouds on GOME-2/IASI
Collocations with ozone profile measurements
~ 90 000 each for ozone sondes ACE-FTS AURA-MLS
![Page 5: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/5.jpg)
Operational Setup for NNORSY-METOP Version 3 Combining Hierarchical Networks and Averaging
IASI50%
clouds
IASI100%clouds
GOME50%
clouds
GOME100%clouds
same orslightly
differentconfig.
cloudcover
weighted average
retrievedprofile
averageoutput
hierarch50%
clouds
averageoutput
hierarch100%
clouds
ECMWFT-profile
+ one error network trained on retrieved profile errors
+ one error network trained on retrieved profile errors
![Page 6: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/6.jpg)
Improvements of NNORSY V3 compared to V2 NNORSY Methodology
V2 scheme's RMSE was higher by a factor of 1.2 to 1.5
Strongest RMSE reductions in the most critical regions (UTLS, troposphere)
GOME2 + IASI + T: on test data set ─
Version 2: simple combination of neural networks
─
Version 3: hierarch + clould
fraction + averaging
GOME2 + IASI + T: on test data set ─
Version 2: simple combination of neural networks
─
Version 3: hierarch + clould
fraction + averaging
![Page 7: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/7.jpg)
Retrieval Error Assignment Examples
ozone sondeozone sonde AURA-MLSAURA-MLS ACE-FTSACE-FTS
Multiplying error output by factor ~1.2 yields approximate standard deviation
![Page 8: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/8.jpg)
- 9 -
Difference between Training and Validation Data Set
global
NH SH
NNORSY-METOP V3:
MLS training
data: ~35 Td.
MLS validation
data: 2.9 Million
latitude
Latitudinal distribution of MLS validation data
![Page 9: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/9.jpg)
Station 99 (Hohenpeisssenberg)
NNORSY-METOP V3: Long Term Performance
Time series with 4 week moving average
![Page 10: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/10.jpg)
Learn-O-Matic
Multi-tier GPU based machine learning system with user friendly web-frontend
~ 250 time faster compared to high performance CPU
Machine Learning and Optimization Tool including Deep Learning and Automatic Feature Selection for NNORSY*
*) Sehnke
et al. 2012, Learn-O-Matic
-
Fully automated Machine Learning, ZSW internal Tech. Note
![Page 11: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/11.jpg)
Learn-O-Matic: Implemented Features Deep neural networks
Reduced Boltzmann machines (Hinton et al. 2006)
Support vector machines
Gaussian Processes (sparse approximation/regression scheme)
Policy Gradient with Parameter-based Exploration (PGPE): reinforcement learning scheme for all kind of optimization tasks (Sehnke
et al. 2010, 2011)
![Page 12: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/12.jpg)
Learn-O-Matic: GOME-2/IASI Channel Selection
This normalisation allows for a result driven feature selection.
The automatic feature selection produces a feature set with corresponding colour coded (blue to red) weight strengths shown here.
This normalisation allows for a result driven feature selection.
The automatic feature selection produces a feature set with corresponding colour coded (blue to red) weight strengths shown here.
ECMWF temperatures
IASI
GOME
![Page 13: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/13.jpg)
Learn-O-Matic: IASI Channel SelectionJoined GOME-2 & IASI retrieval
![Page 14: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/14.jpg)
Learn-O-Matic: GOME-2 Channel Selection
Comparison Joined GOME-2 & IASI and GOME-2 only
![Page 15: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/15.jpg)
NNORSY-METOP V3/V4 Comparison
Version 3(full set!)
Version 3(full set!)
Learn-O-MaticVersion 4
(test set)
Learn-O-MaticVersion 4
(test set)
Version 3 vs. 4
Version 3 hierarchical and averaging
Version 4 single deep NN with automatic channel selection
![Page 16: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/16.jpg)
NNORSY Nadir Satellite Instruments Already Processed
NNORSY-METOP: two different ozone profile data sets GOME-2 spectra only Synergistic retrieval using GOME-2 and IASI spectra
ENVISAT-SCIAMACHY (V3)
ERS2-GOME (V2)
METOP-GOME-2 & IASI (V3/V4)
Example NNORSY timeseries for Hohenpeissenberg
![Page 17: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/17.jpg)
Conclusion1.
NNORSY-METOP Version 3 with hierarchical approach
First full joined GOME-2/IASI retrieval
IASI improves ozone profile retrieval in UTLS and troposphere
2.
Learn-O-Matic
Fully automated machine learning tool with channel selection for GOME-2 and IASI NNORSY-METOP Version 4
Already further improvements for ozone profile retrieval with only one deep neural network expecting more improvements with averaging
3.
NNORSY ozone profiles using ERS2/GOME, SCIAMACHY and GOME-2/IASI long term ozone profile ECV (July 1995 –
present)
![Page 18: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/18.jpg)
Questions and Comments
![Page 19: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/19.jpg)
Backup Slides
![Page 20: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/20.jpg)
NNORSY-METOP V3: Validation Single Stations
-
21 -
SyowaHohenpeissenberg
![Page 21: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/21.jpg)
-
22 -
Training Data: Seasonal Dependency
NH spring
NH summer
NH autumn
NH winter
![Page 22: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/22.jpg)
Validation Data: AURA-MLS Latitude Bands
-
23 -
10 degree latitude bands: 90N –
20S
![Page 23: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/23.jpg)
Validation Data: AURA-MLS Latitude Bands
-
24 -
10 degree latitude bands: 30S –
90S
On global scale:
no offset but STD on validation
slightly higher STD > 40km up to 20% MLS itself SH: STD + 5% higher NH: STD – 5 % higher
Latitude bands: MLS scan pattern visible negative bias over Antarctica
![Page 24: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/24.jpg)
-
25 -
SZA DependencyRelative [%]
![Page 25: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/25.jpg)
GOME-2 FOV Dependency
-
26 -
Relative [%]
![Page 26: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/26.jpg)
Cloud Fraction Dependency
-
27 -
Relative [%]
![Page 27: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/27.jpg)
Validation Data: Single Station
-
28 -
Hohenpeissenberg
(mid
latitude)NNORSY-METOP
ozone
sonde
relative difference
[%]
![Page 28: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/28.jpg)
Validation Data: Single Station
-
29 -
Syowa: Antarctica
NNORSY-METOP
ozone
sonde
relative difference
[%]
![Page 29: * now working @ EUMETSAT€¦ · * now working @ EUMETSAT. Study partly funded by Eumetsat. Outline. 1. NNORSY Overview 2. Co-registration of METOP data and clouds 3. NNORSY-METOP](https://reader034.vdocuments.mx/reader034/viewer/2022051607/60341c37eb8b4d11ea5389b5/html5/thumbnails/29.jpg)
Backup