hernan g. arango, rutgers university ([email protected])

33
Hernan G. Arango, Rutgers University ([email protected]) Tal Ezer, Pricenton University A Community Terrain- following Ocean Modeling System

Upload: dianne

Post on 28-Jan-2016

73 views

Category:

Documents


0 download

DESCRIPTION

A Community T errain-following O cean M odeling S ystem. Hernan G. Arango, Rutgers University ([email protected]) Tal Ezer, Pricenton University ([email protected]) FTP File: TOMS.tar. OBJECTIVES. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Hernan G. Arango, Rutgers University ([email protected])

Tal Ezer, Pricenton University ([email protected])

FTP File: TOMS.tar

A Community Terrain-following Ocean Modeling

System

Page 2: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

To design, develop and test an expert ocean modeling system for scientific and operational applications

To support advanced data assimilation strategies

To provide a platform for coupling with operational atmospheric models (like COAMPS)

To support massive parallel computations

To provide a common set of options for all coastal developers with a goal of defining an optimum coastal/relocatable model for the navy

OBJECTIVES

Page 3: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Use state-of-the-art advances in numerical techniques, subgrid-scale parameterizations, data assimilation, nesting, computational performance and parallelization

Modular design with ROMS as a prototype

Test and evaluate the computational kernel and various algorithms and parameterizations

Build a suite of test cases and application databases

Provide a web-based support to the user community and a linkage to primary developers

APPROACH

Page 4: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

“The complexity of physics, numerics,data assimilation, and hardware technology should be transparent

to the expert and non-expertUSER”

CHALLENGE

Page 5: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Free-surface, hydrostatic, primitive equation model

Generalized, terrain-following vertical coordinates

Boundary-fitted, orthogonal curvilinear, horizontal coordinates on an Arakawa C-grid

Non-homogeneous time-stepping algorithm

Accurate discretization of the baroclinic pressure gradient term

High-order advection schemes

Continuous, monotonic reconstruction of vertical gradients to maintain high-order accuracy

TOMS KERNEL ATTRIBUTES

Page 6: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Dispersive Properties of Advection

/2/4 3/4

kx

1/2

1

3/2

2

5/2

K(k

) • x

2

4

610

8

ParabolicSplines

Vs

FiniteCentered

Differences

Page 7: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Horizontal mixing of tracers along level, geopotential, isopycnic surfaces

Transverse, isotropic stress tensor for momentum

Local, Mellor-Yamada, level 2.5, closure scheme

Non-local, K-profile, surface and bottom closure scheme

TOMS SUBGRID-SCALE PARAMETERIZATION

Page 8: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Air-Sea interaction boundary layer from COARE (Fairall et al., 1996)

Oceanic surface boundary layer (KPP; Large et al., 1994)

Oceanic bottom boundary layer (inverted KPP; Durski et al., 2001)

TOMS BOUNDARY LAYERS

Page 9: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Boundary Layer Schematic

Longwave

Shor

twav

e

Evap

OHH

OHH

1. ABL2. SBL3. BBL

4. WCBL

Page 10: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Air-Sea interaction boundary layer from COARE (Fairall et al., 1996)

Oceanic surface boundary layer (KPP; Large et al., 1994)

Oceanic bottom boundary layer (inverted KPP; Durski et al., 2001)

TOMS BOUNDARY LAYERS

Wave / Current / Sediment bed boundary layer (Styles and Glenn, 2000)

Sediment transport

Page 11: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Lagrangian Drifters (Klinck, Hadfield)

Tidal Forcing (Hetland, Signell)

TOMS MODULES

Page 12: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Gulf of Maine M2 Tides

Surface

Elevation(m)

Page 13: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Lagrangian Drifters (Klinck, Hadfield)

Tidal Forcing (Hetland, Signell)

TOMS MODULES

River Runoff (Hetland, Signell, Geyer)

Page 14: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

5 10 15 20 25

Distance (km)

-10

-15

-25

-20

-5

Dep

th (

m)

30

25

20

15

10

5

Sal

init

y (P

SS

)

Hudson River Estuary

Page 15: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Lagrangian Drifters (Klinck, Hadfield)

Tidal Forcing (Hetland, Signell)

River Runoff (Hetland, Signell, Geyer)

TOMS MODULES

Biology Fasham-type Model (Moisan, Shchepetkin)

EcoSim Bio-Optical Model (Bissett)

Page 16: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Modular, efficient, and portable Fortran code (F77+, F90)

C-preprocessing managing

Multiple levels of nesting

Lateral boundary conditions options for closed, periodic, and radiation

Arbitrary number of tracers (active and passive)

Input and output NetCDF data structure

Support for parallel execution on both shared- and distributed -memory architectures

TOMS CODE DESIGN

Page 17: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Coarse-grained parallelization

TOMS PARALLEL DESIGN

Page 18: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

}

} Nx

Ny

PARALLEL TILE PARTITIONS

8 x 8

Page 19: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Coarse-grained parallelization

TOMS PARALLEL DESIGN

Shared-memory, compiler depend directives MAIN (OpenMP standard)

Distributed-memory (MPI; SMS)

Optimized for cache-bound computers

ZIG-ZAG cycling sequence of tile partitions

Few synchronization points (around 6)

Serial and Parallel I/O (via NetCDF)

Efficiency 4-64 threads

Page 20: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Nudging

Optimal Interpolation (OI)

Tangent linear and Adjoint algorithms

4D VARiational data assimilation (4DVAR) and Physical Statistical Analysis System (PSAS) algorithms

Inverse Ocean Modeling System (IOMS)

Ensemble prediction platform based on singular value decomposition

Error Subspace Statistical Estimation (ESSE)

TOMS DATA ASSIMILATION

Page 21: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Historical, Synoptic, Future in

Situ/Remote Field/Error Observations

d0R0

FieldInitialization

Central Forecast

Sample Probability

Density

Mean

SelectBest

Forecast

Shooting

ESSE Smoothing viaStatistical Approximation

MinimumError

Variance

Within ErrorSubspace

(Sequential processing ofObservations)

MeasurementModel

A PosterioriResidulesdr (+)

Performance/AnalysisModules

OA viaESSE

GriddedResidules

Synoptic Obs

Measurement Model

Measurement Error

Covariance

^

cf(-)^

0

Options/Assumptions

Most Probable Forecast

mp(-)^

EnsembleMean

q{j^

Adaptive Error

SubspaceLearning

ConvergenceCriterion

Continue/StopIteration Breeding

PeripheralsAnalysisModules

Normalization

SVDp

Continuous Time Model Errors Q(t)

ScalableParallel

EnsembleForecast

+PerturbationsError SubspaceInitialization

1

j

q

1

j

q

^

^

^

uj(o,Ip)with physicalconstraints

+

(+)^

E(+)(+)

E0

(+)^

Ea(+)a(+)

FieldOperationAssumption

Key

(-)^

E(-)(-)

-+

+

+

-

+-

---

-

+

+

+

dC(-)

Data Residuals

^

+

+

+

--

+/-+

j=1

j=q

+

ESSE FlowDiagram

Page 22: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Density Jacobian Class (Blumberg and Mellor, 1987; Song 1998; Song and Wright 1998)

More Accurate

Error vanishes with linear density profiles

Pressure Jacobian Class (Lin 1998; Shchepetkin and McWilliams, 2001)

JEBAR consistent

Conserve Energy

PRESSURE GRADIENT FORCE

Page 23: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Seamount Test Case

(64 x 64 x 20) dx = dy = 8 km

Page 24: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Models with 2nd order advection schemePOM ROMS

Second Order Advection Scheme

SurfaceElevationAnomaly

StreamFunctionAnomaly

Page 25: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Advection Schemes in ROMS (Seamount Case)

V

Second OrderCentered

Third Order Upstream Bias

Fourth Order Centered

Page 26: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Pressure Gradient Errors

POM(6th order)

U (

cm/s

)V

(cm

/s)

ROMS

POM

X (km)

Page 27: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Relative CPU per time step

Per

cen

tage

Page 28: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Build TOMS from ROMS prototype Mellor-Yamada, level 2.5 Passive and active open boundary conditions Tidal forcing River runoff Lagrangian drifters Data assimilation

Inter-comparison between POM and ROMS Evaluation of time-stepping, advection, and

pressure gradient algorithms

Initial development of TOMS web site

RESULTS (YEAR 1)

Page 29: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Bennett et al. (FNMOC; OSU)

Chassignet / Iskandarani et al. (RSMAS)

Cornuelle / Miller (SIO)

Geyer (WHOI)

Hetland (TAMU)

Lermusiaux (Harvard)

Mellor (Pricenton)

Moore (U. Colorado)

Shchepetkin (UCLA)

Signell (SACLANT; USGS)

COLLABORATORS

Page 30: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Chao / Song (JPL)

Preller / Martin (NRL)

Naval Operational Community

POM Ocean Modeling Community

ROMS / SCRUM Ocean Modeling Community

OTHER COLLABORATORS

Page 31: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

To Be Determined !!!

Potential Users:

NAVO

FNMOC

NOAA

USCG

TRANSITION PATHS

Page 32: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Chassignet et al., 2000: Damee modeling review

Ezer, 2000: Mixed-layer evaluation

Ezer and Mellor, 2000: POM Damee application

Haidvogel et al., 2000: ROMS Damee application

Malanotte-Rizzoli et al., 2000: ROMS Damee

Mellor, 2001: Improved turbulence scheme

Mellor et al., 2001: Generalized vertical coordinate

PUBLICATIONS

Page 33: Hernan G. Arango,  Rutgers University (arango@imcs.rutgers)

Initial web page: www.aos.princeton.edu/WWWPUBLIC/ezer/TOMS