explore. discover. understand. providing data services for over 42 projects in 2007, 275 terabytes...

Explore. Discover. Understand.

• Providing data services for over 42 Projects• In 2007, 275 Terabytes of data distributed to 34,000 customers in 110 countries• Over 2 Petabytes of data in the archive

NASA Distributed Active Archive Centers/Atmospheric Science Data Center

Radiation Budget

Clouds

Aerosols

Tropospheric Chemistry

SSE

ISCCP

MISR

MOPITT

http://eosweb.larc.nasa.gov


Data Center Primary Functions

• Receive data from numerous data providers• Raw data from satellite missions• Archival products for distribution

• Process data to create highest quality science data products from lower level satellite data

• Archive data with high standards of integrity to ensure the long term preservation and use of the science data

• Distribute data to a wide variety of customers

• Provide expert assistance on data management and use of data holdings


Data Processing

• Level 0 – Unprocessed instrument data with communications artifacts removed.

• Level 1 - Reconstructed instrument data annotated with ancillary information (calibration coefficients).

• Level 2 – Algorithms applied to derive geophysical parameters.

• Level 3 – Parameter data mapped onto a standard space-time grid.

• Level 4 – Model output or results from analysis of multiple lower level data sets.


Flight Operations,Data Capture,Initial Processing,Backup Archive

DataTransportto DAACs

Science DataProcessing,Info Mgmt, DataArchive, & Distribution

Distribution,Access,Interoperability,Reuse

EOSSpacecraft

Inte

rne

t

Value-AddedProviders

InteragencyData

Centers

Int’l Partners& Data Centers

Data Acquisition

White SandsComplex

Tracking& Data

Relay Satellite(TDRS)

ResearchUsers

EducationUsers

DataCenters

InstrumentTeams/SIPS

Data Processing

&MissionControl

EOS Polar Ground Stations

Mission Support – Main Components


NASA Distributed Active Archive Centers

SEDACHuman Interactions in

Global Change

GSFCUpper Atmosphere

Atmospheric DynamicsGlobal Biosphere

LaRCRadiation Budget, CloudsAerosols, Tropospheric

Chemistry

ORNLBiogeochemical

DynamicsEOS Land Validation

ASFSAR Products

Sea IcePolar Processes

NSIDCCryosphere

Polar Processes

EDCLand Processes

& Features

JPLOcean Circulation

Air-Sea Interactions


Connections to Other Systems

• Global Change Master Directory (GCMD)- Comprehensive directory of Earth science data sets and services

for global change and Earth science research • EOS Data Gateway (EDG)

- Multi-DAAC ordering system HTML interface to search and order

data from participating archive centers • EOS Clearing House (ECHO)

- Earth science metadata clearinghouse and order broker • Warehouse Inventory Search Tool (WIST)

- New client for searching and ordering earth science data from various NASA and affiliated centers


LaRC DAAC Data Order Tools

• MISR EOS Land Validation Data Access Tool

• MISR Specialized Tools for Field Campaigns

• MISR Order and Customization Tool

• LATIS Order Tool – Java

• LATIS Order Tool – HTML

• GEWEX-RFA Access Tool

• AMAPS Data Access

• OPeNDAP Open-source Data Access


Where do the data come from?

Satellites

Field Experiments

Aircraft


Terra AquaMeteor 3MTRMM

ACRIMSat

CALIPSOAura

Mis

sion

s

CERES ACRIM IIICERESMISR

MOPITT

SAGE III CERES TES CALIPSOInst

rum

ents

1997 1998 1999 2000 2001 2002 2004 20052003

Satellite Missions Supported by ASDC


Who are our customers?

Researchers

Educators

Commercial Applications

Science Literate Public


What types of data?

Earth's energy balance

Clouds

Aerosols

Tropospheric chemistry


Renewable energy industry El nino/atmospheric interactions Air pollution/surface ozone Global climate change

Particulates over Africa

Composite of MISR Aerosols (Safari 2000 Campaign)

Cloud forcing

CERES Total Cloud Forcing at the top of the atmosphere

Solar battery sizing

Surface meteorology & Solar Energy (SSE)

ASDC Data Examples


Monthly Average Aerosol Optical Depth – Multi-angle Imaging SpectroRadiometer (MISR)


Ozone (Surface – 500mb) - Tropospheric Emission Spectrometer (TES)


Monthly Average Carbon Monoxide at 850hPa – Measurements Of Pollution In The Troposphere (MOPITT)


Cloud-Aerosol Lidar and Infrared Satellite Observations (CALIPSO)


Future/Potential Connections

• MISR Smoke Plume Database

• International data providers through GEOSS

• Applied Science Decision support Community

• Renewable Energy/Energy Management Industry

• New missions proposed in Decadal Survey (CLAREO,


Archive – Next Generation (ANGe)• Modernized ingest, archive, and distribution tools

- Advanced hardware and software systems

- Secure, redundant systems for data integrity

- Cost-effective, scalable data management solution

• Replacing two existing ASDC systems:- EOS Core System (ECS)- Langley TRMM and Terra Information System (LATIS)

• Distributed, multi-tier architecture- Grid computing environment enables simultaneous data access- Web service archive access allows more refined data search- Open source metadata database for external system integration

Planned Enhancements/System Trajectory


ANGe Data Discovery and Access

-Apache/Web Services

-Apache/Web Services

Persistent Storage-AMASSAMASS

-SRBSRB-StorNextStorNext

Persistent Storage-AMASSAMASS

-SRBSRB-StorNextStorNext

Cache

Cache

Drop Box Drop Box

Web Interface Web Interface

-GridFTP / scp-GridFTP / scp

Drop BoxDistribution Cache

Ingest

JBoss Cluster

JMS

System Management

Distribution

Archive

PostgreSQLPostgreSQLPostgreSQLPostgreSQL

MetadataMetadata

ManagementManagement

Ingest

Archive

Production

Distribution

DB Queries

Web Tier Data TierBusiness TierHuman with a MISR

or LATIS Order Tool

Programmatic Search and

Retrieval via Grid/Web Services


User Community Issues

• On-line high-volume data storage/data pools

• Phenomenon-based data subsetting

• On-line data analysis and visualization tools

• Timely data processing and dissemination (ie - MODIS Rapid Response)

• Broadly usable data formats (GeoTiff, KML)


More Information?

General DAAC contact info:http://nasadaacs.eos.nasa.gov/[email protected]

Atmospheric Science Data Center:http://[email protected]

explore. discover. understand. providing data services for over 42 projects in 2007, 275 terabytes...

Documents

order data

data services

data capture

distributionprocess

data management

parameter data

petabytes of data

terabytes of data