1

2

• NOAA’s Data Centers (National Oceanographic Data Center, National Climatic Data Center, and National Geophysical Data Center) are the stewards of the nation’s environmental data –collectively they preserve and provide access to scientific quality ocean, climate, and geophysical data and information for current and future generations.

• Preservation of data is critical, as data are irreplaceable!Data Center holdings:– provide a history of the ocean, atmosphere, and our geophysical environment,– are used to determine the state (and changing state) of the climate, – are used to evaluate earth system models, – are used in operations and planning for every sector of society, and– are used to understand how both natural and human-made systems work and

affect each other

• NOAA’s Data Centers are equipped for handling the 20th century data but will be challenged to handle 21st century data (complex, high volume satellite data, high resolution ship and buoy data, autonomous vehicles, model output). NOAA’s Data Centers are working to integrate data in a seamless manner for easy access to a variety of users

NOAA Data CentersWho are we?

3

NODC CORE FUNCTIONS

Archive

Access

Stewardship

4

End-to-End Data Management (NRC, 2007)

Archiving: preserve information for access and use by a Designated Community– Ingest– Archival Storage– Data Management– Preservation Planning

Access: supports Consumers in determining the existence, description, location and availability of information stored in the OAIS and allows Consumers to request and receive Dissemination Information Packages (DIPs)

– Discovery– Integration with other data to create products– Dissemination to users

Stewardship: spans access and archiving and includes all “activities that preserve and improve the information content, accessibility, and usability of data and metadata”

– Long term access and preservation– Preserving data access and archive integrity during media migration and software evolution– Providing effective data support services and tools for users– Enhancing metadata by adding information established throughout the data life cycle.

5

NODC CORE FUNCTIONS

Archive

6

• Traditional “Archive” activities just one part of the picture…

• Monitoring and understanding user communities• Monitoring and understanding technology

changes• Encouraging adoption of standards• Submission Agreements• Working with providers to create “archive ready”

datasets

Environmental Data should be Archived

What do we mean?

In other words, an Archive is a whole lot more than a set of computers

7

Objectives:• Identify and acquire coastal and ocean data

and information;

• Automate the ingest of data received on a regular basis;

• Leverage national and international data management efforts by using standard protocols;

• Leverage the data management efforts of federal agencies and educational institutes that fund ocean projects;

• Implement archive activities following the principles of the OAIS.

A comprehensive ocean archive recognized by users and providers

Successful data management is determined by its usefulness to current and future users

8

NODC CORE FUNCTIONS

Access

9

An effective data archive should provide for discovery, access, and integration

NODC data used for a multitude of purposes

Objectives:• Provide data discovery protocols for

coastal and ocean data;

• Develop tools that support NOAA’s requirements for data integration;

• Engage with the data providers to ensure appropriate metadata are submitted;

• Train and educate data producers and consumers in metadata production.

10

NODC CORE FUNCTIONS

Stewardship

11

Archive and Access require expert stewardship

NODC products recognized as authoritative ocean data records

Objectives• Work with the ocean science community to

develop products based on user requirements;

• Develop ocean climatologies of key ocean variables with increasingly higher spatial and temporal resolution;

• Develop coastal climatologies for key climate, ecosystems, commerce, transportation, and weather applications;

• Leverage expertise in the ocean and coastal communities, particularly the academic community, to build quality products.

12

• Generation of Authoritative Long Term Records– Putting all data sources together, to understand

today’s environment in the context of the past • Data Quality Monitoring for Long Term Applications

– Critically examining data quality from a unique, integrated, and long-term perspective

• Long Term Preservation of Data and Information– Ensuring information survives and remains

understandable for the present and the future• Data Archaeology and Rescue

– Finding, saving, ingesting, and restoring data from all over the world

• Data and Information Access– Providing information to users and ensuring the

feedback loop contributes to its continual improvement

Increa

sing L

evel o

f Stew

ardship

Scientific Ocean Data Stewardship

13

Global Ocean ObservationsIn Situ and Satellite

• World Ocean Database– Data from global sources with consistent QC, unified format, integrated access– Includes Ocean ECVs: Temperature, Salinity, Nutrients, Carbon, Ocean tracers,

Chlorophyll (phytoplankton)

• Global Temperature and Salinity Profile Program– Near-real time quality assurance for profile data

• Global Argo Data Repository

– To provide high quality Argo data to a wide variety of users in a timely and useful manner

• Joint Archive for Sea Level– Collecting and providing research-quality sea level data

• Jason-2/OSTM– Ensure the quality of the data and its connection with data from the other altimeter

missions, including Geosat

• Geosat Tape Recovery– Unique collection of Geosat Exact Repeat Mission (ERM) data - Geodetic Mission (GM)– Ocean ECVs: Sea State and Sea Level plus Wind Speed over oceans– Linking with latest altimeter, Jason-2/OSTM, for which NODC is the official archive

14

NODC Products recognized as Authoritative Records

NODC Scientific Data Stewardship Value-added Products

• Ocean Heat Content – how oceans are warming or cooling in a changing planet

• Ocean Variability Studies – how are the ocean’s physical and biogeochemical

characteristics changing;

• High Resolution Sea Surface Temperature - study of climate variability, operational

weather and ocean forecasting, military operations, validation and forcing of ocean and

atmospheric models, ecosystem assessment, tourism and, fisheries research, amongst many others

• NOAA’s Coral Reef Information System (CoRIS): Users can search for Coral metadata records in a Google map application

• NCDDC Regional Ecosystem Data Management Portal

Putting all our data sources together, to understand today’s environment in the context of the past

1515

Climate InformationExample: Ocean Storage of Heat

Warming ocean waterexpands, leading to

Sea Level Rise

Measuring Ocean Temperature with buoys, ships, Argo profiling floats, and satellitesMeasuring Ocean Temperature with buoys, ships, Argo profiling floats, and satellites

Deploying an Argo Float

Ocean Climate Reference StationHow Argo Floats work

One month of Subsurface Temperature observations from theOne month of Subsurface Temperature observations from theGlobal Ocean Observing System.Global Ocean Observing System.

NOAA provides 48% of the platforms in this international system.NOAA provides 48% of the platforms in this international system.

World OceanHeat Content

Over the past 50 years, 80% of Earth’s warming has occurred in the Ocean.

NODC: Preserving the ocean’s history from buoys, ships, Argo profiling floats and satellites

Global Sea Level Index

16

Using GHRSST data demonstrated a 12-67% Using GHRSST data demonstrated a 12-67% decrease in forecast errors for Hurricane Genevieve decrease in forecast errors for Hurricane Genevieve (Gentemann et al. (2003)(Gentemann et al. (2003)..

GHRSST SST Analysis

The US Naval Oceanographic Office achieved both track and intensity forecast improvements using GHRSST SST in Katrina simulations.

Transformation of Observations to User Applications and Societal Benefits

Operational NCEP SST

Reynolds OI SST

Difference

Integrating Data Access to Addressan Ecological Disaster

Joint Analysis GroupJoint Analysis Group

All Source Observing Systems

Data Centers & Centers of Data

Protecting Living Marine Resources

Archive & Stewardship

NOAA Observing Systems Collection & Process

VerifiedData

Streams

CalibrationValidation

QA/QC

Data Assembly Center(e.g. NODC)

Data Assembly Center(e.g. NODC)

Research Community

Interagency Management

Assimilation, Integration & Visualization

OR&R ICC

Decision Support

Tools

NICNIC

18

NODC Goal: NOAA staff using the Central and Regional libraries as sources for information and research support

Objectives• Meet the expanding needs for information

services;• Maintain, preserve and protect library

collections;

• Build a NOAA-wide institutional repository to provide access to, and archive NOAA’s electronic publications;

• Expand desktop access to journals, databases, e-books, and other online services across NOAA.

19

Communications and Outreach

Priorities for what to archive driven by user requirements

Raise awareness about ocean data stewardship

Maximize public outreach through widespread collaboration with the ocean community

20

• International Data Exchange– World Data Center for Oceanography, Silver Spring– Bilateral Oceanographic Data Exchange Agreements

• Republic of China, Republic of Korea, and France

– International Ocean Atlas and Information Series

• International Partnership– Intergovernmental Oceanographic Commission (IOC)

• International Oceanographic Data and Information Exchange (IODE); World Ocean Database Project (WOD); Global Oceanographic Data Archaeology and Rescue Project (GODAR); Marine Data and Information Management

• Train and host staff from foreign Oceanographic Data Centers (17 visitors from 5 countries)

• International Council for the Exploration of the Sea (ICES)

• Other Programs and Projects– Global Temperature Salinity Profile Program (GTSPP); Argo;– Global Ocean Data Assimilation Experiment (GODAE)– Global Ocean Surface Underway Data Pilot Project (GOSUD)– Joint Archive for Sea Level (JASL); Coral Reef Information System

(CoRIS); SeaDataNet; North Pacific Marine Science Organization (PICES)

Bilateral agreement with Republic of Korea - June 2008

New!

International Ocean Atlas and Information Series, Vol. 11

Success will rely on national and international partnerships

Effective interagency and international partnerships are essential

21

Provide information technology services

NODC Archive Doubles Between FY07 and FY08 and continues to increase exponentially: The size of the NODC archive doubled from 31TB in FY07 to 60 TB in FY08 to 85.7 TB in September 2010. This increase is due to expanding the archive to include satellite and model data. In contrast, back in 1968, the size of the archive was 1GB.

NODC Increased the Complexity of its Archive • In situ data• Satellite data • Video data• Model data• Ecosystem data

22

NODC Staff (as of June 2010)

About 2/3 of the NODC staff are scientists or librarian/information specialists.

About 1/3 of the NODC staff are administrative and IT infrastructure support

23

NODC and FY11

• NOAA is facing new priorities and challenges

• How does NODC support these priorities?– For example, NODC’s role in Climate Services, Marine Spatial Planning

• Focus on easy access to NODC’s products and services

• Focus on strengthening our partnerships across NOAA and the ocean community– Build our constituency– Meeting the needs of our customers and partners

• Vision: shared stewardship of the data – Science/data experts work with the science/archive experts to ensure

the highest quality of data is documented and preserved for use of current and future generations and for a wide variety of applications

24

Potential Areas of Collaboration with CICS

• Expand capabilities to provide scientific data stewardship– Base funding for engaging ocean experts in providing NODC

guidance on stewarding ocean variables (acquisition, quality control, products, metadata)

• NODC working on proposals – opportunities for students, post-doctorates and visiting scientists– Ocean Heat Content– XBT Bias correction– Sea Surface Salinity– Others (biological, chemical, currents)