nsidc distributed active archive center (daac) update › sites › nsidc.org › files › files...

UWG 2015 Annual Meeting

NSIDC Distributed Active

Archive Center (DAAC) Update

NSIDC Distributed Active Archive Center

Outline

Overview

Setting DAAC priorities

Focus Areas for 2015

Highlights and key accomplishments

Data Center move

Looking ahead

What we do …

NASA NSIDC DAAC is responsible for maintaining and

curating cryospheric and related environmental data

datasets created from EOS satellites, NASA field and

airborne campaigns, and other non-EOS data ensuring that

these datasets are preserved, well-documented, accessible

and data quality and integrity are preserved.

Snow

Sea Ice

Glaciers

Ice Sheets

Soil Moisture

Permafrost

Data products and information



Overview of Activities

10.07%

11.42%

13.59%

2.33%31.79%

12.94%

17.86%

administra on

engineering

infrastructure

itsecurity

missionsupport

opera ons

userservices

In our 3rd (option year 2) year of a five year contract


All remote sensing and in-situ data

Liaison with science and user communities

Science support for data users

Data management

4.28%2.21% 3.84% 0.22%

0.37%

4.98%

6.27%

2.12%

6.36%

0.00%8.30%

3.15%20.28%

17.33%

15.49%

4.79%AMSR-E

AMSR2

Aquarius

AVHRR

GLIMS

ICESat

ICESat-2

LegacyDAACData

MEaSUREs2006

MEaSUREs2012

MODIS

Nimbus

Opera onIceBridge

PassiveMicrowave

SMAP

VIIRS

March 2015 – NSIDC data users

6 NSIDC Distributed Active Archive Center

Data Archive

7

ECS–EOSDISCoreSystemV0–NSIDCheritagesystem

Totalof25.3millionfilesinthearchive



NASA EOSDIS components & initiatives

Earthdata login – centralized and simplified

mechanism for user registration and profile

management for all EOSDIS system components

Common Metadata Repository (CMR) – new

metadata system merging all existing capabilities and

metadata from ECHO and GCMD

Big Earth Data Initiative (BEDI) – NASA’s effort to

improve discovery, access and use of Earth

observations by broader community


Other ESDIS and community activities

Earthdata Search Client – a new client under

development for discovering, searching, visualizing,

and retrieving Earth science data

Virtual Collections

Cloud Services/High performance Computing

Setting Priorities

Ongoing

work

New

Missions

work

Statement of work

New

directed

projects

DAAC Product

Teams

Technical

Service Group

Science

Comm. Group

Software Dev.

Group

New ESDIS

Designated

Projects

NASA

Cryosphere

Program

DAAC

MGMT Team

ESDIS review and direction

DAAC

MGMT Team

DAAC

Team

Changing

mission

needs

DAAC review and direction

Create tasks Set Priorities Create Work

Plan Do work/re-

prioritize

Focus areas for the year

NASA ESDIS Priorities

Key mission milestones

NASA Cryosphere

Priorities

Operations performance

User community priorities

UWG Recommendations

Work Priorities

Data operations

User support

Development

Outreach

Sustainment & evolution


Identify initiatives/focus areas/projects

NSIDC

UWG

Guidance

User Services

feedback &

ACSI results

DAAC

MGMT Team


Focus Areas for 2015

SMAP mission support and data management

Earthdata login implementation (CY2015)

BEDI/OPeNDAP/GIBS project (FY2015/2016)

Operation IceBridge support and OIB portal

Data center UPS replacement or move

Focus areas intended to guide work because they are

priorities within NASA ESDIS, have key milestones in

the year and/or align with DAAC strategic direction:


Focus Areas – 2nd tier

Common Metadata Repository (CMR) support

DAAC Data Access and Services project (DAS)

Virtual collection & Data analytics

Increasing level of data science support

- SMAP postdoc support

- Passive microwave and sea ice products

HIGHLIGHTS &

ACCOMPLISHMENTS


SMAP launches …

Public release:

SMAP L1A Radiometer Time-Ordered Parsed Telemetry

SMAP L1B Radiometer Half-Orbit Time-Ordered Brightness Temperatures

SMAP L1C Radiometer Half-Orbit 36 km EASE-Grid Brightness Temperatures

Ingesting approx. 47 GB/day



Operation IceBridge – ARISE campaign

New FLIR imagery

CAMBOT

With many data providers using

MetGen and reformatting data to

conform to NASA standards ECS

for data management

ARISE campaign: data to NSIDC and

ASDC DAACs

2 new campaigns: ARISE and melt

season with focus on mid-season

snow and ice dynamics

NASA LVIS

Operation IceBridge – the portal development

Development focused on

data products (rather than

flight lines)

Driven by user feedback

Enabled by “rich” metadata

Exploring DropBox and

Google-drive delivery

method

Flight line

“Schwab socks”

granule browse image

Data order

Digital Mapping System (DMS) example


Passive Microwave – code update

Additions to ice masks

Code updates to improve stability

and maintenance, and provide

greater consistency across multiple

sea ice data sets

Reduce missing data around pole


SOAC: added Sea Ice Age



Accomplishments/highlights

ICESat-2

- Hosted 2 ATDB meetings

- on-going testing with SIPS and EDOS using GridFTP transfer protocol

MODIS Collection 6 Sea Ice reprocessing began on 19 Feb 2015 (data

2000 to 2011)

Migrating MEaSUREs data sets to ECS to access richer data services,

easier for long term management

- Improved self-describing metadata for snow and sea ice for GIS

Nimbus 4 Image Dissector Camera System satellite data recovered &

added to the timeline (spans April 1969 - Apr 1971)

Our use of virtual machines and servers continues to bring greater

stability to core operations, and gain efficiencies in maintenance and

deployment of software applications

In past year, average 515 user request each month & 91 notices for

updates to/releases of 129 data sets

20

NSIDC Data Center Study

Problem: Data center uninterruptible power supply (UPS) has

been in operations for 17 years and is nearing its end of life

in June 2016. Manufacturer no longer supporting

maintenance & repair. Challenges:

Already at the weight limit of floor (limits solutions, growth)

Costly to replace and maintain new unit (> $150K; ~$20k per

year)

Requires some asbestos remediation (schedule and cost

risk)

What we’re doing: An alternative solution to move the

NSIDC data center has costs advantage over replacing the

UPS.


Locations

21

NSDIC

CU Space Science Data Center


Data Center Move - schedule

Schedule

Evaluate costs and risk Jan. to Apr. 2015

Preliminary decision May 2015

University agreements finalized July 2015

Begin facility preparation August 2015

Readiness review Nov. 2015

Non-ECS hardware move Jan. 2016

ECS hardware move Feb. 2016



Looking Ahead

SMAP release of higher-level data products

ICESat-2 pre-launch preparation

- Start of ground readiness testing

- Data services/tools definition & development

- Launch planned for late-2017

2 new OIB missions in Greenland and Antarctica

Distribution of SNPP VIIRS snow and ice products

- Expected Feb. 2016 for snow products

Contingency plan for DMSP SSMIS F17 F19

JPSS J1 VIIRS snow products (launch 2nd QTR FY 2017?

Other areas?

nsidc distributed active archive center (daac) update › sites › nsidc.org › files › files...

Documents