ToolsToolsfor accessing distributed in-situ data collectionsfor accessing distributed in-situ data collections

Donald W. Denbo, NOAA/PMEL-JISAOJason E. Fabritz, NOAA/PMEL-JISAO

Bernard J. Kilonsky, Sea Level Center/ADCP Center, University of Hawaii

John R. Osborne, OceanAtlas SoftwareL. Charles Sun, NOAA/NODC

Willa H. Zhu, NOAA/JISAONancy Soreide, NOAA/PMEL

AMS IIPSAMS IIPSFeb 9-13 2003, Long Beach, CAFeb 9-13 2003, Long Beach, CA

ChallengeChallenge

Locating and selecting individual Locating and selecting individual observations from large, distributed observations from large, distributed collections of collections of in situin situ data data observationsobservations Examples: Individual oceanic or

atmospheric profiles, time series, buoy tracks, etc.

Some solutionsSome solutions

Tools and ApplicationsTools and Applications LDAP Directory Services NdEdit for subsetting large in-situ collections Interactive Java graphics Intensive exploration of multiple data types OPeNDAP (DODS) clients and servers for in-situ data Access from Desktop and Web

Assembled from OpenSource componentsAssembled from OpenSource components http://www.epic.noaa.gov/epic/software/ep_java.htm

LDAP Directory ServiceLDAP Directory ServiceFinding distributed data collectionsFinding distributed data collections

Search on geographic region, observed quantities or Search on geographic region, observed quantities or keywordkeyword Automatically populated from data serversAutomatically populated from data servers Metadata instantly known to LDAP directoriesMetadata instantly known to LDAP directories Access control for experimental data productsAccess control for experimental data products

Open SourceOpen Source Standards-basedStandards-based Platform independent, Platform independent, Scalable, extensible, Scalable, extensible, Supports desktop or web clientSupports desktop or web client

X-Y map view

Y-TY-T time range

NdEdiNdEditt

Investigate space-time distribution

Select data in any View

Explore Data Locations and Subset Data Collections

Interactive, linked windows

View any 2D sliice xy, xt, xz, yt, yz, yt Select

time rangeSee data in range

X-Y map view

Y-TY-T time range

Section Tool - select stations along a depth contour

NdEdiNdEditt

Selected stations are in a narrow time band

NdEdiNdEditt

Polygon tool – select an oblique section line

See time range of stations

NdEdiNdEditt

NdEdiNdEditt

NdEdit is an interactive Java toolNdEdit is an interactive Java tool NdEdit is being re-engineered for the WebNdEdit is being re-engineered for the Web

SGT: SGT: A Scientific Graphics ToolkitA Scientific Graphics Toolkit Java toolkit for scientific graphicsJava toolkit for scientific graphics

On-line documentation, examples, tutorials, streaming On-line documentation, examples, tutorials, streaming videovideo

JavaBeans in next releaseJavaBeans in next release FeaturesFeatures

Contour, line and vector plots, Contour, line and vector plots, Axes user settable or automatically scaledAxes user settable or automatically scaled multiple Time Axis formats multiple Time Axis formats mouse-movable, customizable Labels, line keys, iconsmouse-movable, customizable Labels, line keys, icons Legend generation automaticLegend generation automatic

Widely used, freely availableWidely used, freely available scientific and commercial applications use SGTscientific and commercial applications use SGT 12836 downloads by 4508 unique sites from 66 12836 downloads by 4508 unique sites from 66

countriescountries http://www.epic.noaa.gov/java/sgt/http://www.epic.noaa.gov/java/sgt/

ApplicationsApplications

Java Desktop and Web clientsJava Desktop and Web clients

ncBrowsencBrowseJava tool for data/metadata browseJava tool for data/metadata browse

NetCDF and full OPeNDAP supportNetCDF and full OPeNDAP support Desktop Java application Axis mapping, parametric plots, flexible mapping of

independent variables to axes Line, vector and contour plots Animations, 3D graphics via VisAD

Popular, freely availablePopular, freely available 6471 downloads by 2896 unique sites in 57 countries OPeNDAP (DODS) client, Unidata netCDF client, WOCE

data CD, etc. http://www.epic.noaa.gov/java/ncBrowse/

See: AMS Paper 15.2 – Thursday 4:45pm - Donald DenboSee: AMS Paper 15.2 – Thursday 4:45pm - Donald Denbo

Java OceanAtlasJava OceanAtlasfor browsing ocean datafor browsing ocean data

Intensive Java desktop browsing of ocean dataIntensive Java desktop browsing of ocean data Property-property plots with up to 7 x axes, waterfall diagrams, Property-property plots with up to 7 x axes, waterfall diagrams,

Contour plots/residual contour plots, Map plots with optional Contour plots/residual contour plots, Map plots with optional "bubble" isosurface plots, Linked browsing of all plot types, Built-in "bubble" isosurface plots, Linked browsing of all plot types, Built-in and custom calculations, NdEdit for data location/selectionand custom calculations, NdEdit for data location/selection

Reads WOCE, EPIC, OPeNDAP netCDF data, some ARGO formatsReads WOCE, EPIC, OPeNDAP netCDF data, some ARGO formats Extended for wide range of data typesExtended for wide range of data types

Profile, time series, drifting buoy, gridded analyses, model outputsProfile, time series, drifting buoy, gridded analyses, model outputs Widely used, freely availableWidely used, freely available

http://www.epic.noaa.gov/epic/software/JavaJOA.htmhttp://www.epic.noaa.gov/epic/software/JavaJOA.htm http://odf.ucsd.edu/joa/jsindex.htmlhttp://odf.ucsd.edu/joa/jsindex.html

Climate Data PortalClimate Data PortalDistributed ocean observationsDistributed ocean observations

Major Major in situin situ data data collections:collections: TAO El Nino buoy data

(realtime/PMEL), Global sea level data (realtime/U of Hi), GTSPP (NODC), PMEL hydrographic data and time series collection, WOCE ADCP (U of Hi), IPRC/APDRC in situ data, US Coastal Ocean Time Series database (NODC)

OPeNDAP: in-situ data server and clientOPeNDAP: in-situ data server and client LDAP directory services NdEdit for data selection/subsetting Data Servers, Clients (Java and Web) – focus on in

situ data http://www.epic.noaa.gov/cdp/cdpjava.htm

OceanShareOceanShareNetwork collaboration toolNetwork collaboration tool

Collaboration featuresCollaboration features Local, remote data file access and Java graphicsLocal, remote data file access and Java graphics Standard collaboration tool features (annotation, Standard collaboration tool features (annotation,

whiteboard, etc) whiteboard, etc) Secure LDAP Document RepositorySecure LDAP Document Repository

Proposals, papers in progress, data, imagesProposals, papers in progress, data, images Access control by document or by folderAccess control by document or by folder Accessible from web and desktop Accessible from web and desktop

OPeNDAP compatible soonOPeNDAP compatible soon http://www.epic.noaa.gov/collab/http://www.epic.noaa.gov/collab/

EPIC tools for the Web EPIC tools for the Web for building customized web access to datafor building customized web access to data

EPIC Web ToolkitEPIC Web Toolkit Interface design Backend graphics Map data selector

Example applicationsExample applications EPIC Web Browser (general) TAO (El Nino buoys) Unaami (Arctic time series) OSCAR (Satellite ocean

currents) Multibeam data

(hydrography) http://www.epic.noaa.gov

Tools and Applications Tools and Applications Java desktop and WebJava desktop and Web

Modular Web and Open Source Modular Web and Open Source componentscomponents

Java interactivityJava interactivity Low cost development/maintenance Low cost development/maintenance OpenSource, standards-basedOpenSource, standards-based Scalable, extensibleScalable, extensible OPeNDAP supported or plannedOPeNDAP supported or planned

http://www.epic.noaa.govhttp://www.epic.noaa.gov http://www.epic.noaa.gov/epic/software/http://www.epic.noaa.gov/epic/software/

ep_java.htmep_java.htm