polder: polar data discovery enhancement research...polder: polar data discovery enhancement...

1
Is single-window data search a myth or can it be made real? Developing Federated Search for Polar Oceanographic and Terrestrial Data POLDER: Polar Data Discovery Enhancement Research Polder (Dutch verb): to work collaboratively to achieve a common goal. 1 NIOZ Royal Netherlands Institute for Sea Research and Utrecht University,Texel, Netherlands 2 Integrated Marine Observing System, Hobart, Australia, 3 Arctic Portal, Akureyri, Iceland, 4 Royal Belgian Institute for Natural Sciences, Leuven, Belgium, 5 University of Colorado INSTAAR, Boulder, USA, 6 Billingsley Custom Software, Boulder, USA, 7 Norwegian Polar Institute,Tromso, Norway, 8 Belgian Marine Data Centre, Leuven, Belgium, 9 Southern Ocean Observing System, Battery Point, Australia [[email protected]] Taco de Bruin 1 , Roger Proctor 2 , Alexander Smirnov 3 , Anton Van de Putte 4 , William Manley 5 , Brendan Billingsley 6 , Halldor Johansson 3 , Marten Tacoma 1 , Peter Pulsifer 5 , Stein Tronstad 7 , Thomas Vandenberghe 8 and Pip Bricher 9 Esri, Garmin, GEBCO, NOAA NGDC, and other contributors Esri, Garmin, GEBCO, NOAA NGDC, and other contributors Dozens of discovery metadata catalogues list polar datasets The catalogues use a wide range of metadata standards, profiles, and web service protocols to organise these records Science communities have long asked for a single- window search to aid in data discovery and access But polar data management efforts have historically been siloed by national or discipline boundaries This variety of approaches has historically made federation and aggregation of catalogues challenging These problems are not unique to polar regions, but the preexisting community relationships in polar data management make it a sensible scale for coordinating needs and planning developments Gulf of Alaska Data Portal Alaska Satellite Facility ASF Arctic Data Explorer Arctic Institute of North America Arctic Landscape Conservation Cooperative Arctic Observing Viewer Arctic Spatial Data Infrastructure ArcticConnect Arctic Research Mapping Application Barrow Area Information Database Centre Etude Nordique Conservation of Arctic Flora and Fauna Dept. Fisheries and Oceans Canada EnviDat Environment Canada Biological and Chemical Oceanography Data Management Office British Oceanographic Data Centre Chinese National Arctic and Antarctic Data Centre CLIVAR and Carbon Hydrographic Data Office DataONE Dryad EarthChem Earth Observation Laboratory UCAR/NCAR Environmental Data Initiative EUDAT GEOTRACES Global Biodiversity Information Facility Global Cryosphere Watch Global Terrestrial Network for Permafrost Group on Earth Observations System of Systems Joint Technical Committee of Marine Meteorology Platform Support Centre KNB Data Repository Met.no NASA ABoVE NASA GCMD/CMR NCEI National Climatic Data Center NCEI - National Geophysical Data Center NCEI - National Oceanographic Data Center NCEI - World Data System Paleoclimatology Data National Institute of Polar Research National Snow and Ice Data Center Netherlands Polar Data Center Norwegian Meteorological Institute Norwegian Polar Institute OBIS Ocean Data and Information System PANGAEA Polar Data Catalogue R2R Research Data Archive UCAR/NCAR SeaDataNet SESAR The digital Archaeological Record USGS ScienceBase WMO Integrated Global Observing System Antarctic Master Directory (GCMD) Australian Antarctic Data Centre Australian Ocean Data Network biodiversity.aq British Antarctic Survey Polar Data Centre Marlin (CSIRO) MGDS Antarctic SOOS (GCMD) US Antarctic Program Data Portal Environment Climate Data Sweden ICES INTAROS International Arctic Research Center Inuit Qaujisarvingat National Ecological Observatory Network North Slope Science Initiative NSF Arctic Data Center NWT Discovery Portal Open Data (Canada) Scholars Portal Dataverse U. of Toronto Svalbard Integrated Arctic Earth Observing System University of Alberta WMO ADC Yukon Research Centre https://polder.info To get involved, please visit POLDER is a group of polar data managers identifying and advocating the needs of the polar data users in a fast-moving environment Through coordination on metadata exchange, POLDER can make data more FAIR: Findable, Accessible, Interoperable, and Reusable POLDER is building relationships with metadata federation and discovery projects, such as GEOSS, DataONE, Arctic Data Explorer, and schema.org Figure 1: POLDER has identified these metadata catalogues with significant polar holdings; background data from ESRI, GARMIN, GEBCO, NOAA NGDC Argentina Australia Belgium Canada Chile Estonia Finland France Italy Japan Malaysia Netherlands New Zealand People's Republic of China Republic of Korea Spain Sweden Switzerland Ukraine United Kingdom United States of America Uruguay Antarctic Master Directory and SOOS (GCMD) contributors

Upload: others

Post on 20-Jan-2020

10 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: POLDER: Polar Data Discovery Enhancement Research...POLDER: Polar Data Discovery Enhancement Research Polder (Dutch verb): to work collaboratively to achieve a common goal. 1NIOZ Royal

Is single-window data search a myth or can it be made real? Developing Federated Search for Polar Oceanographic and Terrestrial Data

POLDER: Polar Data Discovery Enhancement ResearchPolder (Dutch verb): to work collaboratively to achieve a common goal.

1NIOZ Royal Netherlands Institute for Sea Research and Utrecht University, Texel, Netherlands 2Integrated Marine Observing System, Hobart, Australia, 3Arctic Portal, Akureyri, Iceland, 4Royal Belgian Institute for Natural Sciences, Leuven, Belgium, 5University of Colorado INSTAAR, Boulder, USA, 6Billingsley Custom Software, Boulder, USA, 7Norwegian Polar Institute, Tromso, Norway, 8Belgian Marine Data Centre, Leuven, Belgium, 9Southern Ocean Observing System, Battery Point, Australia [[email protected]]

Taco de Bruin1, Roger Proctor2, Alexander Smirnov3, Anton Van de Putte4, William Manley5, Brendan Billingsley6, Halldor Johansson3, Marten Tacoma1, Peter Pulsifer5, Stein Tronstad7, Thomas Vandenberghe8 and Pip Bricher9

Esri, Garmin, GEBCO, NOAA NGDC, and other contributors

Esri, Garmin, GEBCO, NOAA NGDC, and other contributors

Dozens of discovery metadata catalogues list polar datasets

The catalogues use a wide range of metadata standards, profiles, and web service protocols to organise these records

Science communities have long asked for a single-window search to aid in data discovery and access

But polar data management efforts have historically been siloed by national or discipline boundaries

This variety of approaches has historically made federation and aggregation of catalogues challenging

These problems are not unique to polar regions, but the preexisting community relationships in polar data management make it a sensible scale for coordinating

needs and planning developments

Gulf of Alaska Data PortalAlaska Satellite Facility ASFArctic Data ExplorerArctic Institute of North AmericaArctic Landscape Conservation CooperativeArctic Observing ViewerArctic Spatial Data InfrastructureArcticConnectArctic Research Mapping Application Barrow Area Information DatabaseCentre Etude NordiqueConservation of Arctic Flora and Fauna Dept. Fisheries and Oceans CanadaEnviDatEnvironment Canada

Biological and Chemical Oceanography Data Management OfficeBritish Oceanographic Data CentreChinese National Arctic and Antarctic Data CentreCLIVAR and Carbon Hydrographic Data Office DataONEDryadEarthChemEarth Observation Laboratory UCAR/NCAREnvironmental Data InitiativeEUDATGEOTRACESGlobal Biodiversity Information FacilityGlobal Cryosphere WatchGlobal Terrestrial Network for PermafrostGroup on Earth Observations System of SystemsJoint Technical Committee of Marine Meteorology Platform Support CentreKNB Data RepositoryMet.noNASA ABoVENASA GCMD/CMR

NCEI National Climatic Data CenterNCEI - National Geophysical Data Center NCEI - National Oceanographic Data CenterNCEI - World Data System Paleoclimatology DataNational Institute of Polar Research National Snow and Ice Data CenterNetherlands Polar Data CenterNorwegian Meteorological InstituteNorwegian Polar InstituteOBISOcean Data and Information System PANGAEAPolar Data CatalogueR2RResearch Data Archive UCAR/NCARSeaDataNetSESARThe digital Archaeological RecordUSGS ScienceBaseWMO Integrated Global Observing System

Antarctic Master Directory (GCMD)Australian Antarctic Data Centre Australian Ocean Data Network biodiversity.aqBritish Antarctic Survey Polar Data CentreMarlin (CSIRO)MGDS AntarcticSOOS (GCMD)US Antarctic Program Data Portal

Environment Climate Data SwedenICESINTAROSInternational Arctic Research CenterInuit QaujisarvingatNational Ecological Observatory Network North Slope Science InitiativeNSF Arctic Data CenterNWT Discovery PortalOpen Data (Canada)Scholars Portal Dataverse U. of TorontoSvalbard Integrated Arctic Earth Observing SystemUniversity of AlbertaWMO ADCYukon Research Centre

https://polder.infoTo get involved, please visit

POLDER is a group of polar data managers identifying and advocating the needs of the

polar data users in a fast-moving environment

Through coordination on metadata exchange, POLDER can make data more FAIR: Findable, Accessible,

Interoperable, and Reusable

POLDER is building relationships with metadata federation and discovery projects, such as GEOSS,

DataONE, Arctic Data Explorer, and schema.org

Figure 1: POLDER has identified these metadata catalogues with significant polar holdings; background data from ESRI, GARMIN, GEBCO, NOAA NGDC

ArgentinaAustraliaBelgiumCanadaChileEstoniaFinlandFranceItalyJapanMalaysiaNetherlandsNew ZealandPeople's Republic of ChinaRepublic of KoreaSpainSwedenSwitzerlandUkraineUnited KingdomUnited States of AmericaUruguay

Antarctic Master Directory and SOOS (GCMD) contributors