ellsworth ledrew, university of waterloo of-ipy// mark parsons taco de bruin
TRANSCRIPT
Ellsworth LeDrew, University of Waterloo
http://www.earthzine.org/2008/03/27/securing-the-legacy-of-ipy//
Mark ParsonsTaco de Bruin
The Role of Data In the History of IPY
IPY 1 1882: much of the data has been lostConsider the potential for temporal
change analysis in the Arctic if these data were available!
IPY 2 1932-33, almost nothing remainsIPY 3 1957-58, Graduate Students are now Senior PI’s: Where are the data?
The Role of Data management In IPY 2007-08
“Building an integrated data set from the broad range of IPY research activities represents one of IPY’s most daunting challenges. An enduring data set, accessible to scientists and the public during IPY and for many decades into the future, will represent one of IPY’s strongest legacies ”(The Scope of Science for the International Polar Year, 2007-2008)
IPY Data Management Policy for CanadaInternational Data Management Policy
written for all IPY projects based upon ICSU documents and unique opportunities for Polar Research
Canadian Data Management Policy written with enhancements for Canadian issues:Health lawPrivacy lawsProtection on endangered species
Meeting of all funded PI’s
MetadataIn accordance with the ISO standard Reference Model for an Open Archival Information System (OAIS) (CCSDS 2002), complete metadata may be defined as all the information necessary for data to be independently understood by users and to ensure proper stewardship of the data. Regardless of any data access restrictions or delays in delivery of the data itself, all IPY projects must promptly provide basic descriptive metadata of collected data in an internationally recognized, standard format to an appropriate catalog or registry.
Metadata are essential to the discovery, access, and effective use of data.
All IPY data must be accompanied by a full set of metadata that completely document and describe the data.
Canadian multiyear funding contingent upon submission of METADATA
Data Access Implicit in the concept of metadata is that colleagues should have access to your metadata
“IPY data, including operational data delivered in real time, are made available fully, freely, openly and on the shortest feasible timescale. Exceptions will only apply to protect confidentiality of information about human subjects, respect needs and rights of holders of local and traditional knowledge and ensure that data release does not lead to harm of endangered or protected resources.”
“shortest feasible timescale”: allow time for basic Validation and QC, of order of months, not years.
WHO PAID FOR THE DATA?
Canada: Polar Data CatalogueA collaboration between CCIN, ArcticNet, IPY, and NCP (others in development): http://www.polardata.ca.
CCIN.ca - RADARSAT ASAPSupport the Capture of metadata through a simple interface using international standardsSeamless Discovery Operation with other Portals
Canada: Polar Data Catalogue (cont’d)A collaboration between CCIN, ArcticNet, IPY, and NCP (others in development):http://www.polardata.ca.
Archive data and derived products for specific projectsDevelop outreach and educational productsBest Practices Wiki
Data RescueDesign interface using approaches and tools familiar to local peoples.
During consultations with communities and partners, it became clear that the Inuit want to know more about the research conducted in the Arctic.
Information such as when and where it is being conducted and what information is being collected and why, as well as who to contact for more information. The facility will also feature various map layers (land
status, political regions, resources, Heritage sites), links of interest to Inuit, and upcoming plain language texts and a tutorial package.
Consideration for local peoples
Data Archive: Actual Data and Metadata
ProvenanceFixityContextPreservation
Ruth Duerr, NSIDC, 2008,Summer Institute on Data Curation
Provenance: Scientific Integrity of the DataInformation about the pedigree/history
of the dataWhere did it come from and where has it
been since?Who created it?How was it created; what algorithms,
algorithm versions, ancillary and calibration data sets were used?
What other data were used to validate these data?
What changes have taken place since these data were originally created?
FixityFixity Information “provides the Data Integrity
checks or Validation/Verification keys used to ensure that the particular Content Information object has not been altered in an undocumented manner. Fixity Information includes special encoding and error detection schemes that are specific to instances of Content Objects … The Fixity Information may specify minimum quality of service requirements for these mechanisms.” Descriptions of the mechanisms used to ensure that
the data has not been changed in an undocumented way
Authentication keys
Context“information [that] documents the
relationships of the Content Information to its environment. This includes why the Content Information was created and how it relates to other Content Information objects existing elsewhere.”
Instrument/sensor characteristics including pre-flight or pre-operational performance measurements (e.g., spectral response, noise characteristics, etc.)
Instrument/sensor calibration data and method Processing algorithms and their scientific basis, including complete
description of any sampling or mapping algorithm used in creation of the product (e.g., contained in peer-reviewed papers, in some cases supplemented by thematic information introducing the data set or derived product)
Complete information on any ancillary data or other data sets used in generation or calibration of the data set or derived product
Preservation Issues:Preservation objectives:
1) providing preservation managers with sufficient knowledge to take appropriate actions in order to maintain a digital object’s bit stream over the long-term,
2) ensuring that the content of an archived object can be rendered and interpreted, in spite of future changes in access technologies.
StewardshipEthical managementIntellectual Property rights
Governance and sustainability of sharing and interoperability of IPY nodes and the networking with other international data nodes
Practical approaches to interoperability of polar data.
The future and processes of the archiving and preservation of data from IPY and the identification of core polar data sets.
What is the definitive “IPY Data Collection” and what is the legacy of said collection?
How IPY data collection and ongoing activities will be presented at Oslo 2010.
IPY Data Management MeetingOctober, Ottawa, Sept 30 –Oct 1
OnGoing IssuesWHO PAYS? Interoperability - GEOSSEquitable Access to Data and Information (Open Access for Data and Publications)The Digital DivideIntellectual Property RightsGovernment held data vs Private Sector Data
