international polar year data management codata06 beijing, china 25 october 2006 mark a. parsons ipy...
TRANSCRIPT
International Polar YearData Management
CODATA06Beijing, China25 October 2006
Mark A. ParsonsIPY Data Policy and Management Sub-committeeIPY Data and Information Service
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20062 QuickTime™ and aGraphics decompressor
are needed to see this picture.
NOAA
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20063 QuickTime™ and aGraphics decompressor
are needed to see this picture.
IPY 11882-83
IPY 21932-33
IGY1957-58
IPY 2007-08
IPY Timeline
the 125 Year
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20064 QuickTime™ and aGraphics decompressor
are needed to see this picture.
IPY Themes
• Current status• Past & future changes• Linkages to global processes• Investigate frontiers of science in polar
regions• Vantage point to earth history & to
space• Social & cultural dynamics & resiliency
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20065 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Joint CommitteeIPY
Joint CommitteeIPY
Data Policy & Management
Subcommittee
Data Policy & Management
Subcommittee
ObservationsSubcommitteeObservations
SubcommitteeEducation, Outreach &
Communication Subcommittee
Education, Outreach & Communication Subcommittee
ProgrammeOffice
ProgrammeOffice
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20066 QuickTime™ and aGraphics decompressor
are needed to see this picture.
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20067 QuickTime™ and aGraphics decompressor
are needed to see this picture.
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20068 QuickTime™ and aGraphics decompressor
are needed to see this picture.
USFWS
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200610 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Systems and Innovation
31%40%
28%23%
15% 18%
53% 33%46%
49%
51%54%
16%27% 26% 28%
34%28%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
1994 1996 1998 2000 2002 2004
The Standish Group’s “CHAOS report”. An assessment of over 40,000 IT application projects
Succeeded
“Challenged”
Failed
“We're entering a new world in which data may be more important than software.”
- Tim O'Reilly
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200611 QuickTime™ and aGraphics decompressor
are needed to see this picture.
The People Part
Service counts.
“A striking proportion of project difficulties stem from people in both customer and supplier organisations failing to implement known best practice.”
— Oxford University/Computer Weekly survey of public and private sector IT projects (emphasis added)
However, people (data managers and data providers) are much more able to adapt to change, uncertainty, and messy systems
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200612 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Exchange for Local Observations and Knowledge in the Arctic
• Local and traditional knowledge (LTK) encompasses the various systems of knowledge, practice, and belief gained through experience and culturally transmitted among members and generations of a community.
• ELOKA is concerned with:• Fair and multilevel access• Fair and multilevel use• Broad sharing of LTK while maintaining local control• Legal requirements
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200613 QuickTime™ and aGraphics decompressor
are needed to see this picture.
What’s been done
• Data Committee has defined a data policy
• Data Committee working on a data strategy and outlining overall IPY data flow.
• Workshop on data management (see report at http://nsidc.org/ipydis)
• Proposals submitted (some funded) to manage and ensure fair access to IPY data.
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200614 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Data used by IPY
Data generated by IPY
Special Cases:• Human subjects• Intellectual property of LTK• Where data release may
cause harm
IPY Data Policy
“…the IPY Joint Committee requires that
IPY data, including operational data
delivered in real time, are made available
fully, freely and on the shortest feasible
timescale.”
http://www.ipy.org/Subcommittees/final_ipy_data_policy.pdf
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200615 QuickTime™ and aGraphics decompressor
are needed to see this picture.
An IPY Data Management Workshop
• More than 40 participants from 13 countries
• Major goal: determine functions, form, and implementation for an IPY Data and Information Service
• Full report at
http://nsidc.org/ipydis
Photo courtesy SJS Khalsa
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200616 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Reference Documents
google “icsu paa” earthobservations.org
ISO 14721:2003
google “oais”
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200617 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Overarching themes
• Outreach to the scientific community• Data discovery and access• Interoperability• A data coordination office• A phased approach• Funding
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200618 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Vision: a cultural shift in science
“Preserve or Perish”
You are not finished until you have done the research, published the results, and published the data, receiving formal credit for everything.
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200619 QuickTime™ and aGraphics decompressor
are needed to see this picture.
catalog 3(Mirror)
catalog 2
catalog 1
catalog 9
catalog 4
catalog 8
catalog 7
catalog 6(Mirror)
catalog 5
Data Discovery & Access—the “Union”Catalog
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200620 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Data Discovery & Access
• Data policy on free and open access• Working with the ICSU CODATA Global
Information Commons for Science Initiative to handle IPR issues with local and traditional knowledge.
• Visualization
18 May 2006
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200622 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Interoperability
“What few things must be the same so everything else can be different.”
• A few good standards: • ISO19115 metadata• Open Geospatial Consortium
• Explore advanced semantic approaches
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200623 QuickTime™ and aGraphics decompressor
are needed to see this picture.
The Equatorial Bias on a Spherical Earth
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200624 QuickTime™ and aGraphics decompressor
are needed to see this picture.
The Equatorial Bias on a Spherical Earth
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200625 QuickTime™ and aGraphics decompressor
are needed to see this picture.
Design for Durability
Data formats should• transparent• interoperable• extensible• compact
Systems should be simple and robust
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200626 QuickTime™ and aGraphics decompressor
are needed to see this picture.
A Phased Approach
Think BIG but start small
IPY provides a unique opportunity to revolutionize data management, but…
IPY is only 126 days away
IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200627 QuickTime™ and aGraphics decompressor
are needed to see this picture.
NOAA
http://nsidc.org/ipydis
Questions?