open access and search4dev - harry heemskerk - kit
TRANSCRIPT
Open Archives Initiative:A model for development data?
Harry Heemskerk, Royal Tropical Institute (KIT)
Amsterdam, The Netherlands www.kit.nl
WARNING!
This presentation is not about data.
Amsterdam, The Netherlands www.kit.nl
In this presentation . . .
What are the issues
Open Archives Initiative (OAI)
Repositories in Africa
Search4Dev: repository for NL development sector
OAI: a model for development data?
Amsterdam, The Netherlands www.kit.nl
The issues
• Digital resources need to appear at many sites, but:o Storage at multiple locations is inefficient and error-
proneo Multiple instances of metadata are inefficient and
often inconsistent• Search engines do not use metadata optimally• Digital resources get lost• Identifiers to digital resources are not persistent
Amsterdam, The Netherlands www.kit.nl
Open Archives Initiative (OAI)
• Initiated by Van de Sompel and others in 2000
• Builds on Open Access initiatives in the 1990’s
• Has since conquered Open Access publishing in the academic world
Amsterdam, The Netherlands www.kit.nl
The principles of OAI
a) Standardize metadata
b) Add metadata at the source
c) Store once, use many
d) Register evolving sets of resources,
not individual resources
e) Create interoperability
Amsterdam, The Netherlands www.kit.nl
a) Standardize metadataMetadata set:
the descriptors to identify and describe the resource
• Dublin Core Metadata Element Set (DCMES)≈ minimum standard
• 15 elements without refinements
• each element optional and repeatable
• also known also know as “Simple Dublin Core”
Amsterdam, The Netherlands www.kit.nl
a) Standardize metadataMetadata exchange standard:
the digital format in which the metadata set is exchanged
Is defined as an XML schema
• Dublin Core based (simple)o OMFo PBCore
• MODS (intermediate) • MARCXML (complex)• METS (object hierarchies)• MPEG-21 DIDL (complex digital objects)• . . .
Amsterdam, The Netherlands www.kit.nl
b) Add metadata at the source
Metadata should be added closeto the creation of the resource.
(Possibly by the author him/herself => self-archiving)
Why?
• Creator knows best
• Consistent
• Efficient
Amsterdam, The Netherlands www.kit.nl
Publication
database
Research
databaseWebsite
Users
Data and services
c) Store once, use many
Amsterdam, The Netherlands www.kit.nl
Topical website
Harvester
Institutional repository I
Institutional repository III
Institutional repository II
Institutional repository IV
Data layer
Users
Service layer
Publication
database
Research
databaseWebsite
c) Store once, use many
Amsterdam, The Netherlands www.kit.nl
Data layer = Repositories
Service layer = Harvesters
Repositories and harvesters
Amsterdam, The Netherlands www.kit.nl
Various types of repositories
• Institutional repository
• Multi-institutional repository
• Aggregating repository
• Governmental repository
• Disciplinary repository
• Subject repository
• . . .
Amsterdam, The Netherlands www.kit.nl
Various types of repositories
• May be very large or very small
• May be rapidly expanding or rather stable
• May store different kinds of content
• May use varying database systems
• May run on all kinds of platforms
• . . .
Amsterdam, The Netherlands www.kit.nl
Various types of harvesters
• General search engine
• Subject portal
• Electronic sourcebook
• Electronic journal
• . . .
Amsterdam, The Netherlands www.kit.nl
Amsterdam, The Netherlands www.kit.nl
About registries of repositoriesRegister sets of resources, not individual resources.
Examples of registries of repositories:
• Registry of Open Access Repositories - ROAR
• Directory of Open Access Repositories - OpenDOAR
• The Open Archives Initiative
• The OAI registry at University of Illinois
• Openarchives.eu
Amsterdam, The Netherlands www.kit.nl
d) Create operability
Communication protocol:
question-and-answer language between repository and harvester
• OAI-PMHOpen Archives Initiative - Protocol for Metadata Harvesting
Amsterdam, The Netherlands www.kit.nl
d) Create operabilityExamples of OAI-PMH conversation
Q: identify – who are you?A: I am the service www.university.edu and my oldest
record is from 2001
Q: listmetadata – what are the metadataformats that you can supply?
A: I can supply my metadata in DC and DIDL
Q: listsets – which sets of information do you have ?A: I have a set of Humanities and a set of Biology records
Amsterdam, The Netherlands www.kit.nl
d) Create operabilityExamples of OAI-PMH conversation
Q: listidentifiers – Give me the headers of the records that were published after 1-1-2010
A: Here are the headers of the records requested
Q: listrecords – Give me details of the records of the records that were published after 1-1-2010
A: Here is a list of records
Q: getrecords – Give me a specific recordA: Here are all the fields of this specific record
Amsterdam, The Netherlands www.kit.nl
Volume of OAI-compliant repositories
Source: OpenDOAR, May 11, 2011
Amsterdam, The Netherlands www.kit.nl
Content of OAI-compliant repositories
Source: OpenDOAR, May 11, 2011
Amsterdam, The Netherlands www.kit.nl
In this presentation . . .
What are the issues
Open Archives Initiative (OAI)
Repositories in Africa
Search4Dev: repository for NL development sector
OAI: a model for development data?
√
√
Amsterdam, The Netherlands www.kit.nl
Repositories in Africa
Source: OpenDOAR, May 11, 2011
Amsterdam, The Netherlands www.kit.nl
Repositories in Africa
Source: ROAR, May 11, 2011
Amsterdam, The Netherlands www.kit.nl
KIT’s activities 1: supporting IRs
Amsterdam, The Netherlands www.kit.nl
KIT’s activities 2: DATAD IIIDatabase of African Theses and Dissertations
Under the responsibility of the Association of African Universities (AAU)
DATAD I: online catalogue of bibliograhic metadata
DATAD II: catalogue with partial access to full text
DATAD III: harvester in a network of institutional repositories
Amsterdam, The Netherlands www.kit.nl
KIT’s activities 3: toolkitToolkit for implementing
institutional repositories in Africa
1. Publication of toolkit in autumn 2011
2. Development of training modules
3. Setting up an online community of practice
Amsterdam, The Netherlands www.kit.nl
Amsterdam, The Netherlands www.kit.nl
KIT’s activities Finally:
There is more than strictly Open Acess
Partnership with Elsevier Publishers to provide free access to some of Elsevier’s commercial databases for 150 academic and research institutions in Africa
Amsterdam, The Netherlands www.kit.nl
In this presentation . . .
What are the issues
Open Archives Initiative (OAI)
Repositories in Africa
Search4Dev: repository for NL development sector
OAI: a model for development data?
√
√
√
Amsterdam, The Netherlands www.kit.nl
Search4Dev
• Inspired by Research4Development in the UK
• Initiated by Development Policy Review Network (DPRN)
• Implemented by KIT
• Launched in December 2008
Amsterdam, The Netherlands www.kit.nl
Web interfaceSearch4Dev
. . .
Academic institutions
IR 1 IR 2 IR 2 IR x
Portal Dutch Development
Cooperation
Research-ers
Policy makers
Practitio-ners
OAI-PMHharvesters
Search4Devrepository
NGOs., Ministry, etc.
Amsterdam, The Netherlands www.kit.nl
Amsterdam, The Netherlands www.kit.nl
Search4Dev: current status
• 32 participating NGOs
Amsterdam, The Netherlands www.kit.nl
Participants• AWEPA - Association of European
Parliamentarians with Africa• Bernard van Leer Foundation• Both ENDS• Cordaid• DCA-VET - Dutch Committee for Afghanistan -
Veterinary Programmes• DPRN - Development Policy Review Network• Euroconsult/BMB Mott MacDonald• Hivos – Humanist Institute for Development
Cooperation• ICCO - Interchurch Organization for
Development Cooperation• IICD - International Institute for Communication
and Development• IKV Pax Christi• IUCN National Committee of the Netherlands• KIT - Royal Tropical Institute• Knowledge Centre Religion and Development• MVO Platform• NCDO - National Committee for International
Cooperation and Sustainable Development
• Oxfam Novib• Partos• PharmAccess Foundation• Plan Nederland• PSO - Capacity Building in Developing
Countries• SNV - Netherlands Development
Organisation• SOMO - Centre for Research on
Multinational Corporations• Spanda Foundation• Stichting Oikos• The Broker• VSO - Voluntary Service Overseas• WECF – Women in Europe for a
Common Future• Wemos Foundation• Woord en Daad• Worldconnectors
Amsterdam, The Netherlands www.kit.nl
Search4Dev: current status
• 32 participating NGOs
• 2.300 titles
• About 1.000 titles added per year
• Full set of metadata added
• Storage format standardized
Amsterdam, The Netherlands www.kit.nl
Search4Dev: current status
• Usage still low . . . but growing
• Substantial usage from outside the Netherlands
• Growing number of harvesterso BASE – Bielefeld Academic Search Engineo Connecting-Africao NARCISo OAIstero OpenDOAR – Directory of Open Access Repositorieso ROAR – Registry of Open Access Repositories
Amsterdam, The Netherlands www.kit.nl
Search4Dev: lessons learned
• Everybody supports the idea
• . . . but not everybody puts in the effort
• Initial enthusiasm may fade
• Acquisition requires persuasion and persistence
• Crucial to have dedicated contact persons
• Legal agreement must precede publication
Amsterdam, The Netherlands www.kit.nl
Search4Dev: lessons learned
Without a strong partner in the service layer
Search4Dev will not reach its full
potential.
Amsterdam, The Netherlands www.kit.nl
What are the issues
Open Archives Initiative (OAI)
Repositories in Africa
Search4Dev: repository for NL development sector
OAI: a model for development data?
In this presentation . . .
√
√
√
√
Amsterdam, The Netherlands www.kit.nl
WARNING!
This presentation is not about data.
Or is it?
Amsterdam, The Netherlands www.kit.nl
Does the Open Archive Initiative
provide a model for sharing
open development data?
Amsterdam, The Netherlands www.kit.nl
Thank youThank you