DISCOVERY AND LIBRARY MANAGEMENT SYSTEMS

Marshall BreedingIndependent Consult, Author, Founder and Publisher, Library Technology Guideshttp://www.librarytechnology.org/http://twitter.com/mbreeding

19 June 2013 HKU Library Leadership Institute

Challenge: More integrated approach to information and service delivery Library Web sites offer a menu of unconnected silos:

Books: Library OPAC (ILS online catalog module) Search the Web site Articles: Aggregated content products, e-journal collections OpenURL linking services E-journal finding aids (Often managed by link resolver) Subject guides (e.g. Springshare LibGuides) Local digital collections

ETDs, photos, rich media collections Metasearch engines Discovery Services – often just another choice among many

All searched separately

Online Catalog

Books, Journals, and Media at the Title Level

Not in scope: Articles Book Chapters Digital objects Web site content Etc.

Scope of SearchSearch:

Search Results

ILS Data

Next-gen Catalogs or Discovery Interface (2002-2009) Single search box Query tools

Did you mean Type-ahead

Relevance ranked results (for some content sources)

Faceted navigation Enhanced visual displays

Cover art Summaries, reviews,

Recommendation services

Discovery Interface search modelSearch: Digital

Collections

ProQuest

EBSCOhost

…MLA

Bibliography

ABC-CLIO

Search Results

Real-time query and responses

ILS Data

Local Index

Metasearch Engine

Discovery Products

http://www.librarytechnology.org/discovery.pl

Differentiation in Discovery Products increasingly specialized

between public and academic libraries Public libraries: emphasis on engagement

with physical collection + e-books Academic libraries: concern for discovery of

heterogeneous material types, especially books + articles + digital objects

Discovery from Local to Web-scale Initial products focused on technology

AquaBrowser, Endeca, Primo, Encore, VuFind, LIBERO Uno, Civica Sorcer, Axiell Arena Mostly locally-installed software

Current phase is focused on pre-populated indexes that aim to deliver Web-scale discovery Primo Central (Ex Libris) Summon (Serials Solutions) WorldCat Local (OCLC) EBSCO Discovery Service (EBSCO) Encore Synergy (no index, though)

Public Library Information PortalSearch:

Digital Collections

Web Site ContentCommunit

yInformatio

n

…Customer-providedcontent

Reference Sources

Search Results

Pre-built harvesting and indexing

Consolidated Index

ILS Data

Aggregated Content packages

Archives

Usage-generate

dData

Customer

Profile

Web-scale Index-based DiscoverySearch:

Digital Collections

Web Site Content

Institutional

Repositories

…E-Journals

Reference Sources

Search Results

Pre-built harvesting and indexing

Consolidated Index

ILS Data

Aggregated Content packages

(2009- present)

Usage-generate

dData

Customer

Profile

Open Access

Web-scale Search ProblemSearch:

Search Results

Pre-built harvesting and indexing

Consolidated Index

???

Non Participating

Content Sources

Problem in how to deal with resources not provided to ingest into consolidated index

Digital Collections

Web Site ContentInstitution

al Repositori

es

…E-Journals

ILS Data

Aggregated Content packages

Discovery Service Installations

Discovery Product

2007 2008

2009

2010 2011 2012 Installed

Primo 12 37 53 506 111 101 1151AquaBrowser 55 339 64 69 74 58 254Encore 72 72 109 56 72 365LS2 PAC   46 77 58 88 73 305Summon     50 164 214 158 504Enterprise   16  75 100 102 328Civica Sorcer     7 12 22 3 42Axiell Arena     61 57 33 76Chamo     10 34 7 23 86

Web-scale Search ProblemSearch:

Search Results

Pre-built harvesting and indexing

Consolidated Index

???

Non Participating

Content SourcesProblem in how to deal with

resources not provided to ingest into consolidated index

Digital Collections

Web Site ContentInstitution

al Repositori

es

…E-Journals

ILS Data

Aggregated Content packages

Challenge for Relevancy Technically feasible to index hundreds of

millions or billions of records through Lucene or SOLR

Difficult to order records in ways that make sense

Many fairly equivalent candidates returned for any given query

Must rely on use-based and social factors to improve relevancy rankings

Evaluating Index-based Discovery Services Intense competition: how well the index covers the

body of scholarly content stands as a key differentiator

Difficult to evaluate based on numbers of items indexed alone.

Important to ascertain now your library’s content packages are represented by the discovery service.

Important to know what items are indexed by citation and which are full text

Important to know whether the discovery service favors the content of any given publisher

Open Discovery Initiative NISO Work Group to Develop Standards

and Recommended Practices for Library Discovery Services Based on Indexed Search

Informal meeting called at ALA Annual 2011

Co-Chaired by Marshall Breeding and Jenny Walker

Term: Dec 2011 – May 2013

Balance of ConstituentsLibraries

Publishers

Service Providers

17

Marshall Breeding, Vanderbilt UniversityJamene Brooks-Kieffer, Kansas State University Laura Morse, Harvard UniversityKen Varnum, University of Michigan

Sara Brownmiller, University of OregonLucy Harrison, College Center for Library Automation (D2D liaison/observer)Michele Newberry

Lettie Conrad, SAGE PublicationsBeth LaPensee, ITHAKA/JSTOR/PorticoJeff Lang, Thomson Reuters

Linda Beebe, American Psychological Assoc

Aaron Wood, Alexander Street Press

Jenny Walker, Ex Libris GroupJohn Law, Serials SolutionsMichael Gorrell, EBSCO Information Services

David Lindahl, University of Rochester (XC)Jeff Penka, OCLC (D2D liaison/observer)

Integrating e-Books into Library Automation Infrastructure

Current approach involves mostly outsourced arrangements

Collections licensed wholesale from single provider

Hand-off to DRM and delivery systems of providers

Loading of MARC records into local catalog with linking mechanisms

No ability to see availability status of e-books from the library’s online catalog or discovery interface

2013: The current state of discovery

Online Catalogs of ILS modules in decline Increasing numbers of academic libraries offer

discovery services Index-based search emerges

Summon, Primo/Primo Central, EBSCO Discovery Service, WorldCat Local

Indexes growing in comprehensiveness and depth. Relevancy algorithms gaining sophistication Increasing numbers of publishers and providers

cooperate with library discovery services Open Discovery Initiative launched October 2011

New-generation Library Management

Fragmented Library Management LMS for management of (mostly) print Duplicative financial systems between library and local

government or other parent organization E-book lending platform (multiple?) Interlibrary loan (borrowing and lending) Self-service and AMH infrastructure Electronic Resource Management PC Scheduling and print management Event scheduling Digital Collections Management platforms (CONTENTdm, DigiTool,

etc.) Discovery-layer services for broader access to library collections No effective integration services / interoperability among

disconnected systems, non-aligned metadata schemes

Is the status quo sustainable? ILS for management of (mostly) print Duplicative financial systems between library and campus Electronic Resource Management (non-integrated with ILS) OpenURL Link Resolver w/ knowledge base for access to

full-text electronic articles Digital Collections Management platforms (CONTENTdm,

DigiTool, etc.) Institutional Repositories (DSpace, Fedora, etc.) Discovery-layer services for broader access to library

collections No effective integration services / interoperability among

disconnected systems, non-aligned metadata schemes

Integrated (for print) Library System

Circulation

BIB

Staff Interfaces:

Holding / Items

CircTransact User Vendor Policies$$$

Funds

Cataloging Acquisitions Serials OnlineCatalog

Public Interfaces:

Interfaces

BusinessLogic

DataStores

LMS / ERM: Fragmented Model

Circulation

BIB

Staff Interfaces:

Holding / Items

CircTransactUserVendor Policies$$$

Funds

CatalogingAcquisitionsSerials OnlineCatalog

Public Interfaces:

Application Programming Interfaces`

LicenseManagement

LicenseTerms

E-resourceProcurement

VendorsE-JournalTitles

Protocols: CORE

Common approach for ERM

Circulation

BIB

Staff Interfaces:

Holding / Items

CircTransactUserVendor Policies$$$

Funds

CatalogingAcquisitionsSerials OnlineCatalog

Public Interfaces:

Application Programming Interfaces

Budget License Terms

Titles / Holdings

Vendors

Access Details

Gaps in Automation Almost no systematic automation

support for references and research services Customer Relationship Management?

Resource sharing / Interlibrary loan management

Collection development support

Comprehensive Resource Management No longer sensible to use different software

platforms for managing different types of library materials

ILS + ERM + OpenURL Resolver + Digital Asset management, etc. very inefficient model

Flexible platform capable of managing multiple type of library materials, multiple metadata formats, with appropriate workflows

Support for management of metadata in bulk Continuous lifecycle chain initiated before

publication

Academic Libraries need a new model of library management

Not an Integrated Library System or Library Management System

The ILS/LMS was designed to help libraries manage print collections

Generally did not evolve to manage electronic collections

Other library automation products evolved: Electronic Resource Management Systems –

OpenURL Link Resolvers – Digital Library Management Systems -- Institutional Repositories

Library Services Platform Library-specific software. Designed to help libraries

automate their internal operations, manage collections, fulfillment requests, and deliver services

Services Service oriented architecture Exposes Web services and other API’s Facilitates the services libraries offer to their users

Platform General infrastructure for library automation Consistent with the concept of Platform as a Service Library programmers address the APIs of the platform to

extend functionality, create connections with other systems, dynamically interact with data

Library Services Platform Characteristics

Highly Shared data models Knowledgebase architecture Some may take hybrid approach to accommodate local

data stores Delivered through software as a service

Multi-tenant Unified workflows across formats and media Flexible metadata management

MARC – Dublin Core – VRA – MODS – ONIX Bibframe New structures not yet invented

Open APIs for extensibility and interoperability

Library Services PlatformsCategory WorldShare

Management Services

Alma Intota Sierra Services Platform

Kuali OLE

Responsible Organization

OCLC. Ex Libris Serials Solutions

Innovative Interfaces, Inc

Kuali Foundation

Key precepts Global network-level approach to management and discovery based on central data: stores WorldCat + holdings + Items

Consolidate workflows, unified management: print, electronic, digital; Hybrid data model

Knowledgebase driven. Pure multi-tenant SaaS

Service-oriented architectureTechnology uplift for Millennium ILS. More open source components, consolidated modules and workflows

Manage library resources in a format agnostic approach. Integration into the broader academic enterprise infrastructure

Software model

Proprietary Proprietary

Proprietary Proprietary Open Source

Library Services PlatformsCategory WorldShare

Management Services

Alma Intota Sierra Services Platform

Kuali OLE

Status In Production:100+ libraries

In production

In Development:

In production: 150+ libraries. (Mostly Millennium migrations)

In Development. Some early adopting partners expect production in 2013 (2014?)

Discovery? Designed for WorldCat Local, Partnership with EDS as alternative

Designed for Primo / Primo Central, APIs for others

Designed for Summon, APIs for other

Designed for Encore, EDS for Discovery Index

No Discovery: APIs available. Initial partners will use Blacklight, Summon, etc.

Development Resources (2011)Company Dev Sup Sales Admin Other Total

Ex Libris 170 231 54 44 13 512Follett Software Company 87 143 86 49 0 365Innovative Interfaces, Inc. 83 158 43 24 3 311SirsiDynix Corporation 84 166 51 23 56 380Serials Solutions 80 50 46 4 57 237Axiell 57 66 34 35 34 226The Library Corporation 39 91 28 13 28 199Polaris Library Systems 27 42 15 2   86VTLS Inc. 24 48 12 8 18 110KohaByWater Solutions 3 12 3 3 1 13Catalyst IT 3         BibLibre 4 3       Koha Total (estimated) 15PTFS 5 16 8 8   155EvergreenEquinox Software 6 5 2 3 5 21

Open Systems Achieving openness has risen as the key

driver behind library technology strategies Libraries need to do more with their data Ability to improve customer experience and

operational efficiencies Demand for Interoperability Open source – full access to internal

program of the application Open API’s – expose programmatic

interfaces to data and functionality

Open Source Integrated Library Systems

Major thread in library systems development Koha Evergreen Kuali OLE

Consolidated indexUnified Presentation LayerSearch:

Digital Coll

ProQuest

EBSCO…

JSTOR

Other Resour

ces

New Library Management Model

`API Layer

Library Services Platform

LearningManageme

nt

Enterprise ResourcePlanning

StockManageme

nt

Self-Check /

Automated Return

Authentication

Service

Smart Cad /

Payment systems

Discovery

Service

Development / Deployment perspective

Beginning of a new cycle of transition Over the course of the next decade,

academic libraries will replace their current legacy products with new platforms

Not just a change of technology but a substantial change in the ways that libraries manage their resources and deliver their services

Eventual product consolidation Alma for resource management

Eventual transition of Voyager and Aleph Immediate transition of Verde SFX DigiTool for digital collections

Primo / Primo Central for Discovery Rosetta for Preservation

Possible integration into Alma?

Progressive consolidation of library services

Centralization of technical infrastructure of multiple libraries within a campus

Resource sharing support Direct borrowing among partner institutions

Shared infrastructure between institutions Examples: 2CUL (Columbia University /

Cornell University) Orbis Cascade Alliance (37 independent

colleges and universities to merge into shared LSP)

Traditional Proprietary Commercial ILS Aleph, Voyager, Millennium, Symphony, Polaris, BOOK-IT, DDELibra, Libra.se LIBERO, Amlib, Spydus, TOTALS II, Talis Alto, OpenGalaxy

Traditional Open Source ILS Evergreen, Koha

New generation Library Services Platforms Ex Libris Alma Kuali OLE (Enterprise, not cloud) OCLC WorldShare Management Services, Serials Solutions Intota Innovative Interfaces Sierra (evolving)

Competing Models of Library Automation

Convergence Discovery and Management solutions will

increasingly be implemented as matched sets Ex Libris: Primo / Alma Serials Solutions: Summon / Intota OCLC: WorldCat Local / WorldShare Platform Except: Kuali OLE, EBSCO Discovery Service

Both depend on an ecosystem of interrelated knowledge bases

API’s exposed to mix and match, but efficiencies and synergies are lost

Leveraging the Cloud Moving legacy systems to hosted

services provides some savings to individual institutions but does not result in dramatic transformation

Globally shared data and metadata models have the potential to achieve new levels of operational efficiencies and more powerful discovery and automation scenarios that improve the position of libraries overall.