e-book usage statistics data collection & assessment maryland library association technical...
TRANSCRIPT
E-Book Usage StatisticsData Collection & Assessment
Maryland Library Association Technical Service Division E-Resources Boot Camp
August 4, 2014
Randy Lowe – Collection Development, Acquisition & Serials Librarian, Frostburg State University
OverviewWhy E-Resources (E-Book)
Assessment?Usage Statistics – Characteristics,
Reports, Data Elements, Collection
Assessment – Applying usage statistics to collection management decision-making
Why E-Resource Assessment?Libraries have historically measured use of
services (circulation statistics, re-shelving counts, gate counts, etc.)
The technology upon which e-resources reside inherently allows for extensive collection of usage data – and assessment of that use
Assessment of use data supports evidence-based collection management
Libraries operate in a challenging fiscal environment – demonstrating e-resource value and fiscal responsibility is a must
Effective E-Resources AssessmentTwo essential elements in
conducting effective e-resource assessments:◦Efficient and Accurate Data
Collection◦Clear and Succinct Analysis
E-Resource assessment is more than just collecting usage statistics – it is applying them in the making of sound management decisions regarding library resources
E-Resource Usage Statistics – CharacteristicsStatistics usually available at platform,
package and title levelsUseful measures include Sessions,
Searches, Accesses, Linking data (sources & targets)
Usage statistics measure number of times resources are used, but also can be extremely useful in identifying user behavior trends
Focus here will be e-books, but basic concepts apply to all e-resource types
What Can You Do with Usage Statistics?Track usage / Assess overall collection useTrack expenditures / Figure cost-per-useTrack turnawaysAssess title, subject, publisher and other
usage elementsAssist in making collection development
decisions, including acquisition model selection
Effectively advocate for resources – especially if assessment is tied to institutional goals/strategic plan
Types of Usage Statistics ReportsYou can only work with the data that is provided to youVendor-Defined
◦ Range widely, depending on the vendor◦ Some vendors provide great detail in one or two
reports, which can be very useful in assessing various use elements [Example 1] [Example 2]
◦ Other vendors provide basic reports only [Example]◦ Useful when assessing data from a single vendor◦ Financial transaction/cost information obtained
through these reports◦ Usage comparison across vendors may be
problematic
Types of Usage Statistics ReportsCOUNTER-Compliant
◦Project COUNTER (http://www.projectcounter.org) – Establishes standards and protocols for consistent, credible and comparable vendor-generated usage statistics
◦Especially useful when collecting and analyzing e-resource statistics across vendors
◦Vendor diligence and application varies
◦Does not include cost data
Types of Usage Statistics ReportsCOUNTER-Compliant (continued)
◦COUNTER Reports for E-Books (Release 4 – http://www.projectcounter.org/r4/COPR4.pdf) Book Report 1 – Number of Successful Title
Requests by Month & Title [Example] – Useful for tracking individual and aggregate e-book use; a book is a single file on vendor platform
Book Report 2 – Number of Successful Section Requests by Month & Title [Example] – Useful for tracking section/chapter use, especially for reference and edited works; book sections comprise the files on vendor platform
Types of Usage Statistics ReportsCOUNTER-Compliant (continued)
◦COUNTER Reports for E-Books (Release 4 – http://www.projectcounter.org/r4/COPR4.pdf) Book Report 3 – Access Denied to Content Items
by Month, Title & Category [Example] – Turnaways at the title level; helpful in assessing acquisition model/simultaneous user limits/needed copies
Book Report 4 – Access Denied to Content Items by Month, Platform & Category –Turnaways at the platform level
Book Report 5 – Total Searches by Month & Title – Total searches and sessions at the title level
When to Use Various Usage ReportsVendor-Defined
◦Analyzing usage data from a single vendor◦Obtaining cost information◦Comprehensive data files make it easy to
analyze combinations of various data elements [Example]
COUNTER-Compliant◦Analyzing usage data across multiple
vendors◦Ensuring data integrity though adherence
to recognized standards
Data Elements Common to E-Book Assessment
Primary Elements (Examples)◦Title◦Publisher◦Cost/Expenditures◦Transaction type (purchase or short-term
loan/rental)◦Subject, LCC, Dewey (if available)
Situational Elements (Examples)◦Campus or Library (consortial, library
system)◦User/User Type (if ID is established –
Example)
Collecting Usage DataDefine Objectives
◦What you need to know or are trying to find out should drive your data collection decisions
◦Collecting Usage Statistics can be a major time commitment Use your assessment objectives to help you to
not only determine what data to collect, but when you have collected enough data to analyze
Properly balancing time and resources dedicated to both data collection and analysis is vital
Collecting Usage DataManual CollectionAutomated Collection Harvesting
Tools◦SUSHI (Standardized Usage Statistics
Harvesting Initiative) – http://www.niso.org/workrooms/sushi/
◦Next generation ILS toolsThird-party Usage Collection
Collecting Usage DataVarious vendors present data differently – this
can present a challenge not only across vendors, but even with combining data elements from a single vendor
Manipulation / Formatting of raw data will likely be necessary
Schedule time(s) to collect data – vendors’ archival policies for maintaining usage statistics vary
Example – COUNTER BR1 Report + Acquisition Type Data + Cost Data Compiled Manually = Data for Assessment
Assessing Usage Data
You have usage data – What do you do with it?It is easy to get overwhelmed in
usage data – analysis should be guided by your assessment objectives◦What do you want/need to assess?◦What questions are you trying to
answer?◦Who is your audience?
Assessing Usage DataE-Book Assessment Objective Examples
◦ Frostburg State University: Report overall use and expenditures of e-books over time; implement the most cost effective DDA acquisition model(s)
◦ USMAI Consortial E-Book Pilot: Assess the effectiveness of a specific DDA acquisition model for the consortium; use and expenditures by consortium members and user types; identification of possible future program funding models
There is no single method for assessing usage statistics in every case – the “right data” to analyze and include in your report is that which will support your assessment objectives
Usage Data AnalysisData analysis should be thorough,
but presented succinctlyConclusions, trends, etc. should be
clear and verifiableBeware of pre-conceived notions,
perceptions or opinions – hypotheses can be both proven and refuted
State known limitations of the data you have collected and how they may affect your analysis
Writing Your ReportKnow your audienceInclude a brief
purpose/introductionWrite clearly and succinctlyReported usage data should
support the purpose of the assessment◦Only include data that supports your
stated objectives – don’t include all collected data; it won’t be read by administrators
Writing Your ReportReported usage data should support the
purpose of the assessment (continued)◦ Include data within the text of your report where
it is necessary and provides clear evidence for the points you are making
◦ It is usually more effective to include visual representations of (charts, graphs) rather than just figures within the text of reports
◦Larger tables and data sets, if necessary to include, are best placed in appendices
Conclusions and recommendations should be easily identified and based on the evidence presented
E-Book Usage Assessment Examples
◦Frostburg State University: Objective - Report overall use and expenditures of e-books; implement the most cost effective DDA acquisition model(s) [Report]
◦USMAI Consortial E-Book Pilot: Objective - Assess the effectiveness of a specific DDA acquisition model for the consortium; use and expenditures by consortium members and user types; identification of possible future program funding models
◦[Report]
Other ExamplesExamples of reports from many college
and university libraries as well as library systems, consortia and organizations may be found via a quick Internet Search.
One of my favorite E-Book usage studies is:◦Fischer, K., Wright, M., Clatanoff, K., Barton,
H., & Shreeves, E. (2012). Give 'Em What They Want: A One-Year Study of Unmediated Patron-Driven Acquisition of e-Books. College & Research Libraries, 73(5), 469-492. http://crl.acrl.org/content/73/5/469
