bringing consistency to digital resource evaluation
TRANSCRIPT
Bringing Consistency to Digital Resource Evaluation
Paula Weaver, Digital Services Librarian Clifton Park-Halfmoon Public Library SMART Flash Talk Oct. 2015
Agenda
Issues
Goal
Tool & Process
Future Improvements
Q & A
Issues
No standard review process
Decisions based on subjective review
Lack of documentation on decisions
Growing # of potential resources
Increasing $ for existing resources
Goal
Create a means to consistently review and evaluate digital resources to support selection decisions
Tool & Process
Developed survey for resource evaluation
Broken down into five steps
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Determine Criteria
Reviewed and selected criteria
Library requirements
Key Issues for E-Resource Collection Development Guide published by IFLA
Evaluation Criteria For Electronic Resources by Rutgers University Libraries
E-Resources Collection Development Policy - December 2014 Revision by Columbia College Chicago Library
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Create Survey
Grouped into 6 categories
Content
Search
Documentation
Cost
Vendor Support
Technical Considerations
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Digital Services o 27 questions
all librarians o 55 questions
Create Survey
Created in Word originally
Converted to SurveyMonkey
Ease of use and re-use
Results summarized for easier analysis and decision making
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Create Survey
Modified open-ended questions to specific options and comments
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Create Survey
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Establish Process
Create copy of survey for each evaluation
Three or more librarians review resource and complete survey
Appropriate department and Digital Services
Analyze survey responses and make decision
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Implement
Reviewed with librarians
Started use in May 2015
Results exported and saved
Feedback incorporated
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Maintain Survey
Continuous process
Updated questions
o New/changed criteria
o Modified options
Added logic to skip questions
Determine Criteria
Create Survey
Establish Process
Implement Maintain
Survey
1 2 3 4 5
Future Improvements
Continue making updates
Incorporate quantitative aspect to simplify evaluation decision
Make less “database-ish” and relevant for wider variety of digital resources
Questions
Resources
Key Issues for e-Resource Collection Development: A Guide for Libraries Sharon Johnson, with Ole Gunnar Evensen, Julia Gelfand, Glenda Lammers,
Lynn Sipe and Nadia Zilper
Publisher: IFLA Acquisition & Collection Development Section
http://www.ifla.org/publications/key-issues-for-e-resource-collection-development-a-guide-for-libraries?og=55
Evaluation Criteria For Electronic Resources Susan J. Beck, Rutgers University Libraries
http://www.libraries.rutgers.edu/rul/staff/collection_dev/reports/eval_criteria_e-resources.shtml
E-Resources Collection Development Policy - December 2014 Revision Columbia College Chicago Library
http://library.colum.edu/about/policies/e-resources-collection-development-policy.html