AUTHOR IDENTIFIERS & RESEARCH IMPACT:A ROLE FOR LIBRARIESKristi Holmes, PhD Becker Medical Library

Washington University ICTS

VIVO

ORCID: 0000-0001-8420-5254

ALA Midwinter

January 26, 2014

New Possibilities in Evaluation Metrics:

Authors + Altmetrics = ?

So many great library-based projects

Projects that depend on good identifiers

• Research impact• Library-based services,

reports, analyses

• Research networking and discovery, research information systems • Identity management, data

acquisition and processing, analyses and visualizations, liaison-type services

Tools in our toolbox

• ORCID iDs• Students and postdocs,

research groups, others on campus

• Scopus & other data sources

• Analysis and visualization software (Sci2, etc.)

Leverage the skills, resources, strengths, and expertise of the library

Research Impact

Services• Reports from many sources• Analyses (pub data and more)• Visualizations • Other support services,

workshops

Why do we need to think about research impact?

• Quantify and document research impact

• Justify future requests for funding

• Quantify return on research investment

• Discover how research findings are being used

• Identify similar research projects• Identify possible collaborators• Determine if research findings

are duplicated, confirmed, corrected, improved or repudiated

• Determine if research findings were extended (different human populations, different animal models/species, etc.)

• Confirm that research findings were properly attributed/credited

• Demonstrate that research findings are resulting in meaningful health outcomes

• Discover community benefit as a result of research findings

• Progress reports• Tenure• Promotion dossiers

https://becker.wustl.edu/impact-assessment/model

Research Impact

Wells R, Whitworth A. 2007. Assessing outcomes of health and medical research: do we measure

what counts or count what we can measure? Australia and New Zealand Health Policy, 4:14

“It is no longer enough to measure what we can – we need to measure what

matters.”

How do we measure what matters?

https://becker.wustl.edu/impact-assessment

Leveraging the Becker Model

• Would like to scale the Becker Model for use by others.

• Adaptations in disciplines such as agriculture, archeology, nanotechnology, and more

The Becker Model• Provides a supplement to publication analysis to provide a

more robust and comprehensive perspective of biomedical research impact.• reporting templates, glossary of resources and terms, examples of

relevant indicators of impact across the research process, and readings

• Straightforward framework for tracking diffusion of research outputs and activities to locate indicators that demonstrate evidence of biomedical research impact• individual, core, and institutional-level; modify for different disciplines

• Guidance for quantifying and documenting research impact as well as resources for locating evidence of impact.

• Strategies for enhancing the impact of research• Preparing for Publication, Dissemination, and Keeping Track of Your Research.

Meaningful impact• New diagnostic criteria• New standard of care• Curriculum guidelines• Measurement instruments• Continuing education materials• Clinical/practice guidelines• Quality measure guidelines• Private healthcare benefit

plans• Cost-effective intervention• Consensus development

conferences American Medical Association Current Procedural Terminology (CPT) codes

• Change in delivery of healthcare services

Likely familiar…

• Reviews• New funding awarded• New research studies• Invited lectures, new focus

areas at conferences• Membership on

committees• Awards

PathwaysAdvancement of

KnowledgeClinical ImplementationLegislation and Policy

Enactment Economic BenefitCommunity Benefit

Ok…so what do we DO with this? How can we continue to make use of this information?

(we don’t want it getting lost in a pile of paper on somebody’s desk) ;)

Research networking and discovery, Research information systems

• Showcase achievements and expertise• Facilitate diffusion of research products• Better understanding of the research enterprise• Peer comparisons• Strategic planning• …and so on

• Many products (VIVO, SciVal Experts, Profiles, etc.)

What is VIVO?

1. An open source semantic web application

2. An information model

3. An open community*

* A big, welcoming OS community! Let us know if you have questions or need information, connections, or materials: http://vivoweb.org/contact

VIVOAn open-source semantic web application that enables the discovery of research and scholarship across disciplines in an institution.

VIVO harvests data from verified sources and offers detailed profiles of faculty and researchers.

Public, structured linked data about investigators interests, activities and accomplishments, and tools to use that data to advance science.

VIVO enjoys a robust open community space to support implementation, adoption, & development efforts around the world. See http://wiki.duraspace.org/display/VIVO

VIVO and DuraSpace

• VIVO’s ontology as an information model• ORCID identifiers have been part of the VIVO ontology since the very early

days of ORCID• ISF ontology to include research resources – also contributions!• Ontology extensions around impact are in progress• Linked Data for Libraries to Cornell, Stanford, and Harvard

• By May, as part of the recently awarded Sloan Foundation funds, bi-directional data exchange with ORCID will be in place.• VIVO projects – and also other RN platforms, repositories, etc.

• These efforts will allow everybody (individuals AND institutions!) a way to better tie meaningful scholarly contributions to individuals.

• WCMC (and others) are leveraging Scopus data in their local VIVO; informs compliance, strategic decision making and reporting activities.

VIVO and Science of Team Science conferences are co-located this August in Austin, TX!

AcknowledgementsCollaborators:• Cathy Sarli, MLS, AHIP • Washington University ICTS• Becker Medical Library

Questions/Follow-up:• holmeskr@wustl.edu • @kristiholmes

Funding:• Washington University Institute of Clinical and

Translational Sciences, NIH award UL1 RR024992

• VIVO - DuraSpace