6th conference on open access scholarly publishing september 17th – 19th, 2014 kevin dolby...
TRANSCRIPT
![Page 1: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/1.jpg)
6th Conference on Open Access Scholarly PublishingSeptember 17th – 19th, 2014
Kevin DolbyWellcome Trust
OA Publishing Community Standards:Article Level Metrics
A Funder’s perspective
![Page 2: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/2.jpg)
OutlineO The Wellcome Trust -
How we use Article Level Metrics Why they are important to us
Current sources of data (and the problems with them) Initiatives and collaborations changing the landscape
![Page 3: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/3.jpg)
Set up in 1936 under the will of Sir Henry Wellcome.
Our vision is to achieve extraordinary improvements in human and animal health.
Our mission is to support the brightest minds in biomedical research and the medical humanities.
We spend approximately £650 million on research per year.
The Wellcome Trust
![Page 4: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/4.jpg)
Current grant portfolio
![Page 5: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/5.jpg)
Monitoring progress: WT’s key indicatorsOutcomes Key indicators of progress
Discoveries
Applications
Engagement
Research leaders
Research environment
Influence
1. significant advances in the generation of new knowledge2. contribute to discoveries with tangible impacts on health
3. contribute to the development of enabling technologies, products and devices
4. uptake of research into policy and practice5. enhanced level of informed debate in biomedicine6. significant engagement of key audiences & increased reach
7. develop a cadre of research leaders8. evidence of significant career progression among those we
support9. key contributions to the creation, development and maintenance
of major research resources10. contributions to the growth of centres of excellence
11. significant impact on science funding & policy developments12. significant impact on global research priorities and processes
![Page 6: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/6.jpg)
![Page 7: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/7.jpg)
o Cited 2904 times; o Normalised
Citation Impact = 327;
o Acta Crystal D JIF = 7.232
Article level metrics vs. Journal level metrics
![Page 8: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/8.jpg)
Alternative metrics – beyond citations
![Page 9: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/9.jpg)
MEP
Centre for Bioethics
MEP
Professor of EBM
Journal editor
Health journalist
NGO
Health, Population & Nutrition @ The World
Bank
Engagement and Influence
![Page 10: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/10.jpg)
Monitoring progress: WT’s key indicatorsOutcomes Key indicators of progress
Discoveries
Applications
Engagement
Research leaders
Research environment
Influence
1. significant advances in the generation of new knowledge2. contribute to discoveries with tangible impacts on health
3. contribute to the development of enabling technologies, products and devices
4. uptake of research into policy and practice5. enhanced level of informed debate in biomedicine6. significant engagement of key audiences & increased reach
7. develop a cadre of research leaders8. evidence of significant career progression among those we
support9. key contributions to the creation, development and maintenance
of major research resources10. contributions to the growth of centres of excellence
11. significant impact on science funding & policy developments12. significant impact on global research priorities and processes
![Page 11: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/11.jpg)
Sources of data
We need article-level data which is consistent in its source and meaning in order to enable sensible comparisons between outputs of different schemes
Differences between publisher-provided data mean that, primarily, we use third-party data providers:
Thomson Reuters Web of Knowledge Altmetric
![Page 12: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/12.jpg)
Citation data
![Page 13: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/13.jpg)
Differences in citation data
![Page 14: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/14.jpg)
Source Number of citations
Scopus 76Web of Science 64Google Scholar 103CrossRef 56PMC 44EuropePMC 66
For a sample of 358 Wellcome-associated papers, on average:o WoS had 10 cites per papero Scopus 12 cites per papero Google Scholar 18 cites per paper
Differences in citation data
![Page 15: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/15.jpg)
![Page 16: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/16.jpg)
![Page 17: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/17.jpg)
![Page 18: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/18.jpg)
NISO Altmetrics project
Aim to “undertake a two-phase initiative to explore, identify, and advance standards and/or best practices related to a new suite of potential metrics in the community”
First meeting in October 2013 The first phase identified areas for potential
standardization; a consultation period has sought to prioritise these areas; phase two will advance and develop these standards.
Final report due in November 2015
![Page 19: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/19.jpg)
Shared sources – the ALM app
![Page 20: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/20.jpg)
CrossRef DOI Event Tracker (DET) Pilot
Pilot group of publishers and potential users of this data Aim is to test the feasibility of developing and running an
industry -scale infrastructure to track, store and propagate DOI- related “events”.
These “events” may be come from a wide range of sources including:
scholarly publications professional or grey literature scholarly tools mainstream media social media.
![Page 21: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/21.jpg)
CrossRef DOI Event Tracker (DET) Pilot
Looking to establish that it’s possible (and important) to separate out the infrastructure needed for tracking common information about the events from the value–added services (e.g. analysis and visualization)
So there will be the basic data available for all, with potential “premium” services on top.
More to follow…
![Page 22: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/22.jpg)
Key points If ALM data is to be useful we have to understand where
it comes from and what it means Consistency would be good, transparency even more
important Availability is vital
![Page 23: 6th Conference on Open Access Scholarly Publishing September 17th – 19th, 2014 Kevin Dolby Wellcome Trust OA Publishing Community Standards: Article Level](https://reader038.vdocuments.mx/reader038/viewer/2022110206/56649d0d5503460f949e2b9b/html5/thumbnails/23.jpg)
thank you
6th Conference on Open Access Scholarly PublishingSeptember 17th – 19th, 2014