new systems for measuring research impact

Upload: nader-ale-ebrahim

Post on 06-Jul-2018

213 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/17/2019 New Systems for Measuring Research Impact

    1/67

    New systems formeasuring research

    impact

    [email protected]

    @aleebrahim

    www.researcherid.com/rid/C-2414-2009 

    http://scholar.google.com/citations 

    Nader Ale Ebrahim, PhDVisiting Research Fellow

    Research Support Unit

    Centre for Research Services

    Research Management & Innovation Complex

    University of Malaya, Kuala Lumpur, Malaysia

    11th May 2016

    http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://aleebrahim.com/https://twitter.com/aleebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    2/67

    3rd SERIES OF INTRODUCTORY WORKSHOP ON:

    Strategies to Enhance Research

    Visibility, Impact & Citations 

    Nader Ale Ebrahim, PhD=====================================

    Research Support Unit

    Centre for Research Services

    Research Management & Innovation Complex

    University of Malaya, Kuala Lumpur, Malaysiawww.researcherid.com/rid/C-2414-2009  

    http://scholar.google.com/citations  

     All of my presentations are available online at:

    https://figshare.com/authors/Nader_Ale_Ebrahim/100797 

    Link to this presentation: https://dx.doi.org/10.6084/m9.figshare.3364240.v1 

    Read more:

    1. Ale Ebrahim, N., Salehi, H., Embi, M. A., Habibi Tanha, F., Gholizadeh, H., Motahar, S. M., & Ordi, A. (2013). Effective

    Strategies for Increasing Citation Frequency. International Education Studies, 6(11), 93-99. doi: 10.5539/ies.v6n11p93

    2. Ale Ebrahim, Nader. "Optimize Your Article for Search Engine." University of Malaya Research Bulletin 2.1 (2014): 38-39.

    http://www.researcherid.com/rid/C-2414-2009http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttps://figshare.com/authors/Nader_Ale_Ebrahim/100797https://dx.doi.org/10.6084/m9.figshare.3364240.v1http://ssrn.com/abstract=2344585http://ssrn.com/abstract=2344585http://ssrn.com/abstract=2588209http://ssrn.com/abstract=2588209http://ssrn.com/abstract=2588209http://ssrn.com/abstract=2588209http://ssrn.com/abstract=2344585http://ssrn.com/abstract=2344585https://dx.doi.org/10.6084/m9.figshare.3364240.v1https://dx.doi.org/10.6084/m9.figshare.3364240.v1https://figshare.com/authors/Nader_Ale_Ebrahim/100797https://figshare.com/authors/Nader_Ale_Ebrahim/100797http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009

  • 8/17/2019 New Systems for Measuring Research Impact

    3/67

     Abstract

    Abstract: The reach of a publication can no longer be judged exclusively

    by the number of times it is cited. Because, we are now in the digital and

    sharing information age, academic conversations are as likely to be found

    on various academic social networks. So, we need new tools to measure

    the research impact. Altmetrics are new metrics proposed as alternatives

    to Impact Factor for journals and personal citation indexes like h-index. Altmetrics attempts to use the online activity to measure impact, buzz,

    word of mouth for scientific information and it includes new ways to

    measure usage at the citation level. In this workshop, I will explain about

    the application of "alternative metrics"  tools such as: Altmetric.com,

    Impactstory.org, Plumanalytics.com, and PLoS metrics.

    Keywords:  Altmetric, H-index, Improve citations, Research tools,

    Bibliometrics, Research Visibility

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    4/67

    Research Tools Mind Map

    ©2016-2017 Nader Ale Ebrahim

    http://www.mindmeister.com/39583892/research-tools-by-nader-ale-ebrahimhttp://www.mindmeister.com/39583892/research-tools-by-nader-ale-ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    5/67

    Research Tools Mind Map -> h-index ->

    Other Meters

    ©2016-2017 Nader Ale Ebrahim

    https://www.mindmeister.com/39583892/research-tools-by-nader-ale-ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    6/67

    ©2016-2017 Nader Ale Ebrahim

    http://www.american.edu/library/news/altmetrics-borchard.cfm

  • 8/17/2019 New Systems for Measuring Research Impact

    7/67

    Altmetrics

    Webometrics

    Cybermetrics

    Bibliometrics

    Scientometrics

    Informetrics

    Science of

    Science

    Bibliographies – 

    largely

    references

     Alternativemetrics – views,

    downloads, web

    citations, etc

    Web presence,

    visibility and

    impact – links,pages,

    documents

    Whole Internet,

    cyberspace

    Informetrics, scientometrics, bibliometrics,

    webometrics, cybermetrics and altmetrics

    Source: Onyancha, Omwoyo Bosire. "Can informetrics shape biomedical research? A case study of the HIV/AIDS research in sub-Saharan Africa

    1." Inkanyiso: Journal of Humanities and Social Sciences 6.1 (2014): 49-65.

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    8/67

    What it’s like being a researcher  

    I like doingresearch!

     Are you doing anything

    interdisciplinary?

    What were your

    recent publications?

    Where did you

    publish them?

    Is the data

    open too?

    How did you

    pay the APC?

    Where is your

    Research heading?

     Are they Open

     Access?

    Was it wellreceived?

    Did it have any

    impact?

    How many grants have

    you applied for so far?

    How many grant applications

    were successful?

    How are you going to sustain

    your grant income profile?

    Where is your grant

    money?

    What did you do with the

    grant income you received?

    How did you cost your

    overheads?

    Does it have aninternational

    dimension?

    Did it have any

    Impact?

    How many students

    are you teaching?How many students

    are you supervising?

    Did it make a

    spinoff?

    Does it have

    any IMPACT?

    What’s your next

    project? 

    WILL IT HAVE ANYIMPACT? 

    Source: Owen Roberson, Research Information Analyst (2015) Research Information and Analytics at Cambridge: Insight over measurement,Research Information Office, Academic Division

    ©2016-2017 Nader Ale Ebrahim

    http://files.figshare.com/2282721/UCISA___Owen_Roberson.ppthttp://files.figshare.com/2282721/UCISA___Owen_Roberson.ppt

  • 8/17/2019 New Systems for Measuring Research Impact

    9/67

    ©2016-2017 Nader Ale Ebrahim

    Source: http://altmetrics.org/manifesto/

    http://altmetrics.org/manifesto/http://altmetrics.org/manifesto/http://altmetrics.org/manifesto/http://altmetrics.org/manifesto/

  • 8/17/2019 New Systems for Measuring Research Impact

    10/67

    Problems withcitation-based indicators

    Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku

    Problem 1: Time

    Problem 2: Journals

    Problem 3: Impact

    ©2016-2017 Nader Ale Ebrahim

    http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities

  • 8/17/2019 New Systems for Measuring Research Impact

    11/67

    Science

    IMPACT ON:

    Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim

    http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities

  • 8/17/2019 New Systems for Measuring Research Impact

    12/67

    Science

    Society

    Environment

    Culture

    Economy

    Education

    IMPACT ON:

    Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim

    http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities

  • 8/17/2019 New Systems for Measuring Research Impact

    13/67

    Created byresearchers Created bythe public

    Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim

    Altmetrics

    http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities

  • 8/17/2019 New Systems for Measuring Research Impact

    14/67

    Created byresearchers

    Indicating

    futurescientific

    impact?

    Altmetrics

    Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim

    http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities

  • 8/17/2019 New Systems for Measuring Research Impact

    15/67

    Indicating other

    types of impact,

    such as societal

    impact?

    Created bythe public

    Altmetrics

    Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim

    http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities

  • 8/17/2019 New Systems for Measuring Research Impact

    16/67

    How is the Altmetric score calculated? 

    The score is a weighted count

    The score is derived from

    an automated algorithm, and

    represents a weighted count of

    the amount of attention we've

    picked up for a research output.Why is it weighted? To reflect the

    relative reach of each type of

    source. It's easy to imagine that

    the average newspaper story is

    more likely to bring attention to

    the research output than theaverage tweet. This is reflected

    in the default weightings:

    ©2016-2017 Nader Ale Ebrahim

    News  8

    Blogs  5

    Twitter  1

    Facebook  0.25 

    Sina Weibo  1

    Wikipedia  3 

    Policy Documents (per source)  3 

    Q&A  0.25 

    F1000/Publons/Pubpeer  1 

    YouTube  0.25

    Reddit/Pinterest  0.25

    LinkedIn  0.5 

    Source: https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated- 

    https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-

  • 8/17/2019 New Systems for Measuring Research Impact

    17/67

    “Alternative Metrics" Tools

    •  Altmetric.com

    • Impactstory.org

    • Plumanalytics.com• PLoS Article-Level Metrics

    • Usage Count (webofknowledge.com)

    • Bookmetrix (http://www.bookmetrix.com)

    •  Article Metrics in Scopus

    ©2016-2017 Nader Ale Ebrahim

    http://www.bookmetrix.com/http://www.bookmetrix.com/

  • 8/17/2019 New Systems for Measuring Research Impact

    18/67

    Altmetrics 

    •  Altmetrics are new metrics proposed as alternatives to

    Impact Factor for journals and personal citation indexes

    like h-index. The term "article level metrics" was first put

    forward in 2010, but altmetrics (derived from "alternative

    metrics") become prevalent as it better suggested arange of new metrics. Altmetrics can be applied not only

    to articles but also to people, journals, books, data sets,

    web pages, etc. Many aspects of the impact of a work

    (such as article views, downloads, mentions in socialmedia and new services) can be measured, as well as

    traditional citation counts.

    ©2016-2017 Nader Ale Ebrahim

    Source: http://www.swansea.ac.uk/iss/researchsupport/metrics/altmetrics/ 

    http://dx.doi.org/10.1038/495437ahttp://www.swansea.ac.uk/iss/researchsupport/metrics/altmetrics/http://www.swansea.ac.uk/iss/researchsupport/metrics/altmetrics/http://www.swansea.ac.uk/iss/researchsupport/metrics/altmetrics/http://dx.doi.org/10.1038/495437a

  • 8/17/2019 New Systems for Measuring Research Impact

    19/67

    ©2016-2017 Nader Ale Ebrahim

    https://impactstory.org/aleebrahimhttps://impactstory.org/NaderAleEbrahim69325/product/hnby4zk64z09srwq0t0ne5uu

  • 8/17/2019 New Systems for Measuring Research Impact

    20/67

    ©2016-2017 Nader Ale Ebrahim

    https://impactstory.org/NaderAleEbrahim69325/product/hnby4zk64z09srwq0t0ne5uuhttps://impactstory.org/NaderAleEbrahim69325/product/hnby4zk64z09srwq0t0ne5uu

  • 8/17/2019 New Systems for Measuring Research Impact

    21/67

    ©2016-2017 Nader Ale Ebrahim

    https://impactstory.org/u/0000-0001-7091-4439

  • 8/17/2019 New Systems for Measuring Research Impact

    22/67

    ©2016-2017 Nader Ale Ebrahim

    https://plu.mx/u/?orcid=0000-0002-2668-4821

  • 8/17/2019 New Systems for Measuring Research Impact

    23/67

     

    ©2016-2017 Nader Ale Ebrahim

    https://plu.mx/plum/https://plu.mx/plum/https://plu.mx/u/nebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    24/67

    PlumX Metrics

    ©2016-2017 Nader Ale Ebrahim

    http://localhost/var/www/apps/conversion/tmp/scratch_2/Link/PlumX-Suite-Flyer.pdf

  • 8/17/2019 New Systems for Measuring Research Impact

    25/67

    Public Library of Science (PLOS)

     Article-Level Metrics (ALMs)

    ©2016-2017 Nader Ale EbrahimSource: http://www.lagotto.io/plos/

    http://www.lagotto.io/plos/http://www.lagotto.io/plos/http://www.lagotto.io/plos/http://www.lagotto.io/plos/

  • 8/17/2019 New Systems for Measuring Research Impact

    26/67

    Usage Count

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    27/67

    Elsevier journals

    Top downloaded OA articles 

    ©2016-2017 Nader Ale Ebrahim

    http://about.elsevier.com/openaccess/2015/undefined.htmhttp://about.elsevier.com/openaccess/2015/undefined.htmhttp://about.elsevier.com/openaccess/2015/undefined.htmhttp://about.elsevier.com/openaccess/2015/undefined.htmhttp://about.elsevier.com/openaccess/2015/undefined.htm

  • 8/17/2019 New Systems for Measuring Research Impact

    28/67

    Bookmetrix - Springer  

    ©2016-2017 Nader Ale Ebrahim

    http://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrixhttp://www.bookmetrix.com/detail/chapter/a340aec8-a7c3-4405-a8d1-e5cde4b87d3b#downloadshttp://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrixhttp://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrixhttp://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrixhttp://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrix

  • 8/17/2019 New Systems for Measuring Research Impact

    29/67

    Article Metrics in Scopus Effective strategies for increasing citation frequency

    (2013) International Education Studies, 6(11), pp. 93-99

    ©2016-2017 Nader Ale Ebrahim

    http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678

  • 8/17/2019 New Systems for Measuring Research Impact

    30/67

    Article Metrics in Scopus A comparison between two main academic literature collections: Web of science and SCOPUS databases

    (2013) Asian Social Science, 9(5), pp. 18-26

    ©2016-2017 Nader Ale Ebrahim

    http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-84876995338&origin=recordpagehttp://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678

  • 8/17/2019 New Systems for Measuring Research Impact

    31/67

    Introduction to

    altmetrics and Altmetric

    [email protected]

    @aleebrahim

    altmetric.com

    Nader Ale Ebrahim, PhDVisiting Research Fellow

    Research Support Unit

    Centre for Research Services

    Research Management & Innovation Complex

    University of Malaya, Kuala Lumpur, Malaysia

    https://creativecommons.org/licenses/by/3.0/https://twitter.com/aleebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    32/67

    Altmetric Ambassador of the Month:Nader Ale Ebrahim 

    Our Ambassador of the Month for

    September is Nader Ale Ebrahim, a visiting

    research fellow at the University of Malaya.

    He has run over 100 workshops for

    researchers in Malaysia, and is consideredan authority on research promotion

    practices and metrics tools. Learn more

    about what Nader has done so far as an

    Altmetric Ambassador on our blog. 

    ©2016-2017 Nader Ale Ebrahim

    http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://aleebrahim.com/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://aleebrahim.com/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/

  • 8/17/2019 New Systems for Measuring Research Impact

    33/67

    In this session, we’ll cover… 

    Introduction to altmetrics

     Altmetric tools

     Altmetrics use cases

    Examples of using altmetrics data

    Questions?

    1

    2

    3

    4

    5

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    34/67

    Part 1:Introduction to Altmetrics

  • 8/17/2019 New Systems for Measuring Research Impact

    35/67

    Journal Impact Factor

    Citation countsH-index

    Number of publications

    o  Attention to research outputs in non-traditional sources, e.g. policydocuments, news, blogs and social media

    o Indicators of research impact

    o Help understand how research is being received and used

    o Complementary to traditional citation-based analysis

    What are altmetrics?

    Mentions in news reports

    References in policy

    Mentions in social mediaWikipedia citations

    Reference manager

    readers… etc. 

    ACADEMIC

    ATTENTION

    BROADER

    ATTENTION

     Alternative metrics

    “altmetrics” 

    +Traditional metrics

    Traditional

    bibliometrics

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    36/67

     

    o Provide a more coherent understanding of research attentiono Understand the broader reach and early  impact of research

    o Track attention to a broad range of research outputs, including

    articles, posters, data sets and working papers, etc.

    o Help researchers get credit for impact activities

    Why altmetrics?

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    37/67

     Advantages of metrics for single research

    outputs

    Real-time, immediate feedback on attention to

    scholarly content

    Useful for early career researchers whose work maynot have accrued citations

    Showcase attention to a research output beyond

    academia

    Not biased by an over-arching metric

    1

    2

    3

    4

  • 8/17/2019 New Systems for Measuring Research Impact

    38/67

    Each day, we track

    ~44,000 new

    mentions of research

    across sources incl.

    social media, news,

    and policy docs. That’s 1 mention

    every 2 seconds!

    Each week,

    ~50k

    unique itemsare shared.

    Mentions range incomplexity, from

    quick shares to

    comprehensive

    reviews.

     Altmetric data, March 2015

    18m 

    mentions of

    ~3.7m scholarly

    outputs

     Altmetric in numbers: mentions and shares

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    39/67

    What sources does Altmetric track?

    News outlets

    • Over 1,300 sites

    • Manually curated list

    • Text mining

    • Global coverage

    Social mediaand blogs

    • Twitter, Facebook,

    Google+, Sina Weibo

    • Public posts only

    • Manually curated list

    Reference

    managers

    • Mendeley, CiteULike

    • Reader counts

    • Don’t count towards the

     Altmetric score

    Other sources

    • Wikipedia• YouTube

    • Reddit

    • F1000

    • Pinterest

    • Q&A

    Post-publication

    peer review

    • Publons

    • PubPeer

    Policy documents

    • NICE Evidence

    • Intergovernmental Panel

    on Climate Change

    • Many more… 

  • 8/17/2019 New Systems for Measuring Research Impact

    40/67

    How does Altmetric aggregate online attention?

    Search for links

    to papers.

    Follow a list ofsources.

    Collate

    attention.

    Display data in

    “Altmetric details

    pages”. 

    E.g. blogs, news, policydocuments, social media.

     Automatically link

    searching and text

    mining.

    Disambiguation of

    mentioned items across

    different versions.

    Collecting attention data

    Reporting attention data

     Altmetric Details Page.

     All research outputs with

    mentions have an Altmetric

    Details Page in our

    database.©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    41/67

    Part 2:

     Altmetric Tools

  • 8/17/2019 New Systems for Measuring Research Impact

    42/67

    The Altmetric Bookmarklet

    The free Bookmarklet lets you instantly

    retrieve altmetrics data for any article.

    To install, go to: http://altmetric.it 

    ©2016-2017 Nader Ale Ebrahim

    http://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.php

  • 8/17/2019 New Systems for Measuring Research Impact

    43/67

    A Comprehensive Comparison of Educational Growth within Four

    Different Developing Countries between 1990 and 2012 

    ©2016-2017 Nader Ale Ebrahim

    http://dx.doi.org/10.7769/gesec.v6i3.486http://dx.doi.org/10.7769/gesec.v6i3.486http://dx.doi.org/10.7769/gesec.v6i3.486http://dx.doi.org/10.7769/gesec.v6i3.486

  • 8/17/2019 New Systems for Measuring Research Impact

    44/67

    The Altmetric Bookmarklet 

    ©2016-2017 Nader Ale Ebrahim

    http://www.altmetric.com/bookmarklet.phphttp://www.frontiersin.org/Human_Neuroscience/10.3389/fnhum.2013.00291/fullhttp://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.php

  • 8/17/2019 New Systems for Measuring Research Impact

    45/67

    Major trends in knowledge management research:

    a bibliometric study 

    ©2016-2017 Nader Ale Ebrahim

    http://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://link.springer.com/article/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-x

  • 8/17/2019 New Systems for Measuring Research Impact

    46/67

    1

    23

    1

    23

     Altmetric Details Pages

    Estimate attention with the “Altmetric score”. Monitor mentions in the mainstream news.

    See all the conversations and mentions.

    ©2016-2017 Nader Ale Ebrahim

    http://www.altmetric.com/details.php?citation_id=2897131http://www.altmetric.com/details.php?citation_id=2897131http://www.altmetric.com/details.php?citation_id=2897131

  • 8/17/2019 New Systems for Measuring Research Impact

    47/67

    What is the Altmetric donut?

    The Altmetric donut visualizes which are sources discussing an item.

    In the Altmetric Explorer, hover the cursor over the donut visualization to

    see the appropriate legend for an item.

    Each source is colour coded:

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    48/67

    Volume Sources Authors

    The score for an article rises as

    more people mention it.

    Each source category

    contributes a different base

    amount to the final score.

    How often the author of each

    mention talks about scholarly

    articles influences the

    contribution of the mention.

    What is the Altmetric score of attention?

    The Altmetric score provides an indicator of the attention surrounding aresearch output.

    It represents a weighted approximation of all the attention we’ve picked up for a

    research output and is calculated according to three facets:

    Read more about the score here: altmetric.com/blog/scoreanddonut/ 

    ©2016-2017 Nader Ale Ebrahim

    http://www.altmetric.com/blog/scoreanddonut/http://www.altmetric.com/blog/scoreanddonut/

  • 8/17/2019 New Systems for Measuring Research Impact

    49/67

    What can the data tell you?

    What type of attention is this research receiving? 

    Where has this article received the mosttraction? 

    Which countries are engaging most with thecontent? 

    Has this article influenced policy, spurred newresearch, or engaged a new audience? 

     Are reactions to this article positive or negative? 

    ✓ 

    ✓ 

    ✓ 

    ✓ 

    ✓ 

  • 8/17/2019 New Systems for Measuring Research Impact

    50/67

    Remember that the numbers don’t tell

    you… 

    Quality of the paper  

    Quality of the researchers

    Whole story

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    51/67

    Part 3:

     Altmetrics Use Cases

  • 8/17/2019 New Systems for Measuring Research Impact

    52/67

    Uncover conversations about your research

    Set up email alerts for

    your output in theSummary  tab ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    53/67

    Cochrane Library paper investigated use of probiotics to

    treat eczema: There is not enough evidence to recommendusing probiotics for the treatment of eczema.

    The paper has a relatively  low score of attention but

    received mentions across policy documents and

    Wikipedia:

    • Royal College of Paediatrics and Child Health -

     Allergy Care Pathways for Children: core

    competency for health professionals treating

    children with eczema

    Discovering policy references

    ©2016-2017 Nader Ale Ebrahim

    http://www.rcpch.ac.uk/system/files/protected/page/2011_RCPCH-CarePathway-Eczema_v3_(19.23).pdfhttp://www.rcpch.ac.uk/system/files/protected/page/2011_RCPCH-CarePathway-Eczema_v3_(19.23).pdfhttp://www.rcpch.ac.uk/system/files/protected/page/2011_RCPCH-CarePathway-Eczema_v3_(19.23).pdfhttp://www.rcpch.ac.uk/system/files/protected/page/2011_RCPCH-CarePathway-Eczema_v3_(19.23).pdf

  • 8/17/2019 New Systems for Measuring Research Impact

    54/67

    The University of Pittsburgh has embeddedPlumX widgets in their D-Scholarship

    institutional repository. You can see metrics

    across their institution at Plu.mX/Pitt. They have

    also built profiles for researchers across a variety

    of disciplines. Some sample profiles:Peter Brusilovsky 

    Rebecca Crowley 

    Michael Pinsky 

    ©2016-2017 Nader Ale Ebrahim

    http://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829https://demo.plu.mx/pitthttps://demo.plu.mx/u/pbrusilovsky/https://demo.plu.mx/u/rcrowley/https://demo.plu.mx/u/mpinsky/https://demo.plu.mx/u/mpinsky/https://demo.plu.mx/u/mpinsky/https://demo.plu.mx/u/rcrowley/https://demo.plu.mx/u/pbrusilovsky/https://demo.plu.mx/u/pbrusilovsky/https://demo.plu.mx/pitthttps://demo.plu.mx/pitthttp://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829/

  • 8/17/2019 New Systems for Measuring Research Impact

    55/67

    ©2016-2017 Nader Ale Ebrahim

    http://www.altmetric.com/details.php?citation_id=1429810http://www.genetics.org/content/194/4/1029

  • 8/17/2019 New Systems for Measuring Research Impact

    56/67

    ©2016-2017 Nader Ale Ebrahim

    "Th G ld A ? Wh t th 100 M t Cit d

    http://www.genetics.org/content/194/4/1029

  • 8/17/2019 New Systems for Measuring Research Impact

    57/67

    "The Golden Age? What the 100 Most Cited

     Articles in Terrorism Studies Tell Us"

    ©2016-2017 Nader Ale Ebrahim

    http://www.tandfonline.com/doi/abs/10.1080/09546553.2015.1064397

  • 8/17/2019 New Systems for Measuring Research Impact

    58/67

    Teaching Elementary Students Who Speak Black English Vernacular to

    Write in Standard English: Effects of Dialect Transformation Practice 

    ©2016-2017 Nader Ale Ebrahim

    A d i S h E i S d

    http://www.sciencedirect.com/science/article/pii/S0361476X99910020http://www.sciencedirect.com/science/article/pii/S0361476X99910020http://www.sciencedirect.com/science/article/pii/S0361476X99910020http://www.sciencedirect.com/science/article/pii/S0361476X99910020http://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=main

  • 8/17/2019 New Systems for Measuring Research Impact

    59/67

    Academic Search Engine Spam and

    Google Scholar’s Resilience Against it 

    ©2016-2017 Nader Ale Ebrahim

    http://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=main

  • 8/17/2019 New Systems for Measuring Research Impact

    60/67

    Discover popular new content to read

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    61/67

    Use in grant applications and funder

    reporting

    I save a tremendous amount

    of time for my lab.

    ©2016-2017 Nader Ale Ebrahim

    Fi d t ti l ll b t

  • 8/17/2019 New Systems for Measuring Research Impact

    62/67

    Find potential collaborators

    ©2016-2017 Nader Ale Ebrahim

    Embed badges on your website or CV

    http://www.altmetric.com/badges.phphttp://www.altmetric.com/badges.php

  • 8/17/2019 New Systems for Measuring Research Impact

    63/67

    Embed badges on your website or CV 

    ©2016-2017 Nader Ale Ebrahim

    How are institutions using Altmetric?

    http://www.altmetric.com/badges.phphttp://www.altmetric.com/badges.php

  • 8/17/2019 New Systems for Measuring Research Impact

    64/67

    • Support researchers in all of the above

    • Enhance department liaison activities

    • Encourage staff to deposit in your research information

    system

    How are institutions using Altmetric?

    Librarians

    Marketing

    Comms.

    Researchers• Track attention to your research immediately• Uncover (unknown) conversations about your research

    • Use in grant applications & funder reporting

    • Identify research to promote

    • Evaluate success of promotion activities

    • Identify key researchers

    Research

     Administrators

    • Integrate data into your existing performance reports

    • Identify key impacts across institution (i.e. policy docs)

    • Benchmarking (thoughtfully!)

    ©2016-2017 Nader Ale Ebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    65/67

    My recent publications

    ©2016-2017  Nader Ale Ebrahim

    RESEARCH SUPPORT UNIT (RSU)CENTRE FOR RESEARCH SERVICES

    http://www.revistagesec.org.br/secretariado/article/view/486http://link.springer.com/article/10.1007/s11192-016-1938-xhttp://link.springer.com/article/10.1007/s11192-016-1938-xhttp://www.revistagesec.org.br/secretariado/article/view/486http://dx.doi.org/10.1123/japa.2015-0188http://link.springer.com/article/10.1007/s11192-015-1730-3

  • 8/17/2019 New Systems for Measuring Research Impact

    66/67

    Questions?

    E-mail: [email protected]

    Twitter: @aleebrahim

    www.researcherid.com/rid/C-2414-2009 

    http://scholar.google.com/citations 

    Nader Ale Ebrahim, PhD

    =====================================Research Support Unit

    Centre for Research Services

    Research Management & Innovation Complex

    University of Malaya, Kuala Lumpur, Malaysia

    www.researcherid.com/rid/C-2414-2009 

    http://scholar.google.com/citations  

    RESEARCH MANAGEMENT & INNOVATION COMPLEX (IPPP)

    UNIVERSITY OF MALAYA 

    ©2016-2017 Nader Ale Ebrahim

    http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://www.researcherid.com/rid/C-2414-2009http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttps://twitter.com/aleebrahim

  • 8/17/2019 New Systems for Measuring Research Impact

    67/67

    References

    1. Akhavan, P., Ale Ebrahim, N., Fetrati, M. A., & Pezeshkan, A. (2016). Major trends in knowledge management research: a bibliometric study. Scientometrics 1-16.doi:10.1007/s11192-016-1938-x 

    2. Shakiba, M., Ale Ebrahim, N., Danaee, M., Bakhtiyari, K., & Sundararajan, E. (2016). A Comprehensive Comparison of Educational Growth within Four Different

    Developing Countries between 1990 and 2012. Revista de Gestão e Secretariado, 6 (3), 152-174. doi:10.7769/gesec.v6i3.486 

    3. Müller, A. M., Ansari, P., Ale Ebrahim, N., & Khoo, S. (2015). Physical Activity and Aging Research: A Bibliometric Analysis. Journal Of Aging And Physical Activity In

    Press. doi:10.1123/japa.2015-0188 

    4. Maghami, M., Navabi Asl, S., Rezadad, M. i., Ale Ebrahim, N., & Gomes, C. (2015). Qualitative and Quantitative Analysis of Solar hydrogen Generation Literature

    From 2001 to 2014. Scientometrics 105 (2), 759-771. : http://dx.doi.org/10.1007/s11192-015-1730-3  

    5. Ale Ebrahim, N. (2016). Microblogging for Enhancing the Research Accessibility . Retrieved from Research Support Unit, Centre for Research Services, Institute of

    Research Management and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.3202093.v1 

    6. Ale Ebrahim, N. (2016). Establish your expertise with a science blog . Retrieved from Research Support Unit, Centre for Research Services, Institute of Research

    Management and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.3185218.v1 

    7. Ale Ebrahim, N. (2016). Selecting a brand name for your research interest . Retrieved from Research Support Unit, Centre for Research Services, Institute of ResearchManagement and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.3153979.v1 

    8. Ale Ebrahim, N. (2016). Optimize articles for search engine to improve research visibility . Retrieved from Research Support Unit, Centre for Research Services,

    Institute of Research Management and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.3122038.v1 

    9. Ale Ebrahim, N. (2016). Maximizing Articles Citation Frequency . Retrieved from Research Support Unit, Centre for Research Services, Institute of Research

    Management and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.1572226.v2 

    10. Konkiel, S. (2014). 30-Day Impact Challenge: the ultimate guide to raising the profile of your research : Impactstory. http://blog.impactstory.org/wp-

    content/uploads/2015/01/impact_challenge_ebook_links.pdf  

    11. Martín-Martín, A., Orduna-Malea, E., Ayllón, J. M., & López-Cózar, E. D. (2016). The counting house, measuring those who count: Presence of Bibliometrics,

    Scientometrics, Informetrics, Webometrics and Altmetrics in Google Scholar Citations, ResearcherID, ResearchGate, Mendeley, & Twitter. EC3 Reseach Group:

    Evaluación de la Ciencia y de la Comunicación Científica Universidad de Granada and Universidad Politécnica de Valencia (Spain), In Progress,.

    doi:10.13140/RG.2.1.4814.4402

    12. Onyancha, Omwoyo Bosire. "Can informetrics shape biomedical research? A case study of the HIV/AIDS research in sub-Saharan Africa 1." Inkanyiso: Journal of

    Humanities and Social Sciences 6.1 (2014): 49-65.

    13. Owen Roberson, Research Information Analyst (2015) Research Information and Analytics at Cambridge: Insight over measurement, Research Information Office,

     Academic Division

    14. Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku

    http://dx.doi.org/10.1007/s11192-016-1938-xhttp://www.revistagesec.org.br/secretariado/article/view/486http://dx.doi.org/10.1123/japa.2015-0188http://dx.doi.org/10.1007/s11192-015-1730-3https://dx.doi.org/10.6084/m9.figshare.3202093.v1https://dx.doi.org/10.6084/m9.figshare.3185218.v1https://dx.doi.org/10.6084/m9.figshare.3153979.v1https://dx.doi.org/10.6084/m9.figshare.3122038.v1https://dx.doi.org/10.6084/m9.figshare.1572226.v2http://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://files.figshare.com/2282721/UCISA___Owen_Roberson.ppthttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://files.figshare.com/2282721/UCISA___Owen_Roberson.ppthttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttps://dx.doi.org/10.6084/m9.figshare.1572226.v2https://dx.doi.org/10.6084/m9.figshare.1572226.v2https://dx.doi.org/10.6084/m9.figshare.3122038.v1https://dx.doi.org/10.6084/m9.figshare.3122038.v1https://dx.doi.org/10.6084/m9.figshare.3153979.v1https://dx.doi.org/10.6084/m9.figshare.3153979.v1https://dx.doi.org/10.6084/m9.figshare.3185218.v1https://dx.doi.org/10.6084/m9.figshare.3185218.v1https://dx.doi.org/10.6084/m9.figshare.3202093.v1https://dx.doi.org/10.6084/m9.figshare.3202093.v1http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1123/japa.2015-0188http://dx.doi.org/10.1123/japa.2015-0188http://dx.doi.org/10.1123/japa.2015-0188http://www.revistagesec.org.br/secretariado/article/view/486http://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-x