i-metrics: biblio-, web-, alt- & usage- metrics

22
I-Metrics biblio-, web-, alt- & usage- metrics Isidro F. Aguillo [email protected]

Upload: scielo-scientific-electronic-library-online

Post on 05-Jun-2015

203 views

Category:

Technology


1 download

DESCRIPTION

A atual revolução na avaliação de pesquisa é devido a uma série de fatores que estão presentes há vários anos, mas que agora estão convergindo para oferecer um novo cenário onde a presença na web das iniciativas em Acesso Aberto, dos repositórios institucionais, dos portais de periódicos e dos pesquisadores individuais desempenha um papel muito importante. O ranking de Universidades Webometrics há muito tempo antecipou muitas das novidades teóricas e práticas e suas ferramentas ainda são valiosas para descrever os novos processos científicos e sociais que estão afetando não só a academia, mas a todos os atores ligados de alguma forma para o avanço científico, a disseminação das atividades, a divulgação dos resultados e implementação socioeconômica das inovações. The current revolution in research assessment is due to a series of factors that have been present for several years but that now are converging for offering a new scenario where the Open Access initiatives, the institutional repositories, the portals of journals and the researchers individual web presence are to play a very important role. Webometrics long ago anticipated many of the theoretical and practical novelties and its tools are still valuable for describing the new scientific and social processes that are affecting not only to the academia but to all the actors linked in one or other way to the scientific advance, dissemination of the activities, popularization of the results and the socio-economic of the implementation of the innovations. La revolución actual en la evaluación de la investigación se debe a una serie de factores que han estado presentes durante varios años, pero que ahora están convergiendo para ofrecer un nuevo escenario en el que las iniciativas de Acceso Abierto, los repositorios institucionales, los portales de revistas y la presencia individual de los investigadores en el Web, van a jugar un papel muy importante. La webometría hace mucho tiempo ha anticipado muchas de las novedades teóricas y prácticas y sus herramientas siguen siendo valiosas para describir los nuevos procesos científicos y sociales que afectan no sólo a la academia sino a todos los actores vinculados de una u otra manera con el avance científico, la difusión de las actividades, la divulgación de los resultados y el desarrollo socio-económico de la aplicación de las innovaciones.

TRANSCRIPT

Page 1: I-Metrics: biblio-, web-, alt- & usage- metrics

I-Metricsbiblio-, web-, alt- & usage-

metrics

Isidro F. [email protected]

Page 2: I-Metrics: biblio-, web-, alt- & usage- metrics

2

BORED– Journal-level Metrics (infamous Impact Factor)

– Citation-only Analysis (unreliable h-Index)

– Metadata focused repositories

COOL– Identifiers

– Article Level Metrics (ALM)

– Altmetrics (not only ALM)

BETA– Profiles

• Composite indicators

• Visualization

• Rankings

AGENDA

Page 3: I-Metrics: biblio-, web-, alt- & usage- metrics

3

Priorities for editors, librarians, intermediaries– Journal is the unit: continent not content focused

– Article is the unit: the bibliographic record, its metadata description

– Journals Portals: emphasis is on open access

• Unreliable biased metrics (Redalyc)

Priorities for scientists, academicians, policy managers– Visibility: Barriers to crawling in most of the repositories: Huge gaps in

Google Scholar coverage

– Evaluation: Metrics are relevant at author or institutional level

• Not exactly PLoS model: Article-level metrics (also by Altmetric)

• A big issue is the lack of identifiers

– Intellectual property

• OA priority as an excuse for abuses in personal and institutional attributions (moral rights)

Current situation

Page 4: I-Metrics: biblio-, web-, alt- & usage- metrics

4

Standard Identifiers are badly needed!

PP PERSONAL PROFILES ORCID

ALM ARTICLE-LEVEL METRICS DOI

IR INSTITUTIONAL REPORTS ISNI

Page 5: I-Metrics: biblio-, web-, alt- & usage- metrics

5

Sources– Commercial bibliographic databases (WoS, Scopus,…)

– Public Web search engines, incl. academic ones (GS, MS AS, Mendeley)

– Social Web platforms (Academia.edu, ResearchGate, LinkedIn, Wikipedia, YouTube, Twitter, …)

– Personal (and group) webpages

– Repositories

Metrics– Activity: Formal (peer-reviewed papers/chapters/monographs), Informal

– Visibility: Inclusion in repositories, bibliographic databases/search engines

– Impact: Citations, Links, Mentions (incl. likes, discussions & similar)

– Usage: Visits, Visitors (incl. followers), Downloads

Integration (and visualization)– A model like … ImpactStory Plus or PlumX

A Plea for Personal Profiles

Page 6: I-Metrics: biblio-, web-, alt- & usage- metrics

6

A model for I-Metrics

WEBOMETRICS

Number of times the URL of a document/author

webpage is linked from another webpage

ALTMETRICS

Number of times the elements are mentioned

(shared) in websites, wikis, blogs, social bookmarks

and networks (incl. Twitter) or search engines

USAGEMETRICS

Number of times the document is

read/visited/downloaded from its publishing place (incl.

websites)

BIBLIOMETRICS

Number of times the bibliographic record

(identifier) of a paper/book is cited in another similar

formally published paper

Document-level metricsTitleSource:Journal/Book/PatentPublication YearCitationsIdentifier: URL/DOI/HandleSubject/Tags

Author-level metricsAuthor(s)

Institution (Affiliation)Publication YearDiscipline/Tags

Web profilesWeb 2.0 profiles

Page 7: I-Metrics: biblio-, web-, alt- & usage- metrics

7

Personal (Bibliometric) Profiles (I)

Page 8: I-Metrics: biblio-, web-, alt- & usage- metrics

8

Rankings

Page 9: I-Metrics: biblio-, web-, alt- & usage- metrics

9

Hey, Google ScholarWe badly need an API!!

Page 10: I-Metrics: biblio-, web-, alt- & usage- metrics

10

Personal (Bibliometric) Profiles (II)

Page 11: I-Metrics: biblio-, web-, alt- & usage- metrics

11

Visualization

Page 12: I-Metrics: biblio-, web-, alt- & usage- metrics

12

New actors (I)

Page 13: I-Metrics: biblio-, web-, alt- & usage- metrics

13

New actors (II)

Page 14: I-Metrics: biblio-, web-, alt- & usage- metrics

14

Webometrics for individuals, not yet? …

Page 15: I-Metrics: biblio-, web-, alt- & usage- metrics

15

Altmetrics for individuals, not yet? …

Page 16: I-Metrics: biblio-, web-, alt- & usage- metrics

16

(Super)Repositories for individuals, not yet? …

Page 17: I-Metrics: biblio-, web-, alt- & usage- metrics

17

Usagemetrics for individuals, not yet? …

Page 18: I-Metrics: biblio-, web-, alt- & usage- metrics

18

Not against intermediaries, but

Institutions & authors FIRST!

Page 19: I-Metrics: biblio-, web-, alt- & usage- metrics

19

From Profile to Portfolio– Institutionally hosted

• Prestige, authority, long-term preservation

– Caring about Identifiers

– Not only Metrics

• Beyond CV: Narrative introduction

• Updated frequently: Twitter, Blog or similar

• Outlinks rich

But also Metrics– APIs based: Objectivity, Reliability

• Absolute and relative (rankings) figures

– Network visualization: topics, colleagues, institutions

– Public (interactive) dashboard

• Current standard Google Analytics needs to (publicly) emerge

IMHO … Personal Institutional Webpage

Page 20: I-Metrics: biblio-, web-, alt- & usage- metrics

20

Powered by Harvard’s

Page 21: I-Metrics: biblio-, web-, alt- & usage- metrics

21

Combined with … PlumX

Page 22: I-Metrics: biblio-, web-, alt- & usage- metrics

22

Open forum

Thank you!