i-metrics: biblio-, web-, alt- & usage- metrics
DESCRIPTION
A atual revolução na avaliação de pesquisa é devido a uma série de fatores que estão presentes há vários anos, mas que agora estão convergindo para oferecer um novo cenário onde a presença na web das iniciativas em Acesso Aberto, dos repositórios institucionais, dos portais de periódicos e dos pesquisadores individuais desempenha um papel muito importante. O ranking de Universidades Webometrics há muito tempo antecipou muitas das novidades teóricas e práticas e suas ferramentas ainda são valiosas para descrever os novos processos científicos e sociais que estão afetando não só a academia, mas a todos os atores ligados de alguma forma para o avanço científico, a disseminação das atividades, a divulgação dos resultados e implementação socioeconômica das inovações. The current revolution in research assessment is due to a series of factors that have been present for several years but that now are converging for offering a new scenario where the Open Access initiatives, the institutional repositories, the portals of journals and the researchers individual web presence are to play a very important role. Webometrics long ago anticipated many of the theoretical and practical novelties and its tools are still valuable for describing the new scientific and social processes that are affecting not only to the academia but to all the actors linked in one or other way to the scientific advance, dissemination of the activities, popularization of the results and the socio-economic of the implementation of the innovations. La revolución actual en la evaluación de la investigación se debe a una serie de factores que han estado presentes durante varios años, pero que ahora están convergiendo para ofrecer un nuevo escenario en el que las iniciativas de Acceso Abierto, los repositorios institucionales, los portales de revistas y la presencia individual de los investigadores en el Web, van a jugar un papel muy importante. La webometría hace mucho tiempo ha anticipado muchas de las novedades teóricas y prácticas y sus herramientas siguen siendo valiosas para describir los nuevos procesos científicos y sociales que afectan no sólo a la academia sino a todos los actores vinculados de una u otra manera con el avance científico, la difusión de las actividades, la divulgación de los resultados y el desarrollo socio-económico de la aplicación de las innovaciones.TRANSCRIPT
2
BORED– Journal-level Metrics (infamous Impact Factor)
– Citation-only Analysis (unreliable h-Index)
– Metadata focused repositories
COOL– Identifiers
– Article Level Metrics (ALM)
– Altmetrics (not only ALM)
BETA– Profiles
• Composite indicators
• Visualization
• Rankings
AGENDA
3
Priorities for editors, librarians, intermediaries– Journal is the unit: continent not content focused
– Article is the unit: the bibliographic record, its metadata description
– Journals Portals: emphasis is on open access
• Unreliable biased metrics (Redalyc)
Priorities for scientists, academicians, policy managers– Visibility: Barriers to crawling in most of the repositories: Huge gaps in
Google Scholar coverage
– Evaluation: Metrics are relevant at author or institutional level
• Not exactly PLoS model: Article-level metrics (also by Altmetric)
• A big issue is the lack of identifiers
– Intellectual property
• OA priority as an excuse for abuses in personal and institutional attributions (moral rights)
Current situation
4
Standard Identifiers are badly needed!
PP PERSONAL PROFILES ORCID
ALM ARTICLE-LEVEL METRICS DOI
IR INSTITUTIONAL REPORTS ISNI
5
Sources– Commercial bibliographic databases (WoS, Scopus,…)
– Public Web search engines, incl. academic ones (GS, MS AS, Mendeley)
– Social Web platforms (Academia.edu, ResearchGate, LinkedIn, Wikipedia, YouTube, Twitter, …)
– Personal (and group) webpages
– Repositories
Metrics– Activity: Formal (peer-reviewed papers/chapters/monographs), Informal
– Visibility: Inclusion in repositories, bibliographic databases/search engines
– Impact: Citations, Links, Mentions (incl. likes, discussions & similar)
– Usage: Visits, Visitors (incl. followers), Downloads
Integration (and visualization)– A model like … ImpactStory Plus or PlumX
A Plea for Personal Profiles
6
A model for I-Metrics
WEBOMETRICS
Number of times the URL of a document/author
webpage is linked from another webpage
ALTMETRICS
Number of times the elements are mentioned
(shared) in websites, wikis, blogs, social bookmarks
and networks (incl. Twitter) or search engines
USAGEMETRICS
Number of times the document is
read/visited/downloaded from its publishing place (incl.
websites)
BIBLIOMETRICS
Number of times the bibliographic record
(identifier) of a paper/book is cited in another similar
formally published paper
Document-level metricsTitleSource:Journal/Book/PatentPublication YearCitationsIdentifier: URL/DOI/HandleSubject/Tags
Author-level metricsAuthor(s)
Institution (Affiliation)Publication YearDiscipline/Tags
Web profilesWeb 2.0 profiles
7
Personal (Bibliometric) Profiles (I)
8
Rankings
9
Hey, Google ScholarWe badly need an API!!
10
Personal (Bibliometric) Profiles (II)
11
Visualization
12
New actors (I)
13
New actors (II)
14
Webometrics for individuals, not yet? …
15
Altmetrics for individuals, not yet? …
16
(Super)Repositories for individuals, not yet? …
17
Usagemetrics for individuals, not yet? …
18
Not against intermediaries, but
Institutions & authors FIRST!
19
From Profile to Portfolio– Institutionally hosted
• Prestige, authority, long-term preservation
– Caring about Identifiers
– Not only Metrics
• Beyond CV: Narrative introduction
• Updated frequently: Twitter, Blog or similar
• Outlinks rich
But also Metrics– APIs based: Objectivity, Reliability
• Absolute and relative (rankings) figures
– Network visualization: topics, colleagues, institutions
– Public (interactive) dashboard
• Current standard Google Analytics needs to (publicly) emerge
IMHO … Personal Institutional Webpage
20
Powered by Harvard’s
21
Combined with … PlumX
22
Open forum
Thank you!