2
BORED– Journal-level Metrics (infamous Impact Factor)
– Citation-only Analysis (unreliable h-Index)
– Metadata focused repositories
COOL– Identifiers
– Article Level Metrics (ALM)
– Altmetrics (not only ALM)
BETA– Profiles
• Composite indicators
• Visualization
• Rankings
AGENDA
3
Priorities for editors, librarians, intermediaries– Journal is the unit: continent not content focused
– Article is the unit: the bibliographic record, its metadata description
– Journals Portals: emphasis is on open access
• Unreliable biased metrics (Redalyc)
Priorities for scientists, academicians, policy managers– Visibility: Barriers to crawling in most of the repositories: Huge gaps in
Google Scholar coverage
– Evaluation: Metrics are relevant at author or institutional level
• Not exactly PLoS model: Article-level metrics (also by Altmetric)
• A big issue is the lack of identifiers
– Intellectual property
• OA priority as an excuse for abuses in personal and institutional attributions (moral rights)
Current situation
4
Standard Identifiers are badly needed!
PP PERSONAL PROFILES ORCID
ALM ARTICLE-LEVEL METRICS DOI
IR INSTITUTIONAL REPORTS ISNI
5
Sources– Commercial bibliographic databases (WoS, Scopus,…)
– Public Web search engines, incl. academic ones (GS, MS AS, Mendeley)
– Social Web platforms (Academia.edu, ResearchGate, LinkedIn, Wikipedia, YouTube, Twitter, …)
– Personal (and group) webpages
– Repositories
Metrics– Activity: Formal (peer-reviewed papers/chapters/monographs), Informal
– Visibility: Inclusion in repositories, bibliographic databases/search engines
– Impact: Citations, Links, Mentions (incl. likes, discussions & similar)
– Usage: Visits, Visitors (incl. followers), Downloads
Integration (and visualization)– A model like … ImpactStory Plus or PlumX
A Plea for Personal Profiles
6
A model for I-Metrics
WEBOMETRICS
Number of times the URL of a document/author
webpage is linked from another webpage
ALTMETRICS
Number of times the elements are mentioned
(shared) in websites, wikis, blogs, social bookmarks
and networks (incl. Twitter) or search engines
USAGEMETRICS
Number of times the document is
read/visited/downloaded from its publishing place (incl.
websites)
BIBLIOMETRICS
Number of times the bibliographic record
(identifier) of a paper/book is cited in another similar
formally published paper
Document-level metricsTitleSource:Journal/Book/PatentPublication YearCitationsIdentifier: URL/DOI/HandleSubject/Tags
Author-level metricsAuthor(s)
Institution (Affiliation)Publication YearDiscipline/Tags
Web profilesWeb 2.0 profiles
7
Personal (Bibliometric) Profiles (I)
8
Rankings
9
Hey, Google ScholarWe badly need an API!!
10
Personal (Bibliometric) Profiles (II)
11
Visualization
12
New actors (I)
13
New actors (II)
14
Webometrics for individuals, not yet? …
15
Altmetrics for individuals, not yet? …
16
(Super)Repositories for individuals, not yet? …
17
Usagemetrics for individuals, not yet? …
18
Not against intermediaries, but
Institutions & authors FIRST!
19
From Profile to Portfolio– Institutionally hosted
• Prestige, authority, long-term preservation
– Caring about Identifiers
– Not only Metrics
• Beyond CV: Narrative introduction
• Updated frequently: Twitter, Blog or similar
• Outlinks rich
But also Metrics– APIs based: Objectivity, Reliability
• Absolute and relative (rankings) figures
– Network visualization: topics, colleagues, institutions
– Public (interactive) dashboard
• Current standard Google Analytics needs to (publicly) emerge
IMHO … Personal Institutional Webpage
20
Powered by Harvard’s
21
Combined with … PlumX
22
Open forum
Thank you!
