Open AccessCitation Index Services

Tim Brody

Intelligence, Agents, Multimedia Group

University of Southampton

20th February 2006 20-21 February 2006, Berlin, Humboldt University

2

Content

• A slightly irreverent look at evaluation and metrics in science … based on Open Access

20th February 2006 20-21 February 2006, Berlin, Humboldt University

3

Publish or Perish

= 10 =

20th February 2006 20-21 February 2006, Berlin, Humboldt University

4

Publish in a high impact journal or Perish

? Nature = 32.182

ACM Comput Surv = 10.037

IEEE T Inform Theory = 2.029

=2.029 * 10 = 20 ?

Publish or Perish

20th February 2006 20-21 February 2006, Berlin, Humboldt University

5

Impact Factor = Author Impact?

• “Use of journal impact factors conceals the difference in article citation rates (articles in the most cited half of articles in a journal are cited 10 times as often as the least cited half)” P.O. Seglen BMJ 1997;314:497

20th February 2006 20-21 February 2006, Berlin, Humboldt University

6

Author Impact Factors …

?

20th February 2006 20-21 February 2006, Berlin, Humboldt University

7

Names are tricky …

What’s a eukaryote?

20th February 2006 20-21 February 2006, Berlin, Humboldt University

8

But what about my IR record?

eprints.ecs.soton.ac.uk =

20th February 2006 20-21 February 2006, Berlin, Humboldt University

9

… if I could couple my publication record with a citation index?

20th February 2006 20-21 February 2006, Berlin, Humboldt University

10

But I don’t have many citations …

Citebase does track downloads of my papers(in ECS EPrints, UK arXiv.org)

20th February 2006 20-21 February 2006, Berlin, Humboldt University

11

The trouble with metrics

…

Should Lammel, S get +124 downloads?

(* 628 authors)

20th February 2006 20-21 February 2006, Berlin, Humboldt University

12

Perhaps the answer lies in many metrics …

20th February 2006 20-21 February 2006, Berlin, Humboldt University

13

Tim Brody’s Impact Indicators

• Main-author: 3 papers• Contributed to: 10 papers• Presented at: Humboldt University• Published in …

– JASIST (= 2.086 IF)– ECDL Proceedings

• Been cited … 3 times (/ author position?)• Been downloaded … 1100 times• ‘Ranked 154 of 213 researchers in field …’

20th February 2006 20-21 February 2006, Berlin, Humboldt University

14

Practicalities for … Open Access Citation Index Services

• Journal Publications are (for the foreseeable future) the gold standard– Can’t escape the need for journal metadata– Peer-reviewed/non-Peer-reviewed metrics

• Author self-archived e-prints facilitate:– Open Access Citation Services– Usage impact experiments (Web Impact Factor?)

– (n.b. Increased Citation Impact)

20th February 2006 20-21 February 2006, Berlin, Humboldt University

15

IR Implementation Needs

• e-print journal manifestation linking– [combined usage/citation impact]

• e-print refs (and/or full-text?) export– [copyrighted e.g. book = citation + refs]

• e-print usage export (weblogs)

• authoritative publication lists

• … reference linking

20th February 2006 20-21 February 2006, Berlin, Humboldt University

16

Where to Reference Link

• Reference linking at the source– Distributed citation index (IRs+Journals)

• Scalable/sustainable model for a free ‘virtual’ citation index?

– IR reference linking tools/services• allow authors to correct citation links

– Existing structured XML from publishers– Rich OAI export (OpenURL, DIDL, METS etc.)

20th February 2006 20-21 February 2006, Berlin, Humboldt University

17

Parsing/Linking elsewhere …

• Centralised/Commercial:

– ISI WoK will do the job?• Layered:

– Reference Linking ‘middleware’ e.g. through national OA citebases

• Centralised/Subject:

– NASA ADS, Citeseer, …– Sustainability? Duplication of effort?

20th February 2006 20-21 February 2006, Berlin, Humboldt University

18

The Goals

• What technical solution will best achieve …– Promote research incentives– Experimentation and competition– Transparency

20th February 2006 20-21 February 2006, Berlin, Humboldt University

19

Thanks for listening!

• Tim Brody <tdb01r@ecs.soton.ac.uk>

• ISI Web of Science, JCR (2004)

• http://eprints.ecs.soton.ac.uk/

• http://www.citebase.org/

P.S. eukaryote is a single-celled or multicellular organism whose cells contain a distinct membrane-bound nucleus.