jevin west eigen factor

60
Jevin D. West University of Washington The Eigenfactor Metrics: a network approach to assessing scholarly journals [email protected]

Upload: gali-halevi

Post on 11-May-2015

709 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Jevin west eigen factor

Jevin D. West University of Washington

The Eigenfactor Metrics: a network approach to assessing scholarly journals

[email protected]

Page 2: Jevin west eigen factor

The Eigenfactor Project

Q: How does network structure affect function?

The Eigenfactor Algorithm

Q: How can we better evaluate the scholarly literature?

Page 3: Jevin west eigen factor

Citation Networks, Scaling Up

Network Effects, Centrality

Eigenfactor, Article Influence

Mapping, Future Directions

Page 4: Jevin west eigen factor

Citation Networks

Citation Networks, Scaling Up

Page 5: Jevin west eigen factor

Citations

Page 6: Jevin west eigen factor

Citations

Page 7: Jevin west eigen factor
Page 8: Jevin west eigen factor

�Scholarship is all about�

the flow of ideas

Page 9: Jevin west eigen factor

�Networks are all about�the flow of information

Page 10: Jevin west eigen factor

Citations form a vast network

de Solla Price, Science (1965)

Page 11: Jevin west eigen factor

Citations among Authors

Eugene Garfield

Derek de Solla Price

Page 12: Jevin west eigen factor

Citations among Journals

Physical Review Letters

Ecology Letters

Page 13: Jevin west eigen factor

What happens when you scale up?

12,000 Journals

150,000,000 Citations

Page 14: Jevin west eigen factor

How do we identify the important journals?

…using only the citation network

…but all of the citation network

Page 15: Jevin west eigen factor

Network Effects

Network Effects, Centrality

Page 16: Jevin west eigen factor

High School Dating Network

Image Courtesy of Mark Newman

Page 17: Jevin west eigen factor

System Scale: Network Topology Matters

High School Dating Network

Q: Which network would MONO prefer?

Individual Scale: Connection Source Matters

Q: Which girl/boy should I date if I don’t want MONO?

Page 18: Jevin west eigen factor

Image Courtesy of Mark Newman

Who is the most ‘influential’ high school student?

Page 19: Jevin west eigen factor

Degree Centrality

Eigenvector Centrality

Page 20: Jevin west eigen factor

Links

9

5

4

3

2

1

Degree Centrality

Number of students

1234567891011121314

Page 21: Jevin west eigen factor

Accounting for the Network

Page 22: Jevin west eigen factor

The Network Matters

Page 23: Jevin west eigen factor

This network property of the scholarly literature was largely ignored over the first century of

scholarly evaluation.

How can we extract this information in order to better measure

information flow?

Page 24: Jevin west eigen factor

Impact factor Cites in 2010 to articles in 2009 or 2008

Number of articles in 2009 and 2008

Garfield, Science (1955)

Page 25: Jevin west eigen factor

Impact Factor

2010

2008 - 2009

2 articles

!

IF2010

=3

2

3 citations

Page 26: Jevin west eigen factor

Impact Factor Eigenfactor

Page 27: Jevin west eigen factor

Citation Networks, Scaling Up

Network Effects, Centrality

Eigenfactor, Article Influence

Mapping, Future Directions

Page 28: Jevin west eigen factor

Eigenfactor algorithm

Eigenfactor – taking into account the network

Page 29: Jevin west eigen factor

25 nodes and 42 unweighted, undirected links

Page 30: Jevin west eigen factor

25 nodes and 42 weighted, undirected links

Page 31: Jevin west eigen factor

25 nodes and 42 weighted, directed links

Which node is the most central?

4

2

6

5

31

11

97

10

8

21

2018

1917

16

15

14

13

12

25

23

22

24

Page 32: Jevin west eigen factor

Applet: Daniel Edler

Deterministic: iterative voting

Stochastic: random walker

Page 33: Jevin west eigen factor

Eigenfactor – Top Ten Journals in Science (2008)

Rank Journal Eigenfactor

1 Nature 1.76

2 PNAS 1.70

3 Science 1.58

4 Journal of Biological Chemistry 1.33

5 Physical Review Letters 1.28

6 Journal of the American Chemical Society 0.95

7 Physical Review B 0.77

8 Applied Physics Letters 0.72

9 New England Journal of Medicine 0.68

10 Cell 0.67

Total number of journals ranked = 8,232

Page 34: Jevin west eigen factor

Eigenfactor – Top Ten Journals in Science (2008)

Rank Journal Eigenfactor

1 Nature 1.76 %

2 PNAS 1.70 %

3 Science 1.58 %

4 Journal of Biological Chemistry 1.33 %

5 Physical Review Letters 1.28 %

6 Journal of the American Chemical Society 0.95 %

7 Physical Review B 0.77 %

8 Applied Physics Letters 0.72 %

9 New England Journal of Medicine 0.68 %

10 Cell 0.67 %

Total number of journals ranked = 8,232

Page 35: Jevin west eigen factor

Article Influence = Eigenfactor

# articles

Eigenfactor, Ranking & Mapping

Page 36: Jevin west eigen factor

Article Influence – Top Ten Journals in Science (2008)

Rank Journal Article Influence

1 Review of Modern Physics 24.9

2 Annual Review of Immunology 24.7

3 Annual Review of Biochemistry 20.9

4 Nature Reviews Molecular Cell Biology 20.0

5 Annual Review of Neuroscience 18.9

6 Cell 18.9

7 New England Journal of Medicine 18.8

8 CA – A Cancer Journal for Clinicians 17.5

9 Nature 17.3

10 Science 16.3

Total number of journals ranked = 8,232

Page 37: Jevin west eigen factor
Page 38: Jevin west eigen factor
Page 39: Jevin west eigen factor
Page 40: Jevin west eigen factor

Article Influence vs. Impact Factor

Impact Factor, Eigenfactor

Page 41: Jevin west eigen factor

Ecology and Evolution (2007)

Page 42: Jevin west eigen factor

0.1

0.1

0.1

0.1

0.10.5

ImpactFactor

Page 43: Jevin west eigen factor

Eigenfactor

0.342 0.316

0.147

0.103

0.056

0.036

Page 44: Jevin west eigen factor

Mapping

Mapping, Future Directions

Page 45: Jevin west eigen factor

good maps simplify � and highlight� relevant structures

Page 46: Jevin west eigen factor

The map equation tells us the description length for a particular modular structure

The Map Equation

Page 47: Jevin west eigen factor
Page 48: Jevin west eigen factor
Page 49: Jevin west eigen factor
Page 50: Jevin west eigen factor

Hierarchical Maps

Page 51: Jevin west eigen factor

1995 2004

Page 52: Jevin west eigen factor

Alluvial diagrams

Image:NASA

Page 53: Jevin west eigen factor

Rosvall&Bergstrom(2010)

Page 54: Jevin west eigen factor

Mapping, Future Directions

Future Directions

Page 55: Jevin west eigen factor

How can we better�evaluate the scholarly literature?

Page 56: Jevin west eigen factor

How can we better�navigate the scholarly literature?

Page 57: Jevin west eigen factor

Ranking

1.  …..2.  …3.  …4.  …5.  …..6.  …7.  ..8.  …..9.  ..

Mapping

Page 58: Jevin west eigen factor

Scholarly Feedback

Page 59: Jevin west eigen factor

DocumentDeliveryvsDocumentDiscovery

1.Convenientaccesstolotsofdata

2.ConnecKvityofthedata

TheImpactoftheInternet

TheImpactoftheScholar‐net1.Convenientaccesstolotsofdata2.ConnecKvityofthedata

Page 60: Jevin west eigen factor

Acknowledgements

Carl Bergstrom Daril Vilhena Martin Rosvall Ben Althouse Ted Bergstrom Johan Bollen Ralph Dandrea Gail Dykstra Daniel Edler Alan Yen Gregg Gordon Michael Jensen Michael Kurtz Moritz Stefaner Theresa Portzer

NaKonalScienceFoundaKons NaKonalInsKtutesofHealth