www.plos.org “re-engineering the scholarly journal” mark patterson, director of publishing...

www.plos.org

“Re-engineering the scholarly journal”

Mark Patterson, Director of Publishing

Arcadia Seminar, Cambridge: Nov, 2010

Committed to making the world’s

scientific and medical literature

a public resource

www.plos.org

The functions of journals

• Registration– Who’s done what and when?

• Certification– Is the work sound?

• Dissemination– The right information to the people who need it

• Preservation– Archiving for future generations

Roosendaal and Geurts

www.flickr.com/photos/sewpixie/2374778051/

Journals are a giant sorting mechanism

Organization

www.plos.org

Re-engineering

• Dissemination– Open access

• Organization of content– Impact and audience

• Authoring and certification– Eliminating all unnecessary delays

www.plos.org

Re-engineering dissemination

Open Access

www.plos.org

Open access≠Free

access

www.plos.org

What is open access?

• Free, immediate access • Unrestricted reuse• Deposition in a digital public

archive

Bethesda definition, 2003

www.plos.org

Creative Commons Attribution License

Copyright: © 2004 Moorthy et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Goal: make clear to humans (and machines) what can be done

www.creativecommons.org

www.plos.org

No permissionrequired

for any reuse

Translation

Redistribution

Photocopying

Coursepacks

Reproductionof figures

Deposit indatabases

Downloadingdata

Text mining

What is open access?

• Free, immediate access online

• Unrestricted use

What is open access?

• Free, immediate access online

• Unrestricted use

What is open access?

• Free, immediate access online

• Unrestricted use

What is open access?

• Free, immediate access online

• Unrestricted use

www.plos.org

A network of literature

Document

www.plos.org

A network of literature and data

Document

Database

www.plos.orgwww.flickr.com/photos/chris_short/79656776/

Silos of information

www.plos.orgwww.flickr.com/photos/chris_short/79656776/

Open access• Free, immediate access • Unrestricted reuse

http://www.flickr.com/photos/photos_clinker/295038831

www.plos.org

PLoS Founding Board of Directors

Harold VarmusPLoS Co-founder and Chairman of the BoardPresident and CEO of Memorial Sloan-Kettering Cancer Center

Patrick O. BrownPLoS Co-founder and Board MemberHoward Hughes Medical Institute & Stanford University School of Medicine

Michael B. EisenPLoS Co-founder and Board MemberLawrence Berkeley National Laboratory & University of California at Berkeley

www.plos.org

• Establish high quality journals– put PLoS and open access on the map

• Build a more extensive OA publishing operation– an open access home for every paper– publication fee business model– achieve sustainability

• Make the literature more useful – to scientists and the public

PLoS publishing strategy

www.plos.org

€

Publisher

Reader

Pay-per-view SubscriptionLibrary

Subscription journals

GovFundersInstitutionsIndustry

€€€

Researcher

€

www.plos.org

Open access journals

Publishing is the final step in a research project Public

DigitalLibrary

GovFundersInstitutionsIndustry

€Publisher

Reader

Researcher

€

www.plos.org

PLoS BiologyOctober, 2003

PLoS MedicineOctober, 2004

PLoS Community JournalsJune-September, 2005 October, 2007

PLoS ONEDecember,2006

www.plos.org

0

2000

4000

6000

8000

10000

12000

14000

2003 2004 2005 2006 2007 2008 2009

PublicationsSubmissions

Growth in submissions and publications

www.plos.org

Financial growth

% Operating expense covered by operating revenue

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2003 2004 2005 2006 2007 2008 2009

www.oaspa.org

www.plos.org

Re-engineering organization of

content

The life cycle of a research article

Journal name is keyPublication

Research

Submission

Peer review

Reje

cts

2-3 Experts Is it rigorous?Good enough?Right audience?Takes months/years

www.plos.org

What do we need to do before research is

published?

What is best left until after publication?

www.plos.org

www.plos.org

• Editorial criteria– Scientifically rigorous– Ethical– Properly reported– Conclusions supported by the data

• Editors and reviewers do not ask– How important is the work?– Which is the relevant audience?

• Use online tools to sort and filter scholarly content after publication, not before

PLoS ONE’s Key Innovation – The editorial process

www.plos.org

Year Submissions Publications % of annual PubMed

2006* 473 138 0.02%

2007 2497 1231 0.16%

2008 4401 2723 0.34%

2009 6819 4404 0.52%

2010** 10526 5265 Y/E 0.8%?

*Started publishing Dec 20th, 2006**Up to Oct 31st

Community acceptance– largest peer-reviewed journal– >50,000 authors– >1300 Academic Editors

PLoS ONE – statistics

www.plos.org

www.plos.org

What do we need to do before research is

published?

What is best left until after publication?

www.plos.org

Who cares about

measuring researchimpact?

InstitutionsResearchers (authors and

readers)

Publishers

Funders

The public

Librarians

www.plos.org

How do we measure ‘impact’?

The impact factor of the journal in which an article is published.

Recommended reading:Adler, R., Ewing, J. Taylor, P. Citation statistics. A report from the International Mathematical Union. http://www.mathunion.org/publications/report/citationstatistics/

www.plos.org

How could we measure ‘impact’?

• Citations• Web usage• Expert Ratings• Social bookmarking• Community rating• Media/blog coverage• Commenting activity• and more…

Current technology now makes it possible to add these metrics automatically

At the ARTICLE LEVEL, we could track:

(http://tiny.cc/ALM1)

CrossRef Landing Page

www.plos.org

www.plos.org

www.plos.org

CiteULike Landing Page

www.plos.org

www.plos.org

Downloading the data

http://www.plosone.org/static/plos-alm.zip

Evaluating the (usage) data

Evaluating the (usage) data

www.plos.org

“The Dirty War Index (DWI) method has been adapted for use in NATO military environments to monitor civilian, woman and child casualties. This version of the DWI is called a ‘Civilian Battle Damage Assessment Ratio’ (CBDAR). Since October 2009, the CBDAR methodology has been used by NATO forces in Southern Afghanistan in order to reduce the possibility of injuring Afghan civilians. The methodology has identified a number of military activities that historically lead to civilian mortality that has led to NATO changing procedures.”

www.plos.org

Next steps for article-level metrics

• More data sources– F1000, Mendeley, media coverage, tweets

• Impact that is hard to measure• Expert analysis and tools• Broader adoption

– By publishers– By tenure committees, funders etc

• Develop and adhere to standards

The goals of PLoS Hubs

• Aggregate open access content – Wherever it is published

• Add value to content by connecting with data

• Build communities around content

Demonstrate the power of open access

ITIS

Flickr

Wikipedia

NCBI

GBIF

Next steps for PLoS Hubs

• Enhance and automate content enrichment• Develop Hubs community

– allow users to ‘follow’ a curator

• Extend literature sources beyond PMC– ideally to non-OA content

• Extend Hubs concept to other disciplines• Make Hubs easy to replicate

www.plos.org

Re-engineering authoring and certification

www.plos.org

New models of scholarly communication

1 year

100 days

1 day

Conventional PLoS ONE PLoS Currents

Publication

www.plos.org

• An innovative forum for the rapid exchange of results and ideas

• Registration– Articles are date-stamped and citable

• Certification– Reviewed by expert researchers

• Dissemination– All content is open access

• Preservation– Archived at PubMed Central

PLoS Currents: Key features

www.plos.org

Seeking Lessons in Swine Flu Fight

“Another problem is communication.Officials and experts say they have learned a lot about human swine influenza. But relatively little of that information...has been reported and published. Some experts said researchers were waiting to publish in journals, which can take months or longer.”

New York Times, August 10th, 2009Lawrence K. Altman, M.D.

PLoS Currents – Inspiration

www.plos.org

Google Knol: Author(s) assemble content and control access and editing. Authors submit content to PLoS Currents.

PLoS Currents: Expert reviewers control posting of content, commenting and version control.

PubMed Central: Immediate transfer from PLoS Currents site; stable identifier and permanent archiving.

PLoS Currents – Workflow

www.plos.org

www.plos.org

www.plos.org

www.plos.org

• Prescreen by Editors

• Submission sent to Board of Reviewers.

• Does the work contain any obvious methodological, ethical or legal problems?

www.plos.org

From submission to publication in a few days

www.plos.org

www.plos.org

www.plos.org

www.plos.org

www.plos.org

www.plos.org

www.plos.org

PLoS Currents• Very fast• Cost-effective• Reviewed by experts • Citable• Version control• Archived at PubMed Central• Included in PubMed• Flexible and easy to replicate

www.plos.org

PLoS Currents – New sections

• Launched on Sept 2nd

– PLoS Currents: Huntington Disease (produced with support from CHDI Foundation)

– PLoS Currents: Evidence on Genomic Tests (in collaboration with the CDC)

• To be launched in a few weeks– PLoS Currents: Tree of Life (phylogenetic

analyses)

The life cycle of a research article

Journal name is keyPublication

Research

Submission

Peer review

Reje

cts

2-3 Experts Is it rigorous?Good enough?Right audience?Takes months/years

New models of scholarly communication

Focus on the articlePublication

Research

Submission

Peer reviewReje

cts

2-3 Experts Is it rigorous?Good enough?Right audience?Takes weeks/months

Enhanced article Article-level metricsIntegrated with dataOrganization in Hubs

PLoS Currents

www.plos.org

The landscape is changing

www.flickr.com/photos/keepitsurreal/1884615328/