the potential drawbacks of open peer review. a simulation ... · building on the 'peer review...

8
The potential drawbacks of open peer review. A simulation model of scientist behaviour Flaminio Squazzoni & Federico Bianchi GECS-Department of Economics and Management University of Brescia, Italy [email protected] www.gecs.unibs.it/squazzoni.html PEERE Valencia 2016

Upload: others

Post on 09-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the

The potential drawbacks of open peer review.

A simulation model of scientist behaviour

Flaminio Squazzoni & Federico BianchiGECS-Department of Economics and Management

University of Brescia, Italy

[email protected]

www.gecs.unibs.it/squazzoni.html

PEERE Valencia 2016

Page 2: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the

Research question

� Transparency is viewed as a means to avoid selfish behaviour

by scientists and increase science accountability and

credibility

� This is true, in principle, but the devil is in the detail!

PEERE Valencia 2016

Page 3: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the

The basic model

� A population of N agents (authors & referees)

� Resources, productivity and quality

� Evaluation process: intrinsic vs. perceived quality

� Publish or perish

PEERE Valencia 2016

Page 4: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the

Play with our NetLogo model!

https://www.openabm.org/model/4718/version/1/view

PEERE Valencia 2016

Page 5: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the

Transparency implications

PEERE Valencia 2016

Page 6: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the

Dynamics

PEERE Valencia 2016

Page 7: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the

A conflict of values?

� Is science community a society of peers or is it based on a

hierarchical stratification?

� Next step: adding reciprocity strategies that are sensitive to

hierarchy and status

� Does transparency challenge justice?

� Does “respect” question the “truth”?

� Is transparency a dangerous social experiment imposed

without any control factors?

PEERE Valencia 2016

Page 8: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the

PEERE Valencia 2016