bootcamp - data reproducibility as a social system of trust · 2019-06-08 · scaling a data...

23
Data Reproducibility as a Social System of Trust Orfeu M. Buxton, PhD Professor, Biobehavioral Health Data Reproducibility Boot Camp 2019-06-03 (4 Shashi)

Upload: others

Post on 11-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Data Reproducibility as a Social System of Trust

Orfeu M. Buxton, PhDProfessor, Biobehavioral Health

Data Reproducibility Boot Camp 2019-06-03(4 Shashi)

Page 2: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Sleep, Health & Society Collaboratory

Biopsychosocial model

v Collaboratory research topics:

• causes of sleep deficiency in the workplace, home, and society

• health consequences of sleep deficiency, especially cardiometabolic outcomes, and the mechanisms by which these outcomes arise

Page 3: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Lifecourse Context of Health Behaviors

v this matters for health and well-being

v can influence health disparities

v bias for action (intervention)

Page 4: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

The Myth of Sisyphus

Page 5: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Why are you here?

Page 6: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

PipelineIdea > funding > collect data. >. manage > analyze > interpret

The time is past where you can do it all yourself

Page 7: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

data entry and double-checking1990 Alone or in pairs, analog to digital

2000 Merging across systems, narrow queries

2010 Merge/query complex databases

2020

Page 8: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Harmonizing1990 Consistency of measurement

2000 Consistency across studies

2010 Consistency across studies, teams, time

2020

Page 9: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

That Jerk at my Talk

Page 10: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Firing a Cheater

Poison to a social system

Page 11: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Unblinding

A social contract

Page 12: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Harmonizing again1990 Consistency of measurement

2000 Consistency across studies

2010 Consistency across studies, teams, time

2020

Page 13: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Ars Longica

Life is shortand the art long,Occasion instantExperiment perilousDecision difficult

Page 14: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

SCALING

Page 15: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

PennState.Pure

Accessed 2019-05-15

https://pennstate.pure.elsevier.com/en/persons/orfeu-m-buxton/publications/

Network

Page 16: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”
Page 17: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”
Page 18: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”
Page 19: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Worst thingyou can call a scientist?

Sloppy

Page 20: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Sausage-makingunfundableIrreproducibleP-hackingWasting timeFlop at reviewJerky

Open Science Frameworkhttps://osf.io/

Productivity & citationsEfficiency (Jupyter.org)Developing lines of researchTrust of peers

Page 21: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Attention to Purpose

Pre-specification, documentation

Scaling a data pipeline

Science, a social system

Page 22: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

The Myth of Sisyphus

“One must imagine Sisyphus happy.” - Albert Camus

Page 23: Bootcamp - Data Reproducibility as a Social System of Trust · 2019-06-08 · Scaling a data pipeline Science, a social system. The Myth of Sisyphus “One must imagine Sisyphus happy.”

Data Reproducibility as a Social System of Trust

Orfeu M. Buxton, PhDProfessor, Biobehavioral Health

Data Reproducibility Boot Camp 2019-06-03(4 Shashi)