improving integrity, transparency, and reproducibility through connection of the scholarly workflow

Improving  Integrity,  Transparency,  and  Reproducibility  Through  Connec:on  of  

the  Scholarly  Workflow  

Andrew  Sallans  Partnerships  Lead  

Center  for  Open  Science  

A  talk  on  the  Open  Science  Framework  

1.  Free,  open  source  plaHorm  2.  Designed  to  add  efficiency  to  workflow  3.  Connector  to  other  tools  and  services  

So,  why  is  this  important?  

Challenges: Perceived norms Norms Communality Open Sharing

Universalism Evaluate research on own merit

Disinterestedness Motivated by knowledge and discovery

Organized skepticism Consider all new evidence, even against one’s prior work

Quality

Counternorms Secrecy Closed

Particularlism Evaluate research by reputation

Self-interestedness Treat science as a competition

Organized dogmatism Invest career promoting one’s own theories, findings

Quantity

Anderson, Martinson & DeVries, 2007

A  liNle  something  about  COS  •  Est.  2013  •  Non-­‐profit  tech  

startup    •  4  leading  

founda:on  funders,  >  $14M  

•  Located  in  CharloNesville,  VA  

•  Team:    ~  25  FT  &  20  interns  

•  Mostly  so]ware  developers  and  researchers   Mission: Improve openness, integrity, and

reproducibility of research

http://osf.io

Create an account

easy and free!

https://osf.io/settings

Modify Account Settings

Update information

Dashboard

Project Organizer

Project Overview Page

Overview

Using the Wiki

In the menu bar

Wiki history

Add new or edit

Adding Components

Add a new component

Adding Contributors

Select from the results

Choose permissions

Privacy

Uploading Files

Click upload button or just drag and

drop

Versioning

See version history and download

Registering Your Work Choose the registration template

Create a frozen registered version

Sharing Your Work

Create a view-only link

Describe the link use

Option to make

anonymous

Select what parts of the project to share

Unique and permanent IDs Scientific content must be easy to cite and

annotate Approach: GUIDs for all content https://osf.io/e81xl -> RPCB https://osf.io/alh38 -> Tim Errington https://osf.io/ibdv8 -> Coding_Study_1.xslx

Current Add Ons: •  Dropbox •  Github •  Dataverse •  Figshare •  AmazonS3

Connecting the workflow

Examples  of  other  connec:ons  Taking  a  data  management  plan  and  conver:ng  it  into  a  living  document.  

Providing  a  data  repository  lookup  service  and  checklist  to  assist  with  prepara:on  for  deposit.  

Connec:ng  to  a  sensi:ve  video  storage  service.  

Tools  used:  Qualtrics,  Dropbox,  Survey  Monkey,  R  OSF  features  used:    version  control,  collabora:on,  wiki  for  lab  notebook  and  mee:ngs  

OSF in the lab

How has the OSF improved your workflow?

Erica Baranski

Q

Q

Q

What tools do you use in your research?

A

A

A

How do you use the OSF?The OSF makes version

control effortless. My PI,my labmates,

and I have access to previous versions of a file at any time -

and the most current version is always readily available.

OPEN SCIENCE FRAMEWORK

osf.io | @OSFramework | #OSFinAction

Tools  used:    next-­‐gen  sequencers,  pipeline  so]ware,  custom  so]ware  OSF  features  used:    version  control,  file  sharing,  GitHub  and  Dropbox  integra:on,  public  sharing.      

Problem  to  solve:    teaching  undergrads  how  to  make  research  reproducible  and  verifiable.  OSF  features  used:    organiza:on  of  documents  and  data,  command  files,  metadata,  and  file  sharing.  

What’s  underneath  the  hood?  •  Python  •  Javascript  •  Git  •  MongoDB  /  TokuMx  •  Ansible  •  Elas:csearch  •  OSF  API  •  Rackspace  •  Linode  

Want  to  join  the  effort?  •  Contribute  content  to  SHARE  or  partner  on  cura:on  of  content  

•  Serve  as  an  Ambassador  •  Coordinate  a  reproducible  sta:s:cs  and  prac:ces  workshop  

•  Join  the  team  –  hNp://cos.io/jobs    

Open Science Framework osf.io

Email: contact@osf.io Twitter: @OSFramework