yale university open data access project...project model dissemination of findings conferences to...

51
Yale University Center for Outcomes Research and Evaluation Yale University Open Data Access Project A Model for Dissemination and Independent Analysis of Clinical Trial Program Data

Upload: others

Post on 14-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Yale University Open Data Access Project

A Model for Dissemination and Independent Analysis of

Clinical Trial Program Data

Page 2: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 3: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 4: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 5: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

What if….

Page 6: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 7: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 8: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Merck concluded that the cardiovascular effects seen in the VIGOR trial were most likely explained by a cardiovascular effect of naproxen.

Page 9: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation Source: Ross et al. Arch Intern Med 2009;169:1976-1984.

Month/ Year

CV Event/DeathRR (95% CI)

P value

08/1998 1.35 (0.47-4.77) 0.63

Page 10: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

As of 12/00, same time as publication of VIGOR trial

(Vioxx v. naproxen) where RR of MI was 5.00 (1.68-20.13)

Month/ Year

CV Event/DeathRR (95% CI)

P value

1.35 (0.47-4.77) 0.631.47 (0.51-5.15) 0.522.16 (0.79-7.37) 0.151.80 (0.71-5.40) 0.24

12/2000 2.18 (0.93-5.81) 0.07

Source: Ross et al. Arch Intern Med 2009;169:1976-1984.

Page 11: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

As of 6/01, nearly 3 ½ years before Vioxx was withdrawn

from market

Month/ Year

CV Event/DeathRR (95% CI)

P value

1.35 (0.47-4.77) 0.631.47 (0.51-5.15) 0.522.16 (0.79-7.37) 0.151.80 (0.71-5.40) 0.242.18 (0.93-5.81) 0.07

06/2001 1.35 (1.00-1.96) 0.05

Source: Ross et al. Arch Intern Med 2009;169:1976-1984.

Page 12: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Month/ Year

CV Event/DeathRR (95% CI)

P value

1.35 (0.47-4.77) 0.631.47 (0.51-5.15) 0.522.16 (0.79-7.37) 0.151.80 (0.71-5.40) 0.242.18 (0.93-5.81) 0.071.35 (1.00-1.96) 0.051.39 (1.07-1.81) 0.011.38 (1.08-1.77) 0.011.37 (1.07-1.75) 0.01

11/2004 1.43 (1.16-1.76) 0.0007

Source: Ross et al. Arch Intern Med 2009;169:1976-1984.

Page 13: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Not Just Vioxx

• Oseltamivir• Reboxetine• Rosiglitazone

Source: BMJ 2010;341:c4737; NEJM 2007;356:2457-71; BMJ 2010;341:c5641.

Page 14: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation Source: Turner, et al. NEJM. 2008;358:252-60.

Page 15: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation Source: Turner, et al. NEJM. 2008;358:252-60.

Page 16: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation Source: Turner, et al. NEJM. 2008;358:252-60.

Page 17: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 18: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 19: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 20: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 21: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 22: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 23: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 24: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 25: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

46% of trials published!

Source: Ross et al., PLoS Medicine 2009;6:e1000144.

Page 26: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 27: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Trial Registration and Results Reporting

• 1997 FDA Modernization Act, section 113, provided public access to information about ongoing clinical trials in which they may be able to participate

• Led to creation of ClinicalTrials.gov• 2007 FDA Amendments Act broadened

scope

Page 28: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

2007 FDA Amendments Act

• Expanded registry: all studies must be registered at inception

• Results database: trial results uploaded within 12 months of study completion (24 if under review)– “Basic results”: baseline characteristics, 1° & 2°

outcomes, statistical analyses (overall & by arm)– Adverse events (serious & frequent)

• But, no access to trial data …

Page 29: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation Ryan MJ. Science. 2011;334:1229.

Page 30: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation Peng RD. Science. 2011;334:1226.

Page 31: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 32: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 33: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 34: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 35: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 36: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

http://www.indexoncensorship.org/2011/11/science-medicine-secrecy-drug-studies-lives-risk/

Page 37: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 38: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 39: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Bottom Line

• Substantial number of clinical trials are conducted, but never published

• Even among published trials, a limited portion of the collected data is reported

• Thus, patients and physicians frequently make treatment decisions with access to only a fraction of clinical research data

Page 40: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

What can we do?

Page 41: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 42: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 43: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 44: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 45: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

YODA Project Model

Designed to facilitate the release of data, ensure high quality reviews of the

evidence, and provide the public with the scrutiny of independent review

Page 46: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

YODA Project Model

Dissemination of findings

Conferences to discuss issues associated with promoting access to individual clinical product data:

1. Creating standardized protocol for permitting access to product clinical data2. Issues in conducting systematic review and meta- analysis of product data, including clinical trial and post- market surveillance data3. Other issues: importance, strategies, gaps in statistical practice, practical concerns

Solicitation of proposals to conduct independent reviews

Review Organizations conduct independent evaluations in parallel

Selection of 2 research groups

Development of Web site for project communications and facilitation of data distribution

Communication of description of data files that will be made

available to researchers

Acceptance of requests for data using standardized protocol; review

of proposals

Processing of requests for data access; request and application

posted on Web site

Distribution of data

Requirement to submit results within 6 months of completion

data

Dissemination of findingsDissemination of conference

proceedings via peer-reviewed journals and project Web site

Product Identified, including areas of concern

Company releases to Coordinating Organization all clinical trial data (published/unpublished); post-market surveillance data;

and spontaneous adverse events

Steering Committeeguidance

Coordinating Organizationoversight

Development and Refinement of Approach for Disseminating Data Dissemination of Primary Data Review and Synthesis of

Primary Data

Page 47: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

http://online.wsj.com/article/SB10001424052970204630904577058162033028028.html

Page 48: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

http://www.pharmaphorum.com/2011/11/29/publication-of-clinical-trial-data-enough-of-the-excuses/

Page 49: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

http://www.cochrane.org/about-us/our-policies/support-free-access-to-all-data-from-all-clinical-trials

Page 50: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation

Page 51: Yale University Open Data Access Project...Project Model Dissemination of findings Conferences to discuss issues associated with promoting access to individual clinical product data:

Yale UniversityCenter for OutcomesResearch and Evaluation