clinical drug development - pharmacy microsites | ucsf · pdf fileclinical drug development...
TRANSCRIPT
![Page 1: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/1.jpg)
Clinical Drug Development with a
Bayesian Lens
Stephen J Ruberg, PhD Advanced Analytics Eli Lilly & Company
![Page 2: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/2.jpg)
Acknowledgements
21 Apr 2016 2
Meg Gamalo Karen Price Scott Berry
John Seaman
ACDRS - Substantial Evidence
![Page 3: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/3.jpg)
The Beginning is Always the Hardest
21 Apr 2016 3 ACDRS - Substantial Evidence
![Page 4: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/4.jpg)
APPROVAL
21 Apr 2016 4 ACDRS - Substantial Evidence
![Page 5: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/5.jpg)
Key Question
21 Apr 2016 5 ACDRS - Substantial Evidence
What would it look like if
SUBSTANTIAL EVIDENCE was based on a
Bayesian posterior probability rather than
p-value(s)?
![Page 6: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/6.jpg)
Substantial Evidence
21 Apr 2016 6 ACDRS - Substantial Evidence
Pr (drug works) > threshold
![Page 7: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/7.jpg)
Substantial Evidence
21 Apr 2016 7 ACDRS - Substantial Evidence
Pr (drug works) > threshold Drug – Placebo > 0
![Page 8: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/8.jpg)
Substantial Evidence
21 Apr 2016 8 ACDRS - Substantial Evidence
Pr (drug works) > threshold Drug – Placebo > CM
![Page 9: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/9.jpg)
Substantial Evidence
21 Apr 2016 9 ACDRS - Substantial Evidence
Pr (drug works) > threshold Drug – Placebo > Benefit-Risk
![Page 10: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/10.jpg)
Approval
21 Apr 2016 10 ACDRS - Substantial Evidence
Pr (drug works) > threshold Disease Common Life-threatening Rare disease Unmet need
![Page 11: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/11.jpg)
Approval
21 Apr 2016 11 ACDRS - Substantial Evidence
Pr (drug works) > threshold Endpoints Hard Surrogate Objective Subjective
![Page 12: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/12.jpg)
Approval
21 Apr 2016 12 ACDRS - Substantial Evidence
Hypothetical Examples
Pr (cure for pancreatic cancer) > 0.50 Pr (weight loss of 5kg) > 0.95 Pr (increased survival by 9 months) > 0.85
![Page 13: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/13.jpg)
Approval
“FDA is required to exercise its scientific judgment to determine the kind and quantity of data and information an applicant is required to provide for a particular drug to meet the statutory standards.” 21 C.F.R. § 314.105(c).
21 Apr 2016 ACDRS - Substantial Evidence 13
![Page 14: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/14.jpg)
Phase 3 21 Apr 2016 14 ACDRS - Substantial Evidence
![Page 15: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/15.jpg)
How much data?
21 Apr 2016 15 ACDRS - Substantial Evidence
![Page 16: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/16.jpg)
Study Design
21 Apr 2016 16 ACDRS - Substantial Evidence
![Page 17: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/17.jpg)
PRIOR 21 Apr 2016 17 ACDRS - Substantial Evidence
![Page 18: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/18.jpg)
EoPh2 Meeting
21 Apr 2016 18 ACDRS - Substantial Evidence
![Page 19: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/19.jpg)
Mechanistic Research
21 Apr 2016 ACDRS - Substantial Evidence 19
![Page 20: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/20.jpg)
PK / PD Models
21 Apr 2016 ACDRS - Substantial Evidence 20
![Page 21: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/21.jpg)
Phase 2 Data (or Phase 1 in some cases)
21 Apr 2016 ACDRS - Substantial Evidence 21
Use data from trials of same treatment as well as
other treatments in the same class.
Dose 1
Dose 2
Placebo
![Page 22: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/22.jpg)
Robust Bayes ♦ Usual approach: for unknown parameter(s), 𝜽𝜽,
specify ‘informative prior’ 𝜽𝜽 ~ 𝜋𝜋𝐼𝐼(𝜽𝜽|𝜼𝜼) ♦ A ‘robust’ approach (just use a prior mixture):
𝜽𝜽 ~ 𝜖𝜖 ⋅ 𝜋𝜋𝐼𝐼 𝜽𝜽 𝜼𝜼1 + 1 − 𝜖𝜖 ⋅ 𝜋𝜋𝑅𝑅 𝜽𝜽 𝜼𝜼2
♦ Example: 𝜽𝜽 ~ .85 ⋅ 𝑁𝑁 .52, . 1 + .15 ⋅ 𝑈𝑈 .1,2
‘Your informative prior’ ‘Your what-if-I’m-really-wrong prior’
21 Apr 2016 22 ACDRS - Substantial Evidence
Used with permission Zach Thomas, Eli Lilly
![Page 23: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/23.jpg)
Limitations
21 Apr 2016 23 ACDRS - Substantial Evidence
♦ Shrinkage of Ph 2 results ♦ Network meta-analysis
• How much data to include • How far back to go
♦ Changes in patient populations, geographies, doses, duration of treatment
♦ Changing endpoints (actual measure and the time of measurement)
![Page 24: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/24.jpg)
Regulatory Considerations
21 Apr 2016 24 ACDRS - Substantial Evidence
♦ It’s different for everyone, but …
♦ Reward more robust Phase 2 programs
![Page 25: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/25.jpg)
Phase 2 21 Apr 2016 25 ACDRS - Substantial Evidence
![Page 26: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/26.jpg)
PRIOR 21 Apr 2016 26 ACDRS - Substantial Evidence
![Page 27: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/27.jpg)
0
21 Apr 2016 27 ACDRS - Substantial Evidence
![Page 28: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/28.jpg)
0
21 Apr 2016 28 ACDRS - Substantial Evidence
Clinically Meaningful Threshold
![Page 29: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/29.jpg)
Nature Biotechnology January, 2014
![Page 30: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/30.jpg)
BEGIN
21 Apr 2016 30 ACDRS - Substantial Evidence
Regulatory Input or Not?
![Page 31: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/31.jpg)
How many studies?
21 Apr 2016 31 ACDRS - Substantial Evidence
![Page 32: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/32.jpg)
Reproducibility
21 Apr 2016 32 ACDRS - Substantial Evidence
![Page 33: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/33.jpg)
Interim Analysis
21 Apr 2016 33 ACDRS - Substantial Evidence
![Page 34: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/34.jpg)
Multiplicity
21 Apr 2016 34 ACDRS - Substantial Evidence
See Brad Carlin’s presentation
![Page 35: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/35.jpg)
Summary From Comments on ASA Statement on p-values (1) What does the data say?
• P-values attempt to answer Q1, but they are not the best answer.
(2) What should I believe? • A likelihood function gives a richer depiction of
evidence, and Bayesian methods formally answer Q2 with prior probability distribution to represent pre-data information or belief.
(3) What should I decide? • Q3 requires a loss function in addition to data.
21 Apr 2016 35 ACDRS - Substantial Evidence
![Page 36: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/36.jpg)
Summary
Do simulations to assess characteristics
of this system
21 Apr 2016 36 ACDRS - Substantial Evidence
See Scott Berry’s and Telba Irony’s presentations
![Page 37: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/37.jpg)
Summary
Nowhere did I say “Alpha is …”
21 Apr 2016 37 ACDRS - Substantial Evidence
![Page 38: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/38.jpg)
Summary
Making probability assessments (intuition,
judgments) more explicit/quantifiable
21 Apr 2016 38 ACDRS - Substantial Evidence
![Page 39: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/39.jpg)
Summary
ICH-E9 Pre-specification
• Bring objectivity, good science • Minimize post hoc assessments
21 Apr 2016 39 ACDRS - Substantial Evidence
![Page 40: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/40.jpg)
Conclusion Where to start? ♦ Non-inferiority ♦ Pediatrics ♦ Anti-infectives ♦ Orphan drugs ♦ Breakthrough
21 Apr 2016 40 ACDRS - Substantial Evidence
See Telba Irony’s presentation
![Page 41: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/41.jpg)
Conclusion
Fundamentally change the way we do business
21 Apr 2016 41 ACDRS - Substantial Evidence
![Page 42: Clinical Drug Development - Pharmacy Microsites | UCSF · PDF fileClinical Drug Development with a Bayesian Lens . Stephen J Ruberg, PhD . Advanced Analytics . Eli Lilly & Company](https://reader031.vdocuments.mx/reader031/viewer/2022011723/5aa2b88f7f8b9ada698d43e3/html5/thumbnails/42.jpg)
Clinical Drug Development with a
Bayesian Lens
Stephen J Ruberg, PhD Advanced Analytics Eli Lilly & Company