non-inferiority margins in clinical trials. difficult but necessary, or just a waste of time? dr...
TRANSCRIPT
![Page 1: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/1.jpg)
Non-Inferiority Margins in Clinical Trials.Difficult but necessary, or just a
waste of time?
Dr Simon DayRoche Products Ltd
![Page 2: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/2.jpg)
2
A description of the problem
• Consider a model where yij~N(μi,σ2)
Not a very helpful starting position(!)
![Page 3: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/3.jpg)
3
Copyright ©1996 BMJ Publishing Group Ltd.
Jones, B et al. BMJ 1996;313:36-39
A description of the problem
But is this any better?
![Page 4: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/4.jpg)
4
Non-inferiority trials have no place
![Page 5: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/5.jpg)
5
Ethics is a broad subject
• It may not seem unethical to recruit patients into a trial provided they will not be disadvantaged…
• But what about the expense, inconvenience and use of their goodwill?
![Page 6: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/6.jpg)
6
Non-inferiority is useful to Society
• Note – “non-inferiority” includes “equivalence” as a sub-set(but not vice-versa)– Generics (through bio-equivalence and bio-
similarity)– Better safety profile– Preferred formulation
• Includes clinical and pharmaceutical aspects
![Page 7: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/7.jpg)
7
Few examples of real equivalence
BMJ 2008;336:138-142
![Page 8: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/8.jpg)
8
Often not!
![Page 9: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/9.jpg)
9
Why do we not all agree on an appropriate margin?
• Various reasons– We work in different therapeutic areas
• (hence, let’s “not consider a model…”)
– We have different reasons to be interested in trials (and treatments)
• Patients, purchasers, and many in between and off at tangents
![Page 10: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/10.jpg)
10
Lack of thinking???
• “You have to make delta half the difference between standard and placebo – anything else just makes the sample size impossible”
![Page 11: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/11.jpg)
11
Current practice
![Page 12: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/12.jpg)
12
![Page 13: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/13.jpg)
13
[n = 332]
![Page 14: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/14.jpg)
14
Different uses for such studies
• Some to show two products yield materially similar results– Needs a narrow margin
• Some to show a treatment is better than (putative) placebo– A wide margin may answer this question
(but still not make the product very prescribable)
• Some maybe both
![Page 15: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/15.jpg)
15
What makes a margin acceptable?
• The results of the study!
• Treatment choices are based on benefit–risk
• In a superiority study we cannot say, a priori, what size of benefit will be prescribable
• EU regulators rarely (if ever) fully agree to a margin – it’s always conditional
![Page 16: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/16.jpg)
16
Margins depend on results
• DVT rates following surgery, about 15%
• NI margin argued to be 2 percentage points
• Trial results: 4% DVT versus 5% DVT– Unlikely to be accepted
![Page 17: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/17.jpg)
17
Margins depend on results
• Possibly argue Δ1, if overall event rate π0
– Then Δ2 (> Δ1) if π > π 0
– And Δ3 (< Δ1) if π < π 0
• Concept of “equivalent differences”Statistics in Medicine, 1988; 7: 1187–1194.
• Others have argued for similar ideas (successfully, over a narrow, plausible, range of π)
![Page 18: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/18.jpg)
18
Margins depend on consumers
• How much are you prepared to pay?
• What access to medicines do you have?
• What side effects are you prepared to tolerate?
• What’s your prior?
![Page 19: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/19.jpg)
19
Licenses don’t depend on p<0.05
• In a superiority study, getting p<0.05 does not imply automatic grant of an MA
• In a superiority study, getting p>0.05 does not imply automatic failure to grant an MA
• Instead, regulators look at the data (all of it!)
![Page 20: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/20.jpg)
20
Licenses don’t depend on p<0.05
• In a non-inferiority study, getting p<0.05 (against some non-zero margin) does not imply automatic grant of an MA
• In a non-inferiority study, getting p>0.05 (against some non-zero margin) does not imply automatic failure to grant an MA
• Instead, regulators (should) look at the data (all of it!)– And I think they do!
![Page 21: Non-Inferiority Margins in Clinical Trials. Difficult but necessary, or just a waste of time? Dr Simon Day Roche Products Ltd simon.day@Roche.com](https://reader036.vdocuments.mx/reader036/viewer/2022081602/551aff15550346f70d8b54f4/html5/thumbnails/21.jpg)
21
Some Conclusions
• Different people cannot agree on what a reasonable margin should be
• Different people cannot agree on what the principles of defining a margin should
• The acceptability of a margin depends on the results• Licensure/prescribability does not equate to p<0.05
(versus zero or versus “minus something”)• Margins might be helpful for planning purposes but
are much less relevant after the study