principles of signal detection - uppsala university · • a signal is a work hypothesis that needs...

27
Principles of Signal Detection Pia Caduff-Janosa MD Annual Course May 2013

Upload: others

Post on 27-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

Principles of Signal Detection

Pia Caduff-Janosa MD

Annual Course May 2013

Page 2: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

2 Pia Caduff-Janosa, Uppsala Monitoring Centre

Outline

• What is a signal?

• Signal sources

• Triggers

• Assessment of potential risk

• Signal evaluation

• Outcome

Page 3: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

3 Pia Caduff-Janosa, Uppsala Monitoring Centre

What is a signal?

• Reported information on a possible causal relationship between an adverse event and a drug, the relationship being unknown or incompletely documented previously.

• Usually more than a single report is required to generate a signal, depending upon the seriousness of the event and the quality of the information. The publication of a signal usually implies the need for some kind of review or action.

Page 4: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

4 Pia Caduff-Janosa, Uppsala Monitoring Centre

Signal sources

• Individual Case Safety Reports

• Clinical studies

• Literature

• WHO Programme-UMC

• Scientific conferences

• Drug Regulatory Authorities

• Media

Page 5: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

5 Pia Caduff-Janosa, Uppsala Monitoring Centre

Page 6: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

6 Pia Caduff-Janosa, Uppsala Monitoring Centre

Signal bells... .... when should they start ringing?

Page 7: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

7 Pia Caduff-Janosa, Uppsala Monitoring Centre

Triggers

• ADR reported is unexpected

• Fatal outcome or life threatening course

• Specific ADRs – SJS, TEN

– Agranulocytosis

• Cluster

• Unusual aspects of expected ADRs

Page 8: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

10 Pia Caduff-Janosa, Uppsala Monitoring Centre

10

Individual case safety report

Signal confirmed?

Action

Case series further information

Page 9: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

11 Pia Caduff-Janosa, Uppsala Monitoring Centre

11

How many reports make a signal?

• 3 index cases – Completely documented

– No or only minimal confounders

– Positive de-/rechallenge

Page 10: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

12 Pia Caduff-Janosa, Uppsala Monitoring Centre

”Further information”?

• What do we know about the drug itself?

• What do we know about the way it is used?

• What do we know about similar drugs (class effects)?

• Is there a reasonable causal relationship between drug and reaction in our case reports?

• Signal assessment = causality assessment??

Page 11: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

13 Pia Caduff-Janosa, Uppsala Monitoring Centre

13

Signal assessment

• Labelling – national and international

• Case series in databases? – National database

– VigiBase/VigiLyze

• Literature

Page 12: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

14 Pia Caduff-Janosa, Uppsala Monitoring Centre

Signal assessment

• ”Small” database – Mostly case series and assessment of ICSRs

• Large database – Automated search for disproportionalities

– Case series

Page 13: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

15 Pia Caduff-Janosa, Uppsala Monitoring Centre

UMC signalling process

Data mining Disproportionality

measure (IC)

Clinical assessment

UMC + Review Panel

National PV Centres Pharma Company

Not (yet) signal

Triage algorithms

UMC review Literature check etc

WHO db VigiBase

Page 14: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

16 Pia Caduff-Janosa, Uppsala Monitoring Centre

16

Data analysis – single case

• Demographic data • Medical history • Chronology • Risk factors • Differential diagnosis • De-/Rechallenge • Concomitant medication • Other confounders/bias

Page 15: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

17 Pia Caduff-Janosa, Uppsala Monitoring Centre

Signal assessment is about patterns

• Who is at risk?

• Are there patient specific risk factors?

• Are there drug specific risk factors?

• Is there a geographical pattern?

• Does the ADR follow a pattern?

Page 16: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

18 Pia Caduff-Janosa, Uppsala Monitoring Centre

Signal assessment

• There is no magic button...

Page 17: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

19 Pia Caduff-Janosa, Uppsala Monitoring Centre

Signal assessment is about...

• Hard and patient intellectual work

Page 18: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

20 Pia Caduff-Janosa, Uppsala Monitoring Centre

...and

• Decision making

Page 19: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

21 Pia Caduff-Janosa, Uppsala Monitoring Centre

21

Dilemma

• A signal should be identified as soon as possible to allow early warning

but

• should be documented as well as possible (credibility) → When is there ENOUGH evidence?

Page 20: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

22 Pia Caduff-Janosa, Uppsala Monitoring Centre

Risk minimization

• Action taken (mostly) by Regulatory Authorities with the aim of keeping a positive benefit risk balance

Page 21: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

23 Pia Caduff-Janosa, Uppsala Monitoring Centre

Potential risk

• Exposed population (size, sensitive populations)

• Essential medicinal product

• Seriousness and severity of ADR

• Avoidable ADR?

• Rapid increase of number of reports

• Public impact and perception

Page 22: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

24 Pia Caduff-Janosa, Uppsala Monitoring Centre

The risk potential defines the next move

Page 23: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

25 Pia Caduff-Janosa, Uppsala Monitoring Centre

• If the risk is assessed as very high, risk minimizing actions might be justified even if the signal is not (yet) confirmed

Page 24: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

26 Pia Caduff-Janosa, Uppsala Monitoring Centre

More on this....

• ...on Monday May 27th @ 8.30 am

Page 25: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

27 Pia Caduff-Janosa, Uppsala Monitoring Centre

27

Take home messages

• A signal is a work hypothesis that needs to be confirmed or refuted

• Signal assessment is a dynamic process • Signal detection is a lifelong process for

every medicinal product • Well documented ICSRs (index cases) are

one of the most precious elements in signal detection and assessment

• Signal assessment is intellectual work

Page 26: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

28 Pia Caduff-Janosa, Uppsala Monitoring Centre

Questions?

Page 27: Principles of Signal Detection - Uppsala University · • A signal is a work hypothesis that needs to be confirmed or refuted • Signal assessment is a dynamic process • Signal

29 Pia Caduff-Janosa, Uppsala Monitoring Centre

Uppsala Monitoring CentreBox 1051SE-751 40 Uppsala, SwedenVisiting address: Bredgränd 7, Uppsala

tel +46 18 65 60 60fax +46 18 65 60 88website www.who-umc.org