2007 copenhagen sspd how to use srs.ppt · reviews in biomedicine (n=1 307 569) 1200000 1400000...

45
How to use systematic How to use systematic reviews in clinical ti practice Asbjørn Jokstad Faculty of Dentistry Faculty of Dentistry University of Toronto, Canada

Upload: others

Post on 04-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

How to use systematicHow to use systematic reviews in clinical

tipracticeAsbjørn Jokstad

Faculty of DentistryFaculty of DentistryUniversity of Toronto, Canada

Page 2: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Evidence-EvidenceBased Practice:Practice:

SSPD Consensus conference, Copenhagen, August 24, 2007

Modified from Haynes et al. BMJ 1998;317:273-6

Page 3: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Evidence-based Practice

Recognition of need of evidence

d ba d a

need of evidence

Search for Evidence

Make Sense of Evidence

Act on Evidence

SSPD Consensus conference, Copenhagen, August 24, 2007

Act on Evidence

Page 4: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Primary research papers

SSPD Consensus conference, Copenhagen, August 24, 2007

Modified from Haynes et al. BMJ 1998;317:273-6

Page 5: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Publications in Dentistry

1200

1400N=1284

800

1000

400

600

800

200

400

0

190019101920193019401950196019701980199020002007

SSPD Consensus conference, Copenhagen, August 24, 2007

19 19 19 19 19 19 19 19 19 19 20 20

Source: Ulrich’s International Periodicals Directory

Page 6: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

The new graduateg

Advertisingd Publications- producers

- colleaguesPublicationsin dentistrydentistry

Teacher-filtered

“Curriculum”

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 7: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

The Information OverloadThe Information Overload

Advertisingd- producers

- colleagues

D t lMeetings/ courses

Dental literature “Vitenskap

Dental‘science’25 000 ti l /courses

Colleagues

p”25 000 articles/yr

WWW

Patients & (-groups)

SSPD Consensus conference, Copenhagen, August 24, 2007

Patients & ( groups)

Popular magazines & Media

Page 8: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Read and use reviews 2 reasonsRead and use reviews – 2 reasons

1. Sheer volume of literature

2. Saves time doing h lexhaustive literature

researchesresearches

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 9: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Secondary research papers

Modified from Haynes et al. BMJ 1998;317:273-6

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 10: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Reviews in BioMedicine (n=1 307 569)

1200000

1400000

800000

1000000

1200000

600000

800000

200000

400000

0

1962

1966

1970

1974

1978

1982

1986

1990

1994

1998

2002

2006

SSPD Consensus conference, Copenhagen, August 24, 2007

(Source: Medline. OVID search strategy: review.pt)

Page 11: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Reviews in Dentistry (n=12 367) (2007: 191)

12000

14000Reviews in Dentistry (n 12.367) (2007: 191)

8000

10000

12000

6000

8000

2000

4000

0

1962

1966

1970

1974

1978

1982

1986

1990

1994

1998

2002

2006

SSPD Consensus conference, Copenhagen, August 24, 2007

(Source: Medline. OVID search strategy: review.pt + exp dentistry)

Page 12: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

ReviewReviewss -- problemsproblemsReviewReviews s -- problemsproblemsUsually:

• written by a single topic expert

b d th i d t di f th• based on their understanding of the literature

• no methodology is given

b d b d bj t i dd d• a broad based subject is addressed

• the conclusions and advises differ

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 13: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Example: Are splints an Example: Are splints an p pp pefficacious intervention for efficacious intervention for patients with TMD?patients with TMD?patients with TMD?patients with TMD?

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 14: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

SSPD Consensus conference, Copenhagen, August 24, 2007

199 refs

Page 15: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

54 refs

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 16: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

55 f 199 f55 refs 199 refs12 refs appear in both papers

?

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 17: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

S hSRs can show:

A review being published in hi hl bl j la highly reputable journal

does not necessarily meandoes not necessarily mean it can’t be biased

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 18: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Th f thTherefore, the reviews should be

”Systematic”y

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 19: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Systematic review

”S stematic e ie s””Systematic reviews” appearing 1971, 1972, 1973?

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 20: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

”Systematic” review ?Systematic review ?

Is just a word!Is just a word!SSPD Consensus conference, Copenhagen, August 24, 2007

Page 21: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

”Systematic” review ?Systematic review ?Is just a word!Is just a word!

5 Qualifyers are5 Qualifyers are i drequired

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 22: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

5 Qualifyers required:1. The review has to begin with a

Q y q

statement specifying a (clinical) question or(clinical) question or hypothesis

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 23: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

5 Qualifyers required:1. A statement specifying a question or hypothesis

2. A description of a search strategy for

Q y q

2. A description of a search strategy for literature that convinces the reader that all publications/study resultsthat all publications/study results pertinent to the subject area have been identifiedbeen identified

- perhaps limited to a particular type (e.gRandom Controlled Trials (RCT))Random Controlled Trials (RCT))

- from all relevant specific sources (e.g.Web bibliographic databases)

SSPD Consensus conference, Copenhagen, August 24, 2007

Web bibliographic databases)

Page 24: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

5 Qualifyers required:1. A statement specifying a question or hypothesis2. Search strategy that identifies all publications/study

lt ti t t th bj t

Q y q

results pertinent to the subject area- perhaps limited to a particular type (e.g RTCs)- from all relevant specific sources (e.g. bibliographic d b )databases)

3. Valid criteria to include or l d id tifi d t di hexclude identified studies have

been described and applied (e.g. Ob ti ti i t dObservation time, size, study population, outcomes...)

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 25: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

5 Qualifyers required:1. A statement specifying a question or hypothesis2. Search strategy that identifies all

publications/study results pertinent to the

Q y q

publications/study results pertinent to the subject area subject area have been identified.

3. Valid criteria to include or exclude identified studies have been described and applied

4. Extracted relevant data have been combined and comparedIf the data cannot be combined,If the data cannot be combined, the strength of the evidence is assessed and used to evaluate

SSPD Consensus conference, Copenhagen, August 24, 2007

assessed and used to evaluate the results

Page 26: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

5 Qualifyers required:1. A statement specifying a question or hypothesis2. All publications in the subject area are appraised,

perhaps limited to a particular type and from all

Q y q

perhaps limited to a particular type and from all relevant specific sources

3. Valid criteria to include or exclude identified studies have been described and applied

4. Extracted relevant data have been combined and comparedcompared

5. The conclusions are based solely on the results and/orsolely on the results and/or the presence or absence of

ti idSSPD Consensus conference, Copenhagen, August 24, 2007

supporting evidence

Page 27: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Systematric reviews are t il tnot necessarily true or

of relevanceof relevance.ButBut,

they should bethey should be repeatable

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 28: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

M dli A 2007Medline Aug 2007

Reviews (n 1 307 569)Reviews (n=1 307 569)

Systematic Reviews (n=8114) Meta-analyses (7036)

SRs that include a meta-analysis (n=2288)

SSPD Consensus conference, Copenhagen, August 24, 2007

y ( )

Page 29: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

1400

1600

18002000

(Actual number

600

8001000

12001400 (

or an inflation of the term?)

SSPD Consensus conference, Copenhagen, August 24, 2007

0

200400

1990

1992

1994

1996

1998

2000

2002

2004

2006

Page 30: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

” The history” in dentistry N=225in dentistry

(Cumulative)

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 31: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

SRs in dentistry: Topicsy p• Pain & pharmacotherapy (n=51)• Periodontology (n=31)Periodontology (n 31)• Restorative dentistry (n=28)• Caries (n=23)• Caries (n=23)• Fluoride issues (n=17)

O th d ti ( 16)• Orthodontics (n=16)• Implant-related (n=11)• Antibiotics, acupuncture, apnea, infection

control, oral medicine, sealants, sedation, t eatment decisions to icolog TMD

SSPD Consensus conference, Copenhagen, August 24, 2007

treatment decisions, toxicology,TMD...

Page 32: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

What can SRsWhat can SRs show us?show us?

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 33: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Example: How ff ti ieffective is

Guided Tissue iRegeneration

(GTR) for ( )patients with localized bonelocalized bone

loss?

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 34: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

SSPD Consensus conference, Copenhagen, August 24, 2007

1.5 mm vz 4.2 mm = 2.7 mm diff.

Page 35: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Cortellini P, Tonetti M. Focus on intrabony defects: guided tissue regeneration. Periodontology 2000 2000;22:104-132.

SSPD Consensus conference, Copenhagen, August 24, 2007 1.8 mm vz 3.4 mm = 1.6 mm diff.

Page 36: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 37: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

GTR attachment gain compared to open flap debridement

Laurell et al. J Periodontol 1998: 2.7 mm

Cortellini et al. Periodontology 2000 2000: 1.6 mmUncontrolled and unblinded studies

gyUnclear selection criteria for studiesInclusion of studies of short duration

Needleman et al. Cochrane Review 2001: 1.1 mmRandomised, controlled trialsTrials only comparing GTR vs flap debridrementTrials only comparing GTR vs flap debridrementTrials > 12 monthsFurcation involvements excluded

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 38: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

SRs can show:

• The selection of studies to

SRs can show:

• The selection of studies to include in reviews will reflect

l iconclusions• The study methodology aspects• The study methodology aspects

will reflect conclusions• Need to focus on studies with

good methodological designs

SSPD Consensus conference, Copenhagen, August 24, 2007

good methodological designs

Page 39: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

How quickly do dentists change in d ith h?accordance with new research?

Impacted wisdom teeth?Impacted wisdom teeth? TMD management?gRestoration replacement needs?Caries and remineralization potential....Science transfer to dentists seems to be ineffective

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 40: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 41: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

USA

1979: NIH Consensus dev. 1995: Am.Acad.Oral Med.Surg. Consensus dev. Conference for removal of third molars

gParameters of Care

1993: Am.Acad.Or.Med.Surg. Workshop on the managem. of

ti t ith thi d l t th

2000: SIGN Guidelines

1991 Am.Acad.Oral Med.Surg Parameters of Care

patients with third molar teeth

1980 1990 20001980 1990 20001995: Br. Assoc.Oral Med. Surg. Pilot Clinical Guidelines

1996: NHS R&D. National guidelines

Sept 1997: FacDentSurg RoyCollSurg(Eng)

1998: Effectiveness Matters 3(2)

SSPD Consensus conference, Copenhagen, August 24, 2007

1998: Effectiveness Matters 3(2)

2000: NHS R&D HTA Programme2000: NICE Guidelines

Page 42: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

”...studies ....appear to motivate a moreto motivate a more restrictive approach t d d

SSPD Consensus conference, Copenhagen, August 24, 2007

today compared with 10 years ago”

Page 43: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Even if we do have SRs...Even if we do have SRs...

These are not necessarily known toThese are not necessarily known to the dental practitioners community

Who’s responsibility is it to disseminate (new) research resultsdisseminate (new) research results that impacts directly on patient

?care?

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 44: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

E.B. - Recommendations & Guidelines• Scottish Intercollegiate Guidelines Network• Adopted by many goverment health p y y g

agencies worldwide• Grades of Recommendations:

– grade A: based on strong evidence grade B grade C grade D: based weak evidence

SSPD Consensus conference, Copenhagen, August 24, 2007

Page 45: 2007 Copenhagen SSPD How to use SRs.ppt · Reviews in BioMedicine (n=1 307 569) 1200000 1400000 800000 1000000 600000 200000 400000 0 1962 1966 1970 1974 1978 1982 1986 1990 1994

Thank youThank you for yourfor your

ki dkind iattention