less is more: guidelines - esim2014.org is more iv primiano iannone.… · esim summer school ....
TRANSCRIPT
![Page 1: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/1.jpg)
ESIM Summer School June 20 Friday, 2014
Less is more: Guidelines
Primiano Iannone, MD Head of Emergency Department Ospedali del Tigullio, Lavagna (GE) Italy
![Page 2: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/2.jpg)
• What is a clinical guideline• Why do we need clinical guidelines• How guidelines are (and should be) produced• Quality of current guidelines• How to decide whether a guideline is trustworthy• How to use a clinical guideline• The future of clinical guidelines
layout
![Page 3: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/3.jpg)
2011
![Page 4: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/4.jpg)
Farquhar CM, et al. Med J Aus 2002
How clinical guidelines are percieved
![Page 5: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/5.jpg)
• What is a clinical guideline• Why do we need clinical guidelines• How guidelines are (and should be) produced• Quality of current guidelines• How to decide whether a guideline is trustworthy• How to use a clinical guideline• The future of clinical guidelines
![Page 6: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/6.jpg)
Physicians take decisions about (with) their patients
We take clinical decisions every day, several times per day. Often, these decisions are semiautomatic choices dictated by consolidated practices, previous professional experiences and knowledge background, local clinical habits and policies, with an heuristic approach typical of type 1 thinking («fast thinking») according to Kahneman. Often we consider also what our patients say and think about their illness. Sometimes we don’t.
![Page 7: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/7.jpg)
However, we face often serious uncertainty about the quality of evidences on which to base our decisions, as well as to what extent individual patients’ conditions related to age, gender, morbidity, personal preferences and beliefs could modify the picture.
In these cases a sound, slow and complex rational approach («type 2 thinking», referring again to Kahneman’s terminology) is required.
![Page 8: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/8.jpg)
So, we need searching, appraising and staying up-to-date with the best evidence, integrating it with our personal knowledge and experiences, as well aswith cost considerations, weighting risksand benefits carefeully, patientspreferences, with a clever clinicalreasoning
but can we do this efficiently ?
![Page 9: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/9.jpg)
the exponential growth of randomized controlled trials
![Page 10: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/10.jpg)
…we need leaner and moreefficient methods of staying up-to-datewith the evidence. Using current methods,the Cochrane Collaboration has not beenable to keep even half of its reviews up-to-date…
![Page 11: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/11.jpg)
RCTs indexed on PubMED
1978-2013 355.272
1978: 1787 RCTs
2013: 16944 RCTsHeart failure [MeSH] RCTs 2010-2013: 1104
![Page 12: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/12.jpg)
![Page 13: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/13.jpg)
![Page 14: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/14.jpg)
So, what do we need ?
• Raise the right questions in an answerable manner(PICO)
• Search for evidences efficiently• Appraising critically evidences and rating them• Integrating evidence with our experiences and previous
knowledge• Adapting evidences and deciding whehter it is worth
applying them to individual patients
![Page 15: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/15.jpg)
JAMA, 1992; 268: 2420-25
![Page 16: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/16.jpg)
Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. The practice of evidence based medicine means integrating individual clinical expertise withthe best available external clinical evidence from systematic research.
Evidence based medicine: what it is and what it isn't
David L Sackett, William M C Rosenberg, J A Muir Gray, R Brian Haynes, W Scott RichardsonBMJ 1996;312:71-72 (13 January)
![Page 17: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/17.jpg)
Evidence based medicine
Evidence Based Clinical Guidelines
![Page 18: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/18.jpg)
• What is a clinical guideline• Why do we need clinical guidelines• How guidelines are (and should be) produced• Quality of current guidelines• How to decide whether a guideline is trustworthy• How to use a clinical guideline• The future of clinical guidelines
![Page 19: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/19.jpg)
Systematic review of literature
Studies have shown that the balance of disciplines within a guideline development group has considerable influence on theguideline recommendations
Multidisciplinary development
Guidelines based on a consensus of expert opinion or on unsystematic literature surveys have been widely criticised as not reflecting current medical knowledge and being liable to bias.
Graded recommendations
Guideline recommendations are graded to differentiate between those based on strong evidence and those based on weak evidence
Miller J, Petrie J. Development of a practice guideline. Lancet 2000; 355:82–3.
![Page 20: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/20.jpg)
What does it mean systematic review of literature?
To minimise potential sources of bias in the guideline recommendations, the literature should be identified according to an explicit search strategy, selectedaccording to defined inclusion criteria,and assessed againstconsistent methodological standards
![Page 21: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/21.jpg)
Graded recommendations
Certainty(Level of evidence)
Strenghtof recommendations
strong
weaklow
high
![Page 22: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/22.jpg)
Many guidelines derive(d) level of evidence almost exclusively from study type
Moreover classification of level of evidences with letters, numbers, or symbols was chaotic
![Page 23: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/23.jpg)
ESC/AHA
![Page 24: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/24.jpg)
SIGN
![Page 25: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/25.jpg)
ERC 2010 guidelines
![Page 26: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/26.jpg)
Type of study
Quality of evidenceStrength
of recommendation
![Page 27: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/27.jpg)
And so, no RCT, no strong recommendation?
![Page 28: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/28.jpg)
?
![Page 29: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/29.jpg)
Sometimes trials are unethical or impossible
![Page 30: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/30.jpg)
Sometimes trials are unethical or impossible
yet some treatments are quite effective
DC shock for ventricular fibrillation
Insulin for diabetic coma
Blood trasfusion for haemorrhagic shock
![Page 31: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/31.jpg)
Type of study
Quality of evidence Strenghtof recommendation
Other factors ?
![Page 32: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/32.jpg)
1.Relevance of outcomesImportance of the outcome that treatment prevents
Deep vein thrombosis : Postflebitic syndrome vs death from PulmonaryEmbolism
Atrial Fibrillation: Palpitations Vs stroke
![Page 33: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/33.jpg)
2. Magnitude of treatment effectthe lower the NNT (=1/ARR) , more effective the treatment is
![Page 34: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/34.jpg)
Relative risk reduction overestimates effect of treatment
![Page 35: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/35.jpg)
![Page 36: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/36.jpg)
3.Risk of BiasSystematic error leading to overestimate or
underestimateof true treatment effect
Also RCTs may be affected by several biases that weaken their quality
Selection biasDetection biasAttrition bias
Reporting bias…..
![Page 37: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/37.jpg)
4. Precision
Reliable measurement of the effect size of the treatment
95 %Confidence intervals
ASA vs Placebo for stroke prevention in Atrial Fibrillation has wider 95% CIthan in Transient Ischemic Attacks
![Page 38: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/38.jpg)
5. inconsistency
Conflicting results across trials
![Page 39: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/39.jpg)
6. directness
differences between studied and target populationas regard of
Interventions
Patients (applicability)
Outcomes (hard vs surrogate)
Absence of head to head comparisons
![Page 40: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/40.jpg)
type of study
Quality of evidence Strenght of recommendation
magnitude of effectrisk of bias
precision
consistency
directness
relevance
Balance of all favorable /unfavorable outcomes
patients values & preferences
resources ?
a more complex approach is needed
![Page 41: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/41.jpg)
![Page 42: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/42.jpg)
![Page 43: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/43.jpg)
According to GRADE Quality of evidence must be summarized in a table
Iannone et Al,JAMA Intern Med, 2014
![Page 44: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/44.jpg)
a more complex approach
![Page 45: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/45.jpg)
http://www.gradeworkinggroup.org/
![Page 46: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/46.jpg)
![Page 47: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/47.jpg)
There are goodguidelines
![Page 48: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/48.jpg)
However many medicalspecialty societies
haven’t adopted GRADE yet
![Page 49: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/49.jpg)
• What is a clinical guideline• Why do we need clinical guidelines• How guidelines are (and should be) produced• Quality of current guidelines• How to decide whether a guideline is trustworthy• How to use a clinical guideline• The future of clinical guidelines
![Page 50: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/50.jpg)
Grilli et al : Lancet, 2000
Low quality of early guidelines
![Page 51: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/51.jpg)
![Page 52: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/52.jpg)
We have also another problem
![Page 53: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/53.jpg)
Conflict of interests
Bias almost alwaysresults in an overestimation of benefit
and an underestimation ofharm
Is not a source of a random error
COI generates BIAS
![Page 54: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/54.jpg)
A COI is a set of conditions in which professional judgment concerning a primary interest (such as the health and well being of a patient or the validity of research), is unduly influenced by a secondary interest -The secondary interests may be financial or nonfinancial.
Thompson DF (1993) Understanding financial conflicts of interest. NEJM 329: 573–576.
![Page 55: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/55.jpg)
Managing COI within a guideline panel is of
paramount importanceto warrant trustworthy
recommendations
![Page 56: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/56.jpg)
![Page 57: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/57.jpg)
![Page 58: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/58.jpg)
Lenzer et Al, BMJ 2013
![Page 59: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/59.jpg)
Lenzer et Al, BMJ 2013
![Page 60: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/60.jpg)
![Page 61: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/61.jpg)
![Page 62: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/62.jpg)
• What is a clinical guideline• Why do we need clinical guidelines• How guidelines are (and should be) produced• Quality of current guidelines• How to decide whether a guideline is trustworthy• How to use a clinical guideline• The future of clinical guidelines
![Page 63: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/63.jpg)
• How to decide whether a guideline istrustworthy
• Evaluation frameworks (AGREE, GIN, IOM standards)• Concordance between guidelines
Traditional approach
![Page 64: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/64.jpg)
![Page 65: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/65.jpg)
![Page 66: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/66.jpg)
2011
1. Establishing Transparency
2. Management of Conflict of Interest (COI)
3. Guideline Development Group Composition
4. Clinical Practice Guideline–Systematic Review Intersection
5. Establishing Evidence Foundations for and Rating Strength ofRecommendations
6. Articulation of Recommendations
7. External Review
8. Updating
![Page 67: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/67.jpg)
Evaluation frameworks explore the qualityof producing and reporting guidelines
NOT the trustworthiness of their recommendations
![Page 68: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/68.jpg)
Concordance of recommendationsbetween (among) differentguidelines
Proxy of trustiworthiness
Adherence to quality standards
Or not ?
how many guidelinesfor a disease ?
![Page 69: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/69.jpg)
A case study
• Three renowned medical specialty societies• Three guidelines on the same disease (why ?)• Same evidence base about a given drug X• One of three guideline declares to comply with GRADE• Full disclosures of conflict of interests• Another guideline declares to comply with AGREE criteria• Substantial agreement among them about the effectiveness
of drug X
Who could doubt it?
![Page 70: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/70.jpg)
Can dronedarone be recommended for preventing recurrencesof Atrial Fibrillation ?
• Three renowned medical specialty societies (AHA, ESC, CCS)
• Three guidelines on the same disease (why ?)• Same evidence base (6 RCTs) about dronedarone• One guideline declared to comply with GRADE• Full disclosures of conflict of interests• Another guideline declared to comply with AGREE
criteria• Substantial agreement among them about the
effectiveness of dronedarone
![Page 71: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/71.jpg)
However applying GRADE methods to the same evidencebase considered by these three guidelines….
We didn’t find relevant favorable outcomes, we found unexplained heterogeneity of results, and we could not exclude an unfavorable effect of dronedarone on mortality, with an excess of 13 (95%CI, −15 to 61) deaths per 1000 patients treated with it
![Page 72: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/72.jpg)
Iannone et Al, JAMA Internal Medicine, 2014
![Page 73: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/73.jpg)
Can dronedarone be recommended for AtrialFibrillation ?
• Three renowned medical specialty societies (AHA, ESC, CCS)• Three guidelines on the same disease (why ?)• Same evidence base (6 RCTs) about dronedarone• One guideline declares to comply with GRADE• Full disclosures of conflict of interests• Another guideline declares to comply with AGREE criteria• Substantial agreement among them about the effectiveness of dronedarone
NO
![Page 74: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/74.jpg)
![Page 75: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/75.jpg)
in presence of
• flawed methods (no GRADE guidelines)• uncontrolled conflict of interests• restricted panel compositions
Concordance of recommendations betweenguidelines and declared adherence to qualitystandards do not warrant their trustworthiness
![Page 76: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/76.jpg)
A roadmap I would suggest…
(a very modest & weak recommendation…)
![Page 77: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/77.jpg)
Have You a clinical problem ?
Search whether a guideline addressing relevant outcomes does exsist
Sound methodology ?(GRADE fully exploited)
No/Negligible conflict of Interest ?
Multidisciplinary involvement ?
Low risk of untrustworthiness
PICO conceptualisation
YES
YES
IOM criteriahelpful
Evaluate primary evidences carefully in case of any doubt
YES
NO
NO
NO
NO
Search for other
evidences
YES
![Page 78: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/78.jpg)
• Overall quality of evidences• Relevance of outcomes• Type of studies• Precision• Consistency• Directness• Risk of bias• Modifiers
• Balance across all favourable and unfavourableoutcomes
• Patients’ values and preferences• Resources’ use
Follow GRADE conceptualisation
![Page 79: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/79.jpg)
assessing their trustworthiness, too….
![Page 80: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/80.jpg)
• What is a clinical guideline• Why do we need clinical guidelines• How guidelines are (and should be) produced• Quality of current guidelines• How to decide whether a guideline is trustworthy• How to use a clinical guideline• The future of clinical guidelines
![Page 81: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/81.jpg)
If a recommendation is trustworthy, the main issue is deciding whetherIt can be applied to our patient(s)
It is a matter of clinical judgement consideringdifferences beween ideal study conditions whereevidences were produced and real life settings in terms of
• Patients• Type of intervention• Outcomes considered• absence or presence of head-to-head comparisons
There is often some uncertainty about this
![Page 82: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/82.jpg)
![Page 83: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/83.jpg)
If a recommendation is untrustworthy
• It should be openly and widely presented and discussed to avoid unnecessary harm to the patients and resources’ wasting
• Reasons of untrustworthiness should be clarifiedand addressed
• An in depth GRADE based, multidisciplinar, unconflicted reassessment of flawedrecommendations should be urgently carried out to produce more firm guidelines
![Page 84: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/84.jpg)
clinical research agenda should be prioritizedto fulfill these gaps, if relevant for our patients
problem driven research vs
curiosity driven research
When guidelines highlight the absence of firm evidences
EBM helps ethical integrity of biomedical research
![Page 85: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/85.jpg)
• What is a clinical guideline• Why do we need clinical guidelines• How guidelines are (and should be) produced• Quality of current guidelines• How to decide whether a guideline is trustworthy• How to use a clinical guideline• The future of clinical guidelines
![Page 86: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/86.jpg)
Clinical guidelines at their crossroad
Evolution or extinction
![Page 87: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/87.jpg)
More trustworthy, more evidence based,unconflicted, balanced tools to inform wiseclinical decisions and manage uncertainty
Their transformation into
![Page 88: Less is more: Guidelines - esim2014.org is more IV Primiano Iannone.… · ESIM Summer School . June 20 Friday, 2014. Less is more: Guidelines. Primiano Iannone, MD . Head of Emergency](https://reader033.vdocuments.mx/reader033/viewer/2022042402/5f12e08ca08fb10de137e2c1/html5/thumbnails/88.jpg)
I didn’t mean to confuse You
But Evidence Based Medicine isan eminently creative
methodology which emphasizescritical reasoning
and not the robotic application of rules and recommendations…