assessing verbal autopsy as a complement to vital registration
Upload: institute-for-health-metrics-and-evaluation-university-of-washington
Post on 27-Jan-2015
104 views
DESCRIPTION
GHME 2013 Conference Session: Verbal Autopsy Date: June 18 2013 Presenter: Andrea Stewart Institute: Institute for Health Metrics and Evaluation (IHME), University of WashingtonTRANSCRIPT
Assessing verbal autopsy as a complement to vital registrationA data-driven simulation study
Andrea Stewart, Post-Bachelor FellowJune 18, 2013
2
Presentation outline
β’ Uses of verbal autopsy (VA)
β’ Potential uses of new VA methods
β’ Creation of a simulation of incomplete vital registration (VR) complemented with VA estimates
3
Presentation outline
β’ Uses of verbal autopsy (VA)
β’ Potential uses of new VA methods
β’ Creation of a simulation of incomplete vital registration (VR) complemented with VA estimates
4
Uses of verbal autopsy
Photo by Peter Biro/The IRC. Β©2011 International Rescue Committee.
5
Presentation outline
β’ Uses of Verbal Autopsy (VA)
β’ Potential uses of new VA methods
β’ Creation of a simulation of incomplete vital registration (VR) complemented with VA estimates
6
Advancements in VA science
β’ Automated methods for collection and analysis
β’ Less time
β’ Fewer resources
β’ More accurate
Could we use VA in routine national data
collection?
7
Presentation outline
β’ Uses of Verbal Autopsy (VA)
β’ Potential uses of new VA methods
β’ Creation of a simulation of incomplete vital registration (VR) complemented with VA estimates
8
Simulation setting β the data
β’ Need data that has:
o VR estimates (death certificates)
o VA estimates (analyzed by Tariff)
o Known cause of death (based on stringent diagnostic criteria)
9
Population Health Metrics Research Consortium gold standards
VA Tariff method results
Death certificate
Gold standard diagnosis
1,288 VAs from Morelos, Mexico
x 500 test data sets of varying cause composition
10
Metrics
β’ Cause-specific mortality fractions (CSMFs)
β’ Measure of accuracy
β’ Change in that metric across situations
% Accuracy change=( π΄ππ hπ€ππ‘ ππ΄βπ΄ππ πππππππππ‘π
π΄πππππππππππ‘π)Γ100%
πΆπππΉπ΄πππ’ππππ¦=1ββπ=1
π
ΒΏπΆπππΉ ππ‘ππ’πβπΆπππΉ π
ππππβ¨ΒΏ
2(1βππππππ’π(πΆπππΉ ππ‘ππ’π))
ΒΏ
11
Data β mortality registries from Morelos
β’ Mortality registries provide the proportion of deaths by age, sex, and cause of death that occur in health facilities
β’ %
12
Simulation setting β the data
Using Morelos probabilities -
Deaths in facility Deaths out of facility
622 observations with: Death certificateVerbal autopsy
Gold-standard diagnosis
666 observations with: Death certificateVerbal autopsy
Gold-standard diagnosis
13
Simulation setting β incomplete vital registration
Deaths in facility Deaths out of facility
Use death certificate data for
60%
Use death certificate data for 10%
No death certificate
No death certificate
Deaths in facility Deaths out of facility
Gold-standard diagnosis
Gold-standard diagnosis
vs.
ππ’π‘ππ’π‘ : π΄πππππππππππ‘π
14
Simulation setting β add VA estimates
vs.
Deaths in facility Deaths out of facility
Use death certificate data for
60%
Use death certificate data for 10%
Use verbal autopsy data for remaining
90%Use verbal autopsy data for remaining
40%
Deaths in facility Deaths out of facility
Gold-standard diagnosis
Gold-standard diagnosis
ππ’π‘ππ’π‘ : π΄ππ hπ€ππ‘ ππ΄
15
Simulation setting
β’ Do this for each of the simulated scenarioso 0%-100% deaths with DC in facility
o 0%-100% deaths with DC out of facility
β’ Calculate change in CSMF accuracy for each scenario
Accuracy change=( π΄ππ hπ€ππ‘ ππ΄β π΄πππππππππππ‘π
π΄πππππππππππ‘π)Γ100
16
ResultsPercent change in CSMF accuracy when adding VA
% of out-of-facility deaths with death certificates 0 10 20 30 40 50 60 70 80 90 100
% of in-facility deaths with
death certificates
0 27.5 24.3 20.1 17.4 14.5 11.4 10.4 8.9 7.2 6.010 29.1 24.7 21.7 18.0 15.4 12.3 9.6 9.0 7.9 5.7 5.320 26.3 21.8 19.1 15.9 13.7 10.9 8.4 7.8 6.8 5.1 4.330 23.1 19.5 16.6 13.8 11.8 9.5 6.9 6.1 5.3 3.8 3.640 20.2 17.1 14.3 11.7 9.8 7.5 5.2 4.7 4.0 2.6 2.350 17.5 14.9 12.4 10.0 8.0 6.0 4.1 3.9 2.9 1.9 1.760 15.5 12.7 10.3 7.9 6.7 5.0 3.3 3.1 2.3 1.0 0.870 13.3 10.5 8.3 6.2 4.9 3.4 2.1 2.0 1.3 0.6 0.380 11.2 8.8 7.4 5.1 4.0 2.6 1.2 1.2 0.8 -0.1 0.290 9.6 7.9 6.2 3.9 2.7 1.8 0.6 0.6 0.2 -0.2 -0.1
100 8.5 7.0 5.3 3.2 2.2 0.8 0.3 0.2 0.3 -0.2 0.0
17
ResultsPercent change in CSMF accuracy when adding VA
% of out-of-facility deaths with death certificates 0 10 20 30 40 50 60 70 80 90 100
% of in-facility deaths with
death certificates
0 27.5 24.3 20.1 17.4 14.5 11.4 10.4 8.9 7.2 6.010 29.1 24.7 21.7 18.0 15.4 12.3 9.6 9.0 7.9 5.7 5.320 26.3 21.8 19.1 15.9 13.7 10.9 8.4 7.8 6.8 5.1 4.330 23.1 19.5 16.6 13.8 11.8 9.5 6.9 6.1 5.3 3.8 3.640 20.2 17.1 14.3 11.7 9.8 7.5 5.2 4.7 4.0 2.6 2.350 17.5 14.9 12.4 10.0 8.0 6.0 4.1 3.9 2.9 1.9 1.760 15.5 12.7 10.3 7.9 6.7 5.0 3.3 3.1 2.3 1.0 0.870 13.3 10.5 8.3 6.2 4.9 3.4 2.1 2.0 1.3 0.6 0.380 11.2 8.8 7.4 5.1 4.0 2.6 1.2 1.2 0.8 -0.1 0.290 9.6 7.9 6.2 3.9 2.7 1.8 0.6 0.6 0.2 -0.2 -0.1
100 8.5 7.0 5.3 3.2 2.2 0.8 0.3 0.2 0.3 -0.2 0.0
18
ResultsPercent change in CSMF accuracy when adding VA
% of out-of-facility deaths with death certificates 0 10 20 30 40 50 60 70 80 90 100
% of in-facility deaths with
death certificates
0 27.5 24.3 20.1 17.4 14.5 11.4 10.4 8.9 7.2 6.010 29.1 24.7 21.7 18.0 15.4 12.3 9.6 9.0 7.9 5.7 5.320 26.3 21.8 19.1 15.9 13.7 10.9 8.4 7.8 6.8 5.1 4.330 23.1 19.5 16.6 13.8 11.8 9.5 6.9 6.1 5.3 3.8 3.640 20.2 17.1 14.3 11.7 9.8 7.5 5.2 4.7 4.0 2.6 2.350 17.5 14.9 12.4 10.0 8.0 6.0 4.1 3.9 2.9 1.9 1.760 15.5 12.7 10.3 7.9 6.7 5.0 3.3 3.1 2.3 1.0 0.870 13.3 10.5 8.3 6.2 4.9 3.4 2.1 2.0 1.3 0.6 0.380 11.2 8.8 7.4 5.1 4.0 2.6 1.2 1.2 0.8 -0.1 0.290 9.6 7.9 6.2 3.9 2.7 1.8 0.6 0.6 0.2 -0.2 -0.1
100 8.5 7.0 5.3 3.2 2.2 0.8 0.3 0.2 0.3 -0.2 0.0
19
ResultsPercent change in CSMF accuracy when adding VA
% of out-of-facility deaths with death certificates 0 10 20 30 40 50 60 70 80 90 100
% of in-facility deaths with
death certificates
0 27.5 24.3 20.1 17.4 14.5 11.4 10.4 8.9 7.2 6.010 29.1 24.7 21.7 18.0 15.4 12.3 9.6 9.0 7.9 5.7 5.320 26.3 21.8 19.1 15.9 13.7 10.9 8.4 7.8 6.8 5.1 4.330 23.1 19.5 16.6 13.8 11.8 9.5 6.9 6.1 5.3 3.8 3.640 20.2 17.1 14.3 11.7 9.8 7.5 5.2 4.7 4.0 2.6 2.350 17.5 14.9 12.4 10.0 8.0 6.0 4.1 3.9 2.9 1.9 1.760 15.5 12.7 10.3 7.9 6.7 5.0 3.3 3.1 2.3 1.0 0.870 13.3 10.5 8.3 6.2 4.9 3.4 2.1 2.0 1.3 0.6 0.380 11.2 8.8 7.4 5.1 4.0 2.6 1.2 1.2 0.8 -0.1 0.290 9.6 7.9 6.2 3.9 2.7 1.8 0.6 0.6 0.2 -0.2 -0.1
100 8.5 7.0 5.3 3.2 2.2 0.8 0.3 0.2 0.3 -0.2 0.0
20
ResultsPercent change in CSMF accuracy when adding VA
% of out-of-facility deaths with death certificates 0 10 20 30 40 50 60 70 80 90 100
% of in-facility deaths with
death certificates
0 27.5 24.3 20.1 17.4 14.5 11.4 10.4 8.9 7.2 6.010 29.1 24.7 21.7 18.0 15.4 12.3 9.6 9.0 7.9 5.7 5.320 26.3 21.8 19.1 15.9 13.7 10.9 8.4 7.8 6.8 5.1 4.330 23.1 19.5 16.6 13.8 11.8 9.5 6.9 6.1 5.3 3.8 3.640 20.2 17.1 14.3 11.7 9.8 7.5 5.2 4.7 4.0 2.6 2.350 17.5 14.9 12.4 10.0 8.0 6.0 4.1 3.9 2.9 1.9 1.760 15.5 12.7 10.3 7.9 6.7 5.0 3.3 3.1 2.3 1.0 0.870 13.3 10.5 8.3 6.2 4.9 3.4 2.1 2.0 1.3 0.6 0.380 11.2 8.8 7.4 5.1 4.0 2.6 1.2 1.2 0.8 -0.1 0.290 9.6 7.9 6.2 3.9 2.7 1.8 0.6 0.6 0.2 -0.2 -0.1
100 8.5 7.0 5.3 3.2 2.2 0.8 0.3 0.2 0.3 -0.2 0.0
21
Conclusion
In this preliminary simulation environment, adding VA estimates to incomplete VR scenarios improved CSMF accuracy much of the time.
22
Future directions
β’ Update simulation environment to better reflect specific VR coverage scenarios
β’ Re-analyze the VAs assigned to βout of facility,β dropping questions determined to be related to βhealth care experienceβ