diagnostic performance of osmolarity combined with … diagnostic poster... · 2012-09-25 · arvo...

1
DIAGNOSTIC PERFORMANCE OF OSMOLARITY COMBINED WITH SUBSET MARKERS OF DRY EYE DISEASE IN AN UNSTRATIFIED PATIENT POPULATION. Benjamin D. Sullivan 1 , David C. Eldridge 1 , Michael S. Berg 1 , Valerie Kosheleff 1 , Allison Porreco 1 , James T. Truitt 1 , Michael A. Lemp 2 . 1 TearLab, Corp., San Diego, CA; 2 Departments of Ophthalmology, Georgetown and George Washington University, Washington, DC. 1. Purpose 2. Methods Clinical signs were evaluated in both eyes of 314 subjects chosen from the general patient population across 10 sites in the EU and US. Classification of mild/moderate and severe patients was based on a composite disease severity index, derived from the Dry Eye WorkShop severity scale 2 . e more severe measurement for each clinical sign was mapped onto a 0 to 1 scale, normalized by an independent component analysis to remove overlap in mutual information, and then combined into a single normalized Euclidean distance to produce a final composite severity score for each subject 3,4 . Normal, mild, moderate, and severe patients were assigned according to the four quartiles of severity scores. Because of the lack of clinical differentiation between the mild and moderate quartiles, they were combined into a single group: mild/moderate. Diagnostic thresholds used in Table 1 were located at the intersection between normal and overall dry eye distributions. e purpose of this study was to evaluate whether the diagnostic performance of a novel, global test for dry eye disease was improved by the addition of markers specific for aqueous deficient or evaporative dry eye. Depending on the clinical situation, the acceptable risk of false positive or false negative diagnosis are unequal. For more sensitive detection, diagnostic thresholds were located at the intersection between normal and mild/moderate subjects, while more specific detection thresholds were located at the intersection between normal and severe dry eye patient distributions. Linear combinations of subset markers were explored to improve performance 1 : 3. Results 1. Karl W. Clem, Castañon D. Stochastic Processes, Course Notes. Department of Electrical and Computer Engineering, Boston University, Fall 1998. 2. 2007 Report of the International Dry Eye WorkShop (DEWS). Ocular Surface, April 2007 5(2):65-204. 3. Shlens J., Independent Component Analysis, http://www.snl.salk.edu/~shlens/pub/code/ica.infomax.zip, 2003. 4. Bell AJ, Sejnowski TJ. e “independent components” of natural scenes are edge filters. Vision Research 37(23):3327 1997 Funding provided by Alcon Laboratories & TearLab Corp., Financial Disclosure: TearLab Employee, Owner, Patents: Sullivan. TearLab Employee,Owner: Lemp, Berg, Eldridge. Employee: Kosheleff, Porreco, Truitt. 920020 Rev A Table 2. Percentage of correctly diagnosed subjects, broken down by disease severity, using a more sensitive detection threshold. Cutoff values were located at the intersection between normal subjects and the mild/moderate subset of dry eye patients. % Correctly Diagnosed Test Mild Cutoff Normal (n=75) Mild/Moderate (n=149) Severe (n=75) Osmolarity > 308 mOsms/L 81.3% 73.2% 90.7% TBUT < 11 seconds 40.0% 83.2% 100.0% Schirmers < 20 mm 42.7% 82.6% 90.7% Corneal Stain > Grade 0 82.7% 60.4% 85.3% Conjunctival Stain > Grade 1 73.3% 73.2% 90.7% Meibomian Grade > Grade 4 74.7% 54.4% 81.3% Table 3. Percentage of correctly diagnosed subjects, broken down by disease severity, using a more specific detection threshold. Cutoff values were located at the intersection between normal subjects and the severe subset of dry eye patients. % Correctly Diagnosed Test Severe Cutoff Normal (n=75) Mild/Moderate (n=149) Severe (n=75) Osmolarity > 314 mOsms/L 96.0% 56.4% 86.7% TBUT < 6 seconds 69.3% 63.8% 97.3% Schirmers < 16 mm 57.3% 71.8% 86.7% Corneal Stain > Grade 1 89.3% 43.6% 74.7% Conjunctival Stain > Grade 2 90.7% 49.7% 81.3% Meibomian Grade > Grade 5 78.7% 51.7% 80.0% 275 280 300 320 340 360 380 400 0 0.01 0.02 0.03 0.04 0.05 0.06 Normal Average 302.2 ± 8.3 mOsms/L 308.2 mOsms/L 328.2 mOsms/L Mild/Moderate Average 315.0 ± 11.4 mOsms/L Severe Average 336.4 ± 22.3 mOsms/L Osmolarity (mOsms/L) 275 290 305 320 335 350 365 380 400 Normal Mild Moderate Severe Osmolarity (mOsms/L) A B C Fig. 1. (A) The TearLab Osmolarity System is comprised of the reader, pen and a disposable test card. (B) Tear fluid is collected directly from the inferior lateral tear meniscus. (C) The single-use, disposable microchip collects 50 nanoliters (nL) of tear fluid by passive capillary action. Gold electrodes embedded in the chip enable measurement of the impedance of the tear fluid sample in the channel. 100.0% 94.7% 100.0% 100.0% 98.7% 60.3% 58.5% 40.6% 44.6% 41.1% 37.3% 48.0% 81.3% 82.7% 72.0% 96.9% 93.8% 86.2% 88.4% 92.9% TBUT Osmolarity Schirmers Corneal Conjunctival Meibomian Specificity 92.0% 45.3% 50.7% 89.3% 90.7% 78.7% Sensitivity 72.8% 84.4% 79.5% 54.0% 60.3% 61.2% Specificity AND Sensitivity Specificity OR Sensitivity Table 1. Sensitivity and Specificity of common signs of dry eye tested in combination. Observing an elevated osmolarity > 311 mOsms/L OR a reduced breakup time < 7 seconds reported the highest sensitivity, while a combination of osmolarity OR staining gave the best overall performance. Elevated osmolarity (> 311 mOsms/L) AND one additional sign increased specificity at the expense of sensitivity. Elevated osmolarity OR one other sign increased sensitivity at the expense of specificity.

Upload: others

Post on 12-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DIAGNOSTIC PERFORMANCE OF OSMOLARITY COMBINED WITH … Diagnostic Poster... · 2012-09-25 · ARVO Variability Poster Handout p2d Created Date: 4/30/2010 12:28:55 PM

DIAGNOSTIC PERFORMANCE OF OSMOLARITY COMBINED WITH SUBSET MARKERS OF DRY EYE DISEASE IN AN UNSTRATIFIED PATIENT POPULATION. Benjamin D. Sullivan1, David C. Eldridge1, Michael S. Berg1, Valerie Kosheleff1, Allison Porreco1, James T. Truitt1, Michael A. Lemp2. 1TearLab, Corp., San Diego, CA; 2Departments of Ophthalmology, Georgetown and George Washington University, Washington, DC.

1. Purpose

2. Methods

Clinical signs were evaluated in both eyes of 314 subjects chosen from the general patient population across 10 sites in the EU and US. Classification of mild/moderate and severe patients was based on a composite disease severity index, derived from the Dry Eye WorkShop severity scale2. �e more severe measurement for each clinical sign was mapped onto a 0 to 1 scale, normalized by an independent component analysis to remove overlap in mutual information, and then combined into a single normalized Euclidean distance to produce a final composite severity score for each subject3,4. Normal, mild, moderate, and severe patients were assigned according to the four quartiles of severity scores. Because of the lack of clinical differentiation between the mild and moderate quartiles, they were combined into a single group: mild/moderate. Diagnostic thresholds used in Table 1 were located at the intersection between normal and overall dry eye distributions.

�e purpose of this study was to evaluate whether the diagnostic performance of a novel, global test for dry eye disease was improved by the addition of markers specific for aqueous deficient or evaporative dry eye. Depending on the clinical situation, the acceptable risk of false positive or false negative diagnosis are unequal. For more sensitive detection, diagnostic thresholds were located at the intersection between normal and mild/moderate subjects, while more specific detection thresholds were located at the intersection between normal and severe dry eye patient distributions. Linear combinations of subset markers were explored to improve performance1:

3. Results

1. Karl W. Clem, Castañon D. Stochastic Processes, Course Notes. Department of Electrical and Computer Engineering, Boston University, Fall 1998. 2. 2007 Report of the International Dry Eye WorkShop (DEWS). Ocular Surface, April 2007 5(2):65-204. 3. Shlens J., Independent Component Analysis, http://www.snl.salk.edu/~shlens/pub/code/ica.infomax.zip, 2003. 4. Bell AJ, Sejnowski TJ. �e “independent components” of natural scenes are edge filters. Vision Research 37(23):3327 1997 Funding provided by Alcon Laboratories & TearLab Corp., Financial Disclosure: TearLab Employee, Owner, Patents: Sullivan. TearLab Employee,Owner: Lemp, Berg, Eldridge. Employee: Kosheleff, Porreco, Truitt.

920020 Rev A

Table 2. Percentage of correctly diagnosed subjects, broken down by disease severity, using a more sensitive detection threshold. Cuto� values were located at the intersection between normal subjects and the mild/moderate subset of dry eye patients.

% Correctly Diagnosed

Test Mild Cuto� Normal (n=75)

Mild/Moderate (n=149)

Severe (n=75)

Osmolarity > 308 mOsms/L 81.3% 73.2% 90.7%

TBUT < 11 seconds 40.0% 83.2% 100.0%

Schirmers < 20 mm 42.7% 82.6% 90.7%

Corneal Stain > Grade 0 82.7% 60.4% 85.3%

Conjunctival Stain > Grade 1 73.3% 73.2% 90.7%

Meibomian Grade > Grade 4 74.7% 54.4% 81.3%

Table 3. Percentage of correctly diagnosed subjects, broken down by disease severity, using a more speci�c detection threshold. Cuto� values were located at the intersection between normal subjects and the severe subset of dry eye patients.

% Correctly Diagnosed

Test Severe Cuto� Normal (n=75)

Mild/Moderate (n=149)

Severe (n=75)

Osmolarity > 314 mOsms/L 96.0% 56.4% 86.7%

TBUT < 6 seconds 69.3% 63.8% 97.3%

Schirmers < 16 mm 57.3% 71.8% 86.7%

Corneal Stain > Grade 1 89.3% 43.6% 74.7%

Conjunctival Stain > Grade 2 90.7% 49.7% 81.3%

Meibomian Grade > Grade 5 78.7% 51.7% 80.0%

275 280 300 320 340 360 380 4000

0.01

0.02

0.03

0.04

0.05

0.06

Normal Average302.2 ± 8.3 mOsms/L

308.2mOsms/L

328.2mOsms/L

Mild/Moderate Average315.0 ± 11.4 mOsms/L

Severe Average336.4 ± 22.3 mOsms/L

Osmolarity (mOsms/L)

275 290 305 320 335 350 365 380 400

Normal Mild Moderate Severe

Osmolarity (mOsms/L)

A B

C

Fig. 1. (A) The TearLab Osmolarity System is comprised of the reader, pen and a disposable test card. (B) Tear �uid is collected directly from the inferior lateral tear meniscus. (C) The single-use, disposable microchip collects 50 nanoliters (nL) of tear �uid by passive capillary action. Gold electrodes embedded in the chip enable measurement of the impedance of the tear �uid sample in the channel.

100.0% 94.7% 100.0% 100.0% 98.7%

60.3% 58.5% 40.6% 44.6% 41.1%

37.3% 48.0% 81.3% 82.7% 72.0%

96.9% 93.8% 86.2% 88.4% 92.9%

TBUTOsmolarity Schirmers Corneal Conjunctival Meibomian

Speci�city 92.0% 45.3% 50.7% 89.3% 90.7% 78.7%

Sensitivity 72.8% 84.4% 79.5% 54.0% 60.3% 61.2%

Speci�city AND

Sensitivity

Speci�city OR

Sensitivity

Table 1. Sensitivity and Speci�city of common signs of dry eye tested in combination. Observing an elevated osmolarity > 311 mOsms/L OR a reduced breakup time < 7 seconds reported the highest sensitivity, while a combination of osmolarity OR staining gave the best overall performance.

• Elevated osmolarity (> 311 mOsms/L) AND one additional sign increased specificity at the expense of sensitivity. Elevated osmolarity OR one other sign increased sensitivity at the expense of specificity.