2013 02 14 - clinical loinc tutorial - document ontology

42
LOINC Tutorial Documents Daniel J. Vreeman, PT, DPT, MSc Assistant Research Professor, Indiana University School of Medicine Research Scientist, Regenstrief Institute, Inc Clinical LOINC Meeting 2013 02 14 © 2013 [email protected]

Upload: daniel-vreeman

Post on 14-Apr-2015

671 views

Category:

Documents


0 download

DESCRIPTION

Clinical LOINC Document Ontology Tutorial given by Daniel Vreeman

TRANSCRIPT

Page 1: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

LOINC Tutorial Documents

Daniel J. Vreeman, PT, DPT, MSc Assistant Research Professor, Indiana University School of Medicine

Research Scientist, Regenstrief Institute, Inc

Clinical LOINC Meeting

2013 02 14 © 2013 [email protected]

Page 2: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

http://loinc.org/slideshows

Page 3: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Overview

photo via Vernio77

1.  Origins of a Document Ontology

2.  HL7/LOINC Model

3.  Evaluation and Ongoing Development

4.  Future Directions

Page 4: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Origins of a Document Ontology

Page 5: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Local systems have idiosyncratic names…

…need a common, controlled vocabulary

Outpatient Pain Note

Dr. Smith’s Tues Pain Clinic Note

Chronic Pain Clinic

Page 6: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

06/2000 • Document Ontology

Task Force

09/2003 •  First Axis Values and LOINC

Codes 06/2005 •  Expanded SMD Domain

10/2007 • Revised Axis Value

Approval

Ongoing • Harmonization Efforts • New Content Creation

Page 7: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Document Type Codes

Provide consistent semantics for names of documents exchanged between systems

Frazier P, Rossi-Mori A, Dolin RH, Alschuler L, Huff SM. The creation of an ontology of clinical document names. Stud Health Technol Inform. 2001;84(Pt 1):94-8.

Retrieval

Organization

Display Preparation of Templates

Page 8: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

What is a Document? a collection of information

photo via striatic

Page 9: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

an information collection

Title

Sections Sentences

Sentences

Other content

photo via karen horton

Different than a panel enumerated, discrete elements

Page 10: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Clinical Notes

Formal Document Ontology model and rules apply to clinical notes, but not (yet) to reports. (although non-intuitively they are in CLASS:DOC.CLINRPT)

Clinical Note

A clinical document, produced by clinicians spontaneously or in response to a request for consultation.

Clinical Report

A clinical document, produced in response to an order for a procedure.

Page 11: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Approach Empiric analysis of >2000 document names

Mayo, 3M/Intermountain, VA in SLC, VA in Nashville

Find the level of granularity that best meets exchange use case

Photo via Jeffrey Beall

Page 12: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Ultra-specific local names • Dr. Evil’s Friday Afternoon Pain Clinic Note

Commonly understood elements • Outpatient Pain Clinic Note

Page 13: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Local Codes and Names Still probably needed

Can send both in HL7

Mapping to a standard enables: Interoperability

Aggregation

Page 14: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Document Ontology Model Multi-axial / Poly-hierarchical

Page 15: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Names are based on

expected information content

NOT document format photo via karen horton

Page 16: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Names Based on Content Same LOINC code for…

…if information content is the same

Page 17: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Not Part of the Name Author

Location of service

Date of service

Status (e.g. signed, unsigned)

Security/privacy flags (e.g. protected)

Updates or amendments to a document

Page 18: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Assume that these other important attributes would be sent in different fields of the message (e.g. metadata)

Page 19: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Model of Document Names

Subject Matter Domain • e.g. Cardiology, Pediatric Cardiology, Physical Therapy

Role • Author training/professional classification (not @ subspecialty) • e.g. Physician, Nurse, Case Manager, Therapist, Patient

Setting • Modest extension of CMS’s definition (not equivalent to location) • E.g. Hospital, Outpatient, Emergency Department

Type of Service • Service or activity provided to patient • Eg. Consultation, History and Physical, Discharge Summary

Kind of Document • General structure of the document • E.g. Note, Letter, Consent

Page 20: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Rules for Constructing Names

photo via Robert S Donovan

Page 21: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

1. Enumerated List Document names are constructed from enumerated lists of values for each axis.

Page 22: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

2. Document + One Other Document name needs specification of a Kind of Document value and at least one of the other four axes.

• <Type of Service> <Kind of Document> Component

• Find Property

• Pt Time

• <Setting> System

• Doc Scale

• <SMD>.<Role> Method

Page 23: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

3. Combinations Combinations from within an axis are allowed where they make sense (SMD, Service).

Assessment + Plan

Page 24: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Example LOINC Names Component Prop Time System Scale Method

Group counseling note Find Pt Hospital Doc {Provider}

Evaluation and management note Find Pt Outpatient Doc {Provider}

Evaluation and management note Find Pt {Setting} Doc {Provider}

History and physical note Find Pt {Setting} Doc {Provider}

Initial evaluation note Find Pt {Setting} Doc Physician

{curly braces} notation: send that content as a separate item in the message (field or segment).

Page 25: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Hierarchy Made a 1st pass Component hierarchy

– Based on Type of Service Axis

–  Ignored Kind of Document

Multi-axial hierarchy is auto-generated – Available as a separate download

Custom hierarchies (e.g. context-specific) ones are easily imagined

More on this later…

Page 26: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Hierarchy in RELMA

Page 27: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Evolution, Evaluation We’re not done yet

Page 28: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Evolution Ongoing evaluation and evolution Exceptional contributions from Columbia University and the VA

Major Focus: Expanded original SMD values with ABMS specialty names and iterative discussion

More ontology additions from submissions

Page 29: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Iterative Evaluation Case Study NYPH-CUMC

Page 30: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Case Study

Hyun S, Shapiro JS, Melton G, Schlegel C, Stetson PD, Johnson SB, Bakken S. Iterative evaluation of the Health Level 7--Logical Observation Identifiers Names and Codes Clinical Document Ontology for representing clinical document names: a case report. J Am Med Inform Assoc. 2009 May-Jun;16(3):395-9.

SMD Role Setting Type Service Kind of Doc Overall Distinct Original

CDO

26.7% 99.9% 99.9% 43.5% 100% 23.4%

(n=894)

7.9%

Expanded

CDO

98.6% 100% 100% 99.9% 99.9% 98.5%

(n=935)

39.1%

1.  Expanded CDO is better

2.  Many local documents map to 1 LOINC

3.  Inter-rater reliability was good

Page 31: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Nursing

Hyun S, Shapiro JS, Melton G, Schlegel C, Stetson PD, Johnson SB, Bakken S. Iterative evaluation of the Health Level 7--Logical Observation Identifiers Names and Codes Clinical Document Ontology for representing clinical document names: a case report. J Am Med Inform Assoc. 2009 May-Jun;16(3):395-9.

SMD Role Setting Type Service Kind of Doc Overall Distinct SMD +

CDO

74% 100% 100% 100% 100% 74.5%

(n=94)

33%

Page 32: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Cross-site Mapping Study of DO Axes Terms whose titles specified this axis

Li L, Morrey CP, Baorto D. Cross-mapping clinical notes between hospitals: An application of the LOINC Document Ontology. AMIA Symp Proc; 2011:;777-783.

SMD Role Setting Type of Service None West Campus (n=1644)

67.6% 34.6% 28.9% 59.4% 8.2%

East Campus (n=1124)

69.1% 56.0% 12.7% 69.0% 7.1%

1.  Majority of titles map to at least one axis

2.  Sites varied in how they specified titles; creates granularity issues in cross-site aggregation

Page 33: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Cross-site Mapping to LOINC Using LOINC v2.34

Li L, Morrey CP, Baorto D. Cross-mapping clinical notes between hospitals: An application of the LOINC Document Ontology. AMIA Symp Proc; 2011:;777-783.

Combination of LOINC DO axes (null values allowed)

West Campus mapping rate

East Campus mapping rate

Subject Matter Domain, Type of Service, Role, and Setting

22.3% (n=367) 18.7% (n=210)

Subject Matter Domain, Type of Service, and Role

30.8% (n=506) 22.6% (n=254)

Subject Matter Domain and Type of Service

46.9% (n=771) 39.2% (n=441)

1.  Majority of titles map to at least one axis

2.  Documents assigned LOINC codes were less specified than those in their EHR

Page 34: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

The LOINC document ontology model can provide a robust representation of clinical documents. This can be exploited to assist in common naming conventions, finding notes by traversing the axis categories of Subject, Setting, Role and Type of Service. However, the granularity of representation can be an issue in mapping across sites.

Page 35: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Case Study German University Hospital

Page 36: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

German University Hospital

86 Document Types (1.2 mil documents)

44%

44%

12% Mapped to LOINC

Not specific enough mapping

No LOINC match

Dugas M, Thun S, Frankewitsch T, Heitmann KU. LOINC codes for hospital information systems documents: a case study. J Am Med Inform Assoc. 2009 May-Jun;16(3):400-3.

Used LOINC v2.24 (original DocOnt terms)

Page 37: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

German University Hospital

LOINC codes that existed for documents in their set (by volume)

Page 38: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Ongoing Development

Page 39: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

A Work-in-Progress

LOINC User’s Guide is definitive source for current policy

Collaboration/discussion Clinical LOINC Meetings

HL7 SDTC

Online

Page 40: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

The Future Great Scott!

Page 41: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

Future Directions More v1 and v2 axis value harmonization

Identifiers for the axis values

Explicit linkage of DocOnt parts to LOINCs

Axis definitions

Computable hierarchy

Extension to other Kind of Documents

Empiric analysis of document contents

Page 42: 2013 02 14 - Clinical LOINC Tutorial - Document Ontology

photo via milos milosevic