apps to enable ai in ehr research · apps to enable ai in ehr research. ben glicksberg, phd . butte...

37
Apps To Enable AI In EHR Research Ben Glicksberg, PhD Butte Lab Bakar Computational Health Sciences Institute University of California, San Francisco (UCSF) @BenGlicksberg

Upload: others

Post on 26-Sep-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Apps To Enable AI In EHR Research

Ben Glicksberg, PhD Butte Lab

Bakar Computational Health Sciences Institute University of California, San Francisco (UCSF)

@BenGlicksberg

Page 2: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Clinical Informatics in the era of big data

“The Quantified Self” Electronic Health Records

Page 3: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

The power and diversity of EHR studies

Page 4: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Towards a learning health system

Page 5: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Challenges of using EHR data for research

• EHRs are challenging to represent health state o heterogeneous

o noisy o incomplete o structured / unstructured

o redundant o subject to random errors o subject to systematic errors o …and so and so forth

Patient

Reconstruction

EHR

Break down

Page 6: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

EHR barriers to entry • Computational • Domain knowledge:

• Structure • Language

Bodenreider, O (2004): Medical Language System (UMLS) : integrating biomedical terminology

Page 7: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Cross-validation & replication in EHR research

EPIC Cerner

Model/Results Model/Results

Page 8: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

OMOP common data model (CDM)

Resources: https://www.ohdsi.org/ http://www.ohdsi.org/web/wiki/doku.php http://forums.ohdsi.org/ https://github.com/OHDSI/ (most documentation)

Language

Structure

Analysis

Page 9: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

CDM facilitates cross-validation and reproducibility

FHIR

OMOP

Page 10: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

OMOP CDM across the UC system

UC Health Data Analytics Platform

Health Data Warehouse

Network for cross-validation experiments

OMOP

Page 11: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

The OMOP system is efficient but complicated • OMOP still requires extensive domain and computational expertise

Page 12: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

OHDSI has developed powerful, advanced tools

https://github.com/OHDSI https://www.ohdsi.org/analytic-tools/

Page 13: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

…that are sometimes too advanced for most tasks

http://remembar.me/wp-content/uploads/2018/07/garage-pegboard-organization-interior-furniture-full-image-for-tool-storage-special-tools-and-ideas.jpg

https://www.ikea.com/ms/en_CA/customer_service/assembly_instructions/assembly_instructions1.html

Page 14: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

ROMOP a light-weight R package for interfacing with OMOP-formatted Electronic Health Record data Glicksberg et al. JAMIA Open (ooy059)

Page 15: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Goals of ROMOP

1. Automatically connect to OMOP EHR relational database

2. Enable non-technical experts to easily pull data into R-object

3. Facilitate follow-up analyses

Page 16: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

What can ROMOP do? 1. Explore CDM fields 2. Generate population statistics 3. Search for patients:

• Any vocabulary • Inclusion/Exclusion criteria • Flexible search strategies

(e.g., and vs. or) 4. Retrieve all relevant data for

patients: • Demographics • Encounters • Clinical

5. Automatically map concepts to ontologies

6. Export search report

Page 17: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Public sandbox server: interactive tutorial

http://romop.ucsf.edu

• 1MM patients from CMS synthesized clinical dataset (DE-SymPUF) • Package: https://github.com/BenGlicksberg/ROMOP

Page 18: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Data and CDM exploration

Page 19: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Define cohorts/Find patients

Page 20: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Extract Data

Page 21: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Summarize cohort

Page 22: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

PatientExploreR dynamic visualization of clinical history in OMOP format Glicksberg et al. (in revision)

Page 23: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

No flexible application exists

Page 24: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

EPIC

OMOP

Goals

Page 25: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Public Sandbox Server

http://patientexplorer.ucsf.edu

- Synthesized data (no PHI) from CMS - 1 million patients - OMOP format - Open to the public

Code: https://github.com/BenGlicksberg/PatientExploreR

Page 26: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,
Page 27: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,
Page 28: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Automatically generated

clinical history

Page 29: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,
Page 30: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Explore Trends in Data/ Outcomes (targeted)

Page 31: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Explore Trends in Data/ Outcomes (numeric; targeted)

Page 32: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Explore Trends in Data/ Outcomes (multiplex)

Page 33: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Explore Trends in Data/ Outcomes (multiplex timeline)

Page 34: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

How might these tools enable AI-based EHR research?

Page 35: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

How well can we predict…

• Risk for disease • Disease onset • Symptom severity • Treatment response • Medication adverse events • Ideal dose of medication • Symptom flares • Length of stay in hospital

Beau Norgeot, MS

Page 36: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

More representation/data = better reflection of dx

How will model trained here…

…perform here?

1. Precision medicine: finding similar patients to go beyond treating doctor’s, clinic’s, department’s, hospital’s, or even

institution’s expertise.

2. Disease representation in EHR: electronic phenotyping algorithms might not be fully generalizable. Building as a

“meta” signature will be more robust

4. Multi-omic factors: incorporating genetics and environmental data (e.g., pollution) can

help pinpoint etiology and discern GxE interactions

3. Prediction: training and testing models across multiple institutions, alone and in conjunction,

will enable identifying ideal strategies

Page 37: Apps To Enable AI In EHR Research · Apps To Enable AI In EHR Research. Ben Glicksberg, PhD . Butte Lab . Bakar Computational Health Sciences Institute . University of California,

Acknowledgements Boris Oskotsky, PhD Vivek Rudrapatna, MD, PhD Debajyoti Datta, MD, PhD Beau Norgeot Nadav Rappoport, PhD Ted Goldstein, PhD Atul Butte, MD, PhD

Eugenia Rutenberg, MBA Angelo Pelonero Angela Rizk-Jackson, PhD Sharat Israni, PhD

Nicholas Giangreco Phyllis Thangaraj Nicholas Tatonetti, PhD

Li Li, MD Khader Shameer, PhD Riccardo Miotto, PhD Kipp Johnson Marcus Badgeley Mark Shervey Rong Chen, PhD Joel Dudley, PhD

Dana Ludwig, MD Remi Frazier Nelson Lee Rick Larsen Community and Developers