marcelo a. lopetegui, m.d. postdoctoral researcher department of biomedical informatics

TimeCaTTime Capture

Tool

Improving People’s Livesthrough innovations in personalized health care

Time Capture Tool (TimeCaT):Development of a Comprehensive Application to Support Data Capture for Time Motion Studies.

Marcelo A. Lopetegui, M.D.Postdoctoral Researcher

Department of Biomedical Informatics

TimeCaTTime Capture

Tool

Clinical Workflow

HospitalManagement

ClinicalResearch

Understand Measure

Background

TimeCaTTime Capture

Tool

Background

Patient Safety, detecting interruptions and medication errors

Productivity and efficiency

Clinicians workload and time allocation

Quality of care, assessing timeliness of treatments and procedures

Clinical Workflow

Understand Measure

TimeCaTTime Capture

Tool

The observation and analysis of tasks within

an activity with an emphasis on the amount of

time required to perform the task.

Background

Time Motion Studies

TimeCaTTime Capture

Tool

Self Reports External ObserverComputerized

Systems

Background

Time Motion StudiesA

ctiv

e T

rack

ing

Self W

ork

Sam

plin

g

Conti

nuous

Obse

rvati

on

Work

Sam

plin

g

Pass

ive T

rack

ing

Mult

imedia

Reco

rdin

g

Posi

tion T

rack

ing

Devic

e

TimeCaTTime Capture

Tool

Observer Subject

Task one

Task two

Task three

Id task time

1 Begin 09:30:20

2 Task 1 09:30:22

3 Task 2 09:31:54

4 Task 3 09:35:01

5 End 09:36:35

Continuous Observation TMS

Background

TimeCaTTime Capture

Tool

Task one

Task two

Task three

WORKFLOW 1

INTE

RV

EN

TIO

N

Task one

Task four

Task three

WORKFLOW 2

Task two Task four

Background

TimeCaTTime Capture

Tool

Results

Results

Results

+

+

+

H1

H2

H3

Background

TimeCaTTime Capture

Tool

Results

Results

Results

Background

TimeCaTTime Capture

Tool

Background

Continuous observation time motion studies could enhance clinical workflow studies by providing rich quantitative data required for in-depth workflow analyses.

However, methodological inconsistencies have been reported in continuous observation TMS, potentially reducing the validity of TMS’ data and limiting their contribution to the general state of knowledge.

TimeCaTTime Capture

Tool

Background

We aim to standardize clinical workflow time motion studies by developing methods and

tools that ensure their reproducibility.

TimeCaTTime Capture

Tool

Background

Electronic40%

Stopwatch+paper42%

Both2%

n/r16%

Time Capture Tool

Electronic Stopwatch+paper Both n/e

TimeCaTTime Capture

Tool

Methods

TimeCaTTime Capture

Tool

Comprehensive

Accessible Scalable

Dynamic

Time Capture Tool

Background

TimeCaTTime Capture

Tool

Background

THE TIMECAT ROADMAP

1

2

3

4

5

Task 1

Task 2Task

3

Aim: Identify critical areas requiring normalization and gain awareness of the state of the art in TMS.

Aim: Make a time capture tool available to TMS researchers, and use it as means of testing, distributing proposed methods, and collect user’s feedback.

Aim: Propose standards regarding human observers’ training, develop a realistic and appropriate inter-observer reliability assessment score, unify approaches for multitasking scenarios and capturing interruptions.

Aim: Facilitate results aggregation across sites, workflow comparisons and knowledge discovery by solving definitions inconsistencies.

Aim: To move forward in the analysis of TMS produced data: from a simple average time on tasks, to a comprehensive quantitative workflow analysis driven by TMS data.

TimeCaTTime Capture

Tool

Background

ValidationMethods

Incorporation

DisseminationPush New Version

EvaluationCollect Feedback and Analyze Data

DevelopmentMethods

Development

Tool

TimeCaTTime Capture

Tool

TimeCaTTime Capture Tool

v3.9 [BETA]

TimeCaTTime Capture

Tool

Tool

notebook5%

PDA47%

tablet pc21%

Ultra Mobile PC26%

TimeCaTTime Capture

Tool

Cross-Platform(Device and Operative System agnostic)

Tool

TimeCaTTime Capture

Tool

Responsiveand touch-enabled

Tool

TimeCaTTime Capture

Tool

FoundationThe most advanced front-end framework in the world

Tool

TimeCaTTime Capture

Tool


Tool

TimeCaTTime Capture

Tool

23


Data Capture

TimeCaTTime Capture

Tool

Observer Subject

Task A

Task B

Task C

Methods

Task A

Task B

Task C

Start Time

End Time

Obse

rvati

on

TimeCaTTime Capture

Tool

Methods

Task A

Task B

Task C

08:15:22 -Task A08:16:05 -Task C08:16:13 -Task B

Notes:

DELETE RENAME FIX TIME

TimeCaTTime Capture

Tool

Methods

Task A

Task B

Task C

08:15:22 -Task A

08:16:05 -Task C

08:16:13 -Task B

Notes:

STOP 08:17:25 -Other

TimeCaTTime Capture

Tool

Methods

Task A

Task B

Task C

08:15:22 -Task A

08:16:05 -Task C

08:16:13 -Task B

Notes:Interruption

TimeCaTTime Capture

Tool

Methods

Task A

Task B

Task C

08:15:22 -Task A

08:16:05 -Task C

08:16:13 -Task B

Notes:

08:17:01 -Task C

TimeCaTTime Capture

Tool

Methods

Task A

Task B

Task C

08:15:22 -Task A

08:16:05 -Task C

08:16:13 -Task B

Notes: 08:17:01 -Task C

Notes:

Notes:

Notes:

Notes:

Current time Duration of Observation

Duration

TimeCaTTime Capture

Tool

30


Data Schemas

TimeCaTTime Capture

Tool

Observer Subject

Task A

Task B

Task C

Methods

Task A

Task B

Task C

Start Time

End Time

Obse

rvati

on

TimeCaTTime Capture

Tool

Task 1

Task 2

Task 5

Task 3

Task 4

Observer Subject

Methods

TimeCaTTime Capture

ToolStart Time

End Time

Obse

rvati

on

Task A

Task B

Task C

Task D

Task ETask F

Task G

Task H

Task I

Task J

Methods

TimeCaTTime Capture

Tool

Travel Nurse station Phone in/outLog in systemSocial ChatPrepare medication

ChartPatient roomAdmin

medicationExplains

procedureHallway

TMS1 TMS2 TMS3 TMS4 TMS5 TMS6 TMS… TMSn

Po-Yin Yen, RN, PhDResearch Assistant ProfessorDepartment of Biomedical Informatics

COAUTHOR

Methods

TimeCaTTime Capture

Tool

Log in system

Prepare medication

Chart

Admin medication

Phone in/out

Social ChatExplains procedure

TravelNurse station

Patient roomHallway

TASK (hands on) LOCATIONSCOMMUNICATION

Methods

TimeCaTTime Capture

Tool

Notes:Current time Duration of Observation

Com

munic

ati

on

Task

Loca

tion

TimeCaTTime Capture

ToolStart Time

End Time

Obse

rvati

on

Social

Phone-in

Explain Procedure

Prepares Medication

Admin Medication

Chart

Nurse Station

Communication Task Location

Hallway

Patient Room

Hallway

Hallway

Nurse Station

Patient Room

Chart

Admin Med.

Prepare Med.

Prepare Med.

Social

Phone-in

Social

Explain Procedure

Social

Methods

TimeCaTTime Capture

Tool

38


Study Types

TimeCaTTime Capture

Tool

39


One dimension

Linear (sequential) time

Study Types

Multitasking

Three dimensions

Multi-Actor

“n” dimensions

TimeCaTTime Capture

Tool

40


Tasks Taxonomy

TimeCaTTime Capture

Tool

Open flexible task list

Dimension 1

Task A Task B Task C

Dimension 2

Task A Task D

TimeCaTTime Capture

Tool

Open flexible task list

Task A

Name:

Definition:

Start milestone:

End milestone:

TRAINING PUBLISHING

TimeCaTTime Capture

Tool


4

Aim: Facilitate results aggregation across sites, workflow comparisons and knowledge discovery by solving definitions inconsistencies.

TimeCaTTime Capture

Tool

44


Time Engine

TimeCaTTime Capture

Tool

45


Task Name -> Duration

Task Name -> Start Timestamp

Task Name -> Duration

TimeCaTTime Capture

Tool

1 2 3 4

OnlineServer

UniqueTime Stamp Synchronized

5

TimeCaTTime Capture

Tool

1329497834 2012-02-17T16:57:14Z ISO8601

Friday, 17th February 2012 11:57am

1329497834

1329793983

793983

02 hours 14 min 02 sec

11:57:10am

02:12:04pm

UNIX TimestampUNIX Epoch [00:00:00 UTC on 1 January 1970].

TimeCaTTime Capture

Tool

Main Hospital in L.A.=> Pacific Time

Small Clinic in L.A.=> Pacific Time

Main Hospital in Boston=> Eastern Time

TimeCaTTime Capture

Tool


Task A

Client Server

Observation

task_id

observation_id

UNIX Timestamp

task_id

Timestamp

observation_id=>site_id=>Timezone

Task A at 08:20:15 am local time in L.A.

TimeCaTTime Capture

Tool


TimeCaTTime Capture

Tool

51


Training & Reliability

TimeCaTTime Capture

Tool


Real Observation

Training Session

Inter-Observer Reliability Assessment (I.O.R.A.)

TimeCaTTime Capture

Tool

Observer A

Subject One

Data X

Observer B

Data Y

Time

Intervention

TimeCaTTime Capture

Tool

Kappa

Intra-Class Correlation Coefficient

Bland and Altman limits of agreement

Pearson product-moment correlation

Standardization Efforts: Inter-observer reliability

Results

TimeCaTTime Capture

Tool

Standardization Efforts: Inter-observer reliability

Results

TimeCaTTime Capture

Tool

56


Study Management

TimeCaTTime Capture

Tool


Representativeness across the day and the week

Healthcare describes a circadian and seasonal activity pattern

TimeCaTTime Capture

Tool


Number of patients per day during March 2009 and March 2010

Consuls per day

Consuls per day

March 2009

March 2010

TimeCaTTime Capture

Tool

59


Data Visualization

& Reports

TimeCaTTime Capture

Tool

Principal Investigator

TimeCaT

Observer

Subject

Site 1

Observer

Subject

Site 2

Observer

Subject

Results

TimeCaTTime Capture

Tool


Free task name

Tag1, Tag 2 Testing ScheduleTag 2, Tag 3 Tag 2, Tag 4

TimeCaTTime Capture

Tool


TimeCaTTime Capture

Tool

64


Roles and Privileges

TimeCaTTime Capture

Tool


Administrator

Observer

TimeCaTTime Capture

Tool

66


Live Demo

TimeCaTTime Capture

Tool

67


Future Work

TimeCaTTime Capture

Tool


Inter Observer Reliability Assessment

In-depth quantitative workflow analyses

TimeCaTTime Capture

Toolhttp://www.timecat.org

Results

TimeCaTTime Capture

Tool

Po-Yin Yen, RN, PhDResearch Assistant ProfessorDepartment of Biomedical Informatics

CO-INVESTIGATOR

Albert M. Lai, PhDAssistant ProfessorDepartment of Biomedical Informatics

CO-INVESTIGATOR

Peter J. Embi, MD, MSAssociate ProfessorVice-ChairDepartment of Biomedical Informatics

CO-INVESTIGATOR

Philip R. O. Payne, PhDAssociate ProfessorChairDepartment of Biomedical Informatics

PRINCIPAL INVESTIGATOR

Funding: Department of Biomedical Informatics

Acknowledgements

TimeCaTTime Capture

Tool


v3.9 [BETA]

TimeCaTTime Capture

Tool

Methods

TimeCaTTime Capture

Tool

marcelo a. lopetegui, m.d. postdoctoral researcher department of biomedical informatics

Documents