tmf reference model€¦ · and effectiveness drivers of tmf management, including: – knowledge...

52
TMF Reference Model Topline results of 2015 TMF Survey #5 September 2015 Fran Ross TMF Survey Sub-team

Upload: others

Post on 04-May-2020

16 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Reference Model

Topline results of

2015 TMF Survey #5

September 2015

Fran Ross

TMF Survey Sub-team

Page 2: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

• TMF Survey purpose: industry-wide, gather insight into quality, cost

and effectiveness drivers of TMF management, including:

– Knowledge and use of TMF Reference Model

– TMF management pain points

– Paper vs electronic TMF

• Data for the 2015 was collected from May to July 2015

• This TMF Survey has been conducted as an initiative of the TMF

Reference Model (TMF RM) and is performed annually. The TMF

RM committee and leadership operate in coordination with the EDM

Reference Model as initiatives of the Document and Records

Management (DRM) Community in the DIA

Trial Master File (TMF) Survey Background

2

Page 3: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Report Sections

• Respondent Demographics

• TMF / eTMF Insights

• TMF Metrics

• TMF Reference Model Use

• Inspection Trends

• electronic Investigator Site File (eISF)

2015 TMF Survey 3

Page 4: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

RESPONDENT DEMOGRAPHICS

4

Page 5: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

• 159 Evaluable Responses

• Sponsor organizations majority respondents (53%)

Respondent Organization Type

53%

1%

17%

9%

14%

6%

Your organization type:

Sponsor

Site

CRO

Consultant

Vendor

Other (please specify)

2015 TMF Survey 5

Page 6: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Respondent Location

13%

29% 57%

1%

Where are you located?

Asia Pacific

Europe

USA / Canada

Africa

2015 TMF Survey 6

Page 7: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Trial Outsourcing Profile

26%

20%

15%

17%

22%

What percentage of current Phase II/III trials are fully outsourced to CROs? (select closest percentage)

100% fully out-sourced

76-99%

51-75%

26-50%

0-25%

2015 TMF Survey 7

Page 8: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Active Trials

12%

28%

16%

12%

21%

11%

Indicate the number of active trials at your organization

1 to 4

5 to 25

26 to 50

51 to 100

101 to 500

501 to 1000

2015 TMF Survey 8

Page 9: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF / eTMF INSIGHTS

9

Page 10: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF SOP Adherence

61%

28%

0% 6%

2%

3%

Does your organization have and follow a TMF SOP?

Yes, followed consistently

Yes, followed inconsistently

Yes, not followed

No, in development

No, no plans for SOP

Not required

2015 TMF Survey 10

Page 11: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

29%

11% 57%

3%

What format is your file of record?

All Inspectable TMF / ISF inpaper

All Inspectable eTMF / eISF

Combination paper andelectronic

Other

Paper or Electronic

2015 TMF Survey 11

Page 12: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

29%

41%

18%

8% 4%

How many record types in the index / table of contents?

Less than 200

201-400

401-600

601-800

801+

Numbers of unique artifacts

2015 TMF Survey 12

Page 13: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

15%

32%

21%

14%

12%

6%

How many unique content types must be signed?

Less than 10

11-25

26-50

50-75

76-100

101+

Documents requiring signature

2015 TMF Survey 13

Page 14: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

eTMF Status

44%

14%

17%

18%

7%

What is the status of your organization's eTMF?

We currently use eTMF / eISF

Evaluating

Actively Planning

Actively Building/Implementing

Not Considering

2015 TMF Survey 14

Page 15: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

eTMF Duration

12% 4%

46%

21%

17%

How long has your eTMF been in production?

Less than 1 Year

1 Year

2-3 Years

4-5 years

6 or more years

2015 TMF Survey

15

Page 16: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

More Than One System?

58% 20%

22%

Do you use more than one system?

No

Yes - we have multiple

Yes - ours and our CRO's

2015 TMF Survey 16

Page 17: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Issues When Using More Than One eTMF System

0

2

4

6

8

10

12

14

16

None Increasedeffort for

reconcilation

Difficultyestablishingfile of record

UserConfusion

Increased costburden

Increasedcomplication

withsubmissionprocessing

Othernegativeimpacts

Which of the following do you encounter when using more than one system? (select all that apply)

2015 TMF Survey 17

Page 18: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

eTMF Archive Process

25%

42%

19%

8%

0% 6%

What is the eTMF post-trial "archive" process"?

No archive process, remains insystem

Electronic archive, remains insystem

Electronic archive, moved toanother system

Stored on external media

Printed hard copy

Other

2015 TMF Survey 18

Page 19: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Paper retention

46%

50%

4%

Do you retain scanned paper?

Yes, we retain all paper

Yes, we retain some paper

No, we do not retain any paper

2015 TMF Survey 19

Page 20: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Reasons for retaining scanned paper

0

5

10

15

20

25

30

Ink signeddocuments only

In case ofinspection

Company policy /SOPs

Because its saferand easier

Required bySponsor (CRO)

Why do you retain scanned paper?

2015 TMF Survey

20

Page 21: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF METRICS

21

Page 22: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Metrics Program

28%

39%

15%

18%

Do you have a TMF metrics program in place?

Yes

Evaluating

Implementing

Not planning

2015 TMF Survey 22

Page 23: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Metrics Program Measurements

0

1

1

2

2

3

3

4

4

5

Completenessof TMF

IndexingQuality

MetadataQuality

Image Quality System usage Timeliness Documentvolume

What do you measure in your TMF Metrics Program? (select all that apply)

2015 TMF Survey 23

Page 24: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Metrics - Cost

38%

62%

Do you measure TMF costs?

Yes

No

2015 TMF Survey 24

Page 25: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Metrics – Cost Efficiency Opinion

10%

29%

31%

22%

8%

Do you believe your TMF is cost efficient?

Very cost efficient

Somewhat

Neutral

Somewhat inefficient

Very inefficient

2015 TMF Survey 25

Page 26: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Metrics – Risk Based Monitoring

5%

43%

24%

28%

Are eTMF metrics used in your RBM program?

Yes

In the future

No

No RBM program

2015 TMF Survey 26

Page 27: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF REFERENCE MODEL USE

27

Page 28: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Reference Model Awareness

96%

4%

Are you aware of the TMF Reference Model?

Yes

No

2015 TMF Survey 28

Page 29: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Reference Model Use

71%

15%

2% 12%

Is your organization using the TMF Reference Model?

Yes

No

Don't Know

Not Applicable (Vendor,Health Authority,Consultant, Other)

2015 TMF Survey 29

Page 30: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Applying the TMF Reference Model

14%

32% 54%

My organization is using the Model for...

Paper TMFs only

eTMFs only

Both paper andeTMFs

2015 TMF Survey 30

Page 31: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Reference Model Use in New and Ongoing Trials

0

10

20

30

40

50

60

70

80

90

100

New TMFs Ongoing,restructured TMF

Ongoing,documents

added / removed

Closed TMFs Other

My organization is using the Model in... (select all that apply)

2015 TMF Survey 31

Page 32: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Reference Model Adoption Practices

35%

65%

Has your organization adopted the Model as is, without any change?

Yes, adopted as is

No, adapted with changes

2015 TMF Survey 32

Page 33: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

TMF Reference Model Adoption Methods

0

5

10

15

20

25

30

35

40

45

Adding artifacts Condensingartifacts

Branchingartifacts intosub-artifacts

Changing theRM numbering

system

Restructuringthe zones

Other changes

In adopting the Model, my organization is… (select all that apply)

2015 TMF Survey 33

Page 34: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Changes from Adopting TMF Reference Model

0

10

20

30

40

50

60

70

80

Updating/planningto change SOPs

Creating/updatingguidance or best

practice documents

Mapping TMFstructure to model

Changing activeTMFs to reflect

model

Other (pleasespecify)

2015 TMF Survey 34

Page 35: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

INSPECTION TRENDS

35

Page 36: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Inspection History

0

5

10

15

20

25

No

US

- FD

A

EU -

EM

A

UK

- M

HR

A

Jap

an -

PM

DA

Au

stra

lia/N

ewZe

alan

d -

AN

ZTP

A

Bra

zil -

AN

VIS

A

Ch

ina

- SF

DA

Oth

er

Have you had regulatory agency / health authority inspections of your eTMF? (select all that apply)

2015 TMF Survey 36

Page 37: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Remote Inspection History

21%

54%

25%

Have you yet had a remote (off-premise) inspection by any regulatory agency / health authority?

Yes

No

Unknown

2015 TMF Survey 37

Page 38: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Sponsor Inspection History Paper Requests

0

5

10

15

20

25

No

US

- FD

A

EU -

EM

A

UK

- M

HR

A

Jap

an -

PM

DA

Oth

er (

ple

ase

spec

ify)

Has any inspector refused to use eTMF and required paper print out of TMF?

2015 TMF Survey 38

Page 39: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Sponsor Inspection History eTMF Resistance

0

4

8

12

16

20

No refusal EU - EMA UK - MHRA Other (pleasespecify)

Has any inspector refused to use paper and required access to eTMF?

2015 TMF Survey 39

Page 40: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Sponsor Opinion - Inspection Preparation Impact

75%

25%

Has the eTMF helped ease burdens of audits / inspections?

Yes

No

2015 TMF Survey 40

Page 41: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Sponsor Opinion - eTMF Inspection Impact

58% 26%

16%

Have auditors or inspectors found the eTMF easier to inspect using your eTMF software?

Yes

No

We do not allow inspectordirect access to the eTMF

2015 TMF Survey 41

Page 42: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Sponsor Opinion – eTMF Impact Unannounced Inspections

32%

11%

57%

Has the eTMF proved a benefit in allowing you to support unannounced inspections?

Yes

No

Unknown

2015 TMF Survey 42

Page 43: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

ELECTRONIC INVESTIGATOR SITE

FILE (e-ISF)

43

Page 44: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

eTMF Externalization

8%

25%

17% 5%

24%

21%

Does your eTMF externalize content to clinical trial sites (e.g. Investigator Portal)?

We currently externalizecontent

Evaluating

Actively Planning

ActivelyBuilding/Implementing

Not Considering

Not Applicable / Unknown

2015 TMF Survey 44

Page 45: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

eISF Usage

26%

74%

Are electronic Investigator Site Files (eISF) being used in your trials?

Yes

No

2015 TMF Survey 45

Page 46: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Percentage of Trials with eISF

35%

23%

16%

26%

What percent of your trials have an electronic Investigator Site File (eISF)?

0-25%

26-50%

51-75%

76-100%

2015 TMF Survey 46

Page 47: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

eISF Excluded Content

0

5

10

15

20

25

Subject InformedConsent

Signed FinancialDisclosures

Signed Contracts UnblindedSubject ID Log

Payment/FinanceDocuments

Other ExcludedContent

Which of the following documents, if any, are NOT stored in the eISF (select all that apply)

2015 TMF Survey 47

Page 48: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

eISF Archive Process

16%

29%

32%

10%

7% 6%

What is the eISF post trial "archive" process?

No archive, remains in system

Electronic archive, remains insystem

Electronic archive, moved toanother system

Stored on external media

Printed hard copy

Other

2015 TMF Survey 48

Page 49: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

eISF Technology Control

16%

71%

13%

Is the eISF the site's technology or sponsor / CRO's technology?

Site

Sponsor / CRO

Other

2015 TMF Survey 49

Page 50: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

Barriers to eISF uptake

05

10152025303540

Tech

nic

al C

on

stra

ints

Re

gula

tory

con

cern

s/b

arri

ers

Lega

l co

nce

rns/

Bar

rie

rs

Loca

l co

un

try

con

cern

s

Site

re

fusa

l

Fin

anci

al b

arri

ers

No

t co

nsi

der

ed

Oth

er (

ple

ase

sp

ecif

y)

If no eISF, why not? (choose all that apply)

2015 TMF Survey 50

Page 51: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

To join the TMF Ref Model, register on the website:

http://tmfrefmodel.com/

Visit the website for up to date information too!

Join Linked In group “TMF Reference Model” http://www.linkedin.com/groups?home=&gid=2663204&trk=anet_ug_hm

2015 TMF Survey

TMF Reference Model – Participate!

51

Page 52: TMF Reference Model€¦ · and effectiveness drivers of TMF management, including: – Knowledge and use of TMF Reference Model – TMF management pain points – Paper vs electronic

• Shah Ashraf

• Andrew Mitchell

• Penny Jegede

• Betsy Fallen

• Sholeh Ehdaivand

• Steve Scribner

2015 TMF Survey

TMF 2015 Survey Team – THANK YOU!

52