the ediscovery experience © 2012 kpmg llp, a canadian limited liability partnership and a member...

28
Predictive Coding

Upload: steven-mcdonald

Post on 18-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

Predictive Coding

Page 2: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

The eDiscovery Experience

Page 3: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

3

Page 4: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

4

TerminologyExpression Definition

False positives Responsive documents that are irrelevant

False negatives Relevant documents that are not responsive

Synonymy Many words have the same meaning

Polysemy Same word has different meanings

Page 5: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

5

Expression Definition

Precision Proportion of the retrieved documents that are responsive

Recall Proportion of responsive documents that have been retrieved

Terminology

eDiscovery Institute , Comparison of Auto-Categorization with Human Review, (http://www.electronicdiscoveryinstitute.com/pubs/ComparisionAutoCategorization.pdf)

OMG “Oh My God”

Page 6: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

ReviewR

e

v

i

e

w

ab

c d

g

fk z

l

m

n

os

t

u

Page 7: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 8: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 9: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 10: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 11: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

‘97

Page 12: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 13: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 14: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 15: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 16: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 17: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

Principle 7

electronic tools

Technologies

Page 18: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

18

Global Aerospace

Da Silva

Page 19: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

19

Clustering

Page 20: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

20

Similar documents

identifiedReview Sample

Create Sample of

identified documents

Bad MatchesMark not responsive

Category with “Example

documents”

Good MatchesAdd to category

Categorization

Page 21: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

2121

Teaching SetTeaching Set

Predictive Coding

Keywords &

ConceptsReport

Keywords &

ConceptsReport

Page 22: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

22

Keywords &

ConceptsReport

Keywords &

ConceptsReport

100,000 documents

100,000 documents

Responsive Documents

Responsive Documents

100,000 documents

100,000 documents100,000

documents

100,000 documents

100,000 documents

100,000 documents

SampleSample

Predictive Coding

Page 23: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

Statistical Sample QC

Statistical Sample QC

2nd round of Predictive Coding

Teaching Set 500 documents

Responsive

100,000Non-Responsive

300,000Uncategorized

100,000

Responsive

762Non-Responsive

767Uncategorized

250

Responsive

130,000Non-Responsive

330,000Uncategorized

40,000

Responsive

765Non-Responsive

767Uncategorized

250

4,061 coded manually

465,939 categorized by Analytics

500,000 documents

1st round of Predictive Coding

Page 24: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

24

Page 25: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms
Page 26: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

26

eDiscovery: It’s a process,

not a technology™

Page 27: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

Dominic Jaar

djaar@ .ca514.212.9348

www.kpmgblog.ca/imed

Page 28: The eDiscovery Experience © 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms

© 2012 KPMG LLP, a Canadian limited liability partnership and member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

The KPMG name, logo and “cutting through complexity” are registered trademarks or trademarks of KPMG International Cooperative (“KPMG International”).

This presentation shall not be used or published except in relation with the presentation for which it was developed, without written authorization. We will not assume any responsibility or liability for any costs, damages, losses, liabilities or expenses incurred by you, your client or anyone as a result of circulation, publication, reproduction, use of or reliance upon our presentation contrary to the restrictions noted above.

KPMG's services described in this presentation shall not be construed as legal advice as KPMG does not engage in the provision of legal advice.