the ediscovery experience © 2012 kpmg llp, a canadian limited liability partnership and a member...

Predictive Coding

The eDiscovery Experience

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

3

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

4

TerminologyExpression Definition

False positives Responsive documents that are irrelevant

False negatives Relevant documents that are not responsive

Synonymy Many words have the same meaning

Polysemy Same word has different meanings

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

5

Expression Definition

Precision Proportion of the retrieved documents that are responsive

Recall Proportion of responsive documents that have been retrieved

Terminology

eDiscovery Institute , Comparison of Auto-Categorization with Human Review, (http://www.electronicdiscoveryinstitute.com/pubs/ComparisionAutoCategorization.pdf)

OMG “Oh My God”

ReviewR

e

v

i

e

w

ab

c d

g

fk z

l

m

n

os

t

u

‘97

Principle 7

electronic tools

Technologies

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

18

Global Aerospace

Da Silva

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

19

Clustering

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

20

Similar documents

identifiedReview Sample

Create Sample of

identified documents

Bad MatchesMark not responsive

Category with “Example

documents”

Good MatchesAdd to category

Categorization

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

2121

Teaching SetTeaching Set

Predictive Coding

Keywords &

ConceptsReport

Keywords &

ConceptsReport

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

22

Keywords &

ConceptsReport

Keywords &

ConceptsReport

100,000 documents

100,000 documents

Responsive Documents

Responsive Documents

100,000 documents

100,000 documents100,000

documents

100,000 documents

100,000 documents

100,000 documents

SampleSample

Predictive Coding

Statistical Sample QC

Statistical Sample QC

2nd round of Predictive Coding

Teaching Set 500 documents

Responsive

100,000Non-Responsive

300,000Uncategorized

100,000

Responsive

762Non-Responsive

767Uncategorized

250

Responsive

130,000Non-Responsive

330,000Uncategorized

40,000

Responsive

765Non-Responsive

767Uncategorized

250

4,061 coded manually

465,939 categorized by Analytics

500,000 documents

1st round of Predictive Coding

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

24

© 2012 KPMG LLP, a Canadian limited liability partnership and a member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

26

eDiscovery: It’s a process,

not a technology™

Dominic Jaar

djaar@ .ca514.212.9348

www.kpmgblog.ca/imed

© 2012 KPMG LLP, a Canadian limited liability partnership and member firm of the KPMG network of independent member firms affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. All rights reserved.

The KPMG name, logo and “cutting through complexity” are registered trademarks or trademarks of KPMG International Cooperative (“KPMG International”).

This presentation shall not be used or published except in relation with the presentation for which it was developed, without written authorization. We will not assume any responsibility or liability for any costs, damages, losses, liabilities or expenses incurred by you, your client or anyone as a result of circulation, publication, reproduction, use of or reliance upon our presentation contrary to the restrictions noted above.

KPMG's services described in this presentation shall not be construed as legal advice as KPMG does not engage in the provision of legal advice.