case study log analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · data recovery...

28
1 Rich Murphey ACS Automated Windows event log forensics Repair Correlate Extract Case Study Engagement Preliminary Results Final Report Log Analysis Extract Repair Correlate Interpret DFRWS Aug 13, 2007

Upload: others

Post on 10-Aug-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

1

Rich MurpheyACS

Automated Windows event log forensics

Repair

Correlate

Extract

Case StudyEngagementPreliminary ResultsFinal Report

Log AnalysisExtractRepairCorrelateInterpret

DFRWS Aug 13, 2007

Page 2: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

2

Special Thanks ToSponsor:

Digital Forensic Services In-depth Analysis, Testimony

Data Recovery ServicesComplex RAID, Exotic File Systems

Technology Consulting

Reviewers: Matthew Geiger, CERTJerlyn Mardis, ACS

Page 3: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

3

Log Forensics Process

Forensic Process ModelsRepair

Correlate

Extract

Extract

Analyze

Interpret

Page 4: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

4

Log Forensics Process

Forensic Process ModelsRepair

Correlate

Extract

Recover:Step 1 – Extract

•Data Carve for Logs, etc.

Step 2 – Repair and Validate•Obtain valid log files.

Step 3 – Correlate•time, files, paths,…

Analyze

Interpret

Page 5: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

5

1st Hurdle: Define a ScopeOfficer/Director callsSomething bad happened….Possible contract violation.Outgoing transfer of proprietary documents.

#1: Define a scope of work.Can we identify file transfer?Examine hard drivesEmail attachmentsFile transfer, uploadsAnything else?

Page 6: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

6

2nd Hurdle: Preliminary ReportGood news:We know what to look for.Well defined keywords, file names

#2: Preliminary ReportD:\OfInterest.docIn unallocated space….

Bad News:IT deleted the user profile, andgave laptop to a new employee,

six months ago, after they reformatted andreinstalled Windows XP.

Page 7: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

7

Shortcuts#2: Preliminary ReportD:\OfInterest.docIn unallocated space….

Surrounding data looks like a shortcut.

Shortcuts contain a snapshot of:MAC timestampsFilenameAbsolute Path, Relative PathKind of Device (Hard disk/CD-ROM)Partition’s Volume Serial Number

Page 8: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

8

ShortcutsShortcuts may contain IDs, label, sizeA snapshot of file’s attributes, media’s attributes

Shortcut File

Read-onlyFile attributes

N/ALast access time (UTC)11/3/2006 10:12:34 AMLast write time (UTC)11/11/2006 3:21:14 PMCreation time (UTC)1643743File sizeE2C3-F184Volume Serial NumberNov 11 2006Volume LabelCD-ROMVolume TypeD:\OfInterest.docLocal Path

Link target information

Page 9: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

9

3rd Hurdle: Final Report

How to identify outgoingfile transfer?Data carve for file path, time….

Where to find time stamps?Event logsInternet historyShortcutsRegistry, and others?...

Page 10: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

10

Log Analysis

Log recovery process…

Step 1 – ExtractData Carve for Logs, etc.

Step 2 – RepairFix corrupt log files.

Step 3 – CorrelateFormulate queries for time, names,…

Page 11: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

11

XP log signature – 16 bytes30 00 00 00 4c 66 4c 65 01 00 00 00 01 00 00 00

Typical log sizes:512K on desktops1MB on servers

Signatures

Page 12: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

12

Using DataLifter:

Page 13: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

13

Log Recovery

scalpel.conf entry:evt y 1048576\x30\x00\x00\x00\x4c\x66\x4c\x65

\x01\x00\x00\x00\x01\x00\x00\x00

Step 1 – Initial script to recover logs:scalpel /dev/sda1

Repair

Correlate

Extract

Page 14: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

14

Step 1 – Extract

The Results:

Step 1 – ExtractRun DataLifter100 logs are extracted.Only two are viewable.98 corrupt logs

Step 2Repair 98 corrupt logs?

evt y 1048576 \x30\x00\x00\x00\x4c\x66\x4c\x65 \x01\x00\x00\x00\x01\x00\x00\x00% scalpel /dev/sda1

Page 15: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

15

Event LoggingWindows 2000, XP, 2003Time, SID, Source, Severity, Message

windows/system32/config:AppEvent.evtSecEvent.evtSysEvent.evtInternet.evt

Page 16: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

16

Repair

FixEvt – an XP log repair toolAutomatically repairs corrupt logs

Repairs or identifies known forms of corruption.

In seconds.

Steve Bunting's Manual Methodhttp://128.175.24.251/forensics

Repair

Correlate

Extract

http://murphey.org

Page 17: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

17

Repair

XP event log repairInvalid Header:

Trailer with good data:

Repaired Header:

Page 18: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

18

FixEvtAvailable on the web.A 4K command line executable.Very simple – no install.

% fixevt *.evt

For each log, FixEvt reports either:1 - Did not need repair2 - Was repaired3 - Cannot be repaired4 - Might be repaired by another method

Repair

Correlate

Extract

Page 19: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

19

Log Analysis

How the process worksStep 1 – ExtractRun DataLifter100 logs are extracted.98 corrupt logs.

Step 2 – Repair the LogsManual: 15 minutes/log * 98 Logs = 3 days“FixEvt *.evt”: 2 seconds.

Repair

Correlate

Extract

Page 20: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

20

Results

The Results:

Step 1 – Extract100 logs are extracted.98 corrupt logs.2 valid logs

Step 2 – Repair50 logs repaired52 Total logs.

Step 3 – Correlate events in 51 logs?

Repair

Correlate

Extract

scalpel /dev/sda1fixevt *.evt

Page 21: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

21

Correlate

LogParserInput:evt, IIS, REG, FS, ADS

Output:csv, XML, SQL, HTML

Run SQL queries onmultiple log files

Repair

Correlate

Extract

Page 22: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

22

Results50 logs were repaired.Some are still invalid due to corruption.Tools will not parse a sets containing corrupt logs.

Use LogParser to validate the logs.LogParser "select count(*) from log.evt"Returns an error status that indicates parsing errors.

Script to extract, repair and validate logs:

Result: 46 total valid logs23 empty, 23 non-empty87,413 events total

14 months of activity prior to reformatting of the hard drive.

Repair

Correlate

Extract

scalpel /dev/sda1fixevt *.evtfor i in *.evt;do LogParser "select count(*) from $i" \

&& cp $i goodlogs; done

Page 23: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

23

CorrelateStep 3 – Correlate

select <columns> from <table> into <output-file>

logparser “select * from system.evt into excel.csv”Reads the log file: system.evtCreates a spreadsheet of comma separated values“*” selects all columns of data

Write Queries – for correlating time, name…… select TimeGenerated, Message from system.evt …Output timestamp and full message

… where TimeGenerated > '2006-11-11 00:00:00' and TimeGenerated < '2006-11-12 00:00:00'

Filter a one day period.

… where Message like “%CD Burning%” …Filters for start, stop, running events

Page 24: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

24

CorrelateSQL queries to identify patterns

logparser“select TimeGenerated, Message

from system.evtwhere TimeGenerated > '2006-11-11 00:00:00'

and TimeGenerated < '2006-11-12 00:00:00‘and Message like “%CD Burning%”

Repair

Correlate

Extract

The CD Burning service entered the running state.11/11/2006 15:21

MessageTime (UTC)

The CD Burning service entered the running state.11/11/2006 15:26The CD Burning service entered the running state.11/11/2006 15:25The CD Burning service entered the running state.11/11/2006 15:24The CD Burning service entered the running state.11/11/2006 15:23The CD Burning service entered the running state.11/11/2006 15:22

The CD Burning service entered the stopped state.11/11/2006 15:27The CD Burning service entered the running state.11/11/2006 15:27

The CD Burning service was successfully sent a start control.11/11/2006 15:21

Page 25: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

25

ShortcutsShortcuts may contain IDs, label, sizeA snapshot of file’s attributes, media’s attributes

Shortcut File

Read-onlyFile attributes

N/ALast access time (UTC)11/3/2006 10:12:34 AMLast write time (UTC)11/11/2006 3:21:14 PMCreation time (UTC)1643743File sizeE2C3-F184Volume Serial NumberNov 11 2006Volume LabelCD-ROMVolume TypeD:\OfInterest.docLocal Path

Link target information

Page 26: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

26

Timestamp Analysis

Last write time is earlier than created.

Can indicate the time at which a file wastransferred from source media.Can help identify the location of the sourcemedia.

11/3/2006 10:12:34 AMLast write11/11/2006 3:21:14 PMCreated

Read-onlyFile attributes

N/ALast access time (UTC)11/3/2006 10:12:34 AMLast write time (UTC)11/11/2006 3:21:14 PMCreation time (UTC)1643743File sizeE2C3-F184Volume Serial NumberNov 11 2006Volume LabelCD-ROMVolume TypeD:\OfInterest.docLocal Path

Link target information

Page 27: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

27

ReportCorrelations indicateA CD-ROM was burnedOn this system.By account name: BobAt: 11/11/2006 3:21 PM UTC

The CD media may be identified:Label: “Nov 11 2006”Volume serial number: E2C3-F184

The source media may be identified:OfInterest.doc with size = 1643743 bytes, andLast Modified = 11/3/2006 10:12:34 AM UTC

Repair

Correlate

Extract

Page 28: Case Study Log Analysisold.dfrws.org/2007/proceedings/p92-murphey_pres.pdf · Data Recovery Services Complex RAID, Exotic File Systems Technology Consulting Reviewers: Matthew Geiger,

28

[email protected]://murphey.orghttp://acsworldwide.com

Repair

Correlate

Extract