structural abstraction for strong fault models diagnosis (dx 2014 bisfai 2015) roni sternmeir...

28
AI@BGU Structural Abstraction for Strong Fault Models Diagnosis (DX 2014 BISFAI 2015) Roni Stern Meir Kalech Orel Elimelech Ben Gurion University of the Negev, Israel Department of Information Systems Engineering

Upload: ginger-gordon

Post on 26-Dec-2015

214 views

Category:

Documents


1 download

TRANSCRIPT

AI@BGU

Structural Abstraction for Strong Fault Models Diagnosis (DX 2014 • BISFAI 2015)

Roni Stern Meir Kalech Orel Elimelech

Ben Gurion University of the Negev, IsraelDepartment of Information Systems Engineering

2

Outline Introduction to Diagnosis Model-Based Diagnosis

Definition & Motivation Abstraction Literature Review Research Goal

Methodology Evaluation

Results Conclusions Future Work

3

Outline Introduction to Diagnosis Model-Based Diagnosis

Definition & Motivation Abstraction Literature Review Research Goal

Methodology Evaluation

Results Conclusions Future Work

4

What is a Diagnosis?• Identifying the reason for a problem by examining observed symptoms.

• Determining which part of the system is failing.

5

Examples of Diagnosis Domains

http://symptomchecker.isabelhealthcare.com/

6

Diagnosis Approaches• Expert Systems.

• Case-Based Reasoning.

• Probabilistic Reasoning.

• Model-Based Diagnosis.

• And more…

7

Outline Introduction to Diagnosis Model-Based Diagnosis

Definition & Motivation Abstraction Literature Review Research Goal

Methodology Evaluation

Results Conclusions Future Work

8

Model-Based DiagnosisCar System Model A Real Car

[Raymod Reiter. A theory of diagnosis from first principles. 1987].[Johan de Kleer and Brian C. Williams. Diagnosing multiple faults. 1987].

10

Abstraction

32 Components

232

11

32 Components

232Faulty

Abstract Diagnosis What caused this black

box to fail?

12

Abstraction

Input 1

Input 2

Output

Inputs 3 & 4

Input 1

Input 2

Inputs 3 & 4

Output

Abstraction

13

Grounding

Faulty

Input 1 = No Fluids

Input 2 = No Fluids

Expected Output = No FluidsObserved Output = Fluids

Inputs 3 & 4 = No Fluids

Pipe 9 is

Faulty

Grounding

14

Architecture & Terminology

Original System

Abstract System

Diagnosis Engine

Abstract DiagnosesDiagnoses for the Original System

Find Abstraction Finds

Grounding

15

What if we can’t ground an abstract component?

16

Ungroundable Abstract Diagnosis

Input = No Fluids

Expected Output = No FluidsObserved Output = Fluids

Pipe 2 Mode: Healthy \ Blocked

Healthy No Fluids

Blocked No Fluids

Pipe 1

Pipe 2

An abstract component of 2 pipes

The grounding process fails

Using abstraction here is not easy

Can’t explain the observed output Faulty

17

Literature Review

[Metodi, Stern, Kalech and Codish. Compiling Model-Based Diagnosis to Boolean Satisfaction. 2012]

Past work assumed 2 behavior modes: Healthy \ Faulty

Faulty Any desired behaviorPipe 1

Pipe 2

Abstract diagnoses will always be groundable

18

Literature ReviewSome have already tried to diagnose systems with multiple fault modes.

Conflict-Directed with Abstraction• [Feldman, Provan and van Gemund. 2010]

Compilation-Based with Abstraction• [Torta and Torasso. 2013]

19

Our goal is to find an efficient way to diagnose when grounding can fail

20

Outline Introduction to Diagnosis Model-Based Diagnosis

Definition & Motivation Abstraction Literature Review Research Goal

Methodology Evaluation

Results Conclusions Future Work

21

Discard abstract components

that may not be groundable

1. Pessimistic Approach

More components

Harder to diagnose

The grounding process is easier

22

Keep all abstract components and take the risk of failing

during the grounding process.

Less components easier to diagnose

The grounding process is harder

2. Optimistic Approaches

23

2.1. Weak-Optimistic Approach

2.2. Strong-Optimistic Approach

Grounding

Fail

Succ

ess

Grounding

Are there more abstract diagnoses?

Fail

Succ

ess

No

Yes

25

Outline Introduction to Diagnosis Model-Based Diagnosis

Definition & Motivation Abstraction Literature Review Research Goal

Methodology Evaluation

Results Conclusions Future Work

26

Evaluation

• Empirical evaluation.

• The approaches were implemented in Prolog.

• External SAT Solver.

• Modified version of the ISCAS-85 benchmark.

27

Results• Three systems:

• Diagnosis algorithm: SATbD

• Timeout: 20 seconds

System ID |Comps.| Before

Abstraction

|Comps.| After

Abstraction

c880 383 77

c1355 546 58

c2670 1193 167

X Axis – The ApproachesY Axis - Success Rate of Solved Instances

28

Conclusions & Summary

General approach for abstraction in strong-fault models.

Evaluation on a modified version of the ISCAS-85 benchmark.

Abstraction speeds up the diagnosis process.

Mostly the (weak) optimistic approach is the best.

29

Schedule & Future Work Find an efficient method to use abstraction in strong-fault models.

Model the approaches to SAT.

Evaluate the approaches (ISCAS-85 benchmark).

Compare our method to Torta and Torasso. 2013, Feldman et al. 2010.

Optimize the approaches.

Find an hybrid approach based on systems pre-process.

30

[email protected]

www.orel-e.com

+972 52 4370054

https://il.linkedin.com/in/

orelelimelech

Questions

?