tallinn university of technology department of computer engineering ati.ttu.ee jaan raik diamond:...

27
Tallinn University of Technology Department of Computer Engineering Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

Upload: uriel-lippard

Post on 14-Dec-2015

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

Tallinn University of TechnologyDepartment of Computer Engineering

Department of Computer Engineeringati.ttu.ee

Jaan Raik

DIAMOND: Targeting Verification and Reliability Issues in Systems

Page 2: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

DIAMOND: Targeting Verification and Reliability Issues in Systems

EU FP7 STREP Project DIAMOND A holistic view of design and soft errors

Success stories: FoREnSiC (C, system-level) zamiaCAD (VHDL/Verilog/SC, RTL)

Follow-up projects Significance to CEBE

2

Page 3: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

Toyota problems: reliability or verification?

3

Page 4: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

4

The DIAMOND conceptSoft-errors caused by cosmic

radiation

DIAMOND’sdiagnosis/correction

methods

Soft-errors in new generation chips due to background radiation

Electronic systems fail while working in the field

Design mistakes made by the engineer

Page 5: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

5

DIAMOND: Objectives

A unified, holistic diagnostic model for bugs and soft errors at all levels;

Automated localisation & correction techniques based on the unified model, both pre-silicon & post-silicon;

Implementation of a reasoning framework for localisation & correction, encompassing word-level techniques, formal, semi-formal, and dynamic techniques.

Page 6: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

DIAMOND Kick-off, Tallinn, February 2-3, 20106

DIAMOND: FP7 collaborative research

FP7-2009-ICT-4-248613 DIAMOND - Diagnosis, Error Modelling and Correction for Reliable Systems Design

Start January 2010; total budget 3.8M € (EU contribution 2.9M €); 462.5 PM

The IBM logo is a registered trademark of International Business Machines Corporation (IBM) in the United States and other countries.

Page 7: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Verification and debug

7

• ~2/3 of development time for verification• ~2/3 of verification time for debug• Thus, nearly half of the development cycle!• Automation of the debug step needed...

Debug

Verification

Page 8: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Traditional debug flow

8

Verification

Design

Spec

Error!

Counter-examples (waveforms), failed assertions, ...

???

• Too little information• Too much information

JAAN RAIK
Too much information, too little information
Page 9: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Automated debug flow

9

Verification

Design

Spec

Error!

Corrected design, Repair log, ...

Error localization

Error correction

JAAN RAIK
Too much information, too little information
Page 10: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Maksim Jenihhin

DIAMOND Debug Tools

FoREnSiC Formal automated debug

environment for ESL HW in C zamiaCAD

A highly scalable framework for design analysis and automated debug at RTL (VHDL-centric)

10

Page 11: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

11

FoREnSiC

FoREnSiC: Formal Repair Environment for Simple C For system-level HW Developed by TU Graz, University of Bremen and TUT Front-end converting simple C descriptions to

flowchart model, different debug back-ends Open source and available at:

http://www.informatik.uni-bremen.de/agra/eng/forensic.php

Page 12: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

12

Forensic Flow

Page 13: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

13

Available FoREnSiC Back-Ends

FoREnSiC includes 3 complementary back-ends: Symbolic back-end (TU Graz)

Symbolic+concolic engines and model-based diagnosis for localization; template-based correction.

Cut-based back-end (University of Bremen) Formally verifies the equivalence between a C program and

an implementation in HDL.

Simulation-based back-end (Tallinn University of Technology, University of Verona) Intended for correcting larger programs. Statistical

localization + mutation-based correction

Page 14: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Statistical localization + mutations

14

Page 15: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Dynamic slicing for localization

15

Page 16: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Statistical analysis

Ranking according to suspiciousness:

16

Suspiciousness score

Circuit blocks

 

Page 17: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Fault model for correction

17

MUTATION OPERATOR C OPERATORS/EXAMPLES AOR (arithmetic operator replacement) +, -, *, /, % ROR (relational operator replacement) ==, !=, >, <, >=, <= LCR (logical connector replacement) &&, || ASOR (assignment operator replacement) +=, -=, *=, /=, %=, =

UOR (unary operator replacement) +, -, ~, ! Bitwise operator replacement <<, >>, &, |, ^ Bitwise assignment operator replacement <<=, >>=, &=, |=, ^=

Increment/decrement operator replacement x++, ++x, x--, --x

Number mutation (decimal digit replacement in integers, floats and array indexes)

0...9

Constant replacement unary minus/ unary plus/ zero +C, 0, -C

Page 18: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Design error correction experiments

18

Page 19: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Maksim Jenihhin

zamiaCAD team and cooperation Günter Bartsch, Stuttgart – founder Rainer Dorsch, Stuttgart – Bosch/IBM Tallinn University of Technology

Anton Tšepurov, PhD student Maksim Jenihhin Valentin Tihhomirov, PhD student Saif Abrar PhD student Jaan Raik

IBM Faculty Award 2011/2012

19

Page 20: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Maksim Jenihhin

zamiaCAD flow

http://zamiacad.sf.net Front-end currently

supports VHDL Object database ZDB

Persistence Scalability Custom designed Highly optimized for

performance

20

Page 21: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Maksim Jenihhin 21

Page 22: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Maksim Jenihhin

zamiaCAD Evaluation A case study on ROBSY microprocessor 17k lines of VHDL code Error localization based on statistical ranking

22

Bug data The proposed automated localization Manual

debug Statistical Ranking Cone inspection Time (min)

Bug name

Failed/Passed Test cases

Statements cand. / %

Located stm. rank

Cone dir. / depth

Added stm. cand.

Time

Bug 1 4 / 24 14 / 2.9% 3 - - 2 4 hours Bug 2 2 / 26 7 / 1.4% 1 - - 2 2 hours Bug 3 2 / 26 20 / 4% 3 - - 2 4 hours Bug 4 1 / 27 6 / 1.2% (1) fw / 1 21 2+(5) 4 hours Bug 5 2 / 26 11 / 2.3% 1 - - 2 2 hours Bug 6 1 / 27 8 / 1.7% (1) bw / 1 13 2+(10) 5 hours Bug 7 1 / 27 21 / 4.3% (1) fw / 1 10 2+(1) 1 hours

Page 23: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

23

DIAMOND results

Publications 2 papers at IEEE D&T, 2 papers at JETTA, ...

PhD defenses 2012, S.Kostin, A.Tšertov, A.Karputkin, T.Viilukas 2013, I.Aleksejev, A.Tšepurov, U.Reinsalu

Follow-up projects FP7 STREP BASTION 3 EU COST Actions 1 Estonian ICT programme

Page 24: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

24

ICT COST Actions

Rich-model toolkit: an infrastructure for reliable computer systems 2009 oct. – 2013 oct.

Median: manufacturable and dependable multicore architectures at nanoscale 2011 dec. – 2015 nov.

Trustworthy Manufacturing and Utilization of Secure Devices (TRUDEVICE) 2012- 2016

Page 25: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

25

ICTP FUSETEST

Functional Self‐Test, Self‐Diagnosis and Failure Analysis for Integrated Electronics Systems (FUSETEST)

Partner: Testonica 2013 apr. – 2015 aug.

Page 26: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

CEBE IAB meeting 2013

Significance to CEBE

Verification and correction of bugs in the CEBE processor family

Application of design error correction engines in fine-tuning medical algorithms

26

Page 27: Tallinn University of Technology Department of Computer Engineering ati.ttu.ee Jaan Raik DIAMOND: Targeting Verification and Reliability Issues in Systems

Thank you!

27

More info: www.fp7-diamond.eu