1

Lars Frantzen, Pieter Koopman, René de Vries,Tim Willemse, Jan Tretmans

Radboud UniversityNijmegen

© Jan Tretmans Radboud University Nijmegen

Testing at RadBoud

2 © Jan Tretmans Radboud University Nijmegen

Testing Research in NijmegenOverview

Introduction

Integrating Data with ioco

Specification Mining

Jan Tretmans

Lars Frantzen

Tim Willemse

3 © Jan Tretmans Radboud University Nijmegen

Model Based Testing

s LTS

i IOTS

i ioco s

pass fail

testtool

gen : LTS (TTS)

t || i

i || der(s) pass

i ioco s

soundexhaustiv

e

pass fail

spec

IUT

IUTconftospec

testtool

testgeneration

tool

testexecution

tool

IUT passes tests

IUT confto spec

soundexhaustiv

e

with Transition Systems

4 © Jan Tretmans Radboud University Nijmegen

A Tool for Transition Systems Testing: TorX

On-the-fly test generation and test execution

Implementation relation: ioco Mainly applicable to reactive systems / state based systems;

specification languages: LOTOS, Promela, FSP, Automata

TorX IUTobserveoutput

offerinput

nextinput

specification

checkoutput

passfailinconclusive

user:manualautomatic

5 © Jan Tretmans Radboud University Nijmegen

? money

? button1 ? button2

! coffee! tea

test case

fail

! money

! button2

? tea

fail

? coffee

pass

n: int

[ n 35 ] -> [ n 50 ] ->

with data model

and time and hybrid

c := 0

c < 10 c < 15

[ c 5 ] ->

c := 0

d Vt / dt =

3d Vc / dt =

2

Vc := 0

[Vc = 10 ] ->

Vt := 0

[Vt = 15 ] ->

?

coin1

?

coin3

?

coin2and actionrefinement

?

Testing Transition Systems: StatusExtensions

6 © Jan Tretmans Radboud University Nijmegen

Testing Propertiesof Input/Output Programs: Gst

Specification: property over x and y property(x,y) = x 0 |y y - x|

Implementation is function i :: X Y

Test set T X A tool like GST (or QuickCheck) generates thousands of tests

by systematic traversal of all values of type X

But still: what is a "good" set ?

IUT

i(x) = x

x: real

pre: x 0

y: real

post: |y y - x|

7 © Jan Tretmans Radboud University Nijmegen

Current and Future ResearchRadboud

Testing transition systems with data

integrating data with ioco

Specification mining reverse engineering of specification from observations

Approximate correctness some systems are more correct than others

test selection Gst

specification/model testing

Model Based Testing with UML use of industrial modelling techniques

Integration of real-time and data testing

8 © Jan Tretmans Radboud University Nijmegen

Current and Future ResearchRadboud

Tools for transition system testing

TorX

generic test environments

automatic generation of test adapter and test interface

TorXakis - experimenting with data/symbolic testing

Applications

web page testing Gst

smart card testing Gst / TorX(akis)

ASML DCB (Laser Dose Control) TorX

9 © Jan Tretmans Radboud University Nijmegen

Testing Projects

Atomyste - ATOm splitting in eMbedded sYStem TEsting

Uni. of Twente Radboud Uni. Nijmegen

Stress

- Systematic Testing of Real-time Embedded Software Systems

Uni. of Twente Radboud Uni. Nijmegen

Tangram - Model Based Testing and Diagnosis

ASML, ESI, TUD, TUE, UT, RU, S&T, TNO

Tarot - EU FP6 Marie Curie

Artist 2 - EU FP6 Network of Excellence