Download - Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow
![Page 1: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/1.jpg)
Multi-Paradigm Models as Source for Automatic Test Construction
Victor Kuliamin
ISP RAS, Moscow
![Page 2: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/2.jpg)
Why Multiple Models?
Requirements
Functionality ReliabilityEfficiency Usability
0,000
0,200
0,400
0,600
0,800
1,000
1,200
1,400
1,600
1,800
2,000
1 2 3 5 10 15 20
f1()
f2()
accept()
read()
modifyAll()
Testing
?
![Page 3: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/3.jpg)
Modeling Techniques
OperationalCan be executed by virtual machine
ContractPre- and postconditions, data integrity constraints
History-basedConstraints on possible traces
AlgebraicEquivalence between different execution histories
(C)(E)FSM, LTS, PN, CSP, ASMSDL, LOTOS, Lustre, VDM, Murphi, Simulink
Z, B, ADL, JML, Eiffel, VDM, RSLLarch-C++
TL, MSC
Larch, ML, OBJ
![Page 4: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/4.jpg)
Tasks of Testing
Software under Test
Evaluate Correctness
Organize Bundle of
Test Inputs
Construct
Single Test Input
Evaluate Testing Quality
Test Results
Transform Test Inputs and Responses
Gather Responses
![Page 5: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/5.jpg)
Modeling Techniques Comparison
Operational Contract History-based Algebraic
Behavior Evaluation Closeness to Requirements
Low-level Coverage
High-level Coverage
Test Sequence Construction
Single Input Construction
Scalability
Concurrency
![Page 6: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/6.jpg)
Comparison Results
There is no the best technique No one technique is good for everything May be a mix of different approaches can
fit more needs?
![Page 7: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/7.jpg)
UniTesK Technology
Model-based testing technology
Developed in 2000 – 2002 in
ISP RAS
![Page 8: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/8.jpg)
UniTesK Solutions
Contract specifications of behavior
FSM and LTS testing models
![Page 9: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/9.jpg)
Contract Specifications
Preconditions and postconditionsof interface operations andasynchronous reactions
Data integrity constraints
Close to requirements Suitable for oracle generation Provide low-level coverage
criteria
Functional Requirements
Contract Specifications
![Page 10: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/10.jpg)
FSM and LTS Testing Models
Define states and admissible inputactions
More abstract than originalspecifications
Guarantee some low-level coverage
Suitable for test sequence construction
Provide high-level coverage criteria
Contract Specifications
!Coverage Requirements
?
!
?!
!
?
?
?
![Page 11: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/11.jpg)
Relation between Models
states
parameters operation domain
1
2
3coverage goals
![Page 12: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/12.jpg)
Whole Picture I
Software under Test
Model of Behavior Testing Model
Coverage Model
Test OracleTest Sequence Construction
![Page 13: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/13.jpg)
Whole Picture II
Software under Test Model of Behavior Testing Model
Coverage Model
Operation
Data
Event
Operation
Operation
pre post
pre post
Eventpre post
invariantsData model
Operation
StateCalculation
Scenario method
Scenario method
![Page 14: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/14.jpg)
Tool Demo
![Page 15: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/15.jpg)
Set of Integers – Scenario I
0
1 2
312
7
5
States of behavior model
3
5
States of FSM model
![Page 16: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/16.jpg)
Mapping Abstract Call to Specific
1
2
3
current state
parameters
states
![Page 17: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/17.jpg)
Set of Integers – Scenario II
0
1 2
312
7
5
States of FSM model = States of behavior model
![Page 18: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/18.jpg)
Failure
{ -2147483648, 2147483647 }
Add ( -715827883 ) / false
![Page 19: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/19.jpg)
References
1. V. Kuliamin, A. Petrenko, N. Pakoulin, I. Bourdonov, and A. Kossatchev. Integration of Functional and Timed Testing of Real-time and Concurrent Systems. Proc. of PSI 2003. LNCS, Springer-Verlag, 2003.
2. V. Kuliamin, A. Petrenko, I. Bourdonov, and A. Kossatchev. UniTesK Test Suite Architecture. Proc. of FME 2002. LNCS 2391, pp. 77-88, Springer-Verlag, 2002.
3. A. K. Petrenko, I. B. Bourdonov, A. S. Kossatchev, V. V. Kuliamin. Experiences in using testing tools and technology in real-life applications. Proceedings of SETT’01, India, Pune, 2001
4. I. B. Bourdonov, A. S. Kossatchev, V. V. Kuliamin. Using Finite State Machines in Program Testing. "Programmirovanije", 2000, No. 2 (in Russian). Programming and Computer Software, Vol. 26, No. 2, 2000, pp. 61-73 (English version)
5. I. Bourdonov, A. Kossatchev, A. Petrenko, and D. Galter. KVEST: Automated Generation of Test Suites from Formal Specifications. Proceedings of World Congress of Formal Methods, Toulouse, France, LNCS, No. 1708, 1999, pp. 608-621
6. http://www.ispras.ru/groups/rv/rv.html
![Page 20: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/20.jpg)
Contact
Victor V. Kuliamin
E-mail: [email protected]
109004, B. Kommunisticheskaya, 25
Moscow, Russia
Web: http://www.ispras.ru/groups/rv/rv.html
Phone: 007-095-9125317
Fax: 007-095-9121524
![Page 21: Multi-Paradigm Models as Source for Automatic Test Construction Victor Kuliamin ISP RAS, Moscow](https://reader030.vdocuments.mx/reader030/viewer/2022032517/56649c925503460f9494d4cc/html5/thumbnails/21.jpg)
Thank you!