model-based black box testing in automotive and its standardization layers (extract)

Model-Based Black Box Testingin Automotive

and its Standardization Layers(extract)

THE SOLUTION TO BOOST

YOUR TEST EFFICIENCY

MaTeLo

AUTOMOTIVE USE CASE

“Test Object” Presentation

“Test Framework” Presentation

Inputs Outputs

Real -Time NovaSim Environment

Simulink Plant Model

Automation API Control API

LabVIEW GUIEXAM

MODEL BASED TEST PROCESS

TestEnvironment

MODEL-DRIVEN ENGINEERING

FunctionalRequirements

UsageModel

DesignModel

Test CasesCode

Test ScriptsEXE

DESIGN TEST

GenerateGenerate

DeriveCompile

Implement Scenarize

MaTeLoModel Based Testing

MODEL BASED TEST PROCESS

BY PICTURES

MaTeLo MODEL = TEST SPECIFICATION

MaTeLo TEST CASE = TEST CASE SPEC

Input Expected Result

State

Requirement

Test Function Verdict

EXAM TEST SEQUENCE = TEST CASE IMPLEMENTATION (Abstract)

BEGINNING

END

INTERFACE

EXAM GENERATED CODE = TEST IMPLEMENTATION SCRIPT (Concret)

CLASS

Python Code

ALL4TEC MaTeLo and

the “TEST MESS”

THEORETICAL MBT WORKFLOW

AutomationTest Framework

Test Scheduler

Simulator

SystemUnderTest

Test Execution

Log

UsageModel

Test Cases

FunctionalRequirements

AtomicTest

Action

Test Cases

Verdicts

Confidence& Coverage

Reports

Test Scripts

AutomationTest Framework

A 1ST INDUSTRIAL TOOLS INTEGRATION

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

EXAM

UML

Python

dSpace

MicroNova

Carts

Vision CAN

IOs

Doors

MaTeLo

AutomationTest Framework

A 2nd INDUSTRIAL TOOLS INTEGRATION

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

dSpace

MicroNova

Carts

Vision CAN

IOs

Doors

TestStand

Proprietary

Opal-RT

NI

Clemessy

Diagnostic Calibration

Radio

Reqtify

MS Excel

MaTeLo

EXAM

UML

Python

AutomationTest Framework

VARIOUS TOOLS INTEGRATION

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

TestStand

Proprietary

dSpace

Opal-RT MicroNova

NI

Clemessy Carts

Vision

Diagnostic Calibration

CAN

IOs

Radio

Doors Reqtify

MS Excel

EXAM

UML

Python

PROVEtech Proprietary

CANoe EXACT

TTCN-3

VB

C, C#CSV

Java

Simulink CANoe

Flexray

Temperature

XML

CSVHP QC

MaTeLo

AutomationTest Framework

VARIOUS TOOLS INTEGRATION

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

TestStand

Proprietary

dSpace

Opal-RT MicroNova

NI

Clemessy Carts

Vision

Diagnostic Calibration

CAN

IOs

Radio

Doors Reqtify

MS Excel

EXAM

UML

Python

PROVEtech Proprietary

CANoe EXACT

TTCN-3

VB

C, C#CSV

Java

Simulink CANoe

Flexray

Temperature

XML

CSVHP QC

MaTeLo

AutomationTest Framework

MBT AND ITS STANDARDS

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

TestStand

Proprietary

dSpace

Opal-RT MicroNova

NI

Clemessy Carts

Vision

Diagnostic Calibration

CAN

IOs

Radio

Doors Reqtify

MS Excel

EXAM

UML

Python

PROVEtech Proprietary

CANoe EXACT

TTCN-3

VB

C, C#CSV

Java

Simulink CANoe

Flexray

Temperature

XML

CSVHP QC

RIF

ATX

ATX ATX

ODS

OTX HIL API

ODX

FIBEX XCP

GDI

ATX

MaTeLo

ALL4TEC VIEW WITH STANDARDS

ABSTRACTION LAYERS

Usage Scenario Description

Test Flow ControlDevice Driver

Test Case Specification

System Under Test Hardware In the Loop Test Bench

PythonPrecompiled Application

UML Sequence Diagram

Markov-Chain Usage Model

<< derive >>

<< generate >>

<< control >>

MaTeLo

Third Party Equipment

ATX

HIL API

ODX, FIBEX, XCP…

ABSTRACTION MANAGEMENT & STANDARDIZATION

HIL Plateform

dSpaceNovaSim

CartsASAM HIL API

…Proprietary

Network

CAN_1CAN_2LIN_X

FlexRay_1

…FlexRay_2

Functions

Manual GearAuto GearHand Free

ACC

…StartStop

Test Tools

CANoeCANape

INCAMS Excel

…Diag Tool

Env. Model

GasolineDieselTurboHybrid

…Electric

Available Test Configurations

Test Case 1 Test Case 2 Test Case n

Strategic Test Cases

Possible Usage Scenarios

ATX

HIL APIHIL API ODX, FIBEX, XCP…

OTHER STANDARD CONSIDERATION (ATX)

„Related Work“

© ASAM e. V. ATX – Introduction, History, and Goals

23

CONNECTIONATX / (OTX, TTCN3, HIL API)

ATX – OTX cooperation model

© ASAM e. V. ATX – Introduction, History, and Goals

25

ASAM ATX Part 1 (TDX+TAF Folder, Result, Suites - TAF Core)

OTX CoreISO WD/13209-2

OTX Standard Libraries(Lib-Com, Lib-Mmi, …)ISO WD/13209-3

ASAM ATX Part 2 Standard Libraries for ASAM HIL API