test automation

32
ni.com Automating Real-Time Testing for Embedded Software Development Javier Gutierrez Business Development Manager

Upload: javier-gutierrez

Post on 14-Jun-2015

424 views

Category:

Automotive


0 download

DESCRIPTION

This slidedeck goes through the technology involved automatiing tests throught the design cycle (MIL, SIL, HIL and test cells). It also touches on topics like lights-out-testing and links to requirements databases.

TRANSCRIPT

Page 1: Test automation

ni.com

Automating Real-Time Testing for

Embedded Software Development

Javier Gutierrez

Business Development Manager

Page 2: Test automation

2 ni.com

Agenda

•  What is embedded software development?

•  What is Real-Time testing?

•  Manual Real-Time testing

•  Automated Real-Time testing

•  Scripting Real-Time tests

Page 3: Test automation

3 ni.com

Embedded Software Development

Embedded software development is the process used to create the software for a computer system (embedded system) designed to perform one or a few dedicated functions. For example, an engine control unit (ECU)

Page 4: Test automation

4 ni.com

Control System

+ -

Plant Controller error setpoint

Page 5: Test automation

5 ni.com

Embedded Software Development Process

Requirements

Gathering

Model Simulation

Rapid Prototyping

Code Generation and ECU Flashing

Hardware in the Loop Testing

(HIL)

Physical Testing

• Test Cells

Field Test

• Calibration

+ -

Controller Plant

+ -

Plant Controller

Tests

Page 6: Test automation

6 ni.com

Real-Time Testing (RTT)

Test that provides deterministic stimulus for reliability and accurate simulation of an environment

•  RTT Types:

•  Model in the loop (MIL)

•  Rapid Control Prototyping (RCP)

•  Hardware in the Loop (HIL)

•  Functional Testing / Test Cells

Page 7: Test automation

7 ni.com

Test Continuity

Simulated Real Stimulus, Data Logging, User Interface, Analysis

Page 8: Test automation

8 ni.com

Embedded Software Development Process

Requirements

Gathering

Model Simulation

Rapid Prototyping

Code Generation and ECU Flashing

Hardware in the Loop Testing

(HIL)

Physical Testing

• Test Cells

Field Test

• Calibration

+ -

Controller Plant

+ -

Plant Controller

MIL Testing

Page 9: Test automation

9 ni.com

Model In the Loop (MIL) Manual Testing

Requirements

Page 10: Test automation

10 ni.com

Requirements

Environmental Conditions

•  REQ_CoastalSummer_Conditions

Modify the engine model parameters to reflect coastal summer conditions:

Ambient Temperature = 90 deg

Ambient Pressure = 14.5 psi

•  REQ_MountainWinter_Conditions

Modify the engine model parameters to reflect mountain winter conditions:

Ambient Temperature = 20 deg

Ambient Pressure = 10.5 psi.

Stimulus and Analysis •  REQ_FTP1000_SpeedProfile

Exercise the engine, controller and application model closed loop with the FTP1000 speed profile.

•  REQ_NumExceptions_215

Analyze the load torque response vs engine speed. Then compare test results to Mask A. Number of exceptions (points outside the mask) should be less than 215.

The test system will be used to validate an engine controller model with different environmental parameter values.

Requirements

Page 11: Test automation

11 ni.com

Model In the Loop (MIL) Manual Testing

Requirements Models

Page 12: Test automation

12 ni.com

Engine Model Requirement

s Models

Page 13: Test automation

13 ni.com

Model In the Loop (MIL) Manual Testing

Requirements Models Stimulus Profile

Page 14: Test automation

14 ni.com

Engine FTP1000 Speed Profile

Time (s)

Engin

e Spe

ed (R

PM)

Requirements

Models Stimulus Profile

Page 15: Test automation

15 ni.com

Model In the Loop (MIL) Manual Testing

Requirements Models Stimulus Profile Analysis

Page 16: Test automation

16 ni.com

Speed/Torque Mask A Analysis Requirements Models Stimulus Profile Analysis

Page 17: Test automation

17 ni.com

Model In the Loop (MIL) Manual Testing

Requirements Models Stimulus Profile Analysis

Page 18: Test automation

18 ni.com

Application Software

NI Requirements Gateway •  Requirements traceability •  Impact analysis •  Coverage reporting

NI DIAdem •  Data management •  Data visualization •  Data Analysis and reporting

Page 19: Test automation

19 ni.com

Application Software

NI TestStand •  Test automation •  Production test optimization •  Batch test data collection and reporting

NI VeriStand •  Real-Time control, stimulus, and data logging •  Simulation automation and visualization •  Control algorithm prototyping

Page 20: Test automation

20 ni.com

Manual Testing Demo

Page 21: Test automation

21 ni.com

Model In the Loop (MIL) Automated Testing

Requirements Models Stimulus Profile Analysis

Stimulus Profile Analysis

Stimulus Profile Analysis

Page 22: Test automation

22 ni.com

Automation

Requirements

Models Stimulus Profiles Analysis

Model In the Loop (MIL) Automated Testing

Page 23: Test automation

23 ni.com

Automation Requirement

s Models Stimulus Profiles Analysis

Model In the Loop (MIL) Automated Testing

Workspace

Models

Stimulus Profile

Export Channels

Import Channels

Run Script

Page 24: Test automation

24 ni.com

Automation Sequence

Requirements

Model In the Loop (MIL) Automated Testing

Open VeriStand (VS)

Open VeriStand Config File

Set Model Parameters

Run Stimulus Profile

Open DIAdem

Export Log

Run Analysis Script

Close DIAdem

Page 25: Test automation

25 ni.com

Automated Demo

Page 26: Test automation

26 ni.com

Model In the Loop (MIL) Scripting Real-Time Tests

•  Abstract the complexity of the test sequence creation •  Define the test procedure

•  Provide a single tool that abstract other tools

•  Talk the same language as the user

Page 27: Test automation

27 ni.com

Model In the Loop (MIL) Scripting Real-Time Tests

Automated Test Sequence Scripting Test •  Use the NIGEL engine, controller

and application model DLLs as the models to validate

•  Use the CalibFile_CoastalSummer.csv as model parameters file

•  Use the engine 1000.et1 as the stimulus profile

•  Use the NIGEL_MaskA_Analysis.VBS as the analysis script and reporting

Page 28: Test automation

28 ni.com

Model In the Loop (MIL) Scripting Real-Time Tests

Scripting

Automation

Requirements Models Stimulus

Profiles Analysis

Page 29: Test automation

29 ni.com

MIL Scripting Demo

Page 30: Test automation

30 ni.com

Embedded Software Development Process

Requirements

Gathering

Model Simulation

Rapid Prototyping

Code Generation and ECU Flashing

Hardware in the Loop Testing

(HIL)

Physical Testing

• Test Cells

Field Test

• Calibration

+ -

Controller Plant

+ -

Plant Controller

MIL Testing

HIL Testing

Page 31: Test automation

31 ni.com

HIL Scripting Demo

Page 32: Test automation

32 ni.com

Questions?

[email protected]