automated model-based testing of a complex avionics algorithm for the nh-90 helicopter

8/3/2019 Automated Model-Based Testing of a Complex Avionics Algorithm for the NH-90 Helicopter

1/17

Nationaal Lucht- en Ruimtevaartlaboratorium National Aerospace Laboratory NLR

Automated Model-based Testing of aComplex Avionics Algorithm

for the NH-90 helicopter

Edwin van de Sluis [email protected]

Senior Scientist Avionics Software NLR Amsterdam


2/17

NH90 NATO Frigate Helicopter (NFH) variant

Primary roles: Anti-Submarine Warfare (ASW) Anti-Surface Unit Warfare (ASUW) Search and Rescue

Secondary roles: Casualty and/ or medical evacuation Personnel, material and troop transport

3 crew members; PILOT, TACCO, SENSO

A second cabin can be installed for a 4 th

Replaces Lynx helicopter of Royal Netherlands Navy


3/17

NH90 program - NLR involvement

1980 1990 2000 2010

Wind tunneltesting

Tactical SystemEquipment

Stork producedNH-90 tail

long life cycle (1980-2040)

Feasibilitystudy

Development andqualification

Testing Operation

Heli-ShipQualification

Sustainment

2030


4/17

NH90 Avionics with NLR involvement

Landing GearSupport

Intermediate Gear BoxSensor Qualification Support

Remote FrequencyIndicator (RFI)

Cockpit Fuel Panel (CFP)External Fuel Panel (EFP)

Matching Tracks by Associationand Correlation(MTAC)

Nose Wheel SteeringSystem Controller (NWSSC)


5/17

Location CFP, Cockpit Fuel PanelRFI , Remote Frequency Indicator


6/17

Several sensors: introduce operator workload

Radar

FLIR

ESM

Sonics

Data Link 11


7/17

Solution: sensor fusion w ith MTAC

MTAC: Matching ofTracks for Association and Correlation

MTAC is a software module that is part of the NFH Mission

Tactical Computer (MTC, developed by Agusta)

MTAC supports tactical situation awareness compiled fromreal-world object observations from tactical sensors and

other Participating Units

Primary objective: reduction of tactical operators work loadby (un-)linking tracks: (dis-)association or (de-)correlation

Note: Track = data structure containing observation of real-world object


8/17

NH90 MTAC

MTAC: Matching of Tracks for Association & Correlation

Track

information

Vessellibrary

MTAC

Tactical Database Tactical ObjectManagement

Data Link

radar

ESMFLIRsonics

Tactical informationsources LOCAL TRK TN

7122 REM TRK TN6542

ACCEPTREJECT

Alert


9/17

MTAC State Vector Matching

State vector Match Quality (MQ) is computed from distance between track positions distance between track position and bearing speed and course difference

Bearing

1vr

2vr

1vr

11, yx

22, yx

1p

2

p

origin

Uncertainty area (from bearing accuracy)Uncertainty area (from track quality)


10/17

MTAC Attribute Matching

Attribute Match Quality (MQ) wordt verkregen uit Basic Identity (friend, neutral, suspect, hostile, ) Type (frigate, aircraft carrier, ) Classification (subsurface only, probably sub, certainly sub, acoustic positive, ) IFF mode 2 response Fleet size (single, few, many) Propulsion (nuclear, not nuclear, ) Depth Radar cross-section Acoustic footprint Radar signature


11/17


12/17

Verification solution: MTAC model

Separate, dissimilar model of algorithm implemented inMatlab

Input: Excel CSV files (command-line i/f), or GUI based


13/17

Model-Based Test Approach

MTACAda Code

AdaTEST (IPL) test harness

Test Input Actual Test Results

Test

inputs(CSV files)

ExpectedTest

Results

TestReport

MTACMatLab

Model

Expected Test Results

?

=

CSV

2Ada


14/17

Match Quality Results

0

10000

20000

30000

40000

50000

60000

70000

80000

90000

100000

1 101 201 301 401 501 601 701 801 901

TC

MQ(

0-100)

Automation

UNIX scripts to automate test casecompiling and execution, including

test oracle consultancy

Result: (regression) test pass/ fail

But also support for detailed resultinspection

Example Test: Position matching (ca. 172 cases) Course matching (ca. 80 cases)

Speed matching (ca. 30 cases) Point Track Quality (all 49combinations)

Basic Identity matching (all 81combinations)

IFF mode 2 matching (>200combinations)

Identity Amplification matching (all269 combinations) Size matching (all 25 combinations) MQ range coverage (output

equivalence classes)

Total: ca. 9000 test cases


15/17

Concluding remarks

Successful model/ oracle-based test approach for algorithmverification

Supports softw are qualification: requirements and(statement) structural coverage

MTAC has undergone several successful qualifications

Support for validation still TBD

NH90 mission system not fully operational before 2013 (?),so not operational validation feedback until then


16/17

Questions ?


17/17

automated model-based testing of a complex avionics algorithm for the nh-90 helicopter

Documents