model driven workflow - conformiq driven workflow ... [email protected] tibor csöndes...

Slide title

minimum 48 pt

Slide subtitle

minimum 30 pt

Model driven workflow applied to an

IMS Application server

User Conference on Advanced Automated Testing

22-24 October 2013 – Paris, France

Antal Wu-Hen-Chang

[email protected]

Tibor Csöndes

[email protected]

mailto:[email protected]








Slide title

minimum 32 pt

(32 pt makes 2 rows

Text and bullet level 1

minimum 24 pt

Bullets level 2-5

minimum 20 pt

!"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~¡¢£¤¥¦§¨©ª«¬®¯°±²³´¶·¸¹º»¼½ÀÁÂÃÄÅÆÇÈËÌÍÎÏÐÑÒÓÔÕÖ×ØÙÚÛÜÝÞßàáâãäåæçèéêëìíîïðñòóôõö÷øùúûüýþÿĀāĂăąĆćĊċČĎďĐđĒĖėĘęĚěĞğĠġĢģĪīĮįİıĶķĹĺĻļĽľŁłŃńŅņŇňŌŐőŒœŔŕŖŗŘřŚśŞşŠšŢţŤťŪūŮůŰűŲųŴŵŶŷŸŹźŻżŽžƒȘșˆˇ˘˙˚˛˜˝ẀẁẃẄẅỲ

ỳ–—‘’‚“”„†‡•…‰‹›⁄€™−≤≥fifl

ĀĀĂĂĄĄĆĆĊĊČČĎĎĐĐĒĒĖĖĘĘĚĚĞĞĠĠĢĢĪĪĮĮİĶĶ

ĹĹĻĻĽĽŃŃŅŅŇŇŌŌŐŐŔŔŖŖŘŘŚŚŞŞŢŢŤŤŪŪŮŮŰŰŲŲŴŴŶŶŹŹŻŻȘș

ΆΈΉΊΌΎΏΐΑΒΓΕΖΗΘΙΚΛΜΝΞΟΠΡΣΤΥΦΧΨΪΫΆΈΉΊΰαβγδεζηθικλνξορςΣΤΥΦΧΨΩΪΫΌΎΏ

ЁЂЃЄЅІЇЈЉЊЋЌЎЏАБВГДЕЖЗИЙКЛМНОПРСТУФХ

ЦЧШЩЪЫЬЭЮЯАБВГДЕЖЗИЙКЛМНОПРСТУФХЦ

ЧШЩЪЫЬЭЮЯЁЂЃЄЅІЇЈЉЊЋЌЎЏѢѢѲѲѴѴҐҐәǽẀẁẂẃẄẅỲỳ№

Do not add objects or

text in the footer area UCAAT 2013 | 22-24 October 2013 | Paris, France |

Agenda

› Introduction – Model-driven Design (MDD) and

Model-based Testing (MBT) synergy

– IMS Application Server

› Model-driven Workflow – Workflow overview

– Service implementation example

› Experiences – Challenges and solutions

– Benefits

Slide title

minimum 32 pt

(32 pt makes 2 rows


minimum 24 pt

Bullets level 2-5

minimum 20 pt


ỳ–—‘’‚“”„†‡•…‰‹›⁄€™−≤≥fifl









introduction

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt

Characters for Embedded font: !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~¡¢£¤¥¦§¨©ª«¬®¯°±²³´¶·¸¹º»¼½ÀÁÂÃÄÅÆÇÈËÌÍÎÏÐÑÒÓÔÕÖ×ØÙÚÛÜÝÞßàáâãäåæçèéêëìíîïðñòóôõö÷øùúûüýþÿĀāĂăąĆćĊċČĎďĐđĒĖėĘęĚěĞğĠġĢģĪīĮįİıĶķĹĺĻļĽľŁłŃńŅņŇňŌŐőŒœŔŕŖŗŘřŚśŞşŠšŢţŤťŪūŮůŰűŲųŴŵŶŷŸŹźŻżŽžƒȘșˆˇ˘˙˚˛˜˝ẀẁẃẄẅỲỳ–—‘’‚“”„†‡•…‰‹›⁄€™ĀĀĂĂĄĄĆĆĊĊČČĎĎĐĐĒĒĖĖĘĘĚĚĞĞĠĠĢĢĪĪĮĮİĶĶĹĹĻĻĽĽŃŃŅŅŇŇŌŌŐŐŔŔŖŖŘŘŚŚŞŞŢŢŤŤŪŪŮŮŰŰŲŲŴŴŶŶŹŹŻŻȘș−≤≥fifl


ЁЂЃЄЅІЇЈЉЊЋЌЎЏАБВГДЕЖЗИЙКЛМНОПРСТУФХЦ

ЧШЩЪЫЬЭЮЯАБВГДЕЖЗИЙКЛМНОПРСТУФХЦЧШ

ЩЪЫЬЭЮЯЁЂЃЄЅІЇЈЉЊЋЌЎЏѢѢѲѲѴѴҐҐәǽẀẁẂẃẄẅỲỳ№


text in the footer area

UCAAT 2013 | 22-24 October 2013 | Paris, France |

MDD and MBT synergy

Executable

Build

Environment

Executable

Test Suite

TTCN-3

Compiler

C++

Source

TTCN-3

Source

Model

Compiler

Test

Generator

Model

Verifier

Test

Model

xtUML

Model

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Mission

Tool Chain

Modeling expertise

Methodology

Domain specific knowledge

Large scale development

competence

Established WOW

Polished tool chain

Proper methods

Wide scale deployment

WOW

Receiver org

MDW

R

e

s

u

l

t

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









IMS application server

MTAS

SIP SIP

ISC

B2B UA,

Session Control &

Service Interaction (MMT SCIM)

SIP

MRFP

Built in

MRFC

(H.248)

Mp

Subscriber

Data

HSS

sh

Charg

ing

Ro / R

f

Diameter

Charging

system

Ro / Rf

MMT

XDMS ut

API

TIS

PA

N

Serv

ice 1

TIS

PA

N

Serv

ice 1

TIS

PA

N

Serv

ice 1

TIS

PA

N

Serv

ice 2

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Workflow Introduction challenges

MTAS

Service 1

CBA CMCO

AS CC

HW

Service 2 Service N

MMTel Feature teams Enterprise Feature teams

No dependencies WP .. WP .. WP .. WP ..

Appl. Server Common

Component teams WP .. WP .. WP .. WP .. WP .. WP .. WP .. WP ..

WP .. WP .. WP .. WP .. WP .. WP .. WP .. WP ..



Majority of the

staff

Model Driven

Development

& Test

• Several teams

• Seamless gradual

introduction

• Agile ways of working

• Huge handwritten legacy code

• Teams have no modeling knowledge

Slide title

minimum 32 pt

(32 pt makes 2 rows


minimum 24 pt

Bullets level 2-5

minimum 20 pt


ỳ–—‘’‚“”„†‡•…‰‹›⁄€™−≤≥fifl









Model driven workflow

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Service specification (original)

WaitingForGeoResponse

A

B

F C

J

G

K

D

H L

E

(Call Ended) (Call Continue)

Long Distance

Announcement

M N

Call

Rejection

Announcement

O

• New service requirement

• System architect designs the service logic in a natural language document

• Specification is given to the work package teams

• Parallel development of implementation and automated tests

• In the end of the sprints they can test their systems against each other

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Service specification (modeled)

• New service requirement

• System architect designs the service logic in a formal language

• Specification is given to the work package teams

• Parallel development of implementation and automated tests

• Early in the process they can test their systems against each other

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









modeling

Agile way of working

3..4 weeks

CSCF

3 designers

3 testers

1 system

MDW

4 designers

1 tester

2 MC

Component architecture

Architecture plan for legacy

Test modeling

design

test

system

Design: model + basic test

Design: glue code + basic test

Test: test model + model level harness

Test:harness

sprint#1 sprint#2 sprint#3 sprint#N Test o

f fu

nctio

n p

ack N

Test of

fun

ction

pack N

• Starting point: high level black box model

• Test driven development

• Continuous integration: nightly builds

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Original TEST workflow

Test analysis Test case

headers

Design TCs

in TTCN-3

Describe TCs

In FTD

TTCN-3

Test Execution

Test

results

REQs WPS

Test

documents

Write

Test Report Test Report

Specification

Documentation &

Implementation

Execution &

Reports

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Model based Test workflow

High level

modeling

High Level

Model

Test Execution

Test

results

Generate

Test Report Test Report

Specification

Model extension

TTCN-3 Test

documents

Model

Adaptation layer

implementation

REQs WPS

Modeling &

Implementation

Execution &

Reports

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Model in the spec

DNM Service Logic Geo-Location Server

Service Logic

•Top down modeling

• Some of the signaling

is pushed down

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Model in the spec

DNM Service Logic Geo-Location Server

SIP Originating SIP Terminating

SIP SIP

Common Components

Service Logic

Media Player

SIP

• Common parts are

organized in a

separate reusable

libraries

• Upper layer is

evolved continuously

• No structural

changes in the state

machine

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









Function Testing with MBT

QML model

TTCN-3 scripter xtUML scripter

Bridge Point

Test Harness xtUML TCs

TTCN-3

Test Harness TTCN-3 TCs + +

ONE model!

Same TCs in

different

Languages!

› Test Model

– Test goal specific

– High level

› Test Harnesses

– Provides adaptation towards the SUT

› Scripters

– Used to generate the code that realize

the tests

– TTCN-3 scripter, OAL (xtUML) scripter

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









BridgePoint (Design model)

Tool chain Synergy

QML

modeler (test model)

xtUML

scripter

ttcn

scripter

xtUML

tests

ttcn

testcases

xtUML

tests

MC

C++

MC

JAVA

tsp JVM

Leg

ac

y

infra

stru

ctu

re

Model level test

binary binary binary

Function test

Test Message

sequences

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









› Integration

– Deciding the model boundary

– Adaptation to legacy frameworks’ APIs

› Version control and collaborative development

– Model merging problems

› Graphical conflicts

› Not resolvable conflicts: e.g. structural changes

– Solutions

› Tools for automated merge

› Work separation

Challenges and solutions

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









› Resistance at the receiver organization

– Remain enthusiastic

– Working examples are the best evidences

– Be patient, let them do it themselves

– If one turns, the rest will follow

– Expect slow start, they have to learn

› Consultancy

– Orthogonal knowledge areas

– Tailoring for the different needs

– Providing guidelines (e.g. Do not touch the generated code)

› Tools are expensive

– Work separation

Challenges and solutions

Slide title

44 pt


minimum 24 pt

Bullets level 2-5

minimum 20 pt









› Modeling

– Raising the abstraction level

– Thinking before coding

› Use-cases -> Test strategy

› Fixing it on the drawing board or fixing it on-site

– Early testing

– Enables automation

› Test driven development

– Builds confidence

– Facilitates discussion

benefits

model driven workflow - conformiq driven workflow ... [email protected] tibor csöndes...

Documents