HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.

ww

w.huaw

ei.com

Huaw

ei Confidential

Security Level:

Wen

YongxinHuang Shifu

Testing Technology Research Dept, A

&S

wenyongxin@

huawei.com

A keyw

ord-driven service testing fram

ework based

on TT

CN

-3

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 2

Huaw

ei Confidential

Contents

�S

ervice testing

�T

TC

N-3 &

AW

solution

�T

ypical application

�B

enefits

�F

uture work

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 3

Huaw

ei Confidential

Service testing –

characteristics

�M

any protocols are

involved

�T

esters care little about

the protocol details

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 4

Huaw

ei Confidential

Service testing –

Why T

TC

N-3

�S

pecial language designed for

testing

�E

specially on protocol

conformance testing

�S

imulation of netw

ork elements

by the parallel components

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 5

Huaw

ei Confidential

Service testing –

Difficulties

�R

equire more program

ming skill

�H

igh cost of script-based test case maintenances

�W

ithout a test AP

I specification, It is easy to bring

too many A

PIs, w

hich is difficult to use .

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 6

Huaw

ei Confidential

Contents

�S

ervice testing �

TT

CN

-3 & A

W solution

�O

verview�

Fram

ework

�P

resentation layer�

Script generator

�E

xecution layer�

Application area

�T

ypical application�

Benefits

�F

uture work

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 7

Huaw

ei Confidential

TT

CN

-3 & A

Wsolution –

Overview

�A

ction word (A

W ) is a

methodology of keyw

ord-driven

testing from H

uawei

�A

3rd generation of automatic

testing

�S

eparates test design from

test execution

�G

raphical format of test case.

�E

asy to create and maintain

TE

Executable S

ystem

Test

execution

SU

TT

E

TD

E

AW

list

TA

E

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 8

Huaw

ei Confidential

TT

CN

-3 & A

Wsolution –

Fram

ework

Presentation

LayerG

T3000

G T

R

Script G

enerator

ExecutionLayer

Socket

TT

CN

TT

CN

- -3 3

Platform

Platform

Coding Infrastructure

AW

Implem

entation

SU

T

AW

test caseT

est reporting

Requirem

ent R

equirement

and test caseand test casem

anagement

managem

ent

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 9

Huaw

ei Confidential

TT

CN

-3 & A

Wsolution –

Presentation Layer

�S

upports both tabular formatand graphical form

at

Different to E

TS

I standard

Ease of com

plex value assignment

�S

imilar to real test environm

ent

User friendly

�E

xtensible

Can be extended by C

++

,Delphi

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 10

Huaw

ei Confidential

1. Testcase

& A

WT

est steps

paramters

of the

“number assign”

AW

AW

T

ree

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 11

Huaw

ei Confidential

2.User interface

Click

Click

Role

Role

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 12

Huaw

ei Confidential

TT

CN

-3 & A

Wsolution –

Script G

enerator

�C

onvert tabular test case into TT

CN

-3 script

�E

ach TT

CN

-3 AW

has only one parameter, containing a

ll the AW

parameters in a string, it also supports optional p

arameters:

paramA

{valueA} param

B{valueB

} paramC

{valueC} param

D{valueD

}…

�G

enerate PT

Cs

to simulate different netw

ork elements

surrounds

the SU

T

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 13

Huaw

ei Confidential

1. Convert T

abular AW

to TT

CN

-3 function

One param

eter contains all the tabular param

eter value

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 14

Huaw

ei Confidential

2. PT

Cs

simulate different netw

ork elements

two P

TC

s

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 15

Huaw

ei Confidential

3. Convert tabular test case to T

TC

N-3 test case

Preshell

CaseS

tep

PostS

hell

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 16

Huaw

ei Confidential

TT

CN

-3 & A

W solution –

Execution Layer

AW

AW

Implem

entation

PA

PA

SA

SA Telnet,F

TP

,DB

SIP

SIP

MS

RP

MS

RP

RT

PR

TP

… …

GT

RG

TR

�A

ction Word Im

plementation

implem

ents AW

function with

TT

CN

-3

�P

rotocol library

implem

ents protocol stacks like

SIP

stack, with T

TC

N-3

�C

omm

on library

implem

ents comm

on operations

on database, file, telnet, ftp, etc,

with T

TC

N-3 / C

++

(PA

) /TC

L

PT

Cs

PT

Cs

for handling for handling

different protocolsdifferent protocols

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 17

Huaw

ei Confidential

TT

CN

-3 & A

W solution –

Application A

rea

�A

dapt to service testing

�N

ot recomm

ended for protocol testing/ AP

I testing

�G

ood to test service that is :

driven by many protocols

stable, less than 10% changing w

ould be perfect

(so that the A

W test cases can be inherited )

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 18

Huaw

ei Confidential

Contents

�S

ervice Testing

�T

TC

N-3 &

AW

solution

�T

ypical application

�B

enefits

�F

uture work

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 19

Huaw

ei Confidential

Typical application

–T

est scenario

�A

User dialed a virtual num

ber

�T

he AS

called the office phone

and the home telephone at the

same tim

e

�T

he home telephone is picked

up

Softsw

itch

AS

MR

S

sip

sipsip sip

sip

�H

ere , we use T

TC

N-3 &

AW

to simulate

Softsw

itchand

MR

S to test the A

S

SUT

SUT

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 20

Huaw

ei Confidential

Typical application –

Test system

details

�T

TC

N-3 S

IP P

rotocol

Stack handles sip

message and S

IP

transaction, dialog,

etc.

�S

ervice AW

are

TT

CN

-3 functions

that simulate the

Softsw

itch(caller,

callee) and MR

S

actions

AS

Caller

Callee

MR

S

TT

CN

-3 SIP

Protocol S

tack

Service

AW

SIP

AP

IT

est T

est systemsystem

SUT

SUT

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 21

Huaw

ei Confidential

Typical application –

Dem

o Testcase

Caller

AS

Callee

MR

Sinvite

invite

200

invite

ack

200

200

ack

ack

bye

200

Call flow

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 22

Huaw

ei Confidential

Contents

�S

ervice Testing

�T

TC

N-3 &

AW

solution

�T

ypical application

�B

enefits

�F

uture work

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 23

Huaw

ei Confidential

Benefits

0

50

100

150

200

250

300

2005

2006

2007

Total users

Total users

Total test cases

Total test cases

0

5000

10000

15000

20000

25000

30000

35000

40000

45000

20052006

2007

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 24

Huaw

ei Confidential

Contents

�S

ervice Testing

�T

TC

N-3 &

AW

solution

�T

ypical application

�B

enefits

�F

uture work

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 25

Huaw

ei Confidential

Future w

ork

�A

W design w

ith layers

High level A

W can be im

plemented by low

er level

AW

s

�O

bject oriented AW

design

With object oriented design, it is sim

ilar to real

entity

�Integrate A

W im

plemented in C

++/ TC

L/ java

Share A

W pool largely

HU

AW

EI T

EC

HN

OL

OG

IES C

O., L

TD

.Page 26

Huaw

ei Confidential

Thank you!