non-functional testing standards workshop eurostar 2001 stockholm – sweden graham thomas wall...

Non-Functional Testing Standards Workshop

EuroSTAR 2001

Stockholm – Sweden

Graham Thomas

Wall Street Systems

2

Agenda

Introduction History of the BCS SIGIST SWP Work of the Group Workshop

Procedure TestingPerformance TestingSecurity Testing

Summary

3

Introduction

Who are we? What do we do? Why are we here today? What can we do for you? What can you do to help the group?

4

BCS SIGIST SWP history

Group established for 10+ years Generated existing British Standards for

Software TestingBS7925-1 Vocabulary of terms in

software testingBS7925-2 Software component testing

Non-Functional Testing Techniques

5

Non-Functional testing techniques Memory Management Reliability Usability Maintainability Configuration Portability Recovery Disaster Recovery

Performance Stress Security Procedure Interoperability Compatibility Installability Conversion

6

Work of the group

About a year ago . . . Single threaded 8 meetings per year Low response rate Possibility of another 8 years

A change of plan Multi threaded Team based approach 12 meetings per year Higher response rate

7

Work of group

To produce standards that are good enough

To ensure that they are workable

To produce them to a standard format

Structure of a technique

Normative Analysis Design Measurement Guidelines Examples

8

www.testingstandards.co.uk

9

Procedure Testing

10

Procedure Testing

1. Input 2. Output

3. Loop

4. Continuous

5. Workflow

11

Performance Testing

12

Performance Testing

Computer System

Application

Security Layer

Inputs Outputs

Test ToolsTest EnvironmentPerformance Specialists

Expected Load

Required Level of Performance

Test Cases

IndustryStandardBenchmarks

MeasuredPerformance

13

Security Testing

14

Summary

Introduced the BCS SIGIST SWP Explained the work of the group

Three technique workshops

Help us to help you Bookmark this site

www.testingstandards.co.uk