non-functional testing standards workshop eurostar 2001 stockholm – sweden graham thomas wall...

14
Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

Upload: noah-york

Post on 24-Dec-2015

225 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

Non-Functional Testing Standards Workshop

EuroSTAR 2001

Stockholm – Sweden

Graham Thomas

Wall Street Systems

Page 2: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

2

Agenda

Introduction History of the BCS SIGIST SWP Work of the Group Workshop

Procedure TestingPerformance TestingSecurity Testing

Summary

Page 3: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

3

Introduction

Who are we? What do we do? Why are we here today? What can we do for you? What can you do to help the group?

Page 4: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

4

BCS SIGIST SWP history

Group established for 10+ years Generated existing British Standards for

Software TestingBS7925-1 Vocabulary of terms in

software testingBS7925-2 Software component testing

Non-Functional Testing Techniques

Page 5: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

5

Non-Functional testing techniques Memory Management Reliability Usability Maintainability Configuration Portability Recovery Disaster Recovery

Performance Stress Security Procedure Interoperability Compatibility Installability Conversion

Page 6: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

6

Work of the group

About a year ago . . . Single threaded 8 meetings per year Low response rate Possibility of another 8 years

A change of plan Multi threaded Team based approach 12 meetings per year Higher response rate

Page 7: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

7

Work of group

To produce standards that are good enough

To ensure that they are workable

To produce them to a standard format

Structure of a technique

Normative Analysis Design Measurement Guidelines Examples

Page 8: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

8

www.testingstandards.co.uk

Page 9: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

9

Procedure Testing

Page 10: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

10

Procedure Testing

1. Input 2. Output

3. Loop

4. Continuous

5. Workflow

Page 11: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

11

Performance Testing

Page 12: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

12

Performance Testing

Computer System

Application

Security Layer

Inputs Outputs

Test ToolsTest EnvironmentPerformance Specialists

Expected Load

Required Level of Performance

Test Cases

IndustryStandardBenchmarks

MeasuredPerformance

Page 13: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

13

Security Testing

Page 14: Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

14

Summary

Introduced the BCS SIGIST SWP Explained the work of the group

Three technique workshops

Help us to help you Bookmark this site

www.testingstandards.co.uk