non functional within oat test managers summit - jan ‘08 stevan zivanovic [email protected]
TRANSCRIPT
OAT• Operational Testing
– Testing conducted to evaluate a component or system in its operational environment. [IEEE 610](ISTQB Testing Glossary)
• Testing elements can include– Service/Operational processes– Service/Operational error management– Maintainability– Can include other NFT types
ITIL• The key purpose of service validation
and testing is to provide objective evidence that the new/changed service supports the business requirements, including the agreed SLAs.
Source: itSMF An Introductory Overview of ITIL V3
• The service is tested explicitly against the utilities and warranties set out in the service design package, including business functionality, availability, continuity, security, usability and regression testing.
NFT Types
Source: www.testingstandards.co.uk
• Non Functional TestingTesting of those requirements that do not relate to functionality
Performance / Stress
Reliability Security
Memory Management
Interoperability Usability
Portability Procedure Compatibility
Maintainability Recovery Disaster Recovery
Installability Configuration Conversion
Challenges• Both need realistic environments• Both require a greater element of
technical knowledge• Need to be run early in the
development cycle• The client is not always aware of
these requirements
For Discussion• Does it matter where the NFT
types are executed?• Is it relevant to run all these types
of testing?• Who should run these types of
tests?• Who pays for the testing - the
project or the Service team?• Can this be off-shored/outsourced?