New Technologies, New Approaches?

Test Managers ForumStevan Zivanovic July 2016

Introduction

This is an interactive session!

We want to hear your experiences of testing new technologies

However, here are some initial thoughts

IT Emerging Technology

What is new?

• For this conversation:

• Micros-services• Big data• Machine Learning

Challenges

• What are your views of the key challenges?

• My view:• Fear of change• Lack of information• Lack of knowledge• Perceived complexity

Process

Break it down!Look at your

knowledge base Work through all the things that

you need in a test strategy (see

next slide)

Socialise the outcomes

Re-assess

Try to answer each element

Simple frameworkActivity Unit Test and Integration System Test System Integration Testing Non-functional in the Large Business

Acceptance

Functional requirements

Performance Requirements

Security

Failure/fault tolerance

Regulatory

Exploratory testing

Test tools

Automated Deployments

Data

Environment

Micro-service Activity

Unit Test and Integration

System Test System Integration Testing

Non-functional in the Large

Business Acceptance

Functional requirements

N/A Needed Done Partially Needed

Performance Requirements

Profiling needed (us Junit Perf etc)

Partial response and payload monitoring

Partial response and payload monitoring

Needs to be expanded into full

end to end

N/A

Security Needed Needed Partial Needed external team to fully test

N/A

Failure/fault tolerance

Simulate error trapping

Needed Needed N/A

Exploratory testing N/A Needed but use stubs

Needed Needed Needed

Use of Stubs and Mocking of services

Needed Needed N/A N/A N/A

Automated Deployments

Done Needed Needed Needed Needed

Use of real data Partially used, but should be stubbed

N/A Done Done Done

Suggested environment

Dev Dev System Integration System Integration Staging

An example from a micro-services review

Copyright © 2016 Experimentus Ltd 9

An example Big Data review

To Discuss

• Do New Technologies require New Approaches?• Is it not all of the same thing?• What does change for testers?• What changes to test tool are needed?• Look at approaches for AI?

Example for Machine LearningActivity Unit Test and Integration System Test System Integration Testing Non-functional in the Large Business

Acceptance

Functional requirements

Performance Requirements

Security

Failure/fault tolerance

Regulatory

Exploratory testing

Test tools

Automated Deployments

Data

Environment