from requirements to test automation in minutes manual ... · project manager test manager ...

25
© Copyright 2014 Vivit Worldwide © Copyright 2014 Vivit Worldwide From Requirements to Test Automation in Minutes Manual Testing is Now a Thing of the Past! November 20, 2014

Upload: others

Post on 03-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide © Copyright 2014 Vivit Worldwide

From Requirements to Test Automation in Minutes –

Manual Testing is Now a Thing of the Past! November 20, 2014

Page 2: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Brought to you by

Page 3: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Housekeeping

• This “LIVE” session is being recorded

Recordings are available to all Vivit members

• Session Q&A:

Please type questions in the Questions Pane

Page 4: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Webinar Control Panel

Questions

Toggle View Window between

Full screen/window mode.

Page 5: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Hosted by

Bernard Szymczak

Vivit Ohio Chapter Leader

Vivit TQA SIG Leader

Page 6: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Today’s Speaker

Huw Price

Managing Director

Grid-Tools

Page 7: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

The Road to greater Automation And better Testing

Automation:

• Is often only basic happy path test

• Requires extensive manual effort to keep up with changes to requirements

• Doesn’t have the correct test data to be effective

Automation needs to:

• Be linked to better test case design i.e. the minimum set of test cases to cover the maximum functionality

• Be updated within a few minutes of a change to a requirement

• Be linked to matching sets of test data

Tools:

• Agile Designer Perfect sets of Test Case

• Agile Designer-TMX UFT, Rational Functional Tester, Microsoft Test UI, TestPartner, Auto IT etc

• Javelin Test Automation and Workflow

• Datamaker Perfect sets of Test Data

Page 8: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

The Integrated Development Chain

Agile Designer

BA

User

Project Manager <-> Test Manager <-> Programmer <-> Testers

Clarity of Vision

Static Testing

Requirement <-> Traceability <-> Use Cases <-> Traceability <-> Test Case <-> Traceability <-> Defect

HP Service Virtualization

DataMaker

HP QC HP UFT Selenium Javelin

Agile Boards

• Test Cases • Virtual Data • Automation

• Find • Allocate • Synthesize • Data On Demand

• Requirements • Test Cases • Test Data • Defects • Automation

• Story Boards • Work Allocation • Work Tracking • Story Points

Use Cases Requirements Complexity Test Cases Test Data Virtual Data Automation Expected Results

Backlog

User Requirement

Change Request

Continuous Development

Page 9: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

Continuous Development

• Continuous Integration

• Iterative Development

• Dev Ops

• Is mostly Ops

• It starts when development and testing are complete

• It should start when the user has an idea!

• It needs a much higher degree of automation

Page 10: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

What is Testing Coverage?

The Business Thinks it’s:

• Code Covered

• Number of Test Covered – Tests Run

• Percentage of use cases

• All Paired Combinations

It is actually:

• Designing Sufficient Tests To VERIFY That The Design And Code Correctly Implement The Requirements

• Did you get the right answer for the right reason - Two or more defects may sometimes cancel each other out - Observability

Page 11: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

Building Test Cases from Requirements (Manual or Automation)

Baseline Agile Designer

Test Cases Created 14 17

Time Taken 5 hours 2 hours

Test Coverage - % 16% 100%

• Agile Designer was also able to shrink 326 possible test cases down to just 17, retaining 100% coverage

• Better test case design requires a radical shift in the testing industry

Page 12: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement
Page 13: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

Requirements -> Use Cases -> Manual Test Cases -> Test Data

Page 14: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

Agile Designer-TMX – Build Automation

Page 15: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

A Simple Form Easy to test?

Page 16: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

Agile Designer-TMX – Build Automation

Page 17: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

Agile Designer-TMX – Demo UTF (QTP)

Page 18: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

Agile Designer Automation – Step by Step

1. Import your Existing Test Cases or Create a Process Flow from your Requirement

2. Identify Basic UI, File, Database or Service Actions on the pallet – these are the automation building blocks

3. Attach these to the Process Flow

4. Attach any Test Data Requirements to the decision logic

5. Create the perfect set of test cases – maximum coverage

6. Export to TMX or Javelin

7. Execute the automation scripts

8. If a change to the requirement occurs adjust the Process Flow and repeat 5, 6 and 7

Page 19: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

• Create clear, unambiguous, visual requirements to reduce defect creation by as much as 95%

• Quickly and simply introduce agile processes into your existing Waterfall Lifecycles

• Accurately estimate the cost of new software development and changes to existing systems

• Provide a systematic way of enforcing fixed-priced SLAs with outsource partners

• De-duplicate existing test cases to reduce the cost and length of test cycles by more than 30%

• Import existing business process workflows and automatically build the perfect set of test cases

• Generate Automation scripts for all major Automation Engines

• Link to Agile Data™ to find and make the correct test data at any point within your SDLC

• Drive Continuous Integration and Development frameworks

What can Agile Designer™ do for me?

Page 20: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Polling

Percentage of automated tests:

1. 0%

2. less than 5%

3. less than 10%

4. less than 20%

5. greater than 20%

Page 21: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Polling

Do you have a continuous integration/development

framework in place:

1. Yes

2. No

3. Planning

Page 22: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Polling

Do you have a formal requirements definition template:

1. Yes

2. No

Page 23: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Don’t Miss – Register Today

• HP Discover 2014 Barcelona – December 2 – 4, 2014, The Fira Barcelona, Gran Via

– Register at:

http://h30614.www3.hp.com/Discover/home?jumpid=va_r11754_us/en/large/tsg/

pl_ot_aw_homepage_vanity%20url/discover_mkg/20130808

Page 24: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Q & A

Page 25: From Requirements to Test Automation in Minutes Manual ... · Project Manager  Test Manager  Programmer  Testers Clarity of Vision Static Testing Requirement

© Copyright 2014 Vivit Worldwide

Thank you

• Complete the short survey and opt-in for more

information from Grid-Tools.

www.grid-tools.com

www.vivit-worldwide.org