from requirements to test automation in minutes manual ... · project manager test manager ...
TRANSCRIPT
© Copyright 2014 Vivit Worldwide © Copyright 2014 Vivit Worldwide
From Requirements to Test Automation in Minutes –
Manual Testing is Now a Thing of the Past! November 20, 2014
© Copyright 2014 Vivit Worldwide
Brought to you by
© Copyright 2014 Vivit Worldwide
Housekeeping
• This “LIVE” session is being recorded
Recordings are available to all Vivit members
• Session Q&A:
Please type questions in the Questions Pane
© Copyright 2014 Vivit Worldwide
Webinar Control Panel
Questions
Toggle View Window between
Full screen/window mode.
© Copyright 2014 Vivit Worldwide
Hosted by
Bernard Szymczak
Vivit Ohio Chapter Leader
Vivit TQA SIG Leader
© Copyright 2014 Vivit Worldwide
Today’s Speaker
Huw Price
Managing Director
Grid-Tools
The Road to greater Automation And better Testing
Automation:
• Is often only basic happy path test
• Requires extensive manual effort to keep up with changes to requirements
• Doesn’t have the correct test data to be effective
Automation needs to:
• Be linked to better test case design i.e. the minimum set of test cases to cover the maximum functionality
• Be updated within a few minutes of a change to a requirement
• Be linked to matching sets of test data
Tools:
• Agile Designer Perfect sets of Test Case
• Agile Designer-TMX UFT, Rational Functional Tester, Microsoft Test UI, TestPartner, Auto IT etc
• Javelin Test Automation and Workflow
• Datamaker Perfect sets of Test Data
The Integrated Development Chain
Agile Designer
BA
User
Project Manager <-> Test Manager <-> Programmer <-> Testers
Clarity of Vision
Static Testing
Requirement <-> Traceability <-> Use Cases <-> Traceability <-> Test Case <-> Traceability <-> Defect
HP Service Virtualization
DataMaker
HP QC HP UFT Selenium Javelin
Agile Boards
• Test Cases • Virtual Data • Automation
• Find • Allocate • Synthesize • Data On Demand
• Requirements • Test Cases • Test Data • Defects • Automation
• Story Boards • Work Allocation • Work Tracking • Story Points
Use Cases Requirements Complexity Test Cases Test Data Virtual Data Automation Expected Results
Backlog
User Requirement
Change Request
Continuous Development
Continuous Development
• Continuous Integration
• Iterative Development
• Dev Ops
• Is mostly Ops
• It starts when development and testing are complete
• It should start when the user has an idea!
• It needs a much higher degree of automation
What is Testing Coverage?
The Business Thinks it’s:
• Code Covered
• Number of Test Covered – Tests Run
• Percentage of use cases
• All Paired Combinations
It is actually:
• Designing Sufficient Tests To VERIFY That The Design And Code Correctly Implement The Requirements
• Did you get the right answer for the right reason - Two or more defects may sometimes cancel each other out - Observability
Building Test Cases from Requirements (Manual or Automation)
Baseline Agile Designer
Test Cases Created 14 17
Time Taken 5 hours 2 hours
Test Coverage - % 16% 100%
• Agile Designer was also able to shrink 326 possible test cases down to just 17, retaining 100% coverage
• Better test case design requires a radical shift in the testing industry
Requirements -> Use Cases -> Manual Test Cases -> Test Data
Agile Designer-TMX – Build Automation
A Simple Form Easy to test?
Agile Designer-TMX – Build Automation
Agile Designer-TMX – Demo UTF (QTP)
Agile Designer Automation – Step by Step
1. Import your Existing Test Cases or Create a Process Flow from your Requirement
2. Identify Basic UI, File, Database or Service Actions on the pallet – these are the automation building blocks
3. Attach these to the Process Flow
4. Attach any Test Data Requirements to the decision logic
5. Create the perfect set of test cases – maximum coverage
6. Export to TMX or Javelin
7. Execute the automation scripts
8. If a change to the requirement occurs adjust the Process Flow and repeat 5, 6 and 7
• Create clear, unambiguous, visual requirements to reduce defect creation by as much as 95%
• Quickly and simply introduce agile processes into your existing Waterfall Lifecycles
• Accurately estimate the cost of new software development and changes to existing systems
• Provide a systematic way of enforcing fixed-priced SLAs with outsource partners
• De-duplicate existing test cases to reduce the cost and length of test cycles by more than 30%
• Import existing business process workflows and automatically build the perfect set of test cases
• Generate Automation scripts for all major Automation Engines
• Link to Agile Data™ to find and make the correct test data at any point within your SDLC
• Drive Continuous Integration and Development frameworks
What can Agile Designer™ do for me?
© Copyright 2014 Vivit Worldwide
Polling
Percentage of automated tests:
1. 0%
2. less than 5%
3. less than 10%
4. less than 20%
5. greater than 20%
© Copyright 2014 Vivit Worldwide
Polling
Do you have a continuous integration/development
framework in place:
1. Yes
2. No
3. Planning
© Copyright 2014 Vivit Worldwide
Polling
Do you have a formal requirements definition template:
1. Yes
2. No
© Copyright 2014 Vivit Worldwide
Don’t Miss – Register Today
• HP Discover 2014 Barcelona – December 2 – 4, 2014, The Fira Barcelona, Gran Via
– Register at:
http://h30614.www3.hp.com/Discover/home?jumpid=va_r11754_us/en/large/tsg/
pl_ot_aw_homepage_vanity%20url/discover_mkg/20130808
© Copyright 2014 Vivit Worldwide
Q & A
© Copyright 2014 Vivit Worldwide
Thank you
• Complete the short survey and opt-in for more
information from Grid-Tools.
www.grid-tools.com
www.vivit-worldwide.org