reducing false positives in automated testing
TRANSCRIPT
![Page 1: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/1.jpg)
Reducing False Positives
inAutomated
Testing
![Page 2: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/2.jpg)
FALSE POSITIVES ARE “FAILED”TESTS THAT SHOULD HAVE PASSED,
aka FALSE ALARMS.
![Page 3: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/3.jpg)
WHY DO THEY OCCUR?
![Page 4: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/4.jpg)
WHY DO THEY OCCUR?
• AUTOMATION APPROACH
![Page 5: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/5.jpg)
WHY DO THEY OCCUR?
• AUTOMATION APPROACH• IMPLEMENTED FRAMEWORK
![Page 6: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/6.jpg)
WHY DO THEY OCCUR?
• AUTOMATION APPROACH• IMPLEMENTED FRAMEWORK• THE WRITTEN TEST ITSELF
![Page 7: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/7.jpg)
THERE ARE SEVERAL POTENTIALCAUSES FOR FALSE POSITIVES IN
AUTOMATED TESTING:
![Page 8: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/8.jpg)
RELYING ON UI
Cause #1:
![Page 9: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/9.jpg)
Small changes in UI can causetest breakage
![Page 10: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/10.jpg)
CHANGE INUI ELEMENTPROPERTIES
Cause #2:
![Page 11: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/11.jpg)
Any change to:
ID
![Page 12: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/12.jpg)
Any change to:
IDCSS
![Page 13: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/13.jpg)
Any change to:
IDCSS
CLASS NAME
![Page 14: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/14.jpg)
Can result intest breakage
![Page 15: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/15.jpg)
SHAREDENVIRONMENTS
Cause #3:
![Page 16: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/16.jpg)
Functional & automated testing
require separate environments
![Page 17: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/17.jpg)
REFERENCEDATA CHANGE
Cause #4:
![Page 18: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/18.jpg)
Scripts may changeconfiguration data
required by a test
![Page 19: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/19.jpg)
SLOWPERFORMANCE
Cause #5:
![Page 20: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/20.jpg)
Slow performance =Slow test execution
& test failure
![Page 21: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/21.jpg)
MANUALINTERVENTION
Cause #6:
![Page 22: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/22.jpg)
Some data must be cleared manually
before/aftertest execution
![Page 23: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/23.jpg)
RELYING ONSEQUENCE OF
EXECUTION
Cause #7:
![Page 24: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/24.jpg)
Any failure intest sequenceimpacts the entire
test suite
![Page 25: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/25.jpg)
KEYS TOREDUCING
FALSE POSITIVES
![Page 26: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/26.jpg)
USE OPTIMAL CONFIGURATIONS
![Page 27: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/27.jpg)
USE OPTIMAL CONFIGURATIONS
CONTROLLED AUTOMATION ENVIRONMENT
![Page 28: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/28.jpg)
USE OPTIMAL CONFIGURATIONS
CONTROLLED AUTOMATION ENVIRONMENT
KEEP TESTS SHORT
![Page 29: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/29.jpg)
USE OPTIMAL CONFIGURATIONS
CONTROLLED AUTOMATION ENVIRONMENT
KEEP TESTS SHORT
KEEP TESTS INDEPENDENT
![Page 30: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/30.jpg)
USE OPTIMAL CONFIGURATIONS
CONTROLLED AUTOMATION ENVIRONMENT
KEEP TESTS SHORT
KEEP TESTS INDEPENDENT
USE RIGHT LOCATORSFOR OBJECT IDENTIFICATION
![Page 31: Reducing False Positives In Automated Testing](https://reader034.vdocuments.mx/reader034/viewer/2022042701/55c35d2cbb61eb6e6f8b4612/html5/thumbnails/31.jpg)
VIEW THE ENTIRE
QASOURCEWEBINAR
AND READ THE COMPLETE Q & A:Pre and Post Webinar Questions Answered: Reducing
False Positives in Automated Testing
QUESTIONS ABOUT FINANCIAL TESTING?VISIT US AT QASOURCE.COM