using crowdsourced testing to turbocharge your development team
TRANSCRIPT
![Page 1: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/1.jpg)
Using Crowdsourced Testing to Turbocharge your Development Team
![Page 2: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/2.jpg)
What does traditional QA look like?
▸ Write test cases
▹ Feature tests, regression tests, etc
▸ Execute tests
▹ Manual or Automated
▸ Reporting bugs
▸ Feedback Loop
▸ Bug remediation
![Page 3: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/3.jpg)
Traditional QA DOESN’T FIT IN THE DEV PROCESS
▸ Tests exist outside of development environment
▹ Most developers’ workflow takes place in their local
environment
▸ Testing requires a comprehensive review of functionality
▹ It goes beyond the scope of just one change
▸ Tests updated separately from what is being tested
▹ Versions of test and code must match
![Page 4: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/4.jpg)
QA that FITS IN THE DEV PROCESS
“Shifting Left”Building quality in from the start
![Page 5: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/5.jpg)
Dev-Owned QAThe Upside
- Bugs are caught faster- There’s less room for
communication errors- Keeps development agile
![Page 6: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/6.jpg)
Dev-Owned QAThe Downside
- Time is spent on testing, not building
- Delays in release schedule - Because of this “double
duty,” things fall through the cracks
![Page 7: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/7.jpg)
Solution?Testing that keeps up with agile development
![Page 8: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/8.jpg)
Crowdsourced TestingHow does it turbocharge your team?
![Page 9: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/9.jpg)
Write TestsWrite & run functional tests through UI, API or CLI
How Rainforest Works
Run TestsEach test is sent to 3 trained testers from our on-demand crowd of 50K testers
Result VerificationRainforest algorithms verify the accuracy and quality of the tester results
Results Returned Results are returned via Rainforest platform or directly into CI or bug trackers
![Page 10: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/10.jpg)
ExpertiseThe average tester has been working with Rainforest for 16 months
The Rainforest Crowd Difference
Consistency68% of testers execute more than 50 Rainforest tests each week
Continued LearningOur tester pool completes over 15,000 QA training sessions each week
Machine LearningEnsures that each test run meets our standard for quality
![Page 11: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/11.jpg)
Rainforest DevXUsing crowdsourced testers to run tests and provide deterministic results within existing workflows
![Page 12: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/12.jpg)
How Rainforest DevX Works
![Page 13: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/13.jpg)
Rainforest CLI
![Page 14: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/14.jpg)
Benefits of Rainforest DevX
Run all tests synchronously for quick resultsSave developer time and resources by allowing the crowd to execute test cases
Testing FlexibilityTest at any point within your release process
Reduce test management overheadEliminate versioning problems by coupling test expectations with the code being tested
Bring Regression Testing into Your Development Workflow
![Page 15: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/15.jpg)
“
”
Our devs realized that they wouldn’t have to leave their code editor to write a test for something they had just developed... Rainforest DevX makes it a lot easier to maintain and refactor our testsMitch Stewart, CTO, Guru
![Page 16: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/16.jpg)
“
”
We love that we can drive Rainforest from the command line and control the scope of the tests and cherry pick the browsers we want to run tests onWelling LaGrone, Director of Software Engineering, America’s Test Kitchen
![Page 17: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/17.jpg)
$3.3 MM Saved annually over in-house QA
557 HRSSaved on testing per month
30 X Speed of an in-house team
Customer Stats
![Page 18: Using Crowdsourced Testing to Turbocharge your Development Team](https://reader031.vdocuments.mx/reader031/viewer/2022022410/58e7e89d1a28abbc0b8b5219/html5/thumbnails/18.jpg)
LEARN MORETo find out more about streamlining testing…
Contact: [email protected]: @rainforestappFollow: @rainforest_eng