using crowdsourced testing to turbocharge your development team

Post on 08-Apr-2017

218 Views

Category:

Technology

1 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Using Crowdsourced Testing to Turbocharge your Development Team

What does traditional QA look like?

▸ Write test cases

▹ Feature tests, regression tests, etc

▸ Execute tests

▹ Manual or Automated

▸ Reporting bugs

▸ Feedback Loop

▸ Bug remediation

Traditional QA DOESN’T FIT IN THE DEV PROCESS

▸ Tests exist outside of development environment

▹ Most developers’ workflow takes place in their local

environment

▸ Testing requires a comprehensive review of functionality

▹ It goes beyond the scope of just one change

▸ Tests updated separately from what is being tested

▹ Versions of test and code must match

QA that FITS IN THE DEV PROCESS

“Shifting Left”Building quality in from the start

Dev-Owned QAThe Upside

- Bugs are caught faster- There’s less room for

communication errors- Keeps development agile

Dev-Owned QAThe Downside

- Time is spent on testing, not building

- Delays in release schedule - Because of this “double

duty,” things fall through the cracks

Solution?Testing that keeps up with agile development

Crowdsourced TestingHow does it turbocharge your team?

Write TestsWrite & run functional tests through UI, API or CLI

How Rainforest Works

Run TestsEach test is sent to 3 trained testers from our on-demand crowd of 50K testers

Result VerificationRainforest algorithms verify the accuracy and quality of the tester results

Results Returned Results are returned via Rainforest platform or directly into CI or bug trackers

ExpertiseThe average tester has been working with Rainforest for 16 months

The Rainforest Crowd Difference

Consistency68% of testers execute more than 50 Rainforest tests each week

Continued LearningOur tester pool completes over 15,000 QA training sessions each week

Machine LearningEnsures that each test run meets our standard for quality

Rainforest DevXUsing crowdsourced testers to run tests and provide deterministic results within existing workflows

How Rainforest DevX Works

Rainforest CLI

Benefits of Rainforest DevX

Run all tests synchronously for quick resultsSave developer time and resources by allowing the crowd to execute test cases

Testing FlexibilityTest at any point within your release process

Reduce test management overheadEliminate versioning problems by coupling test expectations with the code being tested

Bring Regression Testing into Your Development Workflow

Our devs realized that they wouldn’t have to leave their code editor to write a test for something they had just developed... Rainforest DevX makes it a lot easier to maintain and refactor our testsMitch Stewart, CTO, Guru

We love that we can drive Rainforest from the command line and control the scope of the tests and cherry pick the browsers we want to run tests onWelling LaGrone, Director of Software Engineering, America’s Test Kitchen

$3.3 MM Saved annually over in-house QA

557 HRSSaved on testing per month

30 X Speed of an in-house team

Customer Stats

LEARN MORETo find out more about streamlining testing…

Contact: info@rainforestqa.comGithub: @rainforestappFollow: @rainforest_eng

top related