getting started with open source testing tools
DESCRIPTION
In the not-too-distant past, the only viable options for testing complicated web-based applications were commercial (i.e., expensive) tools. These tools were well designed but difficult to scale without significant investment in both human capital and licensing costs. Now, a number of open-source tools are available, allowing for rich, robust, expressive testing against applications as complicated as any in the world—and they’re free. However, your savings in licensing and support fees can potentially be eclipsed by the cost of maintaining a team of developers to support these "free" tools. But as the tools progress, the industry is starting to shift toward open-source test frameworks to help manage these tools, allowing their support and maintenance to be done through the “community.” This leaves your team with only the challenge of modeling your application. Marcus Merrell presents one such framework, which allows for quick modeling and implementation of a robust, low-maintenance test suite that requires minimal Java skills.TRANSCRIPT
![Page 1: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/1.jpg)
Session
Presented by:
Marcus R
Brought to you by:
340 Corporate Way, Suite Orange Park, FL 32073 888‐2
W11 Concurrent4/9/2014 2:00 PM
“Getting Started with Open Source Testing Tools”
Merrell
etailMeNot, Inc.
300,68‐8770 ∙ 904‐278‐0524 ∙ [email protected] ∙ www.sqe.com
![Page 2: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/2.jpg)
Marcus Merrell RetailMeNot, Inc
A test architect at RetailMeNot, Inc., Marcus Merrell has written UI and API test frameworks for several products since 2001. Marcus is obsessed with code design and holds sacred the philosophy that test frameworks should be approached, developed, and tested just as carefully as the production software they seek to examine. The successful demonstration of these principles has led to an intense focus on collaboration between testers and developers, and to a deep appreciation for code that is at once simple and sophisticated―an API for testers which is reusable, interface-agnostic, and universal to many problem sets.
![Page 3: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/3.jpg)
Getting Started with Open Source Testing ToolsMarcus Merrell, RetailMeNot, inc
@mmerrell
![Page 4: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/4.jpg)
What You Need in a Framework
Multiple browsersAbility to build a “model”Simple execution
CICommand-line
Robust reportingExtensibilityBeware of “codeless” solutions
![Page 5: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/5.jpg)
ChoicesRuby (RSpec, Riot)Python (pytest, nose)Java (JUnit, TestNG)PHP (PHPUnit)… or the thing I’m going to talk about
![Page 6: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/6.jpg)
Our FrameworkContains all the tools above, plus several more
ProxyDatabase interactionAnalytics
Not open source just yetWe’re looking for partners
![Page 7: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/7.jpg)
Tech StackMavenSpringTestNGSeleniumHibernateCQMS
![Page 8: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/8.jpg)
FeaturesScalability
Autoscaling Grid!Data-driven tests
AnalyticsOutclicksSite Catalyst
Database ValidationTest data creation
![Page 9: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/9.jpg)
HierarchyPagesElementsTests
…let’s just look at some code
![Page 10: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/10.jpg)
ExecutionTeamCity kicks off Maven job, which executes TestNG tests
![Page 11: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/11.jpg)
ReportingTeamCityDatabaseTestRails…extensible, can be used with anything
![Page 12: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/12.jpg)
Statistics500 RetailMeNot core tests300 test for mobile site450 internal admin tests100 tests for Native iOS app800 headless API tests
![Page 13: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/13.jpg)
DownsideCommunity supported, but this can be an upside in many casesCan be difficult to measure costsCan be difficult to get started
(that’s where we want to help!)Requires higher skill level to navigate
![Page 14: Getting Started with Open Source Testing Tools](https://reader034.vdocuments.mx/reader034/viewer/2022042509/54c511894a7959226f8b4732/html5/thumbnails/14.jpg)
ConclusionOpen source = robust, well-supported, tight controlScalable, particularly from a license point of viewIf you choose well-supported projects, you’ll get what you need