testingasatopbnotchservice! - agile software development q ... · automation regress products...
TRANSCRIPT
T7 Testing as a Service Thursday, October 24th, 2019 11:30 AM
Testing as a Top-‐Notch Service
Presented by:
Noha Gomaa
Aldo Group
Brought to you by:
888-‐-‐-‐268-‐-‐-‐8770 ·∙·∙ 904-‐-‐-‐278-‐-‐-‐0524 -‐ [email protected] -‐ http://www.starcanada.techwell.com/
Noha Gomaa Noha currently serves as senior manager of software quality assurance for the ALDO Group. She runs a cross-‐functional QA department for different testing teams and various initiatives, including SAP ERP implementations, digital transformations, and e-‐commerce projects spanning multiple channels and solutions platforms, all of which are powered by Hybris technology. Noha has fourteen years of IT experience in the financial, retail, telecom, cloud computing, marketing, and software sectors. Her work focuses on agile transformation, quality management, and software testing. She is also a quality fanatic and has been involved in a number of innovative initiatives, including the development and relaunch of ALDO Group’s e-‐commerce websites and award-‐winning mobile apps. She also successfully introduced agile processes to software development teams and has helped a number of companies implement testing in different lifecycle models for major infrastructure transformations and projects dealing with specific and custom products. When not working, she enjoys practicing yoga, hiking, and photography.
Forming a TOP-NOTCH Service-Oriented Testing Team
1
2
3
“To succeed in business today,
having satisfied customers is
just not good enough—and the
same holds true when you’re
an internal service provider.
Your internal customers must
be truly excited about your
service offering; they must be
Raving Fans”
Raving Fans, Ken Blanchard
4
Varying skill sets for resources lacking
Complicated team structure, Layers in Communication
Structure not adjusted to changing workflows (Agile, Hybrid, Waterfall)
No Resources available for Urgent Requests
Isolation
Layers in communicationLack of collaboration between teams
Contractual employees
Lack of efficient Team structure
Bureaucracy
Pain Points?
QA left out of the deployment process Lack of QA visibility showing business value
No process for different workflows
Shared testing resources/skills/people/tools/approach/ideas across multiple SDLCs
Teams were divided by projects not by skill sets
5
Service versus Bottleneck
6
3 Steps toForming a TOP-NOTCH Service-Oriented Testing Team
1. Decide which services you want to offer
2. Establish Core Services and Add services incrementally
3. Get feedback from my internal customers
7
#1 Decide Which Services You Want to Offer
● Decide what you want
● Discover what the customer wants
● Deliver above and beyond expectations
(plus 1)
8
Example 1 - Missing Requests
Associate Runner
Missed request on associate side
● Associate sent - 9 ● Associate sees - 8● Runner receives - 9
Missed 1 on Associate view
Dev● Fix the issue● Iterations/refactoring
QA● Have a reliable way to test on
every iteration 9
User on Good network
User Login
Scan a product
Select size
Go to poor/bad network
Send request(s)
Validate requests received
Network Tests - Sample Test Flow
10
What they requested Our vision
What we delivered
● Continuous Regression Testing● Retest the Missing Request Bug fix
● Automated Regression Testing● Retest the bug fix
● Automated Regression Testing ● Analysis and automate the test● Reproduce the bug under different network conditions to help the Dev’s
debug the issue● Intercept the Missing request bug systematically● Include the testing in the Automated regression
11
Example 2 - Price Validation
Price sources and accuracy testing
✔ Price is validated for one store per price zone
✔ Price is validated for every sku against POS data
✔ Quick and reliable testing
✔ Test covers all the store apps served by AWS
✔ Tests found SKU discrepancies eg: sku found
in AWS but not in POS file and vice versa
Dashboard
mStock
mFind
mFind mStock
12
What they requested Our vision
What we delivered
● App level UI Testing of Price accuracy (Spot Check)
● UI Regression testing ● App Level UI spot checking for
SKUs provided on the UI level compared to source files provided
● Analysis ● Regression● Backend testing of every sku compare against
source files they provided● Automated validation of every sku covering all
stores, all banners ● Dashboard to view the results for each SKU
13
#2 Establish Core Services and Add Incrementally
2017
● BI Report Testing Process● API Testing● Order Management● API Web Services
● Test Services (analysis, test planning, bug flow, testing, documentation)
● Test Automation● Testers on Agile projects
● Business Process● Non Functional Testing● Backend Testing● Mobile Test Automation● Performance Testing
Value:
● High quality products shipped to our customers● Quick Feedback, quick deployments, quick delivery. Giving people confidence that we didn't inject a
bugs in the core functionality● Right skills, at the right place, at the right time to ensure quick feedback to project teams
14
2018 2019
#3 Get Feedback from My Internal Customers
15
● Bridge communication
● Active listening
● Early communication
Challenges and How We Overcame Them
16
● Changing mindset
● Giving visibility
● Eliminating bureaucracy
QA Services
Backend
Testing: Web services, internal API/Cloud, Database testing
● Databases Testing
● APIs Testing
● Functional testing
● Regression testing
● Logs analysis
● Integration testing
● Data Migration Testing
SWAT
● Investigation
● Automated Regression
Testing
● Functional Testing
Strategic
● QA Process
● QA Metrics
● Analysis &
Recommendations
● Risk Assessment
● Test Artifacts
● QA Project Sizing
● Tools selection
● Resources
● Expert Skill set
● Training and support
● Requirement Analysis
● Data preparation
Testers that jump on projects on emergency basis, crisis management, using necessary tools, techniques, and data in order to find the important bugs quickly
Strategic QA process includes the management and implementation of testing processes and QA artifacts
Automation
Regress products effectively with each change, through the right use of processes, tools, best practices and automation framework
● Agile Automation
● Functional Testing
● Performance Testing
● Regression testing
● Mobile Application
● API/Web Service
● Acceptance Tests
● Business process testing
Customer Facing
Business software products, content Management system, E-Commerce (mobile apps and websites)
● Mobile Application testing
● BI report testing
● Exploratory testing
● Business Processes
● Functional & Regression
● Non Functional Testing
● Order Management
● Root Cause Analysis
● Troubleshooting
17
Metrics
18
References
19
1. Bach, James, 2014, “Test Jumpers”, Satisfice, viewed 25 April 2019, <https://www.satisfice.com/blog/archives/1372>.
2. Blanchard, Ken. Raving Fans New York: Blanchard Family Partnership and Ode to Joy Limited, 1993
3. Sabourin, Robert. "At your Service" STQE, the Software Testing and Quality Engineering magazine, May/June 2001, pp. 47
