test managers: stop managing and start mastering
DESCRIPTION
To be successful, test managers must keep pace with the constantly changing world of software development. The test manager’s job description—planning, supervising, and reporting the activities of the test process, with a focus on functional black-box tests—has remained virtually unchanged over the past decade. Meanwhile, the job requirements have changed dramatically—fast release cycles leading to widespread adoption of agile methodologies; increased security, performance, and usability requirements; and myriad smart devices in users' hands. And these are just the most obvious. Silvio Moser explains how these trends change the way we develop and test software, and describes strategies for tackling these challenges. Test managers must adapt to a new test management curriculum and a transformed role—the test master. While the classic test manager is mainly organizing and controlling, the test master acts as a mediator, moderator, and problem solver. Learn to stop managing and start mastering.TRANSCRIPT
nt Session
Presented by:
Silvio oser Sw g
Brought to you by:
340 Corporate Way, Suite Orange Park, FL 32073 888‐2
W9 Concurre4/9/2014 2:00 PM
“Test Managers: Stop Managing and Start Mastering”
M
issQ Consultin
300,68‐8770 ∙ 904‐278‐0524 ∙ [email protected] ∙ www.sqe.com
Silvio Moser SwissQ Consulting
Silvio Moser is cofounder and CTO of SwissQ, a Switzerland-based IT consulting company, which produces the Swiss Testing Day conference. At SwissQ, Silvio is a management consultant, test master, trainer, and member of the board. In his twenty-plus year career, he has gotten to know software development from the perspectives of a developer, business analyst, tester, and project leader. Since 1997, Silvio has worked in various consulting and management positions in software quality assurance, including head of the test competence center of a Fortune 500 company.
2/4/2014
1
TEST MASTER: STOP MANAGING AND START MASTERING
AboutSilvio Moser
Co‐founder and CTO of SwissQManagement Consultant, Test Master, Trainer
20 l i IT d l20‐plus year career in IT as developer, business analyst, tester, and project leader
Co‐founder of Swiss Testing Board (national branch of ISTQB)
SwissQ A Switzerland‐based IT consulting company, g p y,
specializing in testing and requirements engineering, with a focus on agile methodologies
SwissQ organizes the Swiss Testing Day and actively drives innovation
2
2/4/2014
2
TODAY’S TEST MANAGER ROLE
Today’s Test Manager Role
The person responsible for project management of testing activities and resources, and evaluation of a test object. The individual who directs, controls,
“Managing” is a big part of the job→ Plan and re‐plan testing activities→ Set‐up and configure test management tool (even if it is "just” Excel)
administers, plans and regulates the evaluation of a test object.
→ Maintain test cases and attributes→ Organize and document test meetings (status, defect, review, …)→ Schedule and coordinate test sessions→ Create and update test reports→ …
4
2/4/2014
3
FIT FOR PURPOSE?
It Used To Be Simple...
6
2/4/2014
4
Then Something Was Added...
Letter
Phone
MQ
Tasks
Workload
Client
ConfigurationTools
AdministrationT l
ContentAcquisition
Web
App
Claims
Skills
MQ
SOA
MessageBroker
SOA
I b d WorkloadMgmt
Tools
ReportingTools
7
Customer DB
Codes
Documents SOA
Redundant Server Farm (7*24h)
Rules
BridgeNotification
Error
Inbound
Sync DB
There Is More To Come...
Letter
Phone
MQ
Tasks
Workload
Client
ConfigurationTools
AdministrationT l
ContentAcquisition
Web
App
Claims
Skills
MQ
SOA
MessageBroker
SOA
I b d WorkloadMgmt
Tools
ReportingTools
8
Customer DB
Codes
Documents SOA
Redundant Server Farm (7*24h)
Rules
BridgeNotification
Error
Inbound
Sync DB
2/4/2014
5
And Then…Web Web Browser
Market Share
AppMobile Browser Market Share
OS Market Share
Android Fragmentation
netmarketshare.com, Oct 2013
9
develope
r.and
roid.com
, Oct 2013
Complexity
Level
Interaction
Technical Content
10
2/4/2014
6
How SW Engineering Adapts
OutsourcingArchitectural BlueprintsArchitectural BlueprintsCOTSProliferation of Programming LanguagesAgile Development…
11
AND TESTING?
2/4/2014
7
From Division Of Roles
Test EngineerTest EngineerTest EngineerTest EngineerTest EngineerTest Engineer
TTest Designerest DesignerTTest Designerest DesignerTTest Designerest Designer
Manual Manual TesterTester
Manual Manual TesterTester
Manual Manual TesterTester
Test ManagerTest Manager
13
To One Function Fits All
ttestest managementmanagement
EmbeddedEmbeddedEmbeddedEmbeddedEmbeddedEmbedded
testingtesting
ttestest designdesignregressionregressionttestingesting
ttestest automationautomation
EmbeddedEmbeddedTesterTester
EmbeddedEmbeddedTesterTester
EmbeddedEmbeddedTesterTester
mmanualanualtestingtesting
uusabilitysability
performanceperformance
14
2/4/2014
8
Embedded Testing
Sprint BacklogTest EstimationStory Review Testing Tasks
& Stories
Planning 2
SprintRetro-spective
Planning 1
readyready
Product Backlog
Daily Scrum
Grooming User Story Testing
Exploratory Testing
Regression Testing
Non-Functional Testing
Participation
15
Review
donedoneIncrement
Participation
Test Reporting
Challenge Done Criteria
Demo
BUT… WHAT ABOUT INTEGRATION?
2/4/2014
9
Test Master
(agile) (agile) testtest strategystrategy
integrationintegration
facilitatefacilitate sstakeholdertakeholdermanagementmanagement
moderatemoderate
eendnd‐‐toto‐‐endendtestingtesting
orchestrationorchestration
coachingcoaching
Test MasterTest MasterTest MasterTest MasterTest MasterTest Master
17
Test Master Duties
defines and lives the (agile) Test Strategy,heads the testing Community of Practice, g y ,coaches people in testing roles,coordinates all testing requirements, removes impediments for testing,controls the “Definition of Done” across all levels,facilitates communication about testing in andfacilitates communication about testing in and beyond the team, andplans and coordinates overall testing.
18
Source: Test Master job profile at Fortune 500 reinsurance company
2/4/2014
10
all
Integrated System
Go Live
(final) User Acceptance Test
Integrationm
Overa
Scrum
RUP
Sync Point Sync Point
System Integration Test
End‐to‐End Test
Test MasterTest MasterTest MasterTest MasterTest MasterTest Master
Waterfall
Tea RUP
EmbeddedEmbeddedTesterTester
EmbeddedEmbeddedTesterTester
EmbeddedEmbeddedTesterTester
19
Team vs Overall
O ll
Test MasterTest MasterTest MasterTest MasterTest MasterTest Master
Overall
Team
EmbeddedEmbeddedTesterTester
EmbeddedEmbeddedTesterTester
EmbeddedEmbeddedTesterTester
20
2/4/2014
11
Test Master Qualifications
Essential:→ A minimum of 5 year experience in a Software Engineering role.→ Experience with waterfall and agile methodologies.
Experience in a systems testing environment working on complex→ Experience in a systems testing environment working on complex projects.
→ Good working knowledge of database / DWH development / testing.→ Financial industry experience.→ Excellent communication and negotiation skills.
Should have:→ Risk domain experience.
l b l /→ Experience in global team / structure.→ Advanced Level Testing Certification (ISTQB or ISEB)→ Test Automation expertise.→ Experience of unit testing best practices (Clean Code practices).
21
Source: Test Master job profile at Fortune 500 reinsurance company
Managing vs. Mastering
HolisticIntuitive
IntegratingSynthesizing
InterpersonalFeeling basedKinestheticE i l
OrganizedSequentialPlannedD il d
LogicalAnalyticalFact basedQuantitative
HolisticIntuitive
IntegratingSynthesizing
InterpersonalFeeling basedKinestheticE i l
OrganizedSequentialPlannedD il d
LogicalAnalyticalFact basedQuantitative
TestTestMMTestTest
MMTestTest
MMTest Test
MMTest Test
MM
Source: Hermann International
EmotionalDetailed EmotionalDetailed MasterMasterMasterMasterMasterMasterManagerManagerManagerManager
22
2/4/2014
12
Managing vs. Mastering
Asks HOW Ask WHY
TestTestMMTestTest
MMTestTest
MMTest Test
MMTest Test
MM
Relies on AUTHORITY
Rely on INFLUENCE
Seeks COMFORT
SeekCHALLENGES
MasterMasterMasterMasterMasterMasterManagerManagerManagerManager
IsSYSTEMATIC
Be CREATIVE
The Importance Of Social Skills
Moderating
Collaboration Communication
Conflict Resolution
g
Negotiation
24
2/4/2014
13
Evolution Of The Tester
19901990
Testers, if they exist at all, are an exotic breed, who are not taken seriously.
20002000
The field and profession establish themselves; there are more and more testers, often organized in central teams.
20102010
The payoff of testing is challenged. Testers have to be resourceful.
20142014
Agile methods are widely adoped – death of the tester?
Tester
Test Manager Test Engineer
SW Engineer in Test
Embedded TesterTest Master
25
Key Points
Keep pace with the changing world of software development and increased complexity.Adapt to a new test curriculum.→ Embedded Testing at team level.→ Test Master at integration level.
Defines and lives the (agile) Test Strategy.Requires strong social skills.Requires strong social skills.Individuals and interactions over processes and tools.
26
2/4/2014
14
STOP MANAGING AND START MASTERING