martin pol - questioning the evolution of testing: what's next? - eurostar 2013
DESCRIPTION
EuroSTAR Software Testing Conference 2013 presentation on Questioning the Evolution of Testing: What's Next? by Martin Pol. See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/TRANSCRIPT
![Page 1: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/1.jpg)
Martin Pol
Questioning The Evolution Of Testing: What’s Next?
www.eurostarconferences.com
@esconfs#esconfs
![Page 2: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/2.jpg)
Then Today
S
tru
ctu
rePioneering
Structuring
Optimizing
Unstructured
Undisciplined
Flexible
Structured
Disciplined
Inflexible
![Page 3: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/3.jpg)
• Unknown, no buy-in, no budget, no process, no tools
• Fully integrated in the development process
– Generalists, joined effort
– Prototype, exploratory driven
• Only test pioneers
Pioneering
Then Today
S
tructu
re
![Page 4: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/4.jpg)
• Struggling required to get involved
• Lacking experiences, references
• Only welcome in emergency situations
•
Pioneering
Then Today
S
tructu
re
![Page 5: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/5.jpg)
Structuring
Then Today
S
tructu
re
![Page 6: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/6.jpg)
![Page 7: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/7.jpg)
• Structuring the process
• Publishing
• Functionality and non-functionality
• Test automation
• Test Process Improvement models
– TPI, TMM, TMMi, TOM, TIM, TSM, …
Structuring
Then Today
S
tructu
re
![Page 8: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/8.jpg)
• Dedicated (trained) staff
• (Early) involvement, master test planning
– Risk based coverage
• Independent testing
• Test competence center, factory methods
• Recognized as a function
Structuring
Then Today
S
tructu
re
![Page 9: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/9.jpg)
• Becoming a referee
• Process Improvement freaks
• Measure and metrics mania
– Spreadsheet management
• Complaining and blaming
• Tunnel vision
Structuring
Then Today
S
tructu
re
![Page 10: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/10.jpg)
ProcessTheorySchedule
ManualIndependentDisciplineStructureStandards
Structuring
Then Today
S
tructu
re
![Page 11: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/11.jpg)
Technology push Efficiency push
The IT Optimizing
Then Today
S
tructu
re
![Page 12: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/12.jpg)
• Architecture
– SOA
– Virtualization
– Web technology
– Devices
• Cloud
*aaS
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing,
listening, analyzing, transmitting, learning,
controlling, purchasing, testing, alarming,
changing, updating, deleting, accessing, rejecting,
correcting, studying, booking, receiving, tracing,
protecting, deciding, managing, teaching,
facilitating, identifying, copying, removing,
demonstrating, checking, showing, selecting,
subscribing, unsubscribing, sharing, mailing,
communicating, reading, playing, working,
meeting, gambling, shopping, storing, cross
checking, retrieving, configuring, sketching,
saving, accelerating, enhancing, creating, growing,
checking in, checking out, finding out, reaching,
denying, talking, designing, making, verifying,
measuring
Technologypush
The IT
Surf
Transfer
Develop and Test
Operate and Manage Store
![Page 13: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/13.jpg)
• Architecture
• Cloud
• SoLoMo
The IT
Technologypush
Hi Martin. Good to see you back!Today: 3 pairs of socks, you pay 2
![Page 14: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/14.jpg)
• Architecture
• Cloud
•
The IT
Technologypush
![Page 15: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/15.jpg)
• Architecture
• Cloud
• SoLoMo
• Big Data
• Integration
Technologypush
The IT
![Page 16: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/16.jpg)
Efficiency push• Outsourcing
• *aaS
• Package software
• Agile, Scrum
• Collaboration
The IT
![Page 17: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/17.jpg)
• Outsourcing
• *aaS
• Package software
• Agile, Scrum
• Collaboration
• DevOps
• Continuous Delivery
Efficiency push
The IT
![Page 18: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/18.jpg)
• Architecture
• Cloud, *aaS
• SoLoMo
• Big Data
• Integration
• Outsourcing
• Packages
• Agile, Scrum
• DevOps
• Cont. Delivery
The ITOptimizing
Then Today
S
tructu
re
![Page 19: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/19.jpg)
Optimizing
Today Tomorrow
• Architecture
• Cloud, *aaS
• SoLoMo
• Big Data
• Integration
• Outsourcing
• Packages
• Agile, Scrum
• DevOps
• Cont. Delivery
Actual Requirements for our Community
![Page 20: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/20.jpg)
Optimizing
Then Today
S
tructu
re
• Agile, Scrum
– Joint effort and success
– Focus on business value
– Social skills required
– Test management role
Testing
![Page 21: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/21.jpg)
• Agile, Scrum
• Context Driven
– Problem solving, practice, heuristics, stories, skills
– People, cooperation, community
– Rapid Software Testing
Optimizing
Then Today
S
tructu
re
Testing
The Seven Basic Principles of the Context-Driven School1. The value of any practice depends on its context.
2. There are good practices in context, but there are no best
practices.
3. People, working together, are the most important part of any
project’s context.
4. Projects unfold over time in ways that are often not predictable.
5. The product is a solution. If the problem isn’t solved, the product
doesn’t work.
6. Good software testing is a challenging intellectual process.
7. Only through judgment and skill, exercised cooperatively
throughout the entire project, are we able to do the right things at
the right times to effectively test our products.
![Page 22: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/22.jpg)
• Agile, Scrum
• Context Driven
• SDTM (Service Driven Test Management)
– From complaining and blaming towards enabling
– Tactful leadership
Optimizing
Then Today
S
tructu
re
Testing
![Page 23: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/23.jpg)
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
– Test in production
– Cloud testing (Iaas, Taas)
– Integration
Optimizing
Then Today
S
tructu
re
Testing
![Page 24: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/24.jpg)
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
– Automation of testing
– Architecture
Optimizing
Then Today
S
tructu
re
TestwareTest scriptsTest casesTest data
Registration Reporting
Test AutomationSoftware – Platform – Infrastructure
Test Automation Process & Organization
ProjectsChanges
PatchesFixes
System Under TestSoftware – Service – Platform - Infrastructure
Testing
![Page 25: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/25.jpg)
Testing
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
– Testing in the Cloud (TaaS)
– Testing Cloud Services
Optimizing
Then Today
S
tructu
re
![Page 26: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/26.jpg)
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
– Hot
– Sexy
– Wild
Optimizing
Then Today
S
tructu
re
Testing
![Page 27: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/27.jpg)
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
– Technical skills
– Multi dimensional
– Continuous integration
Optimizing
Then Today
S
tructu
re
Testing
![Page 28: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/28.jpg)
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
– Scoping
– Agreements
– Management
controls, metrics, health checks
test deliverables
test progress test process
product quality
Optimizing
Then Today
S
tructu
re
Testing
![Page 29: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/29.jpg)
Optimizing
Then Today
S
tructu
re
Testing
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
•
![Page 30: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/30.jpg)
Optimizing
Then Today
S
tructu
re
Testing
• Agile, Scrum
• Context Driven
• SDTM
• TestOps
• Automation 2.0
• Cloud Computing
• SoLoMo
• Outsourcing
• Crowd testing
• Changed role
![Page 31: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/31.jpg)
TMapDevOpsCreativeTolerant
CMMI
Outsourcing
SaaS
BYODWaterfall
Telecom
Logistics
Reporting
CI
CD
SBTM
Virtua
lization
IT-general
Networks
Infrastructure
PRINCE2
IREB
![Page 32: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/32.jpg)
DistributedBusiness/RQMS
Development
Operations
TechnicalAutomation
Cloud
SoLoMo
Security
ProgrammingAutomation
Testing
Development
SocialTeam player
Communication
CraftsmanshipTesting
Test management
CHANGED ROLE
![Page 33: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/33.jpg)
ProcessTheorySchedule
ManualIndependentDisciplineStructureStandards
PeopleSkills
ChangeAutomatedCollaboration
SolutionFlexibilityCreative
towards
Optimizing
Then Today Tomorrow
S
tructu
re
Optimizing our contribution
![Page 34: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/34.jpg)
Process
TheorySchedule
DisciplineStructure
Standards
People
Change
Collaboration
Flexibility
Creative
TMap
ISTQB
ISO/IEC 29119
CDT
RST
Exploratory Testing
SBTM
Agile Scrum
Skills
Explicit
Tacit
![Page 35: Martin Pol - Questioning the Evolution of Testing: What's Next? - EuroSTAR 2013](https://reader034.vdocuments.mx/reader034/viewer/2022052508/559eb1081a28abd26a8b4622/html5/thumbnails/35.jpg)
www.polteq.com
The economy continues to challengeJointly optimizing the craft remains top requirement