testing of robots and testing with robots. netherlands testing day 2016 rik marselis
TRANSCRIPT
Testing Robots…
Testing of robots…
Testing with robots…
Nederlandse testdag 2016
|
Who has a robot?
Nederlandse Testdag 2016 2
Who has a robot? In 10 years all of you will !!
|
Technology enters our lives… FAST!!
Nederlandse Testdag 2016 3
|
Robots in praktice
Over 50% of the dairy-farms in the Netherlands uses oneor more robots.
Nederlandse Testdag 2016 4
|
Manure robot
Nederlandse Testdag 2016 5
Low intelligence for specific tasks(“dull and/or dangerous”)
|
Milking robot
Nederlandse Testdag 2016 6
|
Social impact of robots
The farmer and his family can now have dinner together at 18:00 hours !!
Nederlandse Testdag 2016 7
De aardappeleters. Vincent van Gogh
|
Towards autonomous robots
Nederlandse Testdag 2016 9
Testing with robots
Testing Robots…
Nederlandse Testdag 2016
|
Robot automatically performs regression tests
NL Testdag 2016 11
|
Robot automatically performs regression tests
Nederlandse Testdag 2016 12
|
Use robots for…
Nederlandse Testdag 2016 13
Functional testing• Generate test cases• Execute test cases• Analyse the results
Brute-force testing• Generate a huge number of test cases and
execute them
Non-functional testing• Intelligent performance testen
(not just 10.000 times the same transaction)
|
Use robots for…
Nederlandse Testdag 2016 14
Big data analytics (using artificial intelligence)• Analyse live data• Generate relevant test data
Colaboration between human and machine• Robot repetative work• Human creative work
Regression testing• Robots are very good at repetative work!!
And so much more!!!!!
Testing Robots…
Testing of robots
Nederlandse Testdag 2016
|
Different angles of quality for robotics
Nederlandse Testdag 2016 16
Mechanical
Electrical
Information Processing
Machine Intelligence
Business Impact
SocialImpact
For these “traditional” tests we already
have the knowledge and experience
for decades.
|
Different angles of quality for robotics
Nederlandse Testdag 2016 18
Mechanical
Electrical
Information Processing
Machine Intelligence
Business Impact
SocialImpact
new
new
new
|
Testing still has the well-know foundation
Nederlandse Testdag 2016 19
Quality
Risks
ConfidenceQuality attributes
Analysis and mitigation
|
Different angles of quality for robotics
Nederlandse Testdag 2016 20
Mechanical
Electrical
Information Processing
Machine Intelligence
Business Impact
SocialImpact
|
Machine learning
Nederlandse Testdag 2016 21
<<< vervangen door filmclip >>>
|
Testing machine learning: it’s about the input!!
Nederlandse Testdag 2016 22
The tester as “psychologist” of the intelligent machine
|
No more programming but training …
Nederlandse Testdag 2016 23
|
No more programming but training …
Nederlandse Testdag 2016 24
The tester as “trainer” of the intelligent machine
|
Different angles of quality for robotics
Nederlandse Testdag 2016 25
Mechanical
Electrical
Information Processing
Machine Intelligence
Business Impact
SocialImpact
|
Testing still has the well-know foundation
Nederlandse Testdag 2016 26
Quality
Risks
ConfidenceQuality characteristics
Analysis and mitigation
|
New risks having impact on business process
Nederlandse Testdag 2016 27
Product Risk Analysis
New risks
Well-known approach
Other outcoumes, for
• Test strategy• Test techniques
• Test coverage
|
Image remains the highest impact-area…
Nederlandse Testdag 2016 28
|
When will self-driving cars be on the road?
In how many years do you expect a self-driving vehicle will beallowed on the road in the Netherlands
Think of a number…
Who thinks in … years?
Nederlandse Testdag 2016 29
105
21
|
Sogeti has already tested a self-driving vehicle
The Wepod inWageningen
On the public road sinceOctober 2016 !!
Nederlandse Testdag 2016 30
|
Non-functionals become more important
TMap NEXT has 17 quality attributes
ISO9126 has 27 quality attributes
ISO25010 has 37 quality attributes
For “the new world” we have now made a list of
over 70 possible quaility attributes.(work in progress)
Nederlandse Testdag 2016 31
ethics
embodiment
empathy
|
Different angles of quality for robotics
Nederlandse Testdag 2016 32
Mechanical
Electrical
Information Processing
Machine Intelligence
Business Impact
SocialImpact
|
Augmented people
Nederlandse Testdag 2016 33
|
Will robots take over your job?
Source: www.pewinternet.org/2016/03/10/public -predictions-for-the-future-of-workforce-automation/ Nederlandse Testdag 2016 34
The tester as philosopher for applying new technology…
|
Different angles of quality for robotics
TMap dag 2016 35
Mechanical
Electrical
Information Processing
Machine Intelligence
Business Impact
SocialImpact
Robots testing…Existing foundations;
New possibilities and
additions!
Make sure you’re ready for it!Nederlandse Testdag 2016