kickoff test automation day 2012
DESCRIPTION
Presentation to kick off the Test Automation Day, June 21, 2012.http://www.testautomationday.com/TRANSCRIPT
![Page 1: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/1.jpg)
Test Automation Day 2012 Kicking off the Future of Test Automation
Arie van Deursen
Delft University of Technology
Rotterdam WTC, 21 June 2012
@avandeursen #TADNL
![Page 2: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/2.jpg)
The TU Delft Software Engineering Research Group
Education
• Programming, software engineering
• MSc, BSc projects
Research
• Software architecture
• Software testing
• Repository mining
• Collaboration
• Services
• Model-driven engineering
• End-user programming
2
![Page 3: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/3.jpg)
3
![Page 4: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/4.jpg)
• A test case is an executable example of system behavior
• Each example can help in stakeholder communication
• Throughout the full development cycle
4
![Page 5: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/5.jpg)
The Set of Examples is Incomplete
• Too much data
• Too many combinations
• Too many paths
• Properties of interest fundamentally undecidable
5
![Page 6: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/6.jpg)
The Set of Examples needs to Change
• Software serves society
• Society is changing continually
• Successful software is easy to change
6
![Page 7: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/7.jpg)
Test Automation
Automation of any step in the testing process
• Test execution
• Test case design
• Test case creation
• Test data generation
• Test output verification
• Test case management
• Test traceability
• Test adequacy analysis
7
![Page 8: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/8.jpg)
Test Automation
Benefits
• Run tests faster
• Run more of them
• Run as often as you like
• Continuous integration
• Early bug detection
• More variation
• More reliable
The Dark Side
• Costly infrastructure
• Test case construction costs
• Fragile test cases
• Test suite maintenance
• Possibly false sense of safety
• Human out of the loop
Engineering tradeoffs to be made Requires skills and experience.
8
![Page 9: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/9.jpg)
9
Plugin / Junit Testing in Eclipse. >> 1000s of tests
![Page 10: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/10.jpg)
Test Automation: The Past
10
“Test automation has been around
since DAY ONE of the computing industry.”
![Page 11: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/11.jpg)
Test Automation: The Present
• State of the art: Today!
• State of the practice: A bit behind.
11
![Page 12: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/12.jpg)
Test Automation: The Future -- Two Research Examples --
• “Concolic testing”
– Directed automated random testing
• Self-monitoring
– Built-in self testing & testability interfaces
12
![Page 13: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/13.jpg)
Discussions (1)
Die Wahrheit ist konkret • Ask speakers for
concrete experience! • Offer your concrete
experience to audience!
Georg Wilhelm Friedrich Hegel 13
![Page 14: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/14.jpg)
Discussions (2)
Elk nadeel
heb z’n voordeel
Johan Cruijff 14
![Page 15: Kickoff Test Automation Day 2012](https://reader034.vdocuments.mx/reader034/viewer/2022051817/548f8428b479590d2b8b5133/html5/thumbnails/15.jpg)
Plenary Program
9:30 Kickoff
9:55 Keynote 1 Scott Barber Adding Value
10:35 Keynote 2 Walter Belgers Security
11:10 Coffee
11:45 Tracks 1
13:05 Lunch (Tut. Scott Barber)
14:00 Keynote 3 Elfriede Dustin Near Future
15:00 Tracks 2
15:35 Tea
16:10 Tracks 3
16:55 Closing Keynote Dion Johnson Retrospective
17:35 Drinks
18:30 Dinner 15