open sourcing testing

31
OPEN SOURCING TESTING EUROSTAR 2012 CONFERENCE 08 NOV 2012 JULIAN HARTY Contact me: [email protected]

Upload: eurostar-conference

Post on 18-Dec-2014

25 views

Category:

Technology


0 download

DESCRIPTION

EuroSTAR Software Testing Conference 2012 presentation on open sourcing testing

TRANSCRIPT

Page 1: Open Sourcing Testing

OPEN SOURCING TESTING EUROSTAR 2012 CONFERENCE

08 NOV 2012

JULIAN HARTY Contact me: [email protected]

Page 2: Open Sourcing Testing

MY AIM… To answer, in part

What sorts of things would help us be better testers and do better testing?

Page 3: Open Sourcing Testing

OPEN SOURCE

DEFINITIONS & SCOPE

Page 4: Open Sourcing Testing

OPEN SOURCE Public Available for Study, Use & Modification The Open Source Definition http://www.opensource.org/docs/osd

Page 5: Open Sourcing Testing

OPEN SOURCE TESTING Publish •  Charters, Tests, … •  Environment •  Data •  Techniques •  Results •  Assessment •  Code

PERMISSIVE COLLABORATIVE

Page 6: Open Sourcing Testing

HEADLINES

STATE OF THE NATION

Page 7: Open Sourcing Testing

HEADLINES Certification schemes

Best Practices

Death of the Tester: James Whittaker •  StarWest 2011 - All That Testing is Getting in the Way of Quality •  http://www.youtube.com/watch?v=yOrPuMCdVXA

The Future of Quality: Goranka Bjedov •  http://www.belgiumtestingdays.com/program.php?p=12

The growth of open source test automation tools •  Mobile test automation •  Web test automation

Page 8: Open Sourcing Testing

WHY? Enlightened self-interest

Professionalism / Engineering Practices

Improving the craft

Renovate our testing

Feedback loops

Page 9: Open Sourcing Testing

SIMILAR PRACTICES

OPEN SOURCE TESTING

Page 10: Open Sourcing Testing

SIMILAR PRACTICES EXPERIENTIAL

Peer Workshops Let’s Test Conference

EVIDENCE

Scientific Method (in Software Testing)

Open Data

PRACTICE

Code Retreats Test Automation Workshop Hackathons

SHARING

Open Innovation Blogs Open publications

Page 11: Open Sourcing Testing

WHAT IS SCIENCE?

C Weidemann’s material at Let’s Test 2012

Page 12: Open Sourcing Testing

OPEN DATA Government Initiatives •  http://data.gov.uk/ •  Freedom of Information Act

Scientific Initiatives

•  Distinguish Publishing Data from Publishing Papers http://www.springerlink.com/content/m15520un02772l61/fulltext.pdf

Page 13: Open Sourcing Testing

WE’RE SPECIAL!

CONTEXT

Page 14: Open Sourcing Testing

WE’RE SPECIAL… REALLY? We like to believe we are •  special, •  unusual, •  better than average[1]

[1] "all the women are strong, all the men are good looking and all the children are above average," Garrison Keillor: Lake Woebegon http://www.randomhouse.com/kvpa/gilbert/

Page 15: Open Sourcing Testing

I’M SPECIAL REVISITED…

Page 16: Open Sourcing Testing

COMPETITIVE ADVANTAGE

MORE CONTEXT

Page 17: Open Sourcing Testing

COMPETITIVE ADVANTAGE

WHAT DOES IT DO?

Exhilaration Stimulating Exhausting Scary?

CONCERNS

Political aspects? Who are our competitors? Who are we competing with?

EFFECTS

Acceleration First among equals

Page 18: Open Sourcing Testing

WHO ARE WE COMPETING WITH?

COMPETITIVE ADVANTAGE

Page 19: Open Sourcing Testing

BENEFITS

OPEN SOURCE TESTING

Page 20: Open Sourcing Testing

BENEFITS SCOPE

Me Team Project Company Country Community Industry

STAKEHOLDERS

Testers Business Boss Customers End Users

Page 21: Open Sourcing Testing

BENEFITS Repeatability Review Correction Refinement & Enhancement Community education Attracting better people to your organisation? Freedom to invest & reap the rewards of the investment Evolution vs. Repetition

Page 22: Open Sourcing Testing

HOW MUCH IS ENOUGH?

OPEN SOURCE TESTING

Page 23: Open Sourcing Testing

HOW MUCH IS ENOUGH? Levels 0. Sufficient to assess and reproduce 1. Permit modification and enhancement

2. Encourage competition

Minimum Investment?

•  Multiples of 30 minutes[1] •  Flows of investment

[1][ http://www.pomodorotechnique.com/book/

Page 24: Open Sourcing Testing

THINGS TO CONSIDER

OPEN SOURCE TESTING

Page 25: Open Sourcing Testing

CONCERNS TO CONSIDER Protecting •  Privacy •  Secret Sauce

Overcoming •  Stiction, Lethargy, Vested interests, Employment contracts

Risking •  What are we gambling? •  What are we afraid of?

New practices and business models Not a panacea •  Open not necessarily High Quality!

Page 26: Open Sourcing Testing

SUCCESS FACTORS

Sustainability

Benign Dictators

What do you want to optimise situations and outcomes for?

Merit-based feedback

Ask “What can I share?” that doesn’t risk “too much”

Maintaining and encouraging good quality

sqa.stackexchange.com

Page 27: Open Sourcing Testing

SUPPORTING MATERIAL

OPEN SOURCE TESTING

Page 28: Open Sourcing Testing

SUPPORTING MATERIAL

Legal Structures

•  Creative Commons

•  Free and Open Source Software (FOSS) Licenses

Page 29: Open Sourcing Testing

IF NOT NOW, WHEN?

OPEN SOURCE TESTING

http://en.wikipedia.org/wiki/Hillel_the_Elder

Page 30: Open Sourcing Testing

IF NOT YOU, WHO?

Opening the Kimono •  Be open and be open to correction •  The tester, tested?

http://www.hackingwork.com/wp-content/uploads/HWChaps1-4.pdf

Breaking stupid rules for smart results

http://www.gutenberg.org/files/18735/18735-h/18735-h.htm

Page 31: Open Sourcing Testing

OVER TO YOU

THE UNASKED QUESTIONS

Contact me: [email protected]