SlideShare a Scribd company logo
OPEN 
SOURCING 
TESTING 
EUROSTAR 2012 CONFERENCE 
08 NOV 2012 
JULIAN HARTY 
Contact me: julianharty@gmail.com
MY AIM… 
To answer, in part 
What sorts of things would help us be 
better testers and do better testing?
DEFINITIONS & SCOPE 
OPEN 
SOURCE
OPEN SOURCE 
Public 
Available for Study, Use & Modification 
The Open Source Definition 
http://www.opensource.org/docs/osd
OPEN SOURCE 
TESTING 
Publish 
• Charters, Tests, … 
• Environment 
• Data 
• Techniques 
• Results 
• Assessment 
• Code 
PERMISSIVE 
COLLABORATIVE
STATE OF THE NATION 
HEADLINES
HEADLINES 
Certification schemes 
Best Practices 
Death of the Tester: James Whittaker 
• StarWest 2011 - All That Testing is Getting in the Way of Quality 
• http://www.youtube.com/watch?v=yOrPuMCdVXA 
The Future of Quality: Goranka Bjedov 
• http://www.belgiumtestingdays.com/program.php?p=12 
The growth of open source test automation tools 
• Mobile test automation 
• Web test automation
WHY? 
Enlightened self-interest 
Professionalism / Engineering Practices 
Improving the craft 
Renovate our testing 
Feedback loops
OPEN SOURCE TESTING 
SIMILAR 
PRACTICES
SIMILAR PRACTICES 
EXPERIENTIAL 
Peer Workshops 
Let’s Test 
Conference 
EVIDENCE 
Scientific Method 
(in Software Testing) 
Open Data 
PRACTICE 
Code Retreats 
Test Automation 
Workshop 
Hackathons 
SHARING 
Open Innovation 
Blogs 
Open publications
WHAT IS SCIENCE? 
C Weidemann’s material at Let’s Test 2012
OPEN DATA 
Government Initiatives 
• http://data.gov.uk/ 
• Freedom of Information Act 
Scientific Initiatives 
• Distinguish Publishing Data from Publishing Papers 
http://www.springerlink.com/content/m15520un02772l61/fulltext.pdf
CONTEXT 
WE’RE 
SPECIAL!
WE’RE SPECIAL… 
REALLY? 
We like to believe we are 
• special, 
• unusual, 
• better than average[1] 
[1] "all the women are strong, all the men are good 
looking and all the children are above average," 
Garrison Keillor: Lake Woebegon http://www.randomhouse.com/kvpa/gilbert/
I’M SPECIAL 
REVISITED…
MORE CONTEXT 
COMPETITIVE 
ADVANTAGE
COMPETITIVE 
ADVANTAGE 
WHAT DOES IT DO? 
CONCERNS 
Political aspects? 
Who are our 
competitors? 
Who are we 
competing with? EFFECTS 
Acceleration 
First among equals 
Exhilaration 
Stimulating 
Exhausting 
Scary?
COMPETITIVE ADVANTAGE 
WHO ARE WE 
COMPETING 
WITH?
OPEN SOURCE TESTING 
BENEFITS
BENEFITS 
SCOPE 
Me 
Team 
Project 
Company 
Country 
Community 
Industry 
STAKEHOLDERS 
Testers 
Business 
Boss 
Customers 
End Users
BENEFITS 
Repeatability 
Review 
Correction 
Refinement & Enhancement 
Community education 
Attracting better people to your organisation? 
Freedom to invest & reap the rewards of the investment 
Evolution vs. Repetition
OPEN SOURCE TESTING 
HOW MUCH 
IS ENOUGH?
HOW MUCH IS 
ENOUGH? 
Levels 
0. Sufficient to assess and reproduce 
1. Permit modification and enhancement 
2. Encourage competition 
Minimum Investment? 
• Multiples of 30 minutes[1] 
• Flows of investment 
[1][ http://www.pomodorotechnique.com/book/
OPEN SOURCE TESTING 
THINGS TO 
CONSIDER
CONCERNS TO 
CONSIDER 
Protecting 
• Privacy 
• Secret Sauce 
Overcoming 
• Stiction, Lethargy, Vested interests, Employment contracts 
Risking 
• What are we gambling? 
• What are we afraid of? 
New practices and business models 
Not a panacea 
• Open not necessarily High Quality!
SUCCESS FACTORS 
Sustainability 
Benign Dictators 
What do you want to optimise situations and outcomes for? 
Merit-based feedback 
sqa.stackexchange.com 
Ask “What can I share?” that doesn’t risk “too much” 
Maintaining and encouraging good quality
OPEN SOURCE TESTING 
SUPPORTING 
MATERIAL
SUPPORTING 
MATERIAL 
Legal Structures 
• Creative Commons 
• Free and Open Source Software (FOSS) Licenses
OPEN SOURCE TESTING 
IF NOT NOW, 
WHEN? 
http://en.wikipedia.org/wiki/Hillel_the_Elder
IF NOT YOU, WHO? 
Opening the Kimono 
• Be open and be open to correction 
• The tester, tested? 
Breaking stupid rules for smart results 
http://www.gutenberg.org/files/18735/18735-h/18735-h.htm 
http://www.hackingwork.com/wp-content/uploads/HWChaps1-4.pdf
THE UNASKED QUESTIONS 
OVER TO 
YOU 
Contact me: julianharty@gmail.com

More Related Content

PDF
Open Access: the tip of the iceberg
PPTX
Software Testing’s Future—According to Lee Copeland
PPTX
ADDO19: Geek's Guide to DevOps Cultural Transformation
PPTX
Communities of Trust - from regulation to cooperation
PPTX
Social Media & AOD Advocacy (2013 APSAD Conference)
PDF
Tony Bruce - One More question.... - EuroSTAR 2013
PDF
Pradeep Soundararajan - Testing for Sales and Competitor Analysis - EuroSTAR ...
PDF
Jackie McDougall - Testing on Trial - EuroSTAR 2013
Open Access: the tip of the iceberg
Software Testing’s Future—According to Lee Copeland
ADDO19: Geek's Guide to DevOps Cultural Transformation
Communities of Trust - from regulation to cooperation
Social Media & AOD Advocacy (2013 APSAD Conference)
Tony Bruce - One More question.... - EuroSTAR 2013
Pradeep Soundararajan - Testing for Sales and Competitor Analysis - EuroSTAR ...
Jackie McDougall - Testing on Trial - EuroSTAR 2013

Viewers also liked (20)

PDF
Jouri Dufour - How About Security Testing - EuroSTAR 2013
PDF
Geoff & Emily Bache - Specification By Example With GUI Tests-How Could That ...
PDF
Alexandra Schladebeck - What Agile Teams Can Learn From World of Warcraft - E...
PDF
Morten Hougaard - Autism, A Benefit For Testing - EuroSTAR 2013
PDF
Rajesh Mathur - Testing in a Challenging Environment - EuroSTAR 2013
PDF
Ruud Teunissen - The Awful Truth About Estimation, Have I Been Wrong All Alon...
PDF
Pekka Marjamaki - Testing Me - EuroSTAR 2013
PDF
Paul Holland - How To Organise a Peer Conference - EuroSTAR 2013
PDF
Rob Lambert - Moving To Weekly Releases - EuroSTAR 2013
PDF
Alexandra Casapu - Fooled by Unknown Unknowns, A Success Story - EuroSTAR 2013
PDF
Remi Hansen - Test Strategies Are 90% Waste - EuroSTAR 2013
PDF
Albert Witteveen - With Cloud Computing Who Needs Performance Testing
PDF
Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...
PDF
Zeger Van Hese - Testing in the Age of Distraction, The Importance of (De)foc...
PDF
Markus Gartner - Beyond Testing - EuroSTAR 2012
PDF
Jeanne Hofmans & Eduard Hartog - How to Test a Tunnel - EuroSTAR 2013
PDF
Soren Lynggaard & Pusser Janvit - How To Hire A True Tester - EuroSTAR 2013
PDF
Andy Glover - Testing is evolving, but where is the evidence - EuroSTAR 2012
PDF
Iain McCowatt - Automation Time to Change Our Models - EuroSTAR 2013
PDF
Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013
Jouri Dufour - How About Security Testing - EuroSTAR 2013
Geoff & Emily Bache - Specification By Example With GUI Tests-How Could That ...
Alexandra Schladebeck - What Agile Teams Can Learn From World of Warcraft - E...
Morten Hougaard - Autism, A Benefit For Testing - EuroSTAR 2013
Rajesh Mathur - Testing in a Challenging Environment - EuroSTAR 2013
Ruud Teunissen - The Awful Truth About Estimation, Have I Been Wrong All Alon...
Pekka Marjamaki - Testing Me - EuroSTAR 2013
Paul Holland - How To Organise a Peer Conference - EuroSTAR 2013
Rob Lambert - Moving To Weekly Releases - EuroSTAR 2013
Alexandra Casapu - Fooled by Unknown Unknowns, A Success Story - EuroSTAR 2013
Remi Hansen - Test Strategies Are 90% Waste - EuroSTAR 2013
Albert Witteveen - With Cloud Computing Who Needs Performance Testing
Bob Harnisch & Tim Koomen - Mixing Waterfall, Agile & Outsourcing at Dutch Ra...
Zeger Van Hese - Testing in the Age of Distraction, The Importance of (De)foc...
Markus Gartner - Beyond Testing - EuroSTAR 2012
Jeanne Hofmans & Eduard Hartog - How to Test a Tunnel - EuroSTAR 2013
Soren Lynggaard & Pusser Janvit - How To Hire A True Tester - EuroSTAR 2013
Andy Glover - Testing is evolving, but where is the evidence - EuroSTAR 2012
Iain McCowatt - Automation Time to Change Our Models - EuroSTAR 2013
Emily Bache - Readable, Executable Requirements: Hands-On - EuroSTAR 2013
Ad

Similar to Julian Harty - Open Sourcing Testing - EuroSTAR 2012 (20)

PDF
Berkeley Method of Innovation Leadership
PPTX
How do we fix testing
PDF
Testing the unknown: the art and science of working with hypothesis
PPTX
Want a great job do your research webinar final
PPTX
Increasing Traffic Through Content Marketing
PPTX
Improving your innovation capability
PPTX
Разработка эффективной тестовой стратегии, Антон Семенченко
PPT
Beyond the paper cv and developing a scientific profile online
PDF
[HCMC STC Jan 2015] Creating a Better Testing Future
PPTX
Exploratory testing part 1
PDF
The Evidence-Based Organization: A Platform for Innovation
PPT
How to get what you really want from Testing' with Michael Bolton
PDF
Have You Googled Yourself?
PPT
PPTX
Ria Sankar - How to Build Winning Products - Product School Bellevue - 83018
PPTX
Value Proposition – Case – Diagnostics for All
PPT
Making the Move from the Academic to the Commercial Lab: What You Should Kno...
PDF
Lean Startup 301
Berkeley Method of Innovation Leadership
How do we fix testing
Testing the unknown: the art and science of working with hypothesis
Want a great job do your research webinar final
Increasing Traffic Through Content Marketing
Improving your innovation capability
Разработка эффективной тестовой стратегии, Антон Семенченко
Beyond the paper cv and developing a scientific profile online
[HCMC STC Jan 2015] Creating a Better Testing Future
Exploratory testing part 1
The Evidence-Based Organization: A Platform for Innovation
How to get what you really want from Testing' with Michael Bolton
Have You Googled Yourself?
Ria Sankar - How to Build Winning Products - Product School Bellevue - 83018
Value Proposition – Case – Diagnostics for All
Making the Move from the Academic to the Commercial Lab: What You Should Kno...
Lean Startup 301
Ad

More from TEST Huddle (20)

PPTX
Why We Need Diversity in Testing- Accenture
PPTX
Keys to continuous testing for faster delivery euro star webinar
PPTX
Why you Shouldnt Automated But You Will Anyway
PDF
Being a Tester in Scrum
PDF
Leveraging Visual Testing with Your Functional Tests
PPTX
Using Test Trees to get an Overview of Test Work
PPTX
Big Data: The Magic to Attain New Heights
PPTX
Will Robots Replace Testers?
PPTX
TDD For The Rest Of Us
PDF
Scaling Agile with LeSS (Large Scale Scrum)
PPTX
Creating Agile Test Strategies for Larger Enterprises
PPTX
Is There A Risk?
PDF
Are Your Tests Well-Travelled? Thoughts About Test Coverage
PDF
Growing a Company Test Community: Roles and Paths for Testers
PDF
Do we need testers on agile teams?
PDF
How to use selenium successfully
PDF
Testers & Teams on the Agile Fluency™ Journey
PDF
Practical Test Strategy Using Heuristics
PDF
Thinking Through Your Role
PDF
Using Selenium 3 0
Why We Need Diversity in Testing- Accenture
Keys to continuous testing for faster delivery euro star webinar
Why you Shouldnt Automated But You Will Anyway
Being a Tester in Scrum
Leveraging Visual Testing with Your Functional Tests
Using Test Trees to get an Overview of Test Work
Big Data: The Magic to Attain New Heights
Will Robots Replace Testers?
TDD For The Rest Of Us
Scaling Agile with LeSS (Large Scale Scrum)
Creating Agile Test Strategies for Larger Enterprises
Is There A Risk?
Are Your Tests Well-Travelled? Thoughts About Test Coverage
Growing a Company Test Community: Roles and Paths for Testers
Do we need testers on agile teams?
How to use selenium successfully
Testers & Teams on the Agile Fluency™ Journey
Practical Test Strategy Using Heuristics
Thinking Through Your Role
Using Selenium 3 0

Recently uploaded (20)

DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
cuic standard and advanced reporting.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Machine learning based COVID-19 study performance prediction
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
The AUB Centre for AI in Media Proposal.docx
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Understanding_Digital_Forensics_Presentation.pptx
cuic standard and advanced reporting.pdf
Encapsulation_ Review paper, used for researhc scholars
Unlocking AI with Model Context Protocol (MCP)
Chapter 3 Spatial Domain Image Processing.pdf
20250228 LYD VKU AI Blended-Learning.pptx
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Programs and apps: productivity, graphics, security and other tools
Network Security Unit 5.pdf for BCA BBA.
Machine learning based COVID-19 study performance prediction
The Rise and Fall of 3GPP – Time for a Sabbatical?
NewMind AI Weekly Chronicles - August'25 Week I
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
Mobile App Security Testing_ A Comprehensive Guide.pdf
Advanced methodologies resolving dimensionality complications for autism neur...

Julian Harty - Open Sourcing Testing - EuroSTAR 2012

  • 1. OPEN SOURCING TESTING EUROSTAR 2012 CONFERENCE 08 NOV 2012 JULIAN HARTY Contact me: julianharty@gmail.com
  • 2. MY AIM… To answer, in part What sorts of things would help us be better testers and do better testing?
  • 3. DEFINITIONS & SCOPE OPEN SOURCE
  • 4. OPEN SOURCE Public Available for Study, Use & Modification The Open Source Definition http://www.opensource.org/docs/osd
  • 5. OPEN SOURCE TESTING Publish • Charters, Tests, … • Environment • Data • Techniques • Results • Assessment • Code PERMISSIVE COLLABORATIVE
  • 6. STATE OF THE NATION HEADLINES
  • 7. HEADLINES Certification schemes Best Practices Death of the Tester: James Whittaker • StarWest 2011 - All That Testing is Getting in the Way of Quality • http://www.youtube.com/watch?v=yOrPuMCdVXA The Future of Quality: Goranka Bjedov • http://www.belgiumtestingdays.com/program.php?p=12 The growth of open source test automation tools • Mobile test automation • Web test automation
  • 8. WHY? Enlightened self-interest Professionalism / Engineering Practices Improving the craft Renovate our testing Feedback loops
  • 9. OPEN SOURCE TESTING SIMILAR PRACTICES
  • 10. SIMILAR PRACTICES EXPERIENTIAL Peer Workshops Let’s Test Conference EVIDENCE Scientific Method (in Software Testing) Open Data PRACTICE Code Retreats Test Automation Workshop Hackathons SHARING Open Innovation Blogs Open publications
  • 11. WHAT IS SCIENCE? C Weidemann’s material at Let’s Test 2012
  • 12. OPEN DATA Government Initiatives • http://data.gov.uk/ • Freedom of Information Act Scientific Initiatives • Distinguish Publishing Data from Publishing Papers http://www.springerlink.com/content/m15520un02772l61/fulltext.pdf
  • 14. WE’RE SPECIAL… REALLY? We like to believe we are • special, • unusual, • better than average[1] [1] "all the women are strong, all the men are good looking and all the children are above average," Garrison Keillor: Lake Woebegon http://www.randomhouse.com/kvpa/gilbert/
  • 17. COMPETITIVE ADVANTAGE WHAT DOES IT DO? CONCERNS Political aspects? Who are our competitors? Who are we competing with? EFFECTS Acceleration First among equals Exhilaration Stimulating Exhausting Scary?
  • 18. COMPETITIVE ADVANTAGE WHO ARE WE COMPETING WITH?
  • 20. BENEFITS SCOPE Me Team Project Company Country Community Industry STAKEHOLDERS Testers Business Boss Customers End Users
  • 21. BENEFITS Repeatability Review Correction Refinement & Enhancement Community education Attracting better people to your organisation? Freedom to invest & reap the rewards of the investment Evolution vs. Repetition
  • 22. OPEN SOURCE TESTING HOW MUCH IS ENOUGH?
  • 23. HOW MUCH IS ENOUGH? Levels 0. Sufficient to assess and reproduce 1. Permit modification and enhancement 2. Encourage competition Minimum Investment? • Multiples of 30 minutes[1] • Flows of investment [1][ http://www.pomodorotechnique.com/book/
  • 24. OPEN SOURCE TESTING THINGS TO CONSIDER
  • 25. CONCERNS TO CONSIDER Protecting • Privacy • Secret Sauce Overcoming • Stiction, Lethargy, Vested interests, Employment contracts Risking • What are we gambling? • What are we afraid of? New practices and business models Not a panacea • Open not necessarily High Quality!
  • 26. SUCCESS FACTORS Sustainability Benign Dictators What do you want to optimise situations and outcomes for? Merit-based feedback sqa.stackexchange.com Ask “What can I share?” that doesn’t risk “too much” Maintaining and encouraging good quality
  • 27. OPEN SOURCE TESTING SUPPORTING MATERIAL
  • 28. SUPPORTING MATERIAL Legal Structures • Creative Commons • Free and Open Source Software (FOSS) Licenses
  • 29. OPEN SOURCE TESTING IF NOT NOW, WHEN? http://en.wikipedia.org/wiki/Hillel_the_Elder
  • 30. IF NOT YOU, WHO? Opening the Kimono • Be open and be open to correction • The tester, tested? Breaking stupid rules for smart results http://www.gutenberg.org/files/18735/18735-h/18735-h.htm http://www.hackingwork.com/wp-content/uploads/HWChaps1-4.pdf
  • 31. THE UNASKED QUESTIONS OVER TO YOU Contact me: julianharty@gmail.com