SlideShare a Scribd company logo
Testing Robots…
Testing of robots…
Testing with robots…
Nederlandse
testdag 2016
|
Who has a robot?
Nederlandse Testdag 2016 2
Who has a robot? In 10 years all of you will !!
|
Technology enters our lives… FAST!!
Nederlandse Testdag 2016 3
|
Robots in praktice
Over 50% of the dairy-
farms in the
Netherlands uses one
or more robots.
Nederlandse Testdag 2016 4
|
Manure robot
Nederlandse Testdag 2016 5
Low intelligence  for specific tasks
(“dull and/or dangerous”)
|
Milking robot
Nederlandse Testdag 2016 6
|
Social impact of robots
The farmer and his family can now have dinner together at 18:00 hours !!
Nederlandse Testdag 2016 7
De aardappeleters. Vincent van Gogh
|
Towards autonomous robots
Nederlandse Testdag 2016 9
Testing with robots
Testing Robots…
Nederlandse
Testdag 2016
|
Robot automatically performs regression tests
NL Testdag 2016 11
|
Robot automatically performs regression tests
Nederlandse Testdag 2016 12
|
Use robots for…
Nederlandse Testdag 2016 13
Functional testing
• Generate test cases
• Execute test cases
• Analyse the results
Brute-force testing
• Generate a huge number of test cases and
execute them
Non-functional testing
• Intelligent performance testen
(not just 10.000 times the same transaction)
|
Use robots for…
Nederlandse Testdag 2016 14
Big data analytics (using artificial intelligence)
• Analyse live data
• Generate relevant test data
Colaboration between human and machine
• Robot  repetative work
• Human creative work
Regression testing
• Robots are very good at repetative work!!
And so much more!!!!!
Testing Robots…
Testing of robots
Nederlandse
Testdag 2016
|
Different angles of quality for robotics
Nederlandse Testdag 2016 16
Mechanical
Electrical
Information
Processing
Machine
Intelligence
Business
Impact
Social
Impact
For these “traditional” tests we already
have the knowledge and experience
for decades.
|
Different angles of quality for robotics
Nederlandse Testdag 2016 18
Mechanical
Electrical
Information
Processing
Machine
Intelligence
Business
Impact
Social
Impact
new
new
new
|
Testing still has the well-know foundation
Nederlandse Testdag 2016 19
Quality
Risks
Confidence
Quality attributes
Analysis and mitigation
|
Different angles of quality for robotics
Nederlandse Testdag 2016 20
Mechanical
Electrical
Information
Processing
Machine
Intelligence
Business
Impact
Social
Impact
|
Machine learning
Nederlandse Testdag 2016 21
<<< vervangen door filmclip >>>
|
Testing machine learning: it’s about the input!!
Nederlandse Testdag 2016 22
The tester as “psychologist” of the intelligent machine
|
No more programming but training …
Nederlandse Testdag 2016 23
|
No more programming but training …
Nederlandse Testdag 2016 24
The tester as “trainer” of the intelligent machine
|
Different angles of quality for robotics
Nederlandse Testdag 2016 25
Mechanical
Electrical
Information
Processing
Machine
Intelligence
Business
Impact
Social
Impact
|
Testing still has the well-know foundation
Nederlandse Testdag 2016 26
Quality
Risks
Confidence
Quality characteristics
Analysis and mitigation
|
New risks having impact on business process
Nederlandse Testdag 2016 27
Product Risk Analysis
New risks
Well-known approach
Other outcoumes, for
• Test strategy
• Test techniques
• Test coverage
|
Image remains the highest impact-area…
Nederlandse Testdag 2016 28
|
When will self-driving cars be on the road?
In how many years do you expect a self-driving vehicle will be
allowed on the road in the Netherlands
Think of a number…
Who thinks in … years?
Nederlandse Testdag 2016 29
10
5
2
1
|
Sogeti has already tested a self-driving vehicle
The Wepod in
Wageningen
On the public
road since
October 2016 !!
Nederlandse Testdag 2016 30
|
Non-functionals become more important
TMap NEXT has 17 quality attributes
ISO9126 has 27 quality attributes
ISO25010 has 37 quality attributes
For “the new world” we have now made a list of
over 70 possible quaility attributes.
(work in progress)
Nederlandse Testdag 2016 31
ethics
embodiment
empathy
|
Different angles of quality for robotics
Nederlandse Testdag 2016 32
Mechanical
Electrical
Information
Processing
Machine
Intelligence
Business
Impact
Social
Impact
|
Augmented people
Nederlandse Testdag 2016 33
|
Will robots take over your job?
Source: www.pewinternet.org/2016/03/10/public -predictions-for-the-future-of-workforce-automation/ Nederlandse Testdag 2016 34
The tester as philosopher for applying new technology…
|
Different angles of quality for robotics
TMap dag 2016 35
Mechanical
Electrical
Information
Processing
Machine
Intelligence
Business
Impact
Social
Impact
Robots testing…
Existing foundations;
New possibilities and
additions!
Make sure you’re ready for it!
Nederlandse
Testdag 2016

More Related Content

PDF
Testing machine learning, learning machine testing. EuroSTAR 2016 Rik Marselis
PPTX
Newly released app: tap-tap-tap or crap?
PDF
Past het testvak nog in de nieuwe IT-wereld?
PDF
Webinar trends in testing 2017 03 08 (in dutch)
PDF
Robots testen bent u er klaar voor? TMap dag 2016 Rik Marselis
PDF
Exploratory testing by Rik Marselis
PDF
Fear the psychology of testing rik marselis
PDF
Robotesting, are you ready for that yet? 7WCSQ Rik Marselis
Testing machine learning, learning machine testing. EuroSTAR 2016 Rik Marselis
Newly released app: tap-tap-tap or crap?
Past het testvak nog in de nieuwe IT-wereld?
Webinar trends in testing 2017 03 08 (in dutch)
Robots testen bent u er klaar voor? TMap dag 2016 Rik Marselis
Exploratory testing by Rik Marselis
Fear the psychology of testing rik marselis
Robotesting, are you ready for that yet? 7WCSQ Rik Marselis

Similar to Testing OF robots and testing WITH robots. Netherlands testing day 2016 Rik Marselis (20)

PDF
Robotesting at Tricentis Accelerate 2017 by Rik Marselis
PDF
Testing in the digital age; international booklaunch at German Testing Day
PDF
EuroSTAR 2018 tutorial Rik Marselis Testing Intelligent Machines
PDF
How to test when robots become part of your process? Workshop robotesting agi...
PDF
Testing intelligent machines; approaches and techniques (QA&Test Bilbao 2018)
PDF
Intelligent Digital Mesh Testing
PPTX
Artificial Intelligence in testing - A STeP-IN Evening Talk Session Speech by...
PDF
Qx day2018 digital_quality_strategy_rik_marselis
PDF
Rise of the Machines: Can Artificial Intelligence Terminate Manual Testing?
PDF
Artificial Intelligence In Software Testing
PPTX
Will Robots Replace Testers?
PPTX
Testing and AI
PPTX
New Model Testing: A New Test Process and Tool
PDF
Sogetilabs webinar: Uniting Robotics and IT Testing
PDF
Testing in the digital age; AI makes the difference! Booklaunch Rik Marselis
PPTX
Carlos Kidman - Exploring AI Applications in Testing.pptx
PDF
Integrating AI in software quality in absence of a well-defined requirements
PPTX
AI in Test Automation
DOCX
How robotics helps manufacturing businesses
DOCX
Case study 6 chapter 111. 2. Answer the Case Study Questions (.docx
Robotesting at Tricentis Accelerate 2017 by Rik Marselis
Testing in the digital age; international booklaunch at German Testing Day
EuroSTAR 2018 tutorial Rik Marselis Testing Intelligent Machines
How to test when robots become part of your process? Workshop robotesting agi...
Testing intelligent machines; approaches and techniques (QA&Test Bilbao 2018)
Intelligent Digital Mesh Testing
Artificial Intelligence in testing - A STeP-IN Evening Talk Session Speech by...
Qx day2018 digital_quality_strategy_rik_marselis
Rise of the Machines: Can Artificial Intelligence Terminate Manual Testing?
Artificial Intelligence In Software Testing
Will Robots Replace Testers?
Testing and AI
New Model Testing: A New Test Process and Tool
Sogetilabs webinar: Uniting Robotics and IT Testing
Testing in the digital age; AI makes the difference! Booklaunch Rik Marselis
Carlos Kidman - Exploring AI Applications in Testing.pptx
Integrating AI in software quality in absence of a well-defined requirements
AI in Test Automation
How robotics helps manufacturing businesses
Case study 6 chapter 111. 2. Answer the Case Study Questions (.docx
Ad

More from Rik Marselis (19)

PDF
TMAP 30 years celebration at A4Q summit.
PDF
The End Of Testing As We Know It (TestCon - Rik Marselis).pdf
PPTX
TestExpo Quality Engineering & Sustainability
PDF
GTR-The End Of Testing As We Know It
PDF
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
PDF
Quality Engineering in today's cross-functTeams with TMAP
PDF
Quality engineering instead of testing... Why? How?
PDF
Quality Engineering and Testing with TMAP in DevOps IT delivery
PDF
Quality engineering & testing in DevOps IT delivery with TMAP
PDF
Quality engineering in DevOps... Why? How? (TestBusters Day&Night))
PDF
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
PDF
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
PDF
Quality for DevOps teams - Quality engineering in the DevOps culture
PDF
How to write a proposal to speak at a conference? Hints & tips
PDF
Testen ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik Marselis
PDF
Over testen gesproken TestNet najaar 2019 openingskeynote Rik Marselis
PDF
Testing of artificial intelligence; AI quality engineering skils - an introdu...
PDF
Webinar trends in testen 2017-12-13 door Rik Marselis
PDF
Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)
TMAP 30 years celebration at A4Q summit.
The End Of Testing As We Know It (TestCon - Rik Marselis).pdf
TestExpo Quality Engineering & Sustainability
GTR-The End Of Testing As We Know It
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
Quality Engineering in today's cross-functTeams with TMAP
Quality engineering instead of testing... Why? How?
Quality Engineering and Testing with TMAP in DevOps IT delivery
Quality engineering & testing in DevOps IT delivery with TMAP
Quality engineering in DevOps... Why? How? (TestBusters Day&Night))
TMAP Quality Engineering workshop on A4Q congress by Rik Marselis
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
Quality for DevOps teams - Quality engineering in the DevOps culture
How to write a proposal to speak at a conference? Hints & tips
Testen ISTQB, TMap, ISO25010 en meer. Gastcollege Windesheim Rik Marselis
Over testen gesproken TestNet najaar 2019 openingskeynote Rik Marselis
Testing of artificial intelligence; AI quality engineering skils - an introdu...
Webinar trends in testen 2017-12-13 door Rik Marselis
Ketenregie in Agile / DevOps: Noodzaak? (oplossing: Gilde, SAFe, combi ...)
Ad

Recently uploaded (20)

PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PPT
Teaching material agriculture food technology
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Approach and Philosophy of On baking technology
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Network Security Unit 5.pdf for BCA BBA.
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Machine learning based COVID-19 study performance prediction
PDF
Electronic commerce courselecture one. Pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PPTX
Cloud computing and distributed systems.
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
The Rise and Fall of 3GPP – Time for a Sabbatical?
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Teaching material agriculture food technology
Digital-Transformation-Roadmap-for-Companies.pptx
Approach and Philosophy of On baking technology
MYSQL Presentation for SQL database connectivity
Network Security Unit 5.pdf for BCA BBA.
“AI and Expert System Decision Support & Business Intelligence Systems”
Mobile App Security Testing_ A Comprehensive Guide.pdf
NewMind AI Weekly Chronicles - August'25 Week I
Machine learning based COVID-19 study performance prediction
Electronic commerce courselecture one. Pdf
Unlocking AI with Model Context Protocol (MCP)
Cloud computing and distributed systems.
Dropbox Q2 2025 Financial Results & Investor Presentation
Per capita expenditure prediction using model stacking based on satellite ima...
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Building Integrated photovoltaic BIPV_UPV.pdf

Testing OF robots and testing WITH robots. Netherlands testing day 2016 Rik Marselis

  • 1. Testing Robots… Testing of robots… Testing with robots… Nederlandse testdag 2016
  • 2. | Who has a robot? Nederlandse Testdag 2016 2 Who has a robot? In 10 years all of you will !!
  • 3. | Technology enters our lives… FAST!! Nederlandse Testdag 2016 3
  • 4. | Robots in praktice Over 50% of the dairy- farms in the Netherlands uses one or more robots. Nederlandse Testdag 2016 4
  • 5. | Manure robot Nederlandse Testdag 2016 5 Low intelligence  for specific tasks (“dull and/or dangerous”)
  • 7. | Social impact of robots The farmer and his family can now have dinner together at 18:00 hours !! Nederlandse Testdag 2016 7 De aardappeleters. Vincent van Gogh
  • 9. Testing with robots Testing Robots… Nederlandse Testdag 2016
  • 10. | Robot automatically performs regression tests NL Testdag 2016 11
  • 11. | Robot automatically performs regression tests Nederlandse Testdag 2016 12
  • 12. | Use robots for… Nederlandse Testdag 2016 13 Functional testing • Generate test cases • Execute test cases • Analyse the results Brute-force testing • Generate a huge number of test cases and execute them Non-functional testing • Intelligent performance testen (not just 10.000 times the same transaction)
  • 13. | Use robots for… Nederlandse Testdag 2016 14 Big data analytics (using artificial intelligence) • Analyse live data • Generate relevant test data Colaboration between human and machine • Robot  repetative work • Human creative work Regression testing • Robots are very good at repetative work!! And so much more!!!!!
  • 14. Testing Robots… Testing of robots Nederlandse Testdag 2016
  • 15. | Different angles of quality for robotics Nederlandse Testdag 2016 16 Mechanical Electrical Information Processing Machine Intelligence Business Impact Social Impact For these “traditional” tests we already have the knowledge and experience for decades.
  • 16. | Different angles of quality for robotics Nederlandse Testdag 2016 18 Mechanical Electrical Information Processing Machine Intelligence Business Impact Social Impact new new new
  • 17. | Testing still has the well-know foundation Nederlandse Testdag 2016 19 Quality Risks Confidence Quality attributes Analysis and mitigation
  • 18. | Different angles of quality for robotics Nederlandse Testdag 2016 20 Mechanical Electrical Information Processing Machine Intelligence Business Impact Social Impact
  • 19. | Machine learning Nederlandse Testdag 2016 21 <<< vervangen door filmclip >>>
  • 20. | Testing machine learning: it’s about the input!! Nederlandse Testdag 2016 22 The tester as “psychologist” of the intelligent machine
  • 21. | No more programming but training … Nederlandse Testdag 2016 23
  • 22. | No more programming but training … Nederlandse Testdag 2016 24 The tester as “trainer” of the intelligent machine
  • 23. | Different angles of quality for robotics Nederlandse Testdag 2016 25 Mechanical Electrical Information Processing Machine Intelligence Business Impact Social Impact
  • 24. | Testing still has the well-know foundation Nederlandse Testdag 2016 26 Quality Risks Confidence Quality characteristics Analysis and mitigation
  • 25. | New risks having impact on business process Nederlandse Testdag 2016 27 Product Risk Analysis New risks Well-known approach Other outcoumes, for • Test strategy • Test techniques • Test coverage
  • 26. | Image remains the highest impact-area… Nederlandse Testdag 2016 28
  • 27. | When will self-driving cars be on the road? In how many years do you expect a self-driving vehicle will be allowed on the road in the Netherlands Think of a number… Who thinks in … years? Nederlandse Testdag 2016 29 10 5 2 1
  • 28. | Sogeti has already tested a self-driving vehicle The Wepod in Wageningen On the public road since October 2016 !! Nederlandse Testdag 2016 30
  • 29. | Non-functionals become more important TMap NEXT has 17 quality attributes ISO9126 has 27 quality attributes ISO25010 has 37 quality attributes For “the new world” we have now made a list of over 70 possible quaility attributes. (work in progress) Nederlandse Testdag 2016 31 ethics embodiment empathy
  • 30. | Different angles of quality for robotics Nederlandse Testdag 2016 32 Mechanical Electrical Information Processing Machine Intelligence Business Impact Social Impact
  • 32. | Will robots take over your job? Source: www.pewinternet.org/2016/03/10/public -predictions-for-the-future-of-workforce-automation/ Nederlandse Testdag 2016 34 The tester as philosopher for applying new technology…
  • 33. | Different angles of quality for robotics TMap dag 2016 35 Mechanical Electrical Information Processing Machine Intelligence Business Impact Social Impact
  • 34. Robots testing… Existing foundations; New possibilities and additions! Make sure you’re ready for it! Nederlandse Testdag 2016