SlideShare a Scribd company logo
Reading, October 7th 2016
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 1
JSON, XML
Selenium
Sikuli
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 2
 Unit tests: maximum granularity
◦ Assert 2=sum(1,1)
 Quick
 Same codebase
 Immediate feedback
 Need knowledge of the code
 Minimal functional meaning
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 3
 Collection of related Unit Tests
 Still need to have codebase knowledge
 Enhanced functional meaning… but not
complete!
 Still quick and immediate feedback
◦ TestCalculator(a,b,x,y,z…)
◦ Assert x=sum(a,b)
◦ Assert y=prod(a,b)
◦ Assert z=div(a,b)
◦ ….
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 4
 Contract based
 Requirements come into play: functional tests
 Inputs and outputs to full system (E2E) /
components / single component
 Different approaches:
◦ Large inputs: Data Driven Framework
◦ Behaviour Driven Framework: cucumber, jbehave
◦ Keyword Driven Framework
ALL OF THEM COMBINED!
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 5
 Full system End to End, functional tests
 Costly: time, tools, development
 Must be kept SIMPLE
 Flaky!
 Combined with Behaviour, Data Driven or
Keyword driven frameworks
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 6
 How many tests?
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 7
“AS MANY AS NEEDED,
AS LITTLE AS
NECESSARY”
 Decision making process:
◦ What is the impact of not having a test?
◦ What is the cost of building it?
◦ Time constraints?
◦ Tools needed?
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 8
£
 “Why did the automation not detect this?”
 “Will it be 100% automated?”
 “We won’t need manual test”
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 9
EXPLORATORY
TESTING!!
 Test environments challenge
◦ Use of DOCKER
 Performance testing
◦ Gatling
 Continuous Integration challenge
◦ Continuous testing
◦ Automated release build
◦ Speed up of releases
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 10
 NLP Frameworks?
 Machine Learning
 Self correcting software?
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 11
 Counting goals!
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 12
 Risk?
 Approaches:
◦ Unit tests
◦ Data driven
◦ Behaviour driven
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 13
 Unit tests
 :assertEquals(“1-3”, scoreGoal(HOME))…
 All the possible cases?
 Scope? Input, output
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 14
 Data driven framework
 Run the last 20? Man U – Arsenal games
 Assert scores
 Is data complete? Penalties, extra time…
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 15
 Behaviour Driven framework
 Team involvement – business!
 All speak the same language?
 Ambiguity? Duplicity?
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 16
 Keyword driven framework
 Similar to behaviour driven
 Free “syntax”
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 17
07/10/2016
David Montero - Challenges and
Approaces to Automation Testing
of Software 18

More Related Content

PPTX
Experience and best practices from automated software testing in the finance ...
PPTX
Thesis presentation over Web Development
PPTX
Smart : Comprehensive and unified framework for test automation of web and mo...
PDF
Software Testing Interview Questions & Answers | Edureka
PDF
Senior iOS Developer
PPT
Test Automation Demonstration with Dr Yongyan Wang by XBOSoft
DOCX
Mydhili_Resume_EXP
DOCX
lknight.res -04052015
Experience and best practices from automated software testing in the finance ...
Thesis presentation over Web Development
Smart : Comprehensive and unified framework for test automation of web and mo...
Software Testing Interview Questions & Answers | Edureka
Senior iOS Developer
Test Automation Demonstration with Dr Yongyan Wang by XBOSoft
Mydhili_Resume_EXP
lknight.res -04052015

What's hot (20)

DOCX
Resume Sanjeevan S Rawat
PPTX
Automating Common Criteria
DOC
vinayak chavan-tester
PDF
Top 50 Software Testing Interview Questions & Answers | Edureka
PPTX
DOC
Swati_Jain Resume
PDF
CV_LuisMorales_03_2016
PDF
best selenium training institute in Hyderabad
PDF
Test Automation Interview Questions and Answers | Edureka
PDF
How To Write A Test Case In Software Testing | Edureka
PPTX
Istqb foundation-and-selenium-java-automation-testing course
DOC
Resume
DOCX
dhiraj_ghavate
DOCX
Fresher interview question for software testing (QA) manual + basic automation
DOCX
PPTX
Selenium training eduxfactor
PDF
Top 50 Performance Testing Interview Questions | Edureka
PDF
PMBOK® Guide Edition 5 vs 6 | Edureka
PPTX
IGT's Intelligent Automation Framework
PPT
Test Automation
Resume Sanjeevan S Rawat
Automating Common Criteria
vinayak chavan-tester
Top 50 Software Testing Interview Questions & Answers | Edureka
Swati_Jain Resume
CV_LuisMorales_03_2016
best selenium training institute in Hyderabad
Test Automation Interview Questions and Answers | Edureka
How To Write A Test Case In Software Testing | Edureka
Istqb foundation-and-selenium-java-automation-testing course
Resume
dhiraj_ghavate
Fresher interview question for software testing (QA) manual + basic automation
Selenium training eduxfactor
Top 50 Performance Testing Interview Questions | Edureka
PMBOK® Guide Edition 5 vs 6 | Edureka
IGT's Intelligent Automation Framework
Test Automation
Ad

Viewers also liked (14)

PPTX
Método de investigación
DOCX
Informatica en grupo
DOCX
Deontologia 3 hojas
PPTX
Tecnologia de la comunicación
PPTX
Smart city
PPTX
Governors
PPTX
A combizmok kvantitatív MR vizsgálata excentrikus és nyújtásos-rövidüléses ko...
PPT
науково практична конференція
PPTX
Hvordan spille kant i håndball
PPTX
Investigación cualitativa y cuantitativa
PDF
5 hojas deontologia
PDF
Tryo bags presentaion no MRP
PDF
Signing up in sound of space
Método de investigación
Informatica en grupo
Deontologia 3 hojas
Tecnologia de la comunicación
Smart city
Governors
A combizmok kvantitatív MR vizsgálata excentrikus és nyújtásos-rövidüléses ko...
науково практична конференція
Hvordan spille kant i håndball
Investigación cualitativa y cuantitativa
5 hojas deontologia
Tryo bags presentaion no MRP
Signing up in sound of space
Ad

Similar to Challenges and approaches to automating testing of software (20)

PPT
Test planning and software's engineering
PPT
Software Testing 1198102207476437 4
PPT
Software Testing
PDF
The Pothole of Automating Too Much
PDF
A Comparative Guide to Automation and Manual Testing.pdf
PPT
Designing a Test Automation Framework By Quontra solutions
PPTX
unit-5 SPM.pptx
PDF
Abstraction Layers Test Management Summit Faciliated Session 2014
PPT
Test Automation Framework Online Training by QuontraSolutions
PDF
Best automation testing service providers in Ahmedabad
PDF
Functional and Non-functional Test automation
PDF
Test Automation for Data-Centric Applications
PPTX
5. Automation Testing.pptxSoftawre Quality
PPTX
Automated testing
PDF
TLC2018 Thomas Haver: The Automation Firehose - Be Strategic and Tactical
PDF
Capstone-Project-Apply-Automation-Testing.pdf
PPTX
Top Ten Tips for Tackling Test Automation Webinar Presentation.pptx
PPTX
Real Testing Scenario Strategy - Bringing It All Together For Success
PDF
Lessons Learned When Automating
PPTX
Introduction to Automation Testing
Test planning and software's engineering
Software Testing 1198102207476437 4
Software Testing
The Pothole of Automating Too Much
A Comparative Guide to Automation and Manual Testing.pdf
Designing a Test Automation Framework By Quontra solutions
unit-5 SPM.pptx
Abstraction Layers Test Management Summit Faciliated Session 2014
Test Automation Framework Online Training by QuontraSolutions
Best automation testing service providers in Ahmedabad
Functional and Non-functional Test automation
Test Automation for Data-Centric Applications
5. Automation Testing.pptxSoftawre Quality
Automated testing
TLC2018 Thomas Haver: The Automation Firehose - Be Strategic and Tactical
Capstone-Project-Apply-Automation-Testing.pdf
Top Ten Tips for Tackling Test Automation Webinar Presentation.pptx
Real Testing Scenario Strategy - Bringing It All Together For Success
Lessons Learned When Automating
Introduction to Automation Testing

Challenges and approaches to automating testing of software

  • 1. Reading, October 7th 2016 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 1
  • 2. JSON, XML Selenium Sikuli 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 2
  • 3.  Unit tests: maximum granularity ◦ Assert 2=sum(1,1)  Quick  Same codebase  Immediate feedback  Need knowledge of the code  Minimal functional meaning 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 3
  • 4.  Collection of related Unit Tests  Still need to have codebase knowledge  Enhanced functional meaning… but not complete!  Still quick and immediate feedback ◦ TestCalculator(a,b,x,y,z…) ◦ Assert x=sum(a,b) ◦ Assert y=prod(a,b) ◦ Assert z=div(a,b) ◦ …. 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 4
  • 5.  Contract based  Requirements come into play: functional tests  Inputs and outputs to full system (E2E) / components / single component  Different approaches: ◦ Large inputs: Data Driven Framework ◦ Behaviour Driven Framework: cucumber, jbehave ◦ Keyword Driven Framework ALL OF THEM COMBINED! 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 5
  • 6.  Full system End to End, functional tests  Costly: time, tools, development  Must be kept SIMPLE  Flaky!  Combined with Behaviour, Data Driven or Keyword driven frameworks 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 6
  • 7.  How many tests? 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 7 “AS MANY AS NEEDED, AS LITTLE AS NECESSARY”
  • 8.  Decision making process: ◦ What is the impact of not having a test? ◦ What is the cost of building it? ◦ Time constraints? ◦ Tools needed? 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 8 £
  • 9.  “Why did the automation not detect this?”  “Will it be 100% automated?”  “We won’t need manual test” 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 9 EXPLORATORY TESTING!!
  • 10.  Test environments challenge ◦ Use of DOCKER  Performance testing ◦ Gatling  Continuous Integration challenge ◦ Continuous testing ◦ Automated release build ◦ Speed up of releases 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 10
  • 11.  NLP Frameworks?  Machine Learning  Self correcting software? 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 11
  • 12.  Counting goals! 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 12
  • 13.  Risk?  Approaches: ◦ Unit tests ◦ Data driven ◦ Behaviour driven 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 13
  • 14.  Unit tests  :assertEquals(“1-3”, scoreGoal(HOME))…  All the possible cases?  Scope? Input, output 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 14
  • 15.  Data driven framework  Run the last 20? Man U – Arsenal games  Assert scores  Is data complete? Penalties, extra time… 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 15
  • 16.  Behaviour Driven framework  Team involvement – business!  All speak the same language?  Ambiguity? Duplicity? 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 16
  • 17.  Keyword driven framework  Similar to behaviour driven  Free “syntax” 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 17
  • 18. 07/10/2016 David Montero - Challenges and Approaces to Automation Testing of Software 18

Editor's Notes

  • #3: Reverse pyramid ? One of the many pyramids… the one I like most