SlideShare a Scribd company logo
A Sampling of Tools
Benefits and Challenges
Dawn Cannan
@dckismet
http://passionatetester.com
dcannan@gmail.com
George Dinwiddie
@gdinwiddie
iDIA Computing, LLC
gdinwiddie@idiacomputing.com
Agile Development Practices West 2011
Agile Testing Workshop
Tuesday, June 7, 2011
Check http://idiacomputing.com/publications.html for an updated
copy of these slides
“Okay, so I need test automation”
 “Test Automation” has many pieces
 Frameworks
 Runners
 Drivers (like Browser Drivers)
 Reporting tools
 Build Systems
 What do these all mean?
Understanding Your Needs
 Know your technology stack
 Development stack (database, web server, etc)
 Programming language(s)
 Who will be writing tests, and what are their skills?
 Who will be running tests?
 Who will need to see test results, and how?
Layers of Test Automation
Common Stacks
 HP Quick Test Pro (Editor, Runner, Reporter)
 FitNesse (Editor, Runner, Reporter)
 Eclipse/jUnit/Selenium/Hudson (Editor, Runner, Driver,
Reporter)
 Cucumber (Runner, Reporter)
 Robot Framework (Runner, Reporter)
UI Drivers
 Browser Drivers
 Selenium/WebDriver
 Watir
 Capybara
 HTMLUnit
 .NET Desktop Apps
 White
 Java
 Abbott
 SWTBot
 GUIDancer
Below-the-UI Drivers
 FitNesse
 Tests written in wiki page
 “Fixtures” that call directly out to source code
 Cucumber
 Tests written in plain text files
 Many languages: Java, Ruby, .NET
Selenium/WebDriver
public class Example {
public static void main(String[] args) {
WebDriver driver = new FirefoxDriver();
// And now use this to visit Google
driver.get("http://www.google.com");
// Find the text input element by its name
WebElement element = driver.findElement(By.name("q"));
// Enter something to search for
element.sendKeys(”Agile Testing Workshop");
// Submit the form. WebDriver will find the form using the element
element.submit();
// Check the title of the page
System.out.println("Page title is: " + driver.getTitle());
}
}
Cucumber
Feature: Google Search
As a casual internet user
I want to find some information about the Agile Testing Workshop
So that I can learn how to be the best tester I can be
Scenario: Search for Agile Testing Workshop
Given I am on the Google Home Page
When I search for ”Agile Testing Workshop"
Then I should see a link for SQE in the results
Robot Framework
Test Case Action Argument
Search for Agile Testing
Workshop
Go to the Google home
page
Search for Agile Testing Workshop
The results should
contain
A link for SQE
Common Challenges
And How to Tackle Them
Design of the System
 Older systems may not be written in a “testable” way
 Business logic may be scattered across multiple layers
 Try to find the separation, and find test cases that fit based on
where the logic is
 Try to push test cases as low-level as makes sense
Test Management/Organization
 Where will test cases be stored?
 How will suites of tests be executed, and when?
 How are they organized?
 Around components of the system?
 Around stories?
 Tests can be tagged in most automation systems
 Continuous Integration systems can execute groups of tests
Web Testing: Locators
 How to uniquely identify objects to interact with
 Sometimes, many identifiers are dynamic
 Xpath
 //div[contains(@class, ‘article-heading’)]
 CSS Selectors
 css=div.article-heading
Web Testing: Synchronizing
 Timing of rendering of objects with interacting with them
 Most common solution:
 Extensive use of “waitFor…” functions for each element
 Ajax can make this tricky
 Work with developers to be sure of what events are necessary to
track interesting objects
Questions?
Thank you!

More Related Content

PPTX
Web automation with Selenium for software engineers
PPT
Selenium Architecture
PPTX
Architecting test automation using selenium
PPTX
Whys and Hows of Automation
PPTX
How does Java 8 exert hidden power on Test Automation?
PPTX
2 selenium-aakar gupte
PDF
Mastering Test Automation: How to Use Selenium Successfully
PPTX
How to make your functional tests really quick
Web automation with Selenium for software engineers
Selenium Architecture
Architecting test automation using selenium
Whys and Hows of Automation
How does Java 8 exert hidden power on Test Automation?
2 selenium-aakar gupte
Mastering Test Automation: How to Use Selenium Successfully
How to make your functional tests really quick

What's hot (20)

PPT
Web testing with selenium and by quontra solutions
PPTX
AATC2016: Exploratory testing an API
KEY
Automated Battle Scars Se Conf 2011
PDF
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leadi...
PDF
Perils of Page-Object Pattern
PPTX
Selenium Camp 2016 - Effective UI tests scaling on Java
PPTX
Design patterns in web testing automation with WebDriver
PDF
Continuous Testing Meets the Classroom at Code.org
PPTX
Data driven Automation Framework with Selenium
PPT
Stepin evening presented
PDF
Evil testers guide to technical testing
PDF
How to Use Selenium, Successfully
PDF
Resume
PPTX
Brace yourself from automation death trap
PPTX
Agile2015: Explore with Intent - Self-Management
PPTX
TestWorksConf: Experience exploratory testing
PDF
Selenium Users Anonymous
PPTX
Software Automation Testing Introduction
PPTX
Protractor training
PPTX
SQL Injection Attacks - Is Your Data Secure? GroupBy Conference
Web testing with selenium and by quontra solutions
AATC2016: Exploratory testing an API
Automated Battle Scars Se Conf 2011
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leadi...
Perils of Page-Object Pattern
Selenium Camp 2016 - Effective UI tests scaling on Java
Design patterns in web testing automation with WebDriver
Continuous Testing Meets the Classroom at Code.org
Data driven Automation Framework with Selenium
Stepin evening presented
Evil testers guide to technical testing
How to Use Selenium, Successfully
Resume
Brace yourself from automation death trap
Agile2015: Explore with Intent - Self-Management
TestWorksConf: Experience exploratory testing
Selenium Users Anonymous
Software Automation Testing Introduction
Protractor training
SQL Injection Attacks - Is Your Data Secure? GroupBy Conference
Ad

Similar to A Sampling of Tools (20)

PDF
Testing Experience - Evolution of Test Automation Frameworks
PPTX
Browser Automated Testing Frameworks - Nightwatch.js
PPTX
Automation, Selenium Webdriver and Page Objects
PDF
Web Test Automation Framework - IndicThreads Conference
PPTX
#DOAW16 - DevOps@work Roma 2016 - Testing your databases
PDF
Acceptance & Functional Testing with Codeception - SunshinePHP 2016
ODP
Testing In Java
ODP
Testing In Java4278
PPT
Selenium-Webdriver With PHPUnit Automation test for Joomla CMS!
PPTX
Automated tests
PDF
Acceptance & Functional Testing with Codeception - Devspace 2015
PPTX
Testing ASP.NET - Progressive.NET
PPTX
Behavior Driven Development
PPTX
Mastering Test Automation: How To Use Selenium Successfully
PDF
Introduction to Selenium and Test Automation
PPTX
Automation - web testing with selenium
PPTX
Test automation within a scrum process
PPT
Pragmatic Parallels: Java and JavaScript
PPT
Trends in Agile Testing by Lisa Crispin
PDF
Software Quality and Test Strategies for Ruby and Rails Applications
Testing Experience - Evolution of Test Automation Frameworks
Browser Automated Testing Frameworks - Nightwatch.js
Automation, Selenium Webdriver and Page Objects
Web Test Automation Framework - IndicThreads Conference
#DOAW16 - DevOps@work Roma 2016 - Testing your databases
Acceptance & Functional Testing with Codeception - SunshinePHP 2016
Testing In Java
Testing In Java4278
Selenium-Webdriver With PHPUnit Automation test for Joomla CMS!
Automated tests
Acceptance & Functional Testing with Codeception - Devspace 2015
Testing ASP.NET - Progressive.NET
Behavior Driven Development
Mastering Test Automation: How To Use Selenium Successfully
Introduction to Selenium and Test Automation
Automation - web testing with selenium
Test automation within a scrum process
Pragmatic Parallels: Java and JavaScript
Trends in Agile Testing by Lisa Crispin
Software Quality and Test Strategies for Ruby and Rails Applications
Ad

More from Dawn Code (17)

PPT
Executable Specifications with FitNesse and Selenium
PPT
Executable Specifications with FitNesse and Selenium
PPTX
Testing in the Wild
PPTX
Fitting Organizational Structure
PDF
Pair development
PPTX
Remote Dev/Test Pairing
PPTX
Crowdsource Your Career
PPTX
How Low Can Your Tests Go
PPTX
Writing Maintainable Test Automation
PPTX
Exploratory testing part 2
PPTX
Exploratory testing part 1
PPTX
Exploratory testing part 3
PPTX
Agile and Exploratory Testing Jeopardy
PDF
Pair Development from the Trenches
PPTX
Page objects: the good, the bad, the ugly
PDF
Testing Legacy Apps Mindmap
PPTX
Testing Legacy Apps
Executable Specifications with FitNesse and Selenium
Executable Specifications with FitNesse and Selenium
Testing in the Wild
Fitting Organizational Structure
Pair development
Remote Dev/Test Pairing
Crowdsource Your Career
How Low Can Your Tests Go
Writing Maintainable Test Automation
Exploratory testing part 2
Exploratory testing part 1
Exploratory testing part 3
Agile and Exploratory Testing Jeopardy
Pair Development from the Trenches
Page objects: the good, the bad, the ugly
Testing Legacy Apps Mindmap
Testing Legacy Apps

Recently uploaded (20)

PDF
Odoo Companies in India – Driving Business Transformation.pdf
PPTX
WiFi Honeypot Detecscfddssdffsedfseztor.pptx
PPTX
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
PDF
Product Update: Alluxio AI 3.7 Now with Sub-Millisecond Latency
PDF
iTop VPN Crack Latest Version Full Key 2025
PDF
Design an Analysis of Algorithms I-SECS-1021-03
PDF
Salesforce Agentforce AI Implementation.pdf
PPTX
Weekly report ppt - harsh dattuprasad patel.pptx
PDF
Website Design Services for Small Businesses.pdf
PPTX
Embracing Complexity in Serverless! GOTO Serverless Bengaluru
PDF
Autodesk AutoCAD Crack Free Download 2025
PDF
Digital Systems & Binary Numbers (comprehensive )
PPTX
history of c programming in notes for students .pptx
PDF
EN-Survey-Report-SAP-LeanIX-EA-Insights-2025.pdf
PPTX
Computer Software and OS of computer science of grade 11.pptx
PDF
iTop VPN Free 5.6.0.5262 Crack latest version 2025
PDF
Cost to Outsource Software Development in 2025
PDF
Wondershare Filmora 15 Crack With Activation Key [2025
PPTX
Why Generative AI is the Future of Content, Code & Creativity?
PDF
Nekopoi APK 2025 free lastest update
Odoo Companies in India – Driving Business Transformation.pdf
WiFi Honeypot Detecscfddssdffsedfseztor.pptx
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
Product Update: Alluxio AI 3.7 Now with Sub-Millisecond Latency
iTop VPN Crack Latest Version Full Key 2025
Design an Analysis of Algorithms I-SECS-1021-03
Salesforce Agentforce AI Implementation.pdf
Weekly report ppt - harsh dattuprasad patel.pptx
Website Design Services for Small Businesses.pdf
Embracing Complexity in Serverless! GOTO Serverless Bengaluru
Autodesk AutoCAD Crack Free Download 2025
Digital Systems & Binary Numbers (comprehensive )
history of c programming in notes for students .pptx
EN-Survey-Report-SAP-LeanIX-EA-Insights-2025.pdf
Computer Software and OS of computer science of grade 11.pptx
iTop VPN Free 5.6.0.5262 Crack latest version 2025
Cost to Outsource Software Development in 2025
Wondershare Filmora 15 Crack With Activation Key [2025
Why Generative AI is the Future of Content, Code & Creativity?
Nekopoi APK 2025 free lastest update

A Sampling of Tools

  • 1. A Sampling of Tools Benefits and Challenges Dawn Cannan @dckismet http://passionatetester.com dcannan@gmail.com George Dinwiddie @gdinwiddie iDIA Computing, LLC gdinwiddie@idiacomputing.com Agile Development Practices West 2011 Agile Testing Workshop Tuesday, June 7, 2011 Check http://idiacomputing.com/publications.html for an updated copy of these slides
  • 2. “Okay, so I need test automation”  “Test Automation” has many pieces  Frameworks  Runners  Drivers (like Browser Drivers)  Reporting tools  Build Systems  What do these all mean?
  • 3. Understanding Your Needs  Know your technology stack  Development stack (database, web server, etc)  Programming language(s)  Who will be writing tests, and what are their skills?  Who will be running tests?  Who will need to see test results, and how?
  • 4. Layers of Test Automation
  • 5. Common Stacks  HP Quick Test Pro (Editor, Runner, Reporter)  FitNesse (Editor, Runner, Reporter)  Eclipse/jUnit/Selenium/Hudson (Editor, Runner, Driver, Reporter)  Cucumber (Runner, Reporter)  Robot Framework (Runner, Reporter)
  • 6. UI Drivers  Browser Drivers  Selenium/WebDriver  Watir  Capybara  HTMLUnit  .NET Desktop Apps  White  Java  Abbott  SWTBot  GUIDancer
  • 7. Below-the-UI Drivers  FitNesse  Tests written in wiki page  “Fixtures” that call directly out to source code  Cucumber  Tests written in plain text files  Many languages: Java, Ruby, .NET
  • 8. Selenium/WebDriver public class Example { public static void main(String[] args) { WebDriver driver = new FirefoxDriver(); // And now use this to visit Google driver.get("http://www.google.com"); // Find the text input element by its name WebElement element = driver.findElement(By.name("q")); // Enter something to search for element.sendKeys(”Agile Testing Workshop"); // Submit the form. WebDriver will find the form using the element element.submit(); // Check the title of the page System.out.println("Page title is: " + driver.getTitle()); } }
  • 9. Cucumber Feature: Google Search As a casual internet user I want to find some information about the Agile Testing Workshop So that I can learn how to be the best tester I can be Scenario: Search for Agile Testing Workshop Given I am on the Google Home Page When I search for ”Agile Testing Workshop" Then I should see a link for SQE in the results
  • 10. Robot Framework Test Case Action Argument Search for Agile Testing Workshop Go to the Google home page Search for Agile Testing Workshop The results should contain A link for SQE
  • 11. Common Challenges And How to Tackle Them
  • 12. Design of the System  Older systems may not be written in a “testable” way  Business logic may be scattered across multiple layers  Try to find the separation, and find test cases that fit based on where the logic is  Try to push test cases as low-level as makes sense
  • 13. Test Management/Organization  Where will test cases be stored?  How will suites of tests be executed, and when?  How are they organized?  Around components of the system?  Around stories?  Tests can be tagged in most automation systems  Continuous Integration systems can execute groups of tests
  • 14. Web Testing: Locators  How to uniquely identify objects to interact with  Sometimes, many identifiers are dynamic  Xpath  //div[contains(@class, ‘article-heading’)]  CSS Selectors  css=div.article-heading
  • 15. Web Testing: Synchronizing  Timing of rendering of objects with interacting with them  Most common solution:  Extensive use of “waitFor…” functions for each element  Ajax can make this tricky  Work with developers to be sure of what events are necessary to track interesting objects