SlideShare a Scribd company logo
Future of Test Automation
    Tools & Infrastructure

                Anand Bagmar
                ThoughtWorks
Evolution
            Custom frameworks




            Record & Playback




                  Core
               Framework
Custom Frameworks




         • Hybrid
Evolution
              What is next?


             Behavior Driven
            Development (BDD)

                 Custom
               Frameworks

                Record &
                Playback




                  Core
               Framework
UI advancements !!!
The present!!!
Web catching up …
The future!!!
Gesture based
technology
Spatial operating environment
 Professor John Underkoffler - MIT
Sixth Sense Technology
 Pranav Mistry
What this means for us?

What we need to do?

    AND ….



Think big!!
UDD
UI Driven Development
Features
  • Discovery                            • Execute tests
  • Author                                • From within or
                                            command line
  • Publish                               • Create run command
  • Plugin Manager                        • Remote machine(s) or
                                            locally
                        IDE    Runtime




                       Debug   Report

  • Regular debugger                     • Result Analysis
    functions                            • Charts & Graphs
  • Advanced                             • Archive
    debugger
Plugins
                                                Scheduling
                                                             Language /
                                    Test data
                                                             framework
                                   generators
                                                               agnostic

                                                                           Integration
                     Custom
                                                                          with external
                   Reporting –
                                                                             tools &
                  Trend analysis
                                                                          repositories



      Discovery
                                                                                          Omniture
        tools
                                                                                           Testing




xPath Utilities
                                                UDD                                             …
Get credentials


Discovery
                                        Get credentials     from external
                                                             user data file


                             Login      Go to login page



                                             Login


                                                           Get criteria from
                                          Get search
                                                           external search
                                           criteria
                                                               data file


                            Search           Query
            Search & buy
               ticket
                                         Return results



                                             Login



                                          Select ticket    Get search results


                                          Enter ticket
                           Buy ticket
                                            details

                                                            Get card details
                                        Enter payment
                                                             from external
                                           options
                                                                data file


                                           Checkout
Creating new Tests                              Enter
                                               criteria


      Load                            View
      page                           results
                                                       Make
                     Login                           selection
                                                       from
                                                      results




            Select
            ticket           Login
  Enter
  ticket                       Search
  details
                Checkout         Checkout
How do we get there?

• Write better structured / layered code
• Reusability – productize it
• Use external libraries instead of copying the
 code directly.
Example 1 – Omniture Testing
• Generic approach
• Minimum existing test modification
  Omniture_Methods.setRequiresOmnitureTesting();

• Test data defined in easy-to-understand XML
• Can test multiple set of Omniture sections.
• Extracted into a jar for easier reuse.
Example 2 – Custom Listener
• Control test execution flow
• Handle test dependencies
• Critical Test Failures
• Richer reports
Example 3 – Reporting
• Provide visibility “due” for Test automation
• Use the metrics that matter
• Subscription / RSS feed
• Archive
Future of test automation tools & infrastructure

More Related Content

PDF
Future of Testing, Test Automation and The Quality Analyst
PDF
10 Deployments a day - A brief on extreme release protocols
PDF
My First Year in Search@Naukri
PDF
Q con shanghai2013-罗婷-performance methodology
PDF
HCLT Brochure: E-Discovery and Document Review Solutions
PDF
Data Design
PPT
AiRS - ABITS technical introduction (2002)
Future of Testing, Test Automation and The Quality Analyst
10 Deployments a day - A brief on extreme release protocols
My First Year in Search@Naukri
Q con shanghai2013-罗婷-performance methodology
HCLT Brochure: E-Discovery and Document Review Solutions
Data Design
AiRS - ABITS technical introduction (2002)

Similar to Future of test automation tools & infrastructure (20)

PDF
Software QA Metrics Dashboard Benchmarking
PDF
How Salesforce.com Uses Hadoop
PDF
fiwalk With Me: Building Emergent Pre-Ingest Workflows for Digital Archival R...
PPTX
Inventory & Troubleshooting
PDF
Using the LucidWorks REST API to Support User-Configuration Big Data Search E...
PPTX
Sizing Your Software: A Fast Path Approach
PDF
Design For Testability
PPTX
Persistent Analytical Instrumentation Expertise
PDF
Ow2 Open World Forum09 Trustie Project
 
PDF
ezDL Flyer
PPTX
Study of solution development methodology for small size projects.
PPTX
Centralizing sequence analysis
PDF
January 2006 Document Scanning Considerations Presentation
PDF
Minesoft Presentation
PDF
Workshop 1 revised
PPTX
CYBER INTELLIGENCE & RESPONSE TECHNOLOGY
PDF
Value Reference Model - Information and Knowledge Mgt
PPTX
E clinical solutions irug 2012 12sep2012
PDF
Test Automation for Data Warehouses
PPTX
Session #1: Development Practices And The Microsoft Approach
Software QA Metrics Dashboard Benchmarking
How Salesforce.com Uses Hadoop
fiwalk With Me: Building Emergent Pre-Ingest Workflows for Digital Archival R...
Inventory & Troubleshooting
Using the LucidWorks REST API to Support User-Configuration Big Data Search E...
Sizing Your Software: A Fast Path Approach
Design For Testability
Persistent Analytical Instrumentation Expertise
Ow2 Open World Forum09 Trustie Project
 
ezDL Flyer
Study of solution development methodology for small size projects.
Centralizing sequence analysis
January 2006 Document Scanning Considerations Presentation
Minesoft Presentation
Workshop 1 revised
CYBER INTELLIGENCE & RESPONSE TECHNOLOGY
Value Reference Model - Information and Knowledge Mgt
E clinical solutions irug 2012 12sep2012
Test Automation for Data Warehouses
Session #1: Development Practices And The Microsoft Approach
Ad

More from Anand Bagmar (20)

PDF
The Path to Autonomous Testing - Anand Bagmar
PDF
My Journey With Appium @AppiumConf Sept 2024
PDF
Streamlining End-to-End Testing Automation
PDF
Eradicate Flaky Tests
PDF
Automating the real-user scenarios across multi-apps, and multi-devices
PDF
Visual Validation - The missing tip of the automation pyramid @GoT2022
PDF
Design Patterns in Automation
PDF
Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
PDF
Rewrite vs Refactor (AgileIndia 2021)
PDF
Next Generation Functional & Visual Testing powered by AI
PDF
The Best Test Automation Framework is...
PDF
Eradicate Flaky Tests - AppiumConf 2021
PDF
Getting started with Appium 2.0
PDF
Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
PDF
Selenium Deep Dive
PDF
Does your functional automation really add value?
PDF
Measuring Coverage From E2E Tests
PDF
Getting started with Visual Testing using Applitools - @TPC, Feb2020
PDF
Visual validation - The missing tip of the automation pyramid @ QA Symposium
PDF
Collaboration - A Taboo!
The Path to Autonomous Testing - Anand Bagmar
My Journey With Appium @AppiumConf Sept 2024
Streamlining End-to-End Testing Automation
Eradicate Flaky Tests
Automating the real-user scenarios across multi-apps, and multi-devices
Visual Validation - The missing tip of the automation pyramid @GoT2022
Design Patterns in Automation
Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
Rewrite vs Refactor (AgileIndia 2021)
Next Generation Functional & Visual Testing powered by AI
The Best Test Automation Framework is...
Eradicate Flaky Tests - AppiumConf 2021
Getting started with Appium 2.0
Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
Selenium Deep Dive
Does your functional automation really add value?
Measuring Coverage From E2E Tests
Getting started with Visual Testing using Applitools - @TPC, Feb2020
Visual validation - The missing tip of the automation pyramid @ QA Symposium
Collaboration - A Taboo!
Ad

Recently uploaded (20)

PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
Big Data Technologies - Introduction.pptx
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
sap open course for s4hana steps from ECC to s4
PPTX
Cloud computing and distributed systems.
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
DOCX
The AUB Centre for AI in Media Proposal.docx
Reach Out and Touch Someone: Haptics and Empathic Computing
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Mobile App Security Testing_ A Comprehensive Guide.pdf
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Building Integrated photovoltaic BIPV_UPV.pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
MIND Revenue Release Quarter 2 2025 Press Release
Review of recent advances in non-invasive hemoglobin estimation
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
Big Data Technologies - Introduction.pptx
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
sap open course for s4hana steps from ECC to s4
Cloud computing and distributed systems.
NewMind AI Weekly Chronicles - August'25 Week I
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Per capita expenditure prediction using model stacking based on satellite ima...
The AUB Centre for AI in Media Proposal.docx

Future of test automation tools & infrastructure

  • 1. Future of Test Automation Tools & Infrastructure Anand Bagmar ThoughtWorks
  • 2. Evolution Custom frameworks Record & Playback Core Framework
  • 3. Custom Frameworks • Hybrid
  • 4. Evolution What is next? Behavior Driven Development (BDD) Custom Frameworks Record & Playback Core Framework
  • 9. Spatial operating environment  Professor John Underkoffler - MIT
  • 10. Sixth Sense Technology  Pranav Mistry
  • 11. What this means for us? What we need to do? AND …. Think big!!
  • 13. Features • Discovery • Execute tests • Author • From within or command line • Publish • Create run command • Plugin Manager • Remote machine(s) or locally IDE Runtime Debug Report • Regular debugger • Result Analysis functions • Charts & Graphs • Advanced • Archive debugger
  • 14. Plugins Scheduling Language / Test data framework generators agnostic Integration Custom with external Reporting – tools & Trend analysis repositories Discovery Omniture tools Testing xPath Utilities UDD …
  • 15. Get credentials Discovery Get credentials from external user data file Login Go to login page Login Get criteria from Get search external search criteria data file Search Query Search & buy ticket Return results Login Select ticket Get search results Enter ticket Buy ticket details Get card details Enter payment from external options data file Checkout
  • 16. Creating new Tests Enter criteria Load View page results Make Login selection from results Select ticket Login Enter ticket Search details Checkout Checkout
  • 17. How do we get there? • Write better structured / layered code • Reusability – productize it • Use external libraries instead of copying the code directly.
  • 18. Example 1 – Omniture Testing • Generic approach • Minimum existing test modification Omniture_Methods.setRequiresOmnitureTesting(); • Test data defined in easy-to-understand XML • Can test multiple set of Omniture sections. • Extracted into a jar for easier reuse.
  • 19. Example 2 – Custom Listener • Control test execution flow • Handle test dependencies • Critical Test Failures • Richer reports
  • 20. Example 3 – Reporting • Provide visibility “due” for Test automation • Use the metrics that matter • Subscription / RSS feed • Archive