Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing
1 like361 views
The document discusses best practices for end-to-end web application testing, emphasizing the importance of automated testing in enhancing application quality, customer satisfaction, and team morale. It outlines various testing strategies, including the use of specific tools and frameworks, along with the integration of testing into continuous integration processes. Additionally, it highlights the types of tests conducted, execution infrastructure, and the significance of test design.
Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing
- 1. Continuous Testing Odyssey: Learn Best Practices for End-to-End WebApp Testing Subu Baskaran, Sr. Product Manager at Sencha Titus Fortner, Solutions Architect at Sauce Labs
- 2. CONFIDENTIAL • Sencha Inc. ©2016 Web Application - Automated Testing • Set Business Quality Goals • Time to Market • Customer Satisfaction • Application Longevity • Repercussions of No-Automation Strategic • Define ROI • Timeline • Current Team Setup • Application Maturity • Test Design • Finally, Which Tool? Tactical
- 3. CONFIDENTIAL • Sencha Inc. ©2016 Why Test • Good Quality Boosts Value of Business • Increases Longevity of Application • Boosts Team Morale • Good Product == Happy Customer
- 4. CONFIDENTIAL • Sencha Inc. ©2016 Quality First - Ext JS Framework Testing FrameworkTests Data Total number of tests executed across different framework versions 420,000 (approximately) Total number of virtual machines (VM) used for test execution in parallel 50 Execution infrastructure Sauce Labs Types of tests executed Unit, Integration, End-to-End Test Execution Time 20 Minutes – 1 Hour* Tests Executed Every PR, Every Continuous Build, Nightly CI tool TeamCity Test Framework Used Jasmine, Selenium with Test Runner built in-house (grandfather of stc)
- 5. CONFIDENTIAL • Sencha Inc. ©2016 Sencha Process Developer submits PR Bot monitors for source code changes Kicks off tests by merging PR against branch Approve PR if no failure Repeat actions for PRs from all developers Run continuous build once PRs are merged with the master
- 6. CONFIDENTIAL • Sencha Inc. ©2016 Test Execution • Concurrent test runs speeds up test execution • Split up tests into smaller chunks into multiple VMs • Result aggregation at the end of execution
- 7. CONFIDENTIAL • Sencha Inc. ©2016 Automated Testing
- 8. CONFIDENTIAL • Sencha Inc. ©2016 How to Test • Test Design • Separation of Concerns • Pragmatic Approach • Remember: 100% Automation is NOT the Goal
- 9. CONFIDENTIAL • Sencha Inc. ©2016 Test Design 9
- 10. CONFIDENTIAL • Sencha Inc. ©2016 Types of Test • Rendered • Visible • EnabledDisabled • Visual Testing • Text UI Components • Correct Price is Displayed • Grid Shows the Right Value • Form Displays the Correct Content • Workflow Progression Business Logic
- 11. CONFIDENTIAL • Sencha Inc. ©2016 Finding Elements Common Traps • ID • XPath • CSS Selector Angular • by.model • by.binding • by.css Ext JS • xtype • ItemID
- 12. CONFIDENTIAL • Sencha Inc. ©2016 Test Automation in DevOps • One Step Integration With CI Tools • Run Tests on Browser Farms Leveraging Multiple Machines • Unattended Test Execution • Storage of Results in Centralized Location • Results Analysis in Matrix Format Continuous Integration
- 13. Demo
- 14. Resources • Visit the Sencha booth at SauceCon June 6-8 in San Francisco • Learn more about Sencha Test: https://www.sencha.com/products/test/#overview • Try Sencha Test Free for 30 Days: https://www.sencha.com/products/test/evaluate/ • Read our Whitepaper The Evolving Landscape of Web Application Testing: https://www.sencha.com/wp-content/uploads/2016/05/The-Evolving-Landscape-of-Web- Application-Testing-white-paper-screen.pdf
- 15. Q&A
- 16. Thank You!