The Path to Autonomous Testing - Anand Bagmar
0 likes688 views
The document discusses the evolution and future of autonomous testing, highlighting technologies like AI and behavior-driven development. It emphasizes the importance of integrating AI with human insight for effective automation while providing insights on the components and capabilities of modern test automation. The document also explores various technologies and use cases that could influence testing methodologies in the future.
The Path to Autonomous Testing - Anand Bagmar
- 1. @BagmarAnand @BagmarAnand @BagmarAnand The Path to Autonomous Testing Anand Bagmar Software Quality Bartender
- 3. @BagmarAnand @BagmarAnand @BagmarAnand Back to the Past 2010 3
- 4. @BagmarAnand @BagmarAnand @BagmarAnand https://www.youtube.com/watch?v=H5WeeYMGNLo 4
- 7. @BagmarAnand @BagmarAnand @BagmarAnand Have you seen any similar movies? 7
- 8. @BagmarAnand @BagmarAnand @BagmarAnand Have you seen similar applications? 8
- 13. @BagmarAnand @BagmarAnand @BagmarAnand Do you know what this is called? 13
- 16. @BagmarAnand @BagmarAnand @BagmarAnand Pointing to the future of UI https://www.ted.com/talks/john_underkoffler_pointing_to_the_future_of_ui 16
- 18. @BagmarAnand @BagmarAnand @BagmarAnand Interesting use cases & technologies Multi-touch interfaces Iris scanners Autonomous cars Insect robots Gesture recognition Personalized advertising Crime prediction software E-Papers Jet packs https://en.wikipedia.org/wiki/Technologies_in_Minority_Report 18
- 20. @BagmarAnand @BagmarAnand @BagmarAnand Sixth Sense – TED Talk by Pranav Mistry https://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology 20 @BagmarAnand
- 23. @BagmarAnand @BagmarAnand @BagmarAnand Gesture Controlled Interface https://www.youtube.com/watch?v=325W1F1WO_E 23 @BagmarAnand Concept of Future Technologies of Holographic Interfaces – Clark Caputo, 2020
- 29. @BagmarAnand @BagmarAnand @BagmarAnand Age of Robots! 29 https://en.wikipedia.org/wiki/Optimus_(robot), https://edition.cnn.com/2024/10/10/business/elon-musk-tesla-robotaxis/index.html
- 30. @BagmarAnand @BagmarAnand @BagmarAnand Age of Robots! 30 https://en.wikipedia.org/wiki/Optimus_(robot), https://edition.cnn.com/2024/10/10/business/elon-musk-tesla-robotaxis/index.html @BagmarAnand
- 31. @BagmarAnand @BagmarAnand @BagmarAnand How does any of this relate to why we are here??? 31
- 32. @BagmarAnand @BagmarAnand @BagmarAnand Testing & Test Automation 32
- 33. @BagmarAnand @BagmarAnand @BagmarAnand Testing & Test Automation 33
- 34. @BagmarAnand @BagmarAnand @BagmarAnand Testing & AI in Test Automation 34
- 37. @BagmarAnand @BagmarAnand @BagmarAnand What is next? Behavior Driven Development (BDD) Custom Frameworks Record & Playback Core Framework Evolution 37
- 38. @BagmarAnand @BagmarAnand @BagmarAnand Autonomous! Behavior Driven Development (BDD) Custom Frameworks Record & Playback Core Framework Evolution 38
- 39. @BagmarAnand @BagmarAnand @BagmarAnand Test Automation in the World of AI 39 https://external-content.duckduckgo.com/iu/?u=https%3A%2F%2Fimages.pexels.com%2Fphotos%2F39349%2Fteens-robot-future-science-39349.jpeg%3Fcs%3Dsrgb%26dl%3Dai-ausrustung-energie- 39349.jpg%26fm%3Djpg&f=1&nofb=1&ipt=9eca7b838ed028ea98625a48a0fe3d28525cf12114d
- 40. UDD UI Driven (Test) Development 40 @BagmarAnand https://miro.medium.com/v2/resize:fit:2000/1*47bsK-JkulWuJ_U8weyH-w.jpeg
- 41. @BagmarAnand @BagmarAnand @BagmarAnand Sidenote xDD Yet another “DD” practice! 41 https://miro.medium.com/v2/resize:fit:1400/1*NK0K9uG3pXMF5xZ2os3hCw.png
- 44. @BagmarAnand @BagmarAnand @BagmarAnand Path to Autonomous Testing Automatically Create test cases and scenarios based on requirements Automate the tests, in the best possible way Take decisions on the failures (RCA) Real time Insights of Quality! 44
- 45. UDD UI Driven (Test) Development 45 @BagmarAnand https://miro.medium.com/v2/resize:fit:2000/1*47bsK-JkulWuJ_U8weyH-w.jpeg
- 48. @BagmarAnand @BagmarAnand @BagmarAnand Design • Backlog Implement • Author • Maintain • Evolve Validate • Coverage • Functionality • UI/UX Execute • Scale • Self-heal • Repeat Take Decision • Analyse • Feedback Test Automation Lifecycle 48
- 49. Features & Capabilities • Quality Insights • Trend Analysis • Defects & Risks • Advanced debugger • RCA • Relevant artifacts • Execute tests at Scale • Resilient • External and Internal applications • Test Discovery • Create & Update • Exploratory Testing • UI, UX, API, Contract Author Execute Report Debug 49 @BagmarAnand
- 50. Features & Capabilities UDD Language agnostic Test data generator Self Healing & Resiliency CI & CD Test Discovery Analytics Load & Perf Security Insights & Trend analysis Defect Analysis Identify Risks Take Decisions ... 50 @BagmarAnand
- 51. Test Discovery Search & buy ticket Login Get credentials Get credentials from external user data file Go to login page Login Search Get search criteria Get criteria from external search file Query Return results Buy ticket Login Select ticket Get search results Enter ticket details Enter payment options Get card details from external data file Checkout https://semaphoreci.com/wp-content/uploads/2022/06/release-process-1056x393.jpg https://miro.medium.com/v2/resize:fit:1062/1*DfNjzyQKe4qM1Fg0d5i7UA.jpeg, https://media.licdn.com/dms/image/C5112AQFR9v3SLYDz6g/article-cover_image-shrink_600_2000/0/1525154069290?e=2147483647 51 Requirements Source code (product & test) Application @BagmarAnand
- 52. Creating new Tests Login Load page Make selection from results View results Enter criteria Checkout Enter ticket details Select ticket Login Search Checkout 52 @BagmarAnand
- 53. Creating new Tests Login Load page Make selection from results View results Enter criteria Checkout Enter ticket details Select ticket Login Search Checkout 53 https://media.licdn.com/dms/image/C5612AQFStp9D5G_m5w/article-cover_image-shrink_720_1280/0/1622462142820 @BagmarAnand
- 54. Creating new Tests Login Load page Make selection from results View results Enter criteria Checkout Enter ticket details Select ticket Login Search Checkout 54 https://media.licdn.com/dms/image/C5612AQFStp9D5G_m5w/article-cover_image-shrink_720_1280/0/1622462142820 @BagmarAnand Personas Multi-user/platform/device scenarios Concurrency!
- 55. Risk Mitigation 55 Search & buy ticket Login Get credentials Get credentials from external user data file Go to login page Login Search Get search criteria Get criteria from external search file Query Return results Buy ticket Login Select ticket Get search results Enter ticket details Enter payment options Get card details from external data file Checkout https://semaphoreci.com/wp-content/uploads/2022/06/release-process-1056x393.jpg https://miro.medium.com/v2/resize:fit:1062/1*DfNjzyQKe4qM1Fg0d5i7UA.jpeg, https://media.licdn.com/dms/image/C5112AQFR9v3SLYDz6g/article-cover_image-shrink_600_2000/0/1525154069290?e=2147483647 Requirements Source code (product & test) Application @BagmarAnand New Requirement
- 56. @BagmarAnand @BagmarAnand @BagmarAnand 56 UDD DOES NOT mean everything is automated at the UI Layer!
- 58. @BagmarAnand @BagmarAnand @BagmarAnand Build Vs Buy Vs Reuse 58
- 59. @BagmarAnand @BagmarAnand @BagmarAnand Leverage AI in Automation to help focus on what matters! 59
- 60. @BagmarAnand @BagmarAnand @BagmarAnand How to get to Autonomous Testing? Github CoPilot ChatGPT & similar Build your own LLMs Leverage the new Tools like
- 62. @BagmarAnand @BagmarAnand @BagmarAnand Path to Autonomous Development Creating product code based on requirements 62
- 63. @BagmarAnand @BagmarAnand @BagmarAnand Summary AI is NOT the solution (yet)! AI is a big part of getting to the solution! AI + Human Mind is the solution! 63