EXTENT-2016: Realisation of a Collaborative Approach to Test Automation
Download as PPTX, PDF0 likes1,571 views
This document discusses a case study of Clearstream's implementation of a collaborative approach to test automation. Key points include: Clearstream wanted to improve automation rates to meet business goals; a collaborative methodology was developed involving functional testers, technical teams, and tool vendors; Odin's Axe automation platform was selected and implemented on a project to automate testing of Clearstream's Xact web portal; the project achieved a 64.4% automation rate and identified lessons around defect management, naming conventions, and challenges automating new functionality.
EXTENT-2016: Realisation of a Collaborative Approach to Test Automation
- 1. Duncan Brigginshaw Co-Founder and Technical Director Odin Technology Ltd Realisation of a Collaborative Approach to Test Automation
- 2. Realisation of a Collaborative Approach to Test Automation www.odintech.com A case study in post-trade settlement and reconciliation at Clearstream Duncan Brigginshaw Co-Founder and Technical Director, Odin
- 3. www.odintech.com Agenda • Introduction • Background and Business drivers • Defining a collaborative approach to functional test automation • ClearstreamXact Portal and 1CSR Project • Lessons and Conclusions Duncan Brigginshaw Technical Director - Odin
- 4. www.odintech.com Introduction • Deutsche Börse AG • Diversified exchange organisation with wide range of products and services – Listing and Trading, Clearing, Post-Trading, Market- Data and Services • International Central Securities depository (ICSD) - Luxembourg • Post-Trade Infrastructure and Securities service provider • Central Securities Depository (CSD) – Frankfurt • QA Software Vendor • Providers of the Axe Enterprise Test Automation Platform
- 5. www.odintech.com Background and Business drivers Duncan Brigginshaw Technical Director - Odin • Functional GUI Automation key to achieving business goals • History: • Isolated GUI Automation in Business Units – Primarily HP Products – Technical in Nature • Centralised Automation framework developed in-house – Expensive to build and maintain – In-Flexible – Proprietary to HP – Not-Business Oriented • GUI Automation rates not inline with Business goals
- 6. A collaborative test automation approach www.odintech.com
- 7. www.odintech.com Stages Duncan Brigginshaw Technical Director - Odin • High Level Vision – Define a Collaborative Automation Methodology • “Involve Functional Analysts/Testers in Automation” • Requirements – Script-less business focussed automation architecture – Execution Tool Independent (HP + Selenium) – Future Proof – Compatible with current HP ALM Infrastructure • Process – Initial Research and RFP – Matrix Scoring on Requirements – Shortlisted Vendor Proof of Concept – Vendor Selection – Rollout Methodology Defined with Vendor Support – Initial project identified to prove and refine the approach
- 8. www.odintech.com Teams and Geography Business Units Technical Test and Tools Tool Vendors Functional Testers (Offshore) Application Development (Offshore) Functional Testers (Nearshore)
- 9. www.odintech.com • Functional Acceptance Criteria (FAC) • Test Cases • Test Design • Technical Tool Support • Supporting Tool Infrastructure Skill sets and Asset Focus
- 10. www.odintech.com Clear Matrix of Roles and Responsibilities
- 11. www.odintech.com HP ALM Central to Test Asset Mgmt. HP ALM Business Units Technical Test and Tools Functional Testers (Offshore) Functional Testers (Nearshore)
- 12. Business Units www.odintech.com Asset Creation • Functional Acceptance Criteria (FAC) + Test Case / Condition Design Excel Template • Import Creates linked Requirements and Tests in HP ALM automatically HP ALM Import
- 13. Technical Test and Tools www.odintech.com Asset Creation Technical Test Assets Creation Axe Automation Platform • Project Setup • Supporting Custom Code • Added to ALM Test Resources HP ALMHP UFT
- 14. www.odintech.com Asset Creation Functional Test Design / Definition Functional Testers (Offshore) Functional Testers (Nearshore) Axe Automation Platform • Test Design Steps and Automation Code generated automatically HP ALM
- 15. www.odintech.com Test Execution • Automated Tests Scheduled and Executed HP ALM • Results and Acceptance Criteria Coverage Captured HP UFT
- 16. The Initial Project: ClearstreamXact Web Portal www.odintech.com
- 17. www.odintech.com ClearstreamXact WebPortal Duncan Brigginshaw Technical Director - Odin • ClearstreamXact – Framework for access to Clearstream ICSD and CSD Services – Settlement, Cash Management, Asset Servicing, Collateral Management, Securities Lending, Fund Services • Xact Automated access • Xact Web Portal (GUI) • Clearstream Settlement and Reporting – TARGET2 and Global Securities – Instructions, Positions, Cash and Securities
- 18. www.odintech.com Project Snapshot Total 75% Manual Automation Functional Acceptance Criteria Automated Not Automated 64.4% of Target (45% of Total) U Completed 35% Not Completed ForecastTarget
- 19. www.odintech.com Project Timeline & Progress Completed Not Automated Automated 64.4% Month 1 Month 2 Month 3 Month 4 Month 5
- 20. www.odintech.com Duncan Brigginshaw Technical Director - Odin • Application Build and Delivery – Daily Updates – Weekly Delivery • Testing – Subset of Tests Run Daily – Full Regression Pack of Tests run Weekly – 12hr Execution Across 12 Machines Application Build and Test Regime
- 21. www.odintech.com Lessons and Conclusions Duncan Brigginshaw Technical Director - Odin • Lessons Learned - Refinements: – Requirement for automated test failure triage process – Defect management for automation (separate to development) – Asset naming conventions needed early in the project – New functionality found more challenging for automation than regression • Collaboration was key in automation success • Important to define clear roles and responsibilities • Leveraging relevant skills and expertise in the appropriate Mix • Collaborative methodology and selected tooling is proving successful over manual testing and previous automation