Case Study - DevOps QA Helps Leading Event Management Company Reduce Post-production Defects by 40%
1 like352 views
The document summarizes a case study of how Cigniti helped a leading event management company reduce post-production defects by 40% through DevOps QA practices. Key challenges included unclear requirements, unstable test environments, and defects escaping testing. Cigniti introduced standardized QA processes, requirement reviews, and test automation to improve quality while meeting sprint deadlines. This increased test coverage and reduced requirement ambiguity from 35% to 12%, cutting post-production defects significantly.
Case Study - DevOps QA Helps Leading Event Management Company Reduce Post-production Defects by 40%
- 1. www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd DevOps QA Helps Leading Event Management Company Reduce Post-production Defects by 40% The Client is a leading provider of face to face marketing services ranging from Pre-event Planning, On-Site Execution, extending the experience to Audio Visual Solutions with a presence in North America, Europe, and Asia. About the Client CASE STUDY CCS-US003-1215
- 2. www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd Key Business Challenges Delayed receipt of user stories in every sprint Lack of clarity in user story requirements Parallel sprints, each with a rigid schedule Lack of standardized QA processes and best practices Unstable Test Environment with configuration and access issues Critical defects leaked into post-production after regression testing Testing Tools Types of Testing Functional Testing Regression Testing Compatibility Testing
- 3. www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd Solutions Provided Leveraged Cigniti’s Static Requirement Analyzer to improve requirements review process and hence the quality of user stories. Mandated the use of sprint demos to hasten understanding of functionality being added in every sprint. Worked with client team to resolve test environment issues. Introduced reusable process templates to accelerate and standardize QA processes across applications and sprints. Published detailed test execution reports for the compatibility matrix defined to enable easier and fast sprint sign-off. Key Benefits Reduced Requirement Ambiguity Index (RAI) from 35% in sprint 1 to 12% in sprint 3 by improving the clarity of user stories. Increased test coverage by leveraging Cigniti’s Static Requirements Analyzer. Reduced post-production defects by 40%. Met aggressive sprint schedules with the help of reusable process templates. Introduced industry standard Agile and QA best practices to ensure that every sprint stays on schedule. Value Add Formal Test Life Cycle » Defined testing life cycle, end-to-end testing approach that aligns with application development. Significant focus and collaboration of all QA teams to perform integration testing across systems to ensure that critical workflow are testing prior to release . Visibility into Test Coverage and Detailed Test Cases » QA team used the test case template to provide the detailed test cases and ensure that the test coverage for the requirements using test requirement traceability matrix. Test cases are reviewed and formally signed off by BA and Dev before test execution. Formal Requirements early in Application Development » QA started involving early in the requirements phase and validated the requirements through SRA process for testability. Standard Defect Management » Defects posted are daily triaged in the daily defect triage and triage of complete backlog defects for the release. Defined specific process to prioritise the defects, to decide what is important and what is not important for the release. Visibility into Testing Progress and Quality » QA team provided transparency on daily/weekly updates about the status, quality, risks, and upcoming milestones of different projects. Gaps Services/Solutions Provided Formal Test Summary Reporting » QA team provided test summary reports for both sprints and release that provided visibility to product quality. Metrics like Requirement Ambiguity Index, Test Coverage, Test Execution Results, Defect metrics.
- 4. Cigniti Technologies Limited (BSE: 534758, www.cigniti.com), Global Leaders in Independent Software Testing (IST) Services, is headquartered at Hyderabad, India. Cigniti’s 1800+ career testers are spread across US, UK, India, Australia, and Canada. Cigniti is the world’s first IST Services Company to be appraised at CMMI-SVC v1.3, Maturity Level 5, and is also ISO 9001:2008 & ISO 27001:2013 certified. Cigniti’s test offerings include Quality Engineering, Advisory & Transformation, Next Generation Testing, and Core Testing. Over the last decade, Cigniti has helped Enterprises and ISVs build quality software while improving time-to-market and reducing cost of quality. Cigniti has translated its R&D into SMART Tools™ that accelerate testing and help improve the quality of services delivered to clients. Cigniti has India's first of its kind Robotics Test Lab, a Mobile Cloud Test Lab with HP & Experitest, a Cloud-enabled Performance Test Lab, and an IoT & Smart Meter Lab. Gartner has positioned Cigniti as a Challenger in its Magic Quadrant for Application Testing Services Worldwide, 2015. Forrester cites Cigniti among the 9 services firms and systems integrators working to enable Quality at Speed. NelsonHall ranks Cigniti Technologies as a Leader in Software Testing NEAT Charts. Everest Group recognizes Cigniti as a Major Contender with a “Best in Class” rating for Buyer satisfaction in the PEAK Matrix™ for Independent Testing Services, while Forbes recognizes Cigniti as Asia’s 200 best under-billion companies. Cigniti has been awarded a place on the Crown Commercial Service latest G-Cloud 6 framework for providing Lot 4: Specialist Cloud Services that will provide public sector enterprises better access to Cigniti's expertise. Cigniti is also a recipient of the prestigious Frost and Sullivan Customer Value Leadership Award for Global Automated Software Testing Services category consecutively in 2014 and 2015. Cigniti’s CSR initiative, Project Cignificance, aims to impact 1 million+ lives through education as an enabler. About Cigniti www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd Global Leaders in Independent Software Testing Services US Cigniti Inc. 433 E Las Colinas Blvd, Suite 1300, Irving, TX 75039 972.756.0622 India Cigniti Technologies Ltd. 6th Floor, ORION Block, “The V” (Ascendas) Plot #17 Software Units Layout Madhapur, Hyderabad-500081 040-4038 2255 040-3070 2255 Australia Cigniti Technologies (Australia) Pty Ltd Sydney Level 13, 135 King Street Sydney, NSW 2000 +61 2 8973 7579 Canberra Tower A, Level 5, 7 London Circuit Canberra, ACT, 2601 +61 2 6169 4145 UK Cigniti Technologies (UK) Limited 9 Devonshire Square London EC2M 4YF +44 (0)20 36911385 Canada Cigniti Inc 2425 Matheson Boulevard East, 7th floor, Suite 731 Mississauga, Ontario L4W 5K4 647.951.5943 Melbourne Level 28, 303 Collins Street Melbourne, VIC 3000 +61 3 9678 9111 For Other Information info@cigniti.com facebook.com/cignititechnologies linkedin.com/company/cigniti-inc youtube.com/cignititechnologies slideshare.net/cigniti cigniti.com/blog twitter.com/cigniti