Agile Gurugram 2023 I Engineering Metrics: Cornerstone for Building High Quality Products -Manoj Jain
- 1. Manoj Jain Senior Director – Software Engineering Dec 9, 2023 Engineering Metrics CORNERSTONE FOR BUILDING HIGH QUALITY PRODUCTS
- 2. 2 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted About me • Passionate about building high quality products since 1999 • Part of Axtria’s global R&D Team • Previously worked with Mezocliq, Oracle, MakeMyTrip, CA Technologies, Nucleus Software & Newgen Software • Speaker & author • Cyclist • Philanthropist Manoj.jain@axtria.com manojjain99@yahoo.com https://www.linkedin.com/in/manojjain/ https://twitter.com/manojjain99
- 3. 3 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Axtria – Driving Life Sciences Industry performance Through unique LS-focused combination of decision Science, commercial excellence & data management Employees Worldwide 2,900+ Principals with 20+ years of Life Sciences experience Locations Global Delivery and Data Centers 80+ 19 • Enterprise Technology Platform • Cloud-based Configurable IP • Deep Pharma experience • Strategic & Operational Expertise • Cloud Data Management • Cloud BI & Insights • Cloud MDM • Big Data • Territory Alignment • Call Planning • Incentive Compensation • Field Reporting • Sales & Marketing Analytics • OTC Analytics • Patient Analytics • Digital Analytics • NBA • Omnichannel Orchestration • Customer Journey DECISION SCIENCE & COMMERCIAL EXCELLENCE PHARMA DATA MANAGEMENT & TECHNOLOGY Clients including 8 of Top 10 Pharma & 15 of Top 20 Pharma Commercial Ops sales reps on Axtria’s platform 100+ 100,000+ Driving PERFORMANCE for our Clients Through Transformational DECISION SCIENCE & COMMERCIAL EXCELLENCE Powered by Extensive Pharma DATA MANAGEMENT & TECHNOLOGY Expertise Global Presence
- 4. 4 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Why do we aspire for building high quality products?
- 5. 5 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Common challenges across organizations… Subtitle Goes Here And many-more…
- 6. 6 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
- 7. 7 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
- 8. How did we go about it?
- 9. 9 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Metrics Subtitle Goes Here
- 10. 10 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Who all should be covered while considering metrics? Subtitle Goes Here Engineering Metrics Dev QE Support PO Team
- 11. 11 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Engineering Metrics Subtitle Goes Here Function Metrics Target How to track? Development Automated unit test coverage 80%+ Via CI/CD pipeline Development Security Assessment No Open C+H Via CI/CD pipeline Development Static Code Analysis No Open C+H Via CI/CD pipeline Development Defects Density TBD Total defects /KLOC Development Defects leaked by Dev (C+ H) <=10% Defects (C+H)/Total Defects * 100 QE Automated functional tests 80%+ Qmetry QE Defect Escape Rate <=5% Prod. Defects /(Prod. defects + QE defects)*100 QE Performance Assessment (Key Scenarios) <3sec Performance test results Support Average Ageing - Bugs (Critical) 15 days JIRA ServiceDesk Support Average Ageing - Bugs (Overall) 120 days JIRA ServiceDesk Product Mgmt. SLA for review for improvements 30 days JIRA ServiceDesk Product Sprint Velocity (Throughput) 80%+ Product JIRA Product Release Throughput 80%+ Product JIRA
- 12. 12 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Executive Summary View
- 13. 13 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Detailed View (Product Wise)
- 14. 14 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Online dashboard using ELK
- 15. 15 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Notifications using MS Teams
- 16. 16 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Outcome? • Improvement in quality of stories • Improvement in sprint throughputs • Improved CSAT & NPS • Any many more… Teams are well aware about focus areas which help in achieving enterprise excellence!!!
- 17. Tips and Key Takeaways
- 18. 18 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
- 19. 19 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted WHY MOST OF INITIATIVES STRUGGLE?
- 20. 20 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Communication
- 21. 21 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Top 3 key takeaways 1. Don’t look for a perfect start and just start measuring 2. Don’t look at snapshots but have trends to identify patterns & outliers 3. While you may start with manual measurements, get to automation at the earliest
- 22. 22 Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted Questions Manoj.jain@axtria.com manojjain99@yahoo.com https://www.linkedin.com/in/manojjain/ https://twitter.com/manojjain99
- 23. Do you have a question for us?