Shifting Left Using Sauce Analytics
0 likes118 views
The document discusses the concept of 'shifting left' in IT operations to enhance quality and efficiency in software development processes, particularly within DevOps and CI/CD frameworks. It highlights the integration of Sauce Analytics for better visibility into test metrics and defect management, aiming to reduce costs and delivery times while improving overall software quality. The agenda includes presentations on analytics, integration, a demo, and a Q&A session led by industry experts from Omni Sourcing and Sauce Labs.
Shifting Left Using Sauce Analytics
- 1. omnisourcing.net SHIFTING LEFT USING SAUCE ANALYTICS Omni Sourcing
- 2. Transforming IT Operations, Delivering Quality Results2 TODAY’S SPEAKER WilliamHarrison Managing Director, Omni Sourcing Ken Drachnik Director Product Marketing, Sauce Labs
- 3. Transforming IT Operations, Delivering Quality Results3 Agenda • Shift Left with Analytics • Omni Sourcing Integration with Sauce Labs Test Analytics • Demo • Q&A
- 4. Transforming IT Operations, Delivering Quality Results4 Shift Left Problem Companies are trying to Shift Left within DevOps, CI/CD, and Agile Methodologies with historical problems with: Ø Requirement Development Ø Process Management Ø Code Development Ø Cost of Quality “If companies don’t address their underlying SDLC problems; trying to Shift Left will not go right.”
- 5. Transforming IT Operations, Delivering Quality Results5 Shift Left Improve Agility Ensure Quality Improve Time To Market Production Defects found earlier in the SDLC reduces the overall cost of delivering applications and improves time to market DEFECTS DEFECTS DEFECTS Defect Repair Cost Defect Repair Cost
- 6. Transforming IT Operations, Delivering Quality Results6 Shift Left • Shift Left accelerates attention to quality from the inception of the SDLC • It promotes inclusion of quality assurance right from the requirement phase of the process • Quality Assurance is no longer a separate task only done post development. It is a continuous integrated process Requirements 56% Design 27% Code 7% Other 10% DEFECTROOTCAUSE SHIFTLEFTBENEFITS Lower Project Costs Reduced Defects Increased Collaboration EnhancedCustomer Experience IncreasedTime To Market Increased Project Execution Increased Quality
- 7. Transforming IT Operations, Delivering Quality Results7 CI2/CD2 Continuous Improvement/Integration, Continuous Delivery/Deployment Requirements Plan Design Track and monitor Release Dev/Test CI 2 3 4 5 6 1 Slow deployment process ? Increase in frequency of software deployment Long wait time for test results ? Auto-build is triggered after every commit and automatically deployed to test Developers have to check the entire source code for errors? If test fails, developers only have to check last commit for errors Lack of continuous feedback ? Concerned teams are provided with real-time feedback CI/CD2
- 8. Transforming IT Operations, Delivering Quality Results8 Using Sauce Test Analytics to Shift Left Sauce Analytics help provide visibility into your tests, platforms and applications so you can review test metrics, analyze test results and determine the quality of your applications Test Trends Visibility across your organization Test History Identify flaky/problem tests Test Overview Know what to fix first Fix defects Identify root cause Analyze defects Identify error rates by team and applications Identify builds and tests that cause errors in platforms Identify performance bottlenecks in your pipeline INCREASE QUALITY
- 9. Transforming IT Operations, Delivering Quality Results9 Business Unit Analytics Scorecard Defect Cost Defect Root Cause M atrix Business unit results Requirem ents Design Data Deploym en t Environm ent Coding Testing Defect Im pact cost Total Defect Im pact Cost: $12,040,000 SVP Business Unit VP SVP Business Unit VP Business Unit VP Root cause cost im pact fg i fg h h h h $5,000,000 fg fg h h i h fg $1,000 i fg i h h i i $39,000 $1.0M $1.0M $1.0M $500K $500M $2M $1.0M M et goal Area of im provem ent Focus area
- 10. Transforming IT Operations, Delivering Quality Results10 Application Analytics Scorecard Areas of Improvement Delivery scorecard Rank Application VPowner Partner Defect density Defect turnaround time (hrs) Test phase found Defect root cause analysis Overall score 8 XYZ VP Other 1.11 34 55% 50% 9 XYZ VP Other 3.55 26 75% 44% 10 XYZ VP Other N/A 79 80% 81% 11 XYZ VP Other 7.32 49 37% 52% 12 XYZ VP Other 6.09 65 71% 52% M et goal Area of im provem ent Focus area
- 12. Transforming IT Operations, Delivering Quality Results12 Shift Left Analytics Platform Benefits Ø Measures SDLC Quality Ø Historical Execution Data (1 Month and Beyond) Ø Quality Assurance Governance Ø Vendor Management Enabler Ø Cost Of Quality Tracking Ø Methodology Agnostic Ø KPI’s For Strategic Decisions
- 14. Transforming IT Operations, Delivering Quality Results14 RESOURCES 14 Print ● Test Analytics Data sheet ● Driving Test Insights with Test Analytics – biz white paper ● Analytics Solution Brief - Four Ways Test Analytics Can Improve Automated Testing Videos ● Shifting Left Using Sauce Analytics - WilliamHarrison, Omni Sourcing, Sauce Con 18 talk ● 2 min user testimonial video ● Video demo - 5 minute demo overviewof Test Trends ● What Do Your Testing Numbers Tell You - Ken Drachnik, Fernando Vidal, Sauce Labs, Sauce Con 18 talk