Improving Software quality for the Modern Web
3 likes476 views
This document discusses the importance of software quality and testing. It provides examples of costly software bugs from systems like a US Navy ship and the Ariane 5 rocket to illustrate the importance of quality. The document also shares statistics on the high costs of defects and failed/overbudget projects. It promotes testing practices like unit testing, test automation, and exploring different types of testing like functional, load, security and more. Visuals are also provided to explain testing concepts and strategies to improve quality like reducing technical debt through automation.
Improving Software quality for the Modern Web
- 1. IMPROVING SOFTWARE QUALITY FORTHE MODERNWEB EUAN GARDEN MICROSOFT EUANG@MICROSOFT.COM HTTP://WWW.TWITTER.COM/EUANGA HTTP://BLOGS.MSDN.COM/EUANGA
- 2. DOWE STILL NEEDTO CARE ABOUT QUALITY?
- 3. on average professional coders make 100 to 150 errors in every 1000 lines of code they write defects found in production cost 10x more to fix than those found during requirements gathering last year, canceled projects cost firms $67 billion; overruns on the other projects racked up another $21billion software bugs cost the us economy an estimated $59.5 billion every year
- 4. need something a little more concrete?
- 5. USSYORKTOWN, SMARTSHIP crew member entered 0 in a data entry field, caused a “divide by 0” error that shut down propulsion ship was dead in the water for 2hrs 45mins
- 6. ARIANE 5 FLIGHT 501 re-used code from ariane 4, but took a different flight path because of different booster design conversion from 64bit float to 16bit signed int caused overflow (exception handler was disabled for perf reasons) cost: > $370 million @ 1996 prices
- 7. F-22 RAPTOR deploying overseas to japan the first time crossed international dateline Raptor is likely the most advanced manned aircraft that will ever fly… computers crashed losing all navigation and communications systems clear weather allowed them to follow tankers back to hawaii
- 8. need something a little more visual?
- 14. AGILETESTING QUADRANTS functional tests examples story test prototypes simulations exploratory testing scenarios usability testing uat (user acceptance testing) alpha/beta unit tests components tests performance and load testing security testing “ility” testing TECHNOLOGY -FACING CRITIQUEPRODUCT SUPPORTINGTHETEAM BUSINESS-FACING *brian marick
- 15. AGILETESTING QUADRANTS functional tests examples story test prototypes simulations exploratory testing scenarios usability testing uat (user acceptance testing) alpha/beta unit tests components tests performance and load testing security testing “ility” testing TECHNOLOGY -FACING CRITIQUEPRODUCT SUPPORTINGTHETEAM BUSINESS-FACING
- 16. 27% 26% 47% How often do you write unit tests? Almost Always Sometimes Don't Source:Telerik Blog Survey May ‘08
- 17. 14% 60% 26% Why are you not doing more UnitTesting? Not worth writing No time/Too Hard Want to, but have not Source: .Net/GIS Developer Blog Survey ‘08
- 18. “…for an increased development cost of 15-35%... defect reduction of 40-90% can be achieved…” Source: “Realizing quality improvement through test driven development”, MSR et al
- 19. AGILETESTING QUADRANTS functional tests examples story test prototypes simulations exploratory testing scenarios usability testing uat (user acceptance testing) alpha/beta unit tests components tests performance and load testing security testing “ility” testing TECHNOLOGY -FACING CRITIQUEPRODUCT SUPPORTINGTHETEAM BUSINESS-FACING
- 20. 1. stop the bleeding 2.stay current 3. catch up http://blog.mountaingoatsoftware.com/reduce-manual-test-techcnical-debt
- 21. “…the real low-hanging fruit is often not automating some test execution but automating other testing tasks, like populating databases or automatic navigation to the page where you’ll start manual testing. you’re not reducing the number of manual tests, but you’re reducing the total time it takes to run them...” - mike cohn quoting brian marick
- 22. DEMO exploratory testing manual testing fast forward for manual testing Iteration N
- 23. AGILETESTING QUADRANTS functional tests examples story test prototypes simulations exploratory testing scenarios usability testing uat (user acceptance testing) alpha/beta unit tests components tests performance and load testing security testing “ility” testing TECHNOLOGY -FACING CRITIQUEPRODUCT SUPPORTINGTHETEAM BUSINESS-FACING
- 25. DEMO (web) ui test automation Iteration N
- 26. AUTOMATION PLATFORM SUPPORT Fully supported platform Partial solution. Further work required in future to complete Best efforts with known issues. Users can workaround these cases in the code. No major ongoing investment. Currently no support but on the roadmap for future releases Currently no support and none planned for now. Opportunity for partners to add this using the Extensibility support. Docs and samples around extensibility are here. For latest info on this, refer this post. Platform RTM RTM+ Notes IE7/8 – HTML/AJAX Windows Forms 2.0+ .NET Fx Controls fully supported, working on 3rd party support WPF 3.5+ .NET Fx Controls fully supported, working on 3rd party support SharePoint 2007 WindowsWin32 TBD – Known issues & Workarounds MFC TBD – Known issues & Workarounds FF3 – HTML/AJAX Currently in Beta Dynamics (Ax) TBD – Release Plan Silverlight TBD – Release Plan Citrix/TerminalServices The client (MTLM orVS) need to be on remote machine Office Client Apps IE 6 Opportunity for partners to add this using the Extensibility support. Docs and samples around extensibility are here. Chrome/Opera/Safari Flash/Java SAP
- 27. AGILETESTING QUADRANTS functional tests examples story test prototypes simulations exploratory testing scenarios usability testing uat (user acceptance testing) alpha/beta unit tests components tests performance and load testing security testing “ility” testing TECHNOLOGY -FACING CRITIQUEPRODUCT SUPPORTINGTHETEAM BUSINESS-FACING
- 30. but what about the cloud?
- 31. auctioncloud.com mashup service ebay api’s ebay auction service ebay auction data zillow.com public api’s zillow.com service zillow custom data mls public api’s mls service bing maps public api’s bing maps service mls auction data bing maps image store
- 32. pay attention to the details care about quality
- 35. QUESTIONS