Increasing business success with TPI NEXT and PointZERO
3 likes2,169 views
The document discusses the Test Process Improvement (TPI) model, specifically the TPI Next framework, which provides a structured approach to enhance testing maturity across organizations. It outlines four maturity levels—initial, controlled, efficient, and optimizing—along with improvement suggestions, enablers, and practical tips for implementation. The TPI Next model aims to align testing processes with business goals to increase overall organizational success and quality.
Increasing business success with TPI NEXT and PointZERO
- 2. | Increasing Business Success with TPI Stop wasting time and money, focus on quality & risk Siemens Nürnberg, 13 March 2014 Rik Marselis 2
- 3. | History of Test Process Improvement 1998 first TPI book; Martin Pol & Tim Koomen 1999TPI book in English 2002 TPI book in Japanese 2004 TPI Automotive 2009 TPI NEXT book, 6 authors 2010 ISTQB expert level: improving the test process 2011 TPI NEXT auf Deutsch 3
- 4. | Improvement basically is: 4Increasing Business Success with TPI 13 March 2014 Measure Improve
- 5. | The TPI NEXT model 5 Test maturity matrix Improvement suggestions Key areas Maturity levels Checkpoints Enablers Clusters Increasing Business Success with TPI 13 March 2014 MeasureMeasureMeasure ImproveImproveImprove
- 6. Measure
- 7. | Test maturity matrix Elements of the TPI NEXT model for measuring Key areas Maturity levels Checkpoints 7
- 8. | The TPI NEXT maturity levels Initial ad hoc / unstructured / unorganized testing complaint: quality of software not satisfactory Controlled structured & organized testing complaint: testing is too expensive Efficient: early testing complaint: inflexible Optimizing always adapting to current situation 8
- 9. | Why 4 maturity levels? Other models have 5 levels, why only 4 in TPI NEXT? Reason: No more levels are needed Compare to sports: Level 1: you are not in the game Level 2: you are in the game Level 3: you win a medal Level 4: you win a gold medal Nobody stives for winning a silver medal (do you?) 9
- 10. | TPI NEXT tool (www.tpinext.com) 10
- 11. | TPI NEXT tool (www.tpinext.com) 11 Each checkpoint is a question Answer by filling in Yes / No / Not applicable One sheet per key area
- 12. | TPI NEXT tool (www.tpinext.com) 12 Answering all checkpoints results in a Test Maturity Matrix
- 13. | TPI NEXT tool (www.tpinext.com) 13 Each answer is shown in the matrix
- 14. | TPI NEXT tool (www.tpinext.com) 14 This organization is well on its way towards being “controlled”
- 15. | TPI NEXT tool in multiple languages 15
- 16. Improve
- 17. | TPI follows the generic change process 17 Evaluate and redirect Implement actions Make a plan of action Define improvements (generate) Awareness Determine goal, scope and approach Assess current situation Increasing Business Success with TPI 13 March 2014
- 18. | Elements of the TPI NEXT model for improvements Test maturity matrix Clusters Key areas Maturity levels Checkpoints Improvement suggestions Enablers Target situation 18
- 19. | Clusters 19 A cluster is a group of checkpoints from multiple key areas that function as one improvement step. Each cluster is identified by a letter.
- 20. | Current situation and target situation improvement goal: up to cluster “D” 20
- 21. | Characteristics Optional Related to Key areas, not specifically to Checkpoints Help to achieve a desired Maturity level Based on best practices Adaptable to specific circumstances Various ….. Improvement Suggestions (1)
- 22. | Examples from Test strategy from Initial to Controlled: Convince project and line management to perform a product risk analysis Involve various stakeholders in the product risk analysis and the test strategy Discuss light and/or thorough testing depending on the perceived risks from Controlled to Efficient: Define and allocate the tasks of the coordination between test levels and continuously monitor this process. This role must be documented in the master test plan. This person reports to the project manager and other stakeholders. To prevent a conflict of interests, this person should have an independent relationship to the various test levels. Perform an inspection on testware from previous test activities or reviews. The system test delivers a functionally-tested system, including test cases through to the acceptance test. The acceptance test evaluates these test cases (complete or spot-check) and, when in doubt, performs one or more test cases on the delivered software. Consequently its main effort can be directed towards testing the suitability and/or the usability of the system for the organization. Improvement Suggestions (2)
- 23. | Enablers in the Business Driven TPI NEXT model connect Key areas of testing with other activities in the Application Lifecycle model in order to keep test process improvements aligned with other activities across the lifecycle. 3.4 Enablers (1) example Configuration management Quote: “it is possible to implement a highly-efficient testware management process without proper configuration management for non-testing artifacts. But when an organization routinely enforces proper version control on development documentation, testware management becomes much easier.”
- 24. | Characteristics: Reinforcement of other processes Reinforcement of the test process Optional Prevent ‘sub-optimalisation’ Example from stakeholder commitment: If a proper change management process is implemented and followed it helps the stakeholders to also support the test process 3.4 Enablers (2)
- 25. | Practical tip for large organisations: Min/ Max situation Minimum: The checkpoints that ALL projects/groups comply with Maximum: The checkpoints that at least one project/group complies with Immature teams can reuse good practices from mature teams
- 26. | Integrate in Software Process Improvement: CMMI clusters 26 http://www.tmap.net/sites/tmap.net/files/attachments/TPI___NEXT_clusters_for_CMMi_0.pdf TPI NEXT Cluster A TPI NEXT Cluster B TPI NEXT Cluster C TPI NEXT Cluster D If you fulfil all checkpoints of a specific cluster then the test process has reached that CMMI level
- 29. | Benchmark example from industry “Your” score Average scores in peer-group (industry-example) 29
- 31. | 1. Identify the business driver 2. Translate business goals into IT goals 3. Identify the more and less important Key areas for the IT goals 4. Rearrange the Checkpoints in the Clusters Business driven in 4 steps 31
- 32. | TPI NEXT Clusters and prioritites Key areas prioritized 32
- 33. | Business driven: Adapting the model Rearrange the Checkpoints in the Clusters Business driven Base 33
- 35. | Reporting: second measurement (after improvement) 35
- 36. TPI NEXT can be used in any situation
- 37. | Use the “business driven clustering” approach High priority clusters for Agile: Stakeholder commitment Degree of involvement Test strategy Testware management Tester professionalism Test environment TPI NEXT and Agile Chapter 7.2 37 Effective testing in Agile projects2012
- 38. | Using the Model for outsourcing chapter 7.7 ► Special focus on: ► Product risks ● Joint PRA ● Manage ● Reporting (to client) ► Strategy ● Prevent overlap/gaps ● End-to-end testing ► Metrics ● Show/demonstrate quality (process and product) ► Craftmanship ● Test ànd business knowledge ● Techniques, methodical ► Testenvironments ● As much as possible ‘Production Like’ 38
- 39. | TPI NEXT and End-to-End testing 39 Stakeholder commitment Degree of involvement Test organization Test environment Test process management Test strategy Estimating & planning Organization Control Infrastructure
- 40. | End-to-end testing real-life example
- 41. TPI NEXT contributes to increasing business success
- 42. | A mountain can’t be moved in one day 42 Parallel & step-by-step improvement continuous model Start improving at the “weak spots” don’t elevate the peaks but fill up the valleys use the clusters
- 43. | Test process improvement can’t be on its own Frontload the application lifecycle with quality measures “Shift left” “Early reviews” “Integrate testing activities with other lifecycle activities” 43
- 44. | Shift focus to Quality & Risk 44
- 45. | Certification of test-organizations Official certificate of the maturity of the test process. 45 Bronze = 50% controlled Silver = 75% controlled Gold = 100% controlled Platinum = 100% efficient Diamond = 100% optimizing
- 46. | Result: increasing business success 46
- 47. | The books English Deutsch 47 Both are available on paper and as an e-book