Tm mi overview
1 like159 views
This document discusses the need for a standardized test process assessment model and introduces the Test Maturity Model integration (TMMi) as a solution. Key points: - Existing models do not provide sufficient depth in assessing testing processes. TMMi aims to address this with a structured assessment method informed by models like CMMI. - TMMi is being developed as a 5-level staged model by the independent TMMi Foundation to provide a common benchmark and certification for testing process assessments. - The goal is for TMMi to support both isolated assessments of testing as well as integration with other process maturity models and the software development lifecycle.
Tm mi overview
- 1. © 2005 TMMi Foundation 1 A Standard Test Process Assessment Method? The case for Test Maturity Model! Brian Wells ICSTest – 28 September 2005
- 2. © 2005 TMMi Foundation 2 Agenda Why do we need a test process assessment model? What contenders to the crown? Why and what is TMM? The TMMi Foundation Proposed Structure of TMMi
- 3. © 2005 TMMi Foundation 3 Why do we need it? IT ever more complex Growth in CMM/CMMi & other models to improve processes Test Discipline maturing; what is there to assess test & test-related quality processes in depth? How do you assess the quality of the testing process that supposedly demonstrates quality?
- 4. © 2005 TMMi Foundation 4 Motivators What are the testing capabilities internally & of external suppliers? Ensure Regulatory & other Governance? Need objective robust assessment method, clearly understood by all Need to develop a structured test process improvement framework Want to identify improvement opportunities in an action plan with realistic timescales Extend institutionalisation of good practices Need to integrate seamlessly with project lifecycle… often geographically challenged!
- 5. © 2005 TMMi Foundation 5 Other Contenders Test Process Improvement (TPI) - continuous model and flexible to organisation Test Improvement Model (TIM) – Based on CMM but not as extensive in KPAs nor as detailed CMM/CMMI – improving but still no depth in test areas SPICE – Doesn’t address in sufficient detail TOM – good but protected
- 6. © 2005 TMMi Foundation 6 Why TMM? We decided on TMM because: We can use experience and structure of CMM/CMMi assessments and qualified CMM Assessors TMM can be developed as a staged or continuous assessment model TMM can be used in isolation (of overall assessment models)… In reality supports CMMi & other process maturity models, but concentrates on testing! Is robust and readily understood by all – results & certification Robust, structured, common Process Improvement Road Maps result
- 7. © 2005 TMMi Foundation 7 The current TMM Structure 5 Maturity Levels Testing Capability Maturity Goals (KPA) Maturity Sub-Goals (Goals) Activities / Tasks / Responsibilities (KPs) Critical Views (SPs) Implementation and Organisation Adoption Manager Developer / Tester User / Client Indicate Contain Supported by Achieved by Organised by Address
- 8. © 2005 TMMi Foundation 8 TMM Levels
- 9. © 2005 TMMi Foundation 9 The TMMi Foundation Why? Independent reference model development as trusted anchor for enterprise process improvement Integrate existing company-driven initiatives into best of breed Reference Model Establish basis for international test assessment standards Provide standard, robust Assessment Benchmarking Accreditation & Certification Develop public industry benchmarking data No other initiatives evident around the world
- 10. © 2005 TMMi Foundation 10 TMMi Foundation Objectives The TMMi™ Foundation proposes developing: A standard TMMi™ Assessment Model that can be used in isolation or in support of wider Process Assessment models and is either staged or continuous. Assessment Method Accreditation/Audit Framework for TMMi™ in accordance with ISO15504 and the process to certify commercial assessment methods against the standard model. Certification and training/examination process, procedures and standards for formal, public accreditation of Assessors and Lead Assessors and the on-going management An independently managed data repository to support TMMi™ assessment method accreditation, assessor and assessment certification/validation and validated assessment data and certificates.
- 11. © 2005 TMMi Foundation 11 Structure of TMMi Foundation Non-profit making body registered in UK European Board (8 members) Global interest/user base Links to SEI & Illinois Institute of Technology Working parties develop; large expert review panels Reference model & industry benchmarking data placed in public domain
- 12. © 2005 TMMi Foundation 12 Proposed TMMi Reference Model 3 Classes of assessment in line with ISO 15504 Reference Model developed further in line with CMMi (cover missing elements such as Test Environments etc. and cater for progress in other models) Concept of Lead Assessors and Assessors trained, certified and accredited Based on interviews, artefacts and standard rating system; all depersonalised Standard, repeatable and robust assessments which are verifiable and auditable; process certification available
- 13. © 2005 TMMi Foundation 13 Benefits TMMi Foundation is the independent mechanism only; sole interest in developing industry standard! Works with and listens to IT practitioners Develops in line with other standard Quality & Process Models/Methods Common, international standard! Production of benchmark data in public domain
- 14. © 2005 TMMi Foundation 14 Contact us! If interested, please: Visit our website www.tmmifoundation.org/ and register your interest Or Email me on brian.wells@experimentus.com Or Call me on +44 7725 709262