SlideShare a Scribd company logo
Eight deadly defects in
systems engineering and
     how to fix them
        Dr Joseph Kasser
  Leverhulme Visiting Professor
       Cranfield University
    j.kasser@cranfield.ac.uk
Agenda
1.   Selection of independent alternative solutions
2.   The V Model
3.   Lack of a standard process for planning a project
4.   The Waterfall model
5.   Unanswered and unasked questions
6.   Lack of a metric for the goodness of Requirements
7.   Focus on technological solutions not solving
     customer’s problems
8.   The need to focus on people as well as process
•    Summary
•    Questions and discussion
The selection of
       independent alternative
              solutions
• The systems engineering process has
  identified three alternative candidate
  solutions (A, B and C)
• “C” gets the highest score
• Which one is the optimal?
• Possibly none of them
• Possibly a combination of the best parts of
  all of them
                                            3
The “V” Model
Defects in the V
                    Model
• Lacks ‘prevention of defects’
• Definition of successful test?
• Design works from requirements
• T&E work from the need
• T&E identify defects and plan to find them
  after they have been built into the system
• Why not prevent the defects?


    * Kasser 1995                              5
The Project Cycle                      Test
Requirement
                 Design




              Acceptance
                criteria
              (property of a requirement)
                                                   6
Prevention of defective
           requirements
• Requirements Workshop
  at UMUC and UniSA
• FRED and Tiger Pro
• Figure of Merit for
  document
• Produced attitude
  change in student’s
  perceptions
• Produced better
  requirements
                                 7
Lack of a standard process
  for planning a project



 Determination of objectives      Determination of Resources




              Generate preliminary work plan (risks)




                   Draft work plan version 1

                                                               8
Lack of a standard process
  for planning a project



  Determination of objectives      Determination of Resources



 Identify and study lessons learned from previous projects

               Generate preliminary work plan (risks)

             Negotiate objectives and resources

                    Draft work plan version 1

                                                                9
The Waterfall model
• Waterfall approach does not cope well with
  changing requirements.
• Change the production process from the
  waterfall approach to some type of rapid, spiral,
  or other methodology
  – Iterative waterfalls
  – Spiral focuses on Risk Management
• Result
  – Some improvement
     • comparing Chaos 1995 with Chaos 2004


                                                      10
Assumption behind
        Waterfall model
       Contract award


Waterfall        Intermediate milestones
                 (product reviews)



                        Vision of product
       Desired
                                            11
Real world of
               changes
      Contract award                 Desired
                                  (moving target)


Waterfall         Intermediate milestones
                  (product reviews)




            Vision of product
                                              12
Assumptions behind
  Cataract model
Contract award    Desired (keep your
                  eye on the balls)

Cataracts Intermediate milestones
          (product reviews)
          Configuration Control
          (Stage Gates)


 Visions of product (converge)
                                       13
Unanswered and
      unasked questions
• Unanswered questions
  – Can you tell if the project is in trouble?
  – What percentage of the project is complete?
• Unasked questions at SRR
  – Are requirements with the following properties
    really needed?
     • High cost, high risk
     • Low priority, high cost
     • Low priority, high risk
  – Is this projected risk profile industry standard?
                                                        14
Project Priority profiles
       (object-oriented
        requirements)




Why are we
 investing in
this system?

                                15
Project Risk profiles
                  (object-oriented
                   requirements)
Risk: Is this
reasonable?




                                        16
Most successful IS of
         the 20th century?
• RAF Battle of Britain
  Command, Control, &
  Communications System
   – No computers
   – Germany had better
     Radar Technology
   – RAF evolved and used
     an integrated system
   – Adequate technology
• System?
• System of Systems?
• Complex System?
• Network enabled system?
                                17
Not solving
        customer's problems
• “the systems engineer is primarily interested in making equipment
  changes” [Goode and Machol, 1959] page 130).
• The problem the executive had was to secure at all
  times, live and accurate data concerning the exact
  conditions of the business. [Farnham, 1920] page 20)
• [Beer, 1972] page 244) describes a conceptual system.
    – British War Room in the Battle of Britain
    – NASA’s control room at the Manned Space Flight Center in Houston,
      Texas.
    – bits and pieces of it existed at that time.
• Beer proposed a control centre
• Today’s technology allows for personal desktop portals accessing
  information via software agents in an integrated digital or network
  centric environment.

                                                                     18
Complex or
complicated?




               19
The need to focus on
   people as well as process

• Literature
  – Is full of advice as to
    how to make projects
    succeed
  – Has little if anything to
    say about the
    proliferating process
    standards

                                20
The need to focus on
    people as well as process
• Systems engineering is a way of life
  – (Hitchins 1998)
  – Integration of
     • Schedules
     • Design, Testing and Integration
     • Systems of Systems divide?
• Are we focusing on the right things?
  – The Standards do not provide metrics that can
    predict the failure of a project.
     • (K&W, 1998)

                                                    21
Summary
 Selection of independent alternative solutions
 The V Model
 Lack of a standard process for planning a
  project
 The Waterfall model
 Unanswered and unasked questions
 Lack of a metric for the goodness of
  Requirements
 Focus on technological solutions not solving
  customer’s problems
 The need to focus on people as well as
  process
Questions?

More Related Content

PPT
Systems Engineering - a smarter way
PPT
Systems engineering and project management – partners in successful projects
PPTX
Software engineering principles in system software design
PDF
Organizing Design-Driven Development Using Rational Requirements Composer
PDF
2 - Architetture Software - Software architecture
PPTX
[DSBW Spring 2009] Unit 03: WebEng Process Models
PDF
2 Process
PDF
Software Measurement for Lean Application Management
Systems Engineering - a smarter way
Systems engineering and project management – partners in successful projects
Software engineering principles in system software design
Organizing Design-Driven Development Using Rational Requirements Composer
2 - Architetture Software - Software architecture
[DSBW Spring 2009] Unit 03: WebEng Process Models
2 Process
Software Measurement for Lean Application Management

What's hot (20)

PDF
Enterprise mobility solutions & systems
PPTX
Reed simpson
PPT
Systems development fall 2006
PPT
Chapter 01
PDF
Exploiting Tools for Faster, More Acceptable Process Improvement Initiatives
PPT
Managing Technical Debt
PPTX
Wind River For Medical
PDF
Odum.t.averbeck.r
KEY
Whose View is it Anyway: Addressing Multiple Stakeholder Concerns
ODP
Software evolution -- Good practices
PDF
Rapid Product Innovation
PDF
ATI Professional Development Short Course Universal Arhitecture Description F...
PDF
Terry.cooke davies
PDF
Smarter Computing Integrated Systems
PPTX
E2 Manage Tech Design Implementation General 2010
PDF
Why bmc remedy is better than hp 4.5
PDF
Arrow ECS Partner Jam - PureSystems - William Burns
PPTX
Thomas.mc vittie
PPTX
Chen.tim
PDF
Industry - Evolution and migration - Incremental and Iterative Reengineering ...
Enterprise mobility solutions & systems
Reed simpson
Systems development fall 2006
Chapter 01
Exploiting Tools for Faster, More Acceptable Process Improvement Initiatives
Managing Technical Debt
Wind River For Medical
Odum.t.averbeck.r
Whose View is it Anyway: Addressing Multiple Stakeholder Concerns
Software evolution -- Good practices
Rapid Product Innovation
ATI Professional Development Short Course Universal Arhitecture Description F...
Terry.cooke davies
Smarter Computing Integrated Systems
E2 Manage Tech Design Implementation General 2010
Why bmc remedy is better than hp 4.5
Arrow ECS Partner Jam - PureSystems - William Burns
Thomas.mc vittie
Chen.tim
Industry - Evolution and migration - Incremental and Iterative Reengineering ...
Ad

Viewers also liked (20)

PPT
ASE Consulting Vee Model
PDF
Knowledge Centric Systems Engineering
DOCX
EXPERIENCE_CERTI
PDF
"URALVAGONZAVOD" — COMBAT SYSTEMS
PPS
PPTX
Modern tanks
PDF
"URALVAGONZAVOD" — INNOVATIVE INDUSTRIAL EQUIPMENT FOR INFRASTRUCTURE
PDF
“URALVAGONZAVOD” — CATALOGUE OF PRODUCTS
PPTX
505 Army Base Workshop
PPTX
Tactic rommel ( general of germany tank force
PDF
MANUAL DE CAMPANHA EMPREGO DA CAVALARIA C 2-1
PDF
PROGRAMA-PADRÃO DE TREINAMENTO ESPECÍFICO DO MOTORISTA DE VIATURAS BLINDADAS ...
PDF
CADERNO DE INSTRUÇÃO ABRIGOS E ESPALDÕES CI 7-5/1
PDF
Exercito Brasileiro - Manual de Sobrevivencia na Selva
PDF
Sistema De Patrulhas (2)
PDF
Métodos de Treino
PDF
Armas Improvisadas
PPTX
System development life cycle (sdlc)
DOC
Manual de combate urbano infanteria de marina(3)
ASE Consulting Vee Model
Knowledge Centric Systems Engineering
EXPERIENCE_CERTI
"URALVAGONZAVOD" — COMBAT SYSTEMS
Modern tanks
"URALVAGONZAVOD" — INNOVATIVE INDUSTRIAL EQUIPMENT FOR INFRASTRUCTURE
“URALVAGONZAVOD” — CATALOGUE OF PRODUCTS
505 Army Base Workshop
Tactic rommel ( general of germany tank force
MANUAL DE CAMPANHA EMPREGO DA CAVALARIA C 2-1
PROGRAMA-PADRÃO DE TREINAMENTO ESPECÍFICO DO MOTORISTA DE VIATURAS BLINDADAS ...
CADERNO DE INSTRUÇÃO ABRIGOS E ESPALDÕES CI 7-5/1
Exercito Brasileiro - Manual de Sobrevivencia na Selva
Sistema De Patrulhas (2)
Métodos de Treino
Armas Improvisadas
System development life cycle (sdlc)
Manual de combate urbano infanteria de marina(3)
Ad

Similar to Eight deadly defects in systems engineering and how to fix them (20)

PPT
50500113 spiral-model
PPT
Sysdev
PPT
Process models
PDF
Software development PROCESS
PPTX
Software Engineering Methodologies
DOCX
Information systems development methodologies (autosaved)
PPTX
System Analysis and Design (Health Informatics)
PPT
System development
PDF
Software Engineering : Process Models
PDF
Software Engineering The Multiview Approach And Wisdm
PPTX
System Development Life Cycle (SDLC) - Part II
PPTX
Software Development Life Cycle
PPTX
Software Development Lifecycle: What works for you?
PPT
2.Basic Introduction of SDLC Phases and explanation of SDLC Models.ppt
PPT
2.Basic Introduction of SDLC Phases and explanation of SDLC Models (1).ppt
PPT
2.Basic Introduction of SDLC Phases and explanation of SDLC Models.ppt
PDF
Ch 2
PPT
OO Development 2 - Software Development Methodologies
PPT
softwareengineeringlpufeasibilitystudyca
PPT
Introduction and life cycle models
50500113 spiral-model
Sysdev
Process models
Software development PROCESS
Software Engineering Methodologies
Information systems development methodologies (autosaved)
System Analysis and Design (Health Informatics)
System development
Software Engineering : Process Models
Software Engineering The Multiview Approach And Wisdm
System Development Life Cycle (SDLC) - Part II
Software Development Life Cycle
Software Development Lifecycle: What works for you?
2.Basic Introduction of SDLC Phases and explanation of SDLC Models.ppt
2.Basic Introduction of SDLC Phases and explanation of SDLC Models (1).ppt
2.Basic Introduction of SDLC Phases and explanation of SDLC Models.ppt
Ch 2
OO Development 2 - Software Development Methodologies
softwareengineeringlpufeasibilitystudyca
Introduction and life cycle models

More from Joseph KAsser (16)

PPT
Towards a Grand Unified Theory of Systems Engineering (GUTSE)
PPTX
The nine system model
PPTX
Simplifying managing stakeholder expectations using the 9 systems 4
PPTX
Guidelines for creating a system
PPTX
Is there value in INCOSE?
PDF
A program of research into systems engineering
PDF
Seven systems engineering myths and the corresponding realities
PDF
A Proposed Paper Template for improving the Quality of Practitioner Written P...
PDF
An innovative introductory course to systems engineering teaching.pptx
PDF
Applying systems thinking & aligning it to systems engineering
PDF
Fishing for dx
PDF
Kasser synergy amateur radio
PDF
Systems engineering it's an enabler
PDF
Applying holistic thinking to improving your sex life
PDF
Complex solutions for complex problems
PDF
Yes systems engineering, you are a discipline
Towards a Grand Unified Theory of Systems Engineering (GUTSE)
The nine system model
Simplifying managing stakeholder expectations using the 9 systems 4
Guidelines for creating a system
Is there value in INCOSE?
A program of research into systems engineering
Seven systems engineering myths and the corresponding realities
A Proposed Paper Template for improving the Quality of Practitioner Written P...
An innovative introductory course to systems engineering teaching.pptx
Applying systems thinking & aligning it to systems engineering
Fishing for dx
Kasser synergy amateur radio
Systems engineering it's an enabler
Applying holistic thinking to improving your sex life
Complex solutions for complex problems
Yes systems engineering, you are a discipline

Recently uploaded (20)

PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Approach and Philosophy of On baking technology
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
A Presentation on Artificial Intelligence
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
Cloud computing and distributed systems.
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Advanced methodologies resolving dimensionality complications for autism neur...
Reach Out and Touch Someone: Haptics and Empathic Computing
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Mobile App Security Testing_ A Comprehensive Guide.pdf
Approach and Philosophy of On baking technology
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Encapsulation_ Review paper, used for researhc scholars
NewMind AI Monthly Chronicles - July 2025
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Understanding_Digital_Forensics_Presentation.pptx
A Presentation on Artificial Intelligence
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
20250228 LYD VKU AI Blended-Learning.pptx
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
Spectral efficient network and resource selection model in 5G networks
Building Integrated photovoltaic BIPV_UPV.pdf
Cloud computing and distributed systems.

Eight deadly defects in systems engineering and how to fix them

  • 1. Eight deadly defects in systems engineering and how to fix them Dr Joseph Kasser Leverhulme Visiting Professor Cranfield University j.kasser@cranfield.ac.uk
  • 2. Agenda 1. Selection of independent alternative solutions 2. The V Model 3. Lack of a standard process for planning a project 4. The Waterfall model 5. Unanswered and unasked questions 6. Lack of a metric for the goodness of Requirements 7. Focus on technological solutions not solving customer’s problems 8. The need to focus on people as well as process • Summary • Questions and discussion
  • 3. The selection of independent alternative solutions • The systems engineering process has identified three alternative candidate solutions (A, B and C) • “C” gets the highest score • Which one is the optimal? • Possibly none of them • Possibly a combination of the best parts of all of them 3
  • 5. Defects in the V Model • Lacks ‘prevention of defects’ • Definition of successful test? • Design works from requirements • T&E work from the need • T&E identify defects and plan to find them after they have been built into the system • Why not prevent the defects? * Kasser 1995 5
  • 6. The Project Cycle Test Requirement Design Acceptance criteria (property of a requirement) 6
  • 7. Prevention of defective requirements • Requirements Workshop at UMUC and UniSA • FRED and Tiger Pro • Figure of Merit for document • Produced attitude change in student’s perceptions • Produced better requirements 7
  • 8. Lack of a standard process for planning a project Determination of objectives Determination of Resources Generate preliminary work plan (risks) Draft work plan version 1 8
  • 9. Lack of a standard process for planning a project Determination of objectives Determination of Resources Identify and study lessons learned from previous projects Generate preliminary work plan (risks) Negotiate objectives and resources Draft work plan version 1 9
  • 10. The Waterfall model • Waterfall approach does not cope well with changing requirements. • Change the production process from the waterfall approach to some type of rapid, spiral, or other methodology – Iterative waterfalls – Spiral focuses on Risk Management • Result – Some improvement • comparing Chaos 1995 with Chaos 2004 10
  • 11. Assumption behind Waterfall model Contract award Waterfall Intermediate milestones (product reviews) Vision of product Desired 11
  • 12. Real world of changes Contract award Desired (moving target) Waterfall Intermediate milestones (product reviews) Vision of product 12
  • 13. Assumptions behind Cataract model Contract award Desired (keep your eye on the balls) Cataracts Intermediate milestones (product reviews) Configuration Control (Stage Gates) Visions of product (converge) 13
  • 14. Unanswered and unasked questions • Unanswered questions – Can you tell if the project is in trouble? – What percentage of the project is complete? • Unasked questions at SRR – Are requirements with the following properties really needed? • High cost, high risk • Low priority, high cost • Low priority, high risk – Is this projected risk profile industry standard? 14
  • 15. Project Priority profiles (object-oriented requirements) Why are we investing in this system? 15
  • 16. Project Risk profiles (object-oriented requirements) Risk: Is this reasonable? 16
  • 17. Most successful IS of the 20th century? • RAF Battle of Britain Command, Control, & Communications System – No computers – Germany had better Radar Technology – RAF evolved and used an integrated system – Adequate technology • System? • System of Systems? • Complex System? • Network enabled system? 17
  • 18. Not solving customer's problems • “the systems engineer is primarily interested in making equipment changes” [Goode and Machol, 1959] page 130). • The problem the executive had was to secure at all times, live and accurate data concerning the exact conditions of the business. [Farnham, 1920] page 20) • [Beer, 1972] page 244) describes a conceptual system. – British War Room in the Battle of Britain – NASA’s control room at the Manned Space Flight Center in Houston, Texas. – bits and pieces of it existed at that time. • Beer proposed a control centre • Today’s technology allows for personal desktop portals accessing information via software agents in an integrated digital or network centric environment. 18
  • 20. The need to focus on people as well as process • Literature – Is full of advice as to how to make projects succeed – Has little if anything to say about the proliferating process standards 20
  • 21. The need to focus on people as well as process • Systems engineering is a way of life – (Hitchins 1998) – Integration of • Schedules • Design, Testing and Integration • Systems of Systems divide? • Are we focusing on the right things? – The Standards do not provide metrics that can predict the failure of a project. • (K&W, 1998) 21
  • 22. Summary  Selection of independent alternative solutions  The V Model  Lack of a standard process for planning a project  The Waterfall model  Unanswered and unasked questions  Lack of a metric for the goodness of Requirements  Focus on technological solutions not solving customer’s problems  The need to focus on people as well as process