SlideShare a Scribd company logo
The concept of problem complexity
Alejandro Salado
Stevens Institute of Technology
A) Anyone born in Hoboken?
B) Anyone born elsewhere?
C) Anyone unborn?
Choose your preferred concept
Constraints: fixed budget and schedule
A very SIMPLE system
Performance = 1.00
A very COMPLEX system
Performance = 1.00
What is a COMPLEX system?
Emergence
Dynamic
loops
Interconnectivity
Number of parts
Interaction
Disorder Unexpected
Diversity
Exercise 1:
Draw the most COMPLEX figure you can imagine
Time: 2 s
Hint: loops, crossings, corners, randomness...
The Concept of Problem Complexity
Exercise 2:
Draw the SIMPLEST figure you can imagine
Time: 2 s
Hint: a straight line
The Concept of Problem Complexity
What happened?
A SIMPLE system was DIFFICULT to develop
A COMPLEX system was EASY to develop
What is a COMPLEX system?
ACADEMIA
Property of a model
Based on system
elements
INDUSTRY
Difficulty to develop
Based on system /
project properties
Needs a system architecture
Does NOT help in
mitigating/reducing complexity
Why MEASURING complexity?
1. Understand system behavior
2. Design for some -ilities
3. Estimate development effort
Science drive
Design drive
Decision drive
System complexity
FUNCTIONAL PHYSICAL ORGANIZAT.
Interdependence
between system
functions
Interdependence
between system
components
Interdependence
between
organizations
System complexity
SYSTEM PROJECT ENVIRON.
System of
interest
The system
developing
the system
Where the
system
operates
COGNITION
Understanding
of people
interacting
with system
*Sheard and Mostashari, extracting 39 factors from more than 300 definitions
One more thought
Which one is more complex?
A standard car battery
A standard laptop
battery, but with 100 h
autonomy
Does the problem definition induce complexity?
Do requirements influence system complexity?
Can we anticipate a complexity bound?
Perhaps a complexity SPECTRUM?
System
complexity
Problem
complexity
Organiz.
complexity
Functional
complexity
Structural
complexity
Some correlations / overlaps
already measured
Need a common unit of
measurement
How to MEASURE system complexity?
SCIENCE DESIGN ESTIMATION
Disorder
Behavior
Interconnectedness
Parametric cost
estimators
𝐻 = −
𝑖=1
𝑛
𝑝𝑖 ∙ 𝑙𝑜𝑔2 𝑝𝑖 𝐶 = 𝐶1 + 𝐶2 ∙ 𝐶3
N parts, N I/Fs, N reqs,
materials...
𝐹: 𝐶𝑀 → 𝐸
The power of joint ENTROPY
𝐶 𝐶1 ⋯ 𝐶 𝑛 = −
𝑐1
⋯
𝑐 𝑛
𝑃 𝑐1 ⋯ 𝑐 𝑛 ∙ 𝑙𝑜𝑔𝑗 𝑃 𝑐1 ⋯ 𝑐 𝑛
𝐶 𝐶1 ⋯ 𝐶 𝑛 ≥ 𝑚𝑎𝑥 𝐶𝑖
𝐶 𝐶1 ⋯ 𝐶 𝑛 ≤
𝑖
𝐶𝑖
Property 1.
Property 2.
... And therefore
Effort to reduce FUNCTIONAL/STRUCTURAL complexity
may be limited/jeopardized by
how the PROJECT is organized or the REQUIREMENTS to be
fulfilled!
MATHEMATICAL justification
if joint entropy can be applied
Problem Complexity
A function of the SIZE of the solution space
Design space
CS1 CS2
*CS: compliant space
Problem Complexity
A function of AMOUNT of requirements and
CONFLICTS between them
DSM?
Flawed
Problem Complexity
𝐶 𝑝 = 𝐾 ∙
𝑖=1
𝑛
𝑎𝑖 ∙ 𝑟𝑓 𝑖
𝐸
∙
𝑗=1
𝑚
𝐻𝑗
𝑏 𝑗
Inspired on COSYSMO (Valerdi, 2008)
Problem Complexity
𝐶 𝑝 = 𝐾 ∙
𝑖=1
𝑛
𝑎𝑖 ∙ 𝑟𝑓 𝑖
𝐸
∙
𝑗=1
𝑚
𝐻𝑗
𝑏 𝑗
Calibration factor
Size of requirement set
Conflicting requirements
Problem Complexity
𝐶 𝑝 = 𝐾 ∙
𝑖=1
𝑛
𝑎𝑖 ∙ 𝑟𝑓 𝑖
𝐸
∙
𝑗=1
𝑚
𝐻𝑗
𝑏 𝑗
Functional requirementRelative weight
Diseconomies of scale*
Problem Complexity
𝐶 𝑝 = 𝐾 ∙
𝑖=1
𝑛
𝑎𝑖 ∙ 𝑟𝑓 𝑖
𝐸
∙
𝑗=1
𝑚
𝐻𝑗
𝑏 𝑗
Amount of conflicting
requirements *
Diseconomies of scale*
Problem Complexity
𝐶 𝑝 = 𝐾 ∙
𝑖=1
𝑛
𝑎𝑖 ∙ 𝑟𝑓 𝑖
𝐸
∙
𝑗=1
𝑚
𝑏𝑗
𝐻 𝑗
NOT IN THIS PAPER!
Heuristics to identify conflicting requirements
H1
≥ 2 phases of matter
H4
Competing for
resources
H3
Opposing directions
laws of physics
H2
Opposing directions
laws of society
Case Study
ID Requirement (fuzzy)
R1 Standard driving functionality
R2 4x wheel traction
R3 Big trunk
R4 Airbag
R5 Auto parking
R6 Auto breaking
R7 High speed & acceleration
R8 High autonomy
Requirement de-scoping
Industry benchmark
Vs.
Conflict-based
Problem complexity
Vs.
Expert judgment
Case Study: Benchmark
ID Requirement (fuzzy)
R1 Standard driving functionality
R2 4x wheel traction
R3 Big trunk
R4 Airbag
R5 Auto parking
R6 Auto breaking
R7 High speed & acceleration
R8 High autonomy
COSYSMO assessment based on industry experts
Dinh
1
2
1
1
3
3
2
2
De-scoped
Yes
Yes
Case Study: Conflict based
ID Requirement (fuzzy)
R1 Standard driving functionality
R2 4x wheel traction
R3 Big trunk
R4 Airbag
R5 Auto parking
R6 Auto breaking
R7 High speed & acceleration
R8 High autonomy
Sensitivity based on (notional) problem complexity metric
Dinh
1
2
1
1
3
3
2
2
De-scoped
Yes
rf
X
X
X
X
X
H3
+mass
-mass/+energy
-mass/-energy
Case Study: Comparative analysis
Element
Problem complexity
Resulting functionality
Resulting performance
Relative complexity subject matter expert
Dinh de-scoped requirements
Based on industry experts
Benchmark
58.61
3/5
3/3
↑
3
Conflict-based
33.22
5/5
2/3
↓
1
Contributions
System
complexity
Problem
complexity
Organiz.
complexity
Functional
complexity
Structural
complexity
𝐶 𝐶1 ⋯ 𝐶 𝑛
= −
𝑐1
⋯
𝑐 𝑛
𝑃 𝑐1 ⋯ 𝑐 𝑛 ∙ 𝑙𝑜𝑔𝑗 𝑃 𝑐1 ⋯ 𝑐 𝑛
𝐶 𝑝 = 𝐾 ∙
𝑖=1
𝑛
𝑎𝑖 ∙ 𝑟𝑓 𝑖
𝐸
∙
𝑗=1
𝑚
𝐻𝑗
𝑏 𝑗
Left for the future
VALIDATE heuristics based on subject matter expert
Perform RELATIVE calibration of problem complexity
Perform ABSOLUTE calibration of problem complexity
Further investigate IMPLICATIONS of joint entropy


TOPIC TITLE:
THE CONCEPT OF PROBLEM COMPLEXITY
Alejandro Salado
Stevens Institute of Technology
asaladod@stevens.edu
+49 176 321 31458

More Related Content

PPTX
Linear & Non-Linear Systems |Solved problems|
PPTX
A New Spatial Approach for Efficient Transformation of Equality - Generalize...
PPTX
PDF
Forget Big Data. It's All About Smart Data
PDF
Product failure analysis using Explicit dynamic
PDF
Machine learning in science and industry — day 1
PPT
FEM_PPT.ppt
PPT
Fast optimization intevacoct6_3final
Linear & Non-Linear Systems |Solved problems|
A New Spatial Approach for Efficient Transformation of Equality - Generalize...
Forget Big Data. It's All About Smart Data
Product failure analysis using Explicit dynamic
Machine learning in science and industry — day 1
FEM_PPT.ppt
Fast optimization intevacoct6_3final

Similar to The Concept of Problem Complexity (20)

PPT
Grid Connected Electricity Storage Systems (1/2)
PPT
Triz2 15133
PPTX
1 2 chem plantdesign-intro to plant design economics
PDF
Autonomous Systems for Optimization and Control
PDF
Combinatorial optimization and deep reinforcement learning
PDF
Mi 291 chapter 2 (engineering analsysis)
PDF
Autonomous Control AI Training from Data
PDF
AI and Deep Learning
PDF
A data science observatory based on RAMP - rapid analytics and model prototyping
PDF
Design and Analysis Algorithms.pdf
PDF
Day 1 - Part 1 Introduction to FEA CAE.pdf
PDF
HalifaxNGGs
PPTX
Big picture of electronics and instrumentation engineering
PDF
21AI401 AI Unit 1.pdf
PPTX
Hanjun Dai, PhD Student, School of Computational Science and Engineering, Geo...
PDF
IARE_ ACAD LAB MANUAL.pdf
PPTX
Software Requirements and Design Process in the Aerospace Industry
Grid Connected Electricity Storage Systems (1/2)
Triz2 15133
1 2 chem plantdesign-intro to plant design economics
Autonomous Systems for Optimization and Control
Combinatorial optimization and deep reinforcement learning
Mi 291 chapter 2 (engineering analsysis)
Autonomous Control AI Training from Data
AI and Deep Learning
A data science observatory based on RAMP - rapid analytics and model prototyping
Design and Analysis Algorithms.pdf
Day 1 - Part 1 Introduction to FEA CAE.pdf
HalifaxNGGs
Big picture of electronics and instrumentation engineering
21AI401 AI Unit 1.pdf
Hanjun Dai, PhD Student, School of Computational Science and Engineering, Geo...
IARE_ ACAD LAB MANUAL.pdf
Software Requirements and Design Process in the Aerospace Industry
Ad

More from Alejandro Salado (12)

PPTX
A Set of Heuristics to Support Early Identification of Conflicting Requirements
PPTX
Systems Engineering Practices Exhibited in the Creation of a Film Original Score
PPTX
Abandonment: A natural consequence of autonomy and belonging in systems-of-sy...
PPTX
A Research on Measuring and Reducing Problem Complexity to Increase System Af...
PPTX
On the Evolution of Solution Spaces Triggered by Emerging Technologies
PPTX
Fractionated Space Systems: Decoupling Conflicting Requirements and Isolating...
PPTX
Using Requirements-Induced Complexity to Anticipate Development and Integrati...
PPTX
Assessing the Impacts of Uncertainty Propagation to System Requirements by Ev...
PPTX
Elegant space systems: How do we get there?
PDF
Efficient and Effective Systems Integration and Verification Planning Using a...
PPTX
Using Maslow's hierarchy of needs to define elegance in system architecture
PDF
Contextual- and Behavioral-Centric Stakeholder Identification
A Set of Heuristics to Support Early Identification of Conflicting Requirements
Systems Engineering Practices Exhibited in the Creation of a Film Original Score
Abandonment: A natural consequence of autonomy and belonging in systems-of-sy...
A Research on Measuring and Reducing Problem Complexity to Increase System Af...
On the Evolution of Solution Spaces Triggered by Emerging Technologies
Fractionated Space Systems: Decoupling Conflicting Requirements and Isolating...
Using Requirements-Induced Complexity to Anticipate Development and Integrati...
Assessing the Impacts of Uncertainty Propagation to System Requirements by Ev...
Elegant space systems: How do we get there?
Efficient and Effective Systems Integration and Verification Planning Using a...
Using Maslow's hierarchy of needs to define elegance in system architecture
Contextual- and Behavioral-Centric Stakeholder Identification
Ad

Recently uploaded (20)

PPTX
Internet of Things (IOT) - A guide to understanding
PPTX
OOP with Java - Java Introduction (Basics)
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PPTX
Construction Project Organization Group 2.pptx
PDF
Digital Logic Computer Design lecture notes
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
CH1 Production IntroductoryConcepts.pptx
PPTX
Lecture Notes Electrical Wiring System Components
PDF
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PPTX
Artificial Intelligence
PDF
Well-logging-methods_new................
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PPT
Introduction, IoT Design Methodology, Case Study on IoT System for Weather Mo...
PPTX
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
PPTX
Current and future trends in Computer Vision.pptx
PPTX
Geodesy 1.pptx...............................................
PDF
Operating System & Kernel Study Guide-1 - converted.pdf
Internet of Things (IOT) - A guide to understanding
OOP with Java - Java Introduction (Basics)
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
Construction Project Organization Group 2.pptx
Digital Logic Computer Design lecture notes
CYBER-CRIMES AND SECURITY A guide to understanding
UNIT-1 - COAL BASED THERMAL POWER PLANTS
CH1 Production IntroductoryConcepts.pptx
Lecture Notes Electrical Wiring System Components
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
Artificial Intelligence
Well-logging-methods_new................
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
Introduction, IoT Design Methodology, Case Study on IoT System for Weather Mo...
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
Current and future trends in Computer Vision.pptx
Geodesy 1.pptx...............................................
Operating System & Kernel Study Guide-1 - converted.pdf

The Concept of Problem Complexity

  • 1. The concept of problem complexity Alejandro Salado Stevens Institute of Technology
  • 2. A) Anyone born in Hoboken? B) Anyone born elsewhere? C) Anyone unborn?
  • 3. Choose your preferred concept Constraints: fixed budget and schedule A very SIMPLE system Performance = 1.00 A very COMPLEX system Performance = 1.00
  • 4. What is a COMPLEX system? Emergence Dynamic loops Interconnectivity Number of parts Interaction Disorder Unexpected Diversity
  • 5. Exercise 1: Draw the most COMPLEX figure you can imagine Time: 2 s Hint: loops, crossings, corners, randomness...
  • 7. Exercise 2: Draw the SIMPLEST figure you can imagine Time: 2 s Hint: a straight line
  • 9. What happened? A SIMPLE system was DIFFICULT to develop A COMPLEX system was EASY to develop
  • 10. What is a COMPLEX system? ACADEMIA Property of a model Based on system elements INDUSTRY Difficulty to develop Based on system / project properties Needs a system architecture Does NOT help in mitigating/reducing complexity
  • 11. Why MEASURING complexity? 1. Understand system behavior 2. Design for some -ilities 3. Estimate development effort Science drive Design drive Decision drive
  • 12. System complexity FUNCTIONAL PHYSICAL ORGANIZAT. Interdependence between system functions Interdependence between system components Interdependence between organizations
  • 13. System complexity SYSTEM PROJECT ENVIRON. System of interest The system developing the system Where the system operates COGNITION Understanding of people interacting with system *Sheard and Mostashari, extracting 39 factors from more than 300 definitions
  • 14. One more thought Which one is more complex? A standard car battery A standard laptop battery, but with 100 h autonomy
  • 15. Does the problem definition induce complexity? Do requirements influence system complexity? Can we anticipate a complexity bound?
  • 16. Perhaps a complexity SPECTRUM? System complexity Problem complexity Organiz. complexity Functional complexity Structural complexity Some correlations / overlaps already measured Need a common unit of measurement
  • 17. How to MEASURE system complexity? SCIENCE DESIGN ESTIMATION Disorder Behavior Interconnectedness Parametric cost estimators 𝐻 = − 𝑖=1 𝑛 𝑝𝑖 ∙ 𝑙𝑜𝑔2 𝑝𝑖 𝐶 = 𝐶1 + 𝐶2 ∙ 𝐶3 N parts, N I/Fs, N reqs, materials...
  • 19. The power of joint ENTROPY 𝐶 𝐶1 ⋯ 𝐶 𝑛 = − 𝑐1 ⋯ 𝑐 𝑛 𝑃 𝑐1 ⋯ 𝑐 𝑛 ∙ 𝑙𝑜𝑔𝑗 𝑃 𝑐1 ⋯ 𝑐 𝑛 𝐶 𝐶1 ⋯ 𝐶 𝑛 ≥ 𝑚𝑎𝑥 𝐶𝑖 𝐶 𝐶1 ⋯ 𝐶 𝑛 ≤ 𝑖 𝐶𝑖 Property 1. Property 2.
  • 20. ... And therefore Effort to reduce FUNCTIONAL/STRUCTURAL complexity may be limited/jeopardized by how the PROJECT is organized or the REQUIREMENTS to be fulfilled! MATHEMATICAL justification if joint entropy can be applied
  • 21. Problem Complexity A function of the SIZE of the solution space Design space CS1 CS2 *CS: compliant space
  • 22. Problem Complexity A function of AMOUNT of requirements and CONFLICTS between them DSM? Flawed
  • 23. Problem Complexity 𝐶 𝑝 = 𝐾 ∙ 𝑖=1 𝑛 𝑎𝑖 ∙ 𝑟𝑓 𝑖 𝐸 ∙ 𝑗=1 𝑚 𝐻𝑗 𝑏 𝑗 Inspired on COSYSMO (Valerdi, 2008)
  • 24. Problem Complexity 𝐶 𝑝 = 𝐾 ∙ 𝑖=1 𝑛 𝑎𝑖 ∙ 𝑟𝑓 𝑖 𝐸 ∙ 𝑗=1 𝑚 𝐻𝑗 𝑏 𝑗 Calibration factor Size of requirement set Conflicting requirements
  • 25. Problem Complexity 𝐶 𝑝 = 𝐾 ∙ 𝑖=1 𝑛 𝑎𝑖 ∙ 𝑟𝑓 𝑖 𝐸 ∙ 𝑗=1 𝑚 𝐻𝑗 𝑏 𝑗 Functional requirementRelative weight Diseconomies of scale*
  • 26. Problem Complexity 𝐶 𝑝 = 𝐾 ∙ 𝑖=1 𝑛 𝑎𝑖 ∙ 𝑟𝑓 𝑖 𝐸 ∙ 𝑗=1 𝑚 𝐻𝑗 𝑏 𝑗 Amount of conflicting requirements * Diseconomies of scale*
  • 27. Problem Complexity 𝐶 𝑝 = 𝐾 ∙ 𝑖=1 𝑛 𝑎𝑖 ∙ 𝑟𝑓 𝑖 𝐸 ∙ 𝑗=1 𝑚 𝑏𝑗 𝐻 𝑗 NOT IN THIS PAPER!
  • 28. Heuristics to identify conflicting requirements H1 ≥ 2 phases of matter H4 Competing for resources H3 Opposing directions laws of physics H2 Opposing directions laws of society
  • 29. Case Study ID Requirement (fuzzy) R1 Standard driving functionality R2 4x wheel traction R3 Big trunk R4 Airbag R5 Auto parking R6 Auto breaking R7 High speed & acceleration R8 High autonomy Requirement de-scoping Industry benchmark Vs. Conflict-based Problem complexity Vs. Expert judgment
  • 30. Case Study: Benchmark ID Requirement (fuzzy) R1 Standard driving functionality R2 4x wheel traction R3 Big trunk R4 Airbag R5 Auto parking R6 Auto breaking R7 High speed & acceleration R8 High autonomy COSYSMO assessment based on industry experts Dinh 1 2 1 1 3 3 2 2 De-scoped Yes Yes
  • 31. Case Study: Conflict based ID Requirement (fuzzy) R1 Standard driving functionality R2 4x wheel traction R3 Big trunk R4 Airbag R5 Auto parking R6 Auto breaking R7 High speed & acceleration R8 High autonomy Sensitivity based on (notional) problem complexity metric Dinh 1 2 1 1 3 3 2 2 De-scoped Yes rf X X X X X H3 +mass -mass/+energy -mass/-energy
  • 32. Case Study: Comparative analysis Element Problem complexity Resulting functionality Resulting performance Relative complexity subject matter expert Dinh de-scoped requirements Based on industry experts Benchmark 58.61 3/5 3/3 ↑ 3 Conflict-based 33.22 5/5 2/3 ↓ 1
  • 33. Contributions System complexity Problem complexity Organiz. complexity Functional complexity Structural complexity 𝐶 𝐶1 ⋯ 𝐶 𝑛 = − 𝑐1 ⋯ 𝑐 𝑛 𝑃 𝑐1 ⋯ 𝑐 𝑛 ∙ 𝑙𝑜𝑔𝑗 𝑃 𝑐1 ⋯ 𝑐 𝑛 𝐶 𝑝 = 𝐾 ∙ 𝑖=1 𝑛 𝑎𝑖 ∙ 𝑟𝑓 𝑖 𝐸 ∙ 𝑗=1 𝑚 𝐻𝑗 𝑏 𝑗
  • 34. Left for the future VALIDATE heuristics based on subject matter expert Perform RELATIVE calibration of problem complexity Perform ABSOLUTE calibration of problem complexity Further investigate IMPLICATIONS of joint entropy  
  • 35. TOPIC TITLE: THE CONCEPT OF PROBLEM COMPLEXITY Alejandro Salado Stevens Institute of Technology asaladod@stevens.edu +49 176 321 31458