SlideShare a Scribd company logo
Jun 2007
How to Approach Hard vs. Soft Problems
Two problem solving approaches: Holism vs. Reductionism
Let’s preface this discussion by asking a fundamental question
What is Intelligence? What is it used for?
The purpose of intelligence is for prediction
â—Ź Intelligence is for prediction
â—Ź Prediction is a low level operation in the brain
â—Ź Prediction not logic is most important
Many complex systems including entrepreneurial ventures and
creating hit entertainment products require prediction as a
fundamental skill set to achieve success
Throughout history two fundamental approaches to understand science and the
world around us have been used: Reductionism and Holism
Reductionism Holism
â—Ź Parts, Division â—Ź Context, Whole, Environment
â—Ź Math, Physics, Computer Science â—Ź Biology, Ecology, Philosophy
â—Ź Programmers, Surgeons, Engineers â—Ź Nurses, Authors, Philosophers
â—Ź Proof, Precise Measurement, Prediction â—Ź Categories, Description, Speculation
Today we live in a world ruled by Reductionism and Reductionist
scientific approaches
Reductionism vs. Holism
Reductionism focuses on Component Dominated Complexity
Reductionist Approach to Complex Systems
System
Component 2 Component 3
Sub-Component
Sub-Component
Sub-Component
Solution for System Complexity
â—Ź Manage complexity through division
â—Ź DIvide the system into components
â—Ź Create simple interfaces between components
Component 1
Holism on the other hand, focuses on Interaction Dominated Complexity
Holistic Approach to Complex Systems
Examples
â—Ź Neurons in the brain
â—Ź People in society
â—Ź Concepts, abstractions,
ideas
Chaotic Systems
Chaotic Systems and Reductionism
â—Ź Stateful components
â—Ź Non-linear components
â—Ź Interaction dominated
complexity
â—Ź Chaotic systems are
common in life
â—Ź Non-divisible complexity
● Can’t use reductionist
science for prediction
Chaotic Systems Characteristics Key Insights
Ambiguity in Systems
Overview
➢ Incomplete information
➢ Self reference, loops
➢ Chicken and the egg problem
➢ Incorrect information
â—‹ Lies, misunderstandings
â—‹ Multiple points of view, opinions
â—‹ Persuasion
Irreducible Complexity in Systems
Overview
➢ Emergent properties
➢ Everything matters
â—‹ Internally: Curse of Dimensionality
○ Externally: Can’t separate “system” from environment
PROCESS
Complex Systems that defy Reductionism
1. Chaotic
1. Contain Ambiguity
1. Irreducible Complexity
1. Require a Holistic Stance
We have described four kinds of complex systems that defy Reductionism and
are unpredictable relative to reductionist approaches
Soft sciences are more difficult because soft science tends to deal with more
complex systems than hard science does
Overview
➢ Soft science cannot make as good prediction as hard sciences because
they have to deal with life
➢ Life is bizarre
➢ Reductionist (Hard) science cannot deal with bizarre systems
➢ Reductionist success comes from limiting their problem down to non-
bizarre systems
We can express various classes of problems based on the amount of
complexity of the system and the range of prediction possible
Complexity and Prediction
Examples of Bizarre Systems
➢ Entrepreneurial ventures / Venture capital
➢ Language translation
➢ Weather
➢ Stock markets
➢ Human interest / intent / recommendations
➢ Internet search
➢ Hit mobile game design & development
➢ Etc., etc.
Today Reductionist science has solved a major class of problems in the
Complexity/Prediction graph
Complexity and Prediction
Key Takeaway: Different classes of problems require different approaches to
solve!
Complexity vs Prediction Problem Classes

More Related Content

PDF
Influencing leadership system thinking
PPTX
materi berpikir sistem kesmas dan kepemimpinan.pptx
PPT
83690136 sess-3-modelling-and-simulation
PPTX
BB Triatmoko, SJ, MA, MBA, Emerging Management Issues and Challenges.pptx
PDF
Complexity Thinking
PPT
Exploring the Science of Complexity in Aid Policy and Practice
PPTX
Differential diagnosis
Influencing leadership system thinking
materi berpikir sistem kesmas dan kepemimpinan.pptx
83690136 sess-3-modelling-and-simulation
BB Triatmoko, SJ, MA, MBA, Emerging Management Issues and Challenges.pptx
Complexity Thinking
Exploring the Science of Complexity in Aid Policy and Practice
Differential diagnosis

Similar to How to approach hard and soft problems (20)

PPTX
seminar on Critical Thinking and decision making presented by SANJANA AAGATE.E
PPTX
Crisis m anagement final
PPTX
Crisis m anagement final
PPTX
Icmiplenary1a
DOC
MGT 3200 Exam #2
PDF
BA and Beyond 19 Sponsor spotlight - Namahn - Beating complexity with complexity
PPTX
McLeod Trauma Informed Basics CEU
PDF
A rule based approach towards detecting human temperament
 
PPTX
Lecture note
PPT
Patient seen and examined with housestaff. Treatment plan ...
PPTX
Mng urself in workplace 021019ab
PPTX
Decision Making
PPTX
Heuristics, bias and critical thinking in testing distribution
PPTX
Arc 323 human studies in architecture fall 2018 lecture 9-topics 2
PPT
Modularity and complexity management
PPTX
Edgar huse systems and the change process
PPTX
Systems thinking
PDF
Expert system
PPTX
2011 dialogue the language of complex systems v.2
PDF
Course Traning July 2025 critical thinking
seminar on Critical Thinking and decision making presented by SANJANA AAGATE.E
Crisis m anagement final
Crisis m anagement final
Icmiplenary1a
MGT 3200 Exam #2
BA and Beyond 19 Sponsor spotlight - Namahn - Beating complexity with complexity
McLeod Trauma Informed Basics CEU
A rule based approach towards detecting human temperament
 
Lecture note
Patient seen and examined with housestaff. Treatment plan ...
Mng urself in workplace 021019ab
Decision Making
Heuristics, bias and critical thinking in testing distribution
Arc 323 human studies in architecture fall 2018 lecture 9-topics 2
Modularity and complexity management
Edgar huse systems and the change process
Systems thinking
Expert system
2011 dialogue the language of complex systems v.2
Course Traning July 2025 critical thinking
Ad

Recently uploaded (20)

PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
Big Data Technologies - Introduction.pptx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
 
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
Spectroscopy.pptx food analysis technology
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
sap open course for s4hana steps from ECC to s4
PPT
Teaching material agriculture food technology
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Machine learning based COVID-19 study performance prediction
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Per capita expenditure prediction using model stacking based on satellite ima...
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Network Security Unit 5.pdf for BCA BBA.
Big Data Technologies - Introduction.pptx
The Rise and Fall of 3GPP – Time for a Sabbatical?
 
Spectral efficient network and resource selection model in 5G networks
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Programs and apps: productivity, graphics, security and other tools
Spectroscopy.pptx food analysis technology
“AI and Expert System Decision Support & Business Intelligence Systems”
sap open course for s4hana steps from ECC to s4
Teaching material agriculture food technology
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Machine learning based COVID-19 study performance prediction
Advanced methodologies resolving dimensionality complications for autism neur...
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Unlocking AI with Model Context Protocol (MCP)
Diabetes mellitus diagnosis method based random forest with bat algorithm
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Ad

How to approach hard and soft problems

  • 1. Jun 2007 How to Approach Hard vs. Soft Problems Two problem solving approaches: Holism vs. Reductionism
  • 2. Let’s preface this discussion by asking a fundamental question What is Intelligence? What is it used for?
  • 3. The purpose of intelligence is for prediction â—Ź Intelligence is for prediction â—Ź Prediction is a low level operation in the brain â—Ź Prediction not logic is most important Many complex systems including entrepreneurial ventures and creating hit entertainment products require prediction as a fundamental skill set to achieve success
  • 4. Throughout history two fundamental approaches to understand science and the world around us have been used: Reductionism and Holism Reductionism Holism â—Ź Parts, Division â—Ź Context, Whole, Environment â—Ź Math, Physics, Computer Science â—Ź Biology, Ecology, Philosophy â—Ź Programmers, Surgeons, Engineers â—Ź Nurses, Authors, Philosophers â—Ź Proof, Precise Measurement, Prediction â—Ź Categories, Description, Speculation Today we live in a world ruled by Reductionism and Reductionist scientific approaches Reductionism vs. Holism
  • 5. Reductionism focuses on Component Dominated Complexity Reductionist Approach to Complex Systems System Component 2 Component 3 Sub-Component Sub-Component Sub-Component Solution for System Complexity â—Ź Manage complexity through division â—Ź DIvide the system into components â—Ź Create simple interfaces between components Component 1
  • 6. Holism on the other hand, focuses on Interaction Dominated Complexity Holistic Approach to Complex Systems Examples â—Ź Neurons in the brain â—Ź People in society â—Ź Concepts, abstractions, ideas
  • 7. Chaotic Systems Chaotic Systems and Reductionism â—Ź Stateful components â—Ź Non-linear components â—Ź Interaction dominated complexity â—Ź Chaotic systems are common in life â—Ź Non-divisible complexity â—Ź Can’t use reductionist science for prediction Chaotic Systems Characteristics Key Insights
  • 8. Ambiguity in Systems Overview ➢ Incomplete information ➢ Self reference, loops ➢ Chicken and the egg problem ➢ Incorrect information â—‹ Lies, misunderstandings â—‹ Multiple points of view, opinions â—‹ Persuasion
  • 9. Irreducible Complexity in Systems Overview ➢ Emergent properties ➢ Everything matters â—‹ Internally: Curse of Dimensionality â—‹ Externally: Can’t separate “system” from environment
  • 10. PROCESS Complex Systems that defy Reductionism 1. Chaotic 1. Contain Ambiguity 1. Irreducible Complexity 1. Require a Holistic Stance We have described four kinds of complex systems that defy Reductionism and are unpredictable relative to reductionist approaches
  • 11. Soft sciences are more difficult because soft science tends to deal with more complex systems than hard science does Overview ➢ Soft science cannot make as good prediction as hard sciences because they have to deal with life ➢ Life is bizarre ➢ Reductionist (Hard) science cannot deal with bizarre systems ➢ Reductionist success comes from limiting their problem down to non- bizarre systems
  • 12. We can express various classes of problems based on the amount of complexity of the system and the range of prediction possible Complexity and Prediction
  • 13. Examples of Bizarre Systems ➢ Entrepreneurial ventures / Venture capital ➢ Language translation ➢ Weather ➢ Stock markets ➢ Human interest / intent / recommendations ➢ Internet search ➢ Hit mobile game design & development ➢ Etc., etc.
  • 14. Today Reductionist science has solved a major class of problems in the Complexity/Prediction graph Complexity and Prediction
  • 15. Key Takeaway: Different classes of problems require different approaches to solve! Complexity vs Prediction Problem Classes