SlideShare a Scribd company logo
Threats to Validity from Confounding and
Effect Modification
•  Overview: Random vs. systematic error
•  Confounding
•  Effect Modification
•  Logistic regression (time permitting)
•  Special thanks for some of the materials in these
lecture:
–  Professor Jen Ahern (UCB)
–  Professor Madhu Pai (McGilll—a former
250b GSI)
2014 Page 1
1
2014 Page 2
1
The cardinal rule of epidemiology
• Remember that all results based on epidemiology
studies are likely to be …
2014 Page 3
The cardinal rule of epidemiology (continued)
• WRONG…
– unless proper care has been taken to eliminate
all sources of error in the estimate (…and
sometimes even then the results will be
wrong because of unknown sources of error)
2
2014 Page 4
Example: Confounding
• A colleague with outside funding believes that cigarette smoke
is not a “cause” (in any sense) of lung cancer but that exposure
to matches (yes, matches) is the cause. This colleague has
conducted a large case control study to test the null hypothesis:
Ho: “Matches are not associated with lung cancer”.
• What’s the rationale (in the Popperian sense) for stating the null
hypothesis rather than the alternative:
HA: “Matches are associated with lung cancer”.
• What does the colleague hope to do (in terms of hypothesis
testing)
• What do you think of the term “associated” –would it be better
to write “a cause of”?
• “We can never finally prove our scientific
theories, we can merely (provisionally)
confirm or (conclusively) refute them.”
– - Karl Popper
Sir Karl Raimund Popper CH FBA FRS[4] (28 July 1902 – 17 September 1994) was an Austrian-British[5]
philosopher and professor at the London School of Economics.[6] He is generally regarded o regarded as
one of the greatest philosophers of science of the 20th century.[7][8] Popper is known for his rejection of the
classical inductivist views on the scientific method, in favour of empirical falsification: regarded as one of the
greatest philosophers of science of the 20th century.[7][8] (wikipedia.com)
2014 Page 5
2014 Page 6
10
Confounding: smoking, matches,
and lung cancer
• Your colleague has located 1000 cases of lung cancer, of
whom 820 carry matches.
• Among 1000 reference patients (selected randomly from a
population with recently taken normal chest x-rays), 340
carry matches.
• Strengths of the reference selection process? Weaknesses?
• Describe the relationship between matches and lung cancer
in your colleague’s data.
• Would you like to analyze the data in any other fashion?
2014 Page 7
Confounding: smoking, matches,
and lung cancer
• Odds ratio = (820 * 660) / (180 * 340)
• OR = 8.8
• 95% CI (7.2, 10.9)
Cancer No cancer
Matches 820 340
No matches 180 660
2014 Page 8
Confounding: smoking, matches,
and lung cancer
• You decide to look at the relationship between matches
and lung cancer in the smokers separately from the non-
smokers.
• You find that among the 1000 cases, 900 are smokers and
810 (of the 900) carry matches
• Among the 1000 reference patients, 300 are smokers and
270 (of the 300) carry matches
• Calculate the relevant measure(s) of effect.
• What should your colleague do about future funding?
Confounding: smoking, matches, and lung
cancer
• ORpooled = 8.84 (7.2, 10.9)
• ORsmokers = 1.0 (0.6, 1.5)
• ORnonsmokers = 1.0 (0.5, 2.0)
Pooled Cancer No cancer
820
180
Cancer
810
340
660
No cancer
270
Matches No
Matches
Smokers
Matches
No Matches
Non-smoker
Matches
No Matches
2014 Page 9
90
Cancer
10
90
30
No cancer
70
630 13
2014 Page 10
Confounding: smoking, matches,
and lung cancer
• To be complete, you also decide to examine the
relationship between smoking and lung cancer.
• What tables should you construct to do this?
14
Confounding: smoking, matches, and lung
cancer
’
• ORpooled = 21.0 (16.3, 27.1)
• ORmatches = 21.0 (10.5, 46.2)
• ORno matches = 21.0 (12.9, 34.7)
• Discuss your intuitions about the 95% CI s
Pooled Cancer No cancer
Cancer
810
Smoking No 900 300
Smoking 100 700
No cancer
270
Matches
Smoking
No Smoking
No matches
Smoking No
Smoking
2014 Page 11
10
Cancer
90
90
70
No cancer
30
630 16
Confounder?
? ?
? Unadjusted RR
Exposure Disease
? Adjusted
RR
19
2014 Page 12
2
BMJ 2004;329:868-869 (16 October)
2014 Page 13
Why is confounding so important in
epidemiology?
● BMJ Editorial: “The scandal of poor epidemiological
research” [16 October 2004]
● “Confounding, the situation in which an apparent
effect of an exposure on risk is explained by its
association with other factors, is probably the
most important cause of spurious associations in
observational epidemiology.”
Overview
2014 Page 14
3
● Causality is the central concern of epidemiology
● Confounding is the central concern with establishing
causality
● Confounding can be understood using multiple
different approaches
● A strong understanding of various approaches to
confounding and its control is essential for all those
who engage in health research

More Related Content

PDF
Modeling the cost effectiveness of two big league pay-for-performance policies
PDF
Chemical Risk Assessment and Translation to Socio-Economic Assessments
PDF
Transfer and generalization of monetary estimates
PDF
Benefits-Costs Analysis: Triumphs and Troubles
PDF
Measuring the Economic Value of Chemicals on Ecological System and Human Heal...
PDF
Quantifying Regulatory Efficacy
PDF
Interactivo - revista oficial chik's
PPT
PresentacióN2
Modeling the cost effectiveness of two big league pay-for-performance policies
Chemical Risk Assessment and Translation to Socio-Economic Assessments
Transfer and generalization of monetary estimates
Benefits-Costs Analysis: Triumphs and Troubles
Measuring the Economic Value of Chemicals on Ecological System and Human Heal...
Quantifying Regulatory Efficacy
Interactivo - revista oficial chik's
PresentacióN2

Viewers also liked (19)

PPTX
NCBOR 2016 | Veranderend beheer; samen nieuwsgierig en grenzen opzoeken
PPTX
Органи архітектурно-будівельного контролю
PDF
PDF
Color Images
PPTX
Start developing for drones
DOC
Dokumen.tips transmisi pada-traktor
PPTX
Computer Software
PPTX
Webinaire bacheliers methodologie d'études
PDF
Level 3 DataCentersGlobal
PPT
Analyzing Common Stock
PDF
How to make a sonic screwdriver
PDF
Inleiding Wegontwerp les 1
PPTX
NORMAS DE CONVIVENCIA DEL PRIMER CICLO DE ARTATSE
PPT
Coronado presentation
PPT
Knowledge Management and Social Networking
PPTX
Paper 6 Characteristics of the Victorian Age
PDF
Transparency7
 
PDF
Nicoletta Fornara and Fabio Marfia | Modeling and Enforcing Access Control Ob...
PPTX
Tim Hortons - Strategy
NCBOR 2016 | Veranderend beheer; samen nieuwsgierig en grenzen opzoeken
Органи архітектурно-будівельного контролю
Color Images
Start developing for drones
Dokumen.tips transmisi pada-traktor
Computer Software
Webinaire bacheliers methodologie d'études
Level 3 DataCentersGlobal
Analyzing Common Stock
How to make a sonic screwdriver
Inleiding Wegontwerp les 1
NORMAS DE CONVIVENCIA DEL PRIMER CICLO DE ARTATSE
Coronado presentation
Knowledge Management and Social Networking
Paper 6 Characteristics of the Victorian Age
Transparency7
 
Nicoletta Fornara and Fabio Marfia | Modeling and Enforcing Access Control Ob...
Tim Hortons - Strategy
Ad

Similar to 4.1. introduction (20)

PDF
4 Threats to validity from confounding bias and effect modification
 
PPTX
4.3.2. controlling confounding stratification
 
PPT
First in man tokyo
PPTX
Research Designs
PPTX
ANALYTICAL STUDY DESIGN COHORT STUDY.pptx
PPTX
REG PCORI Grant Planning Meeting 26/09/15
PPTX
Asthma_COPD_RiskFor_Arthritis_Journal_Club Cohort study
PPTX
Cohort-Study about research and statistics
PDF
Eliminating occupational cancer
PPTX
UkNSCC 2016 CochraneTAG workshop
PPTX
EVIDENCE BASED DECISION MAKING IN DENTISTRY
PPTX
Convergence of Occupational and Environmental Exposure Science: the Whole Pic...
PPTX
Types of Research Studies
PPT
London 2008
PPT
Published Research, Flawed, Misleading, Nefarious - Use of Reporting Guidelin...
PDF
7. Bias and Causation medical Statistics.pdf
PPTX
Epidemiology and trends of asbestos-related diseases at Helsinki Asbestos 2014
PPTX
Technology Assessment, Outcomes Research and Economic Analyses
PPTX
Rationale and Procedure for Oncology Pricing and Reimbursement in England Tow...
PPT
4. case control study
4 Threats to validity from confounding bias and effect modification
 
4.3.2. controlling confounding stratification
 
First in man tokyo
Research Designs
ANALYTICAL STUDY DESIGN COHORT STUDY.pptx
REG PCORI Grant Planning Meeting 26/09/15
Asthma_COPD_RiskFor_Arthritis_Journal_Club Cohort study
Cohort-Study about research and statistics
Eliminating occupational cancer
UkNSCC 2016 CochraneTAG workshop
EVIDENCE BASED DECISION MAKING IN DENTISTRY
Convergence of Occupational and Environmental Exposure Science: the Whole Pic...
Types of Research Studies
London 2008
Published Research, Flawed, Misleading, Nefarious - Use of Reporting Guidelin...
7. Bias and Causation medical Statistics.pdf
Epidemiology and trends of asbestos-related diseases at Helsinki Asbestos 2014
Technology Assessment, Outcomes Research and Economic Analyses
Rationale and Procedure for Oncology Pricing and Reimbursement in England Tow...
4. case control study
Ad

More from A M (20)

PDF
Transparency6
 
PDF
Transparency5
 
PDF
Transparency4
 
PDF
Transparency3
 
PDF
Transparency2
 
PDF
Transparency1
 
PPTX
5.3.5 causal inference in research
 
PPTX
5.3.4 reporting em
 
PPTX
5.3.3 potential outcomes em
 
PPTX
5.3.2 sufficient cause em
 
PPTX
5.3.1 causal em
 
PPTX
5.2.3 dags for selection bias
 
PPTX
5.2.2 dags for confounding
 
PPTX
5.1.3 hills criteria
 
PPTX
5.1.2 counterfactual framework
 
PPTX
5.1.1 sufficient component cause model
 
PPTX
5.2.1 dags
 
PPTX
4.4. effect modification
 
PPTX
4.5. logistic regression
 
PPTX
4.3.1. controlling confounding matching
 
Transparency6
 
Transparency5
 
Transparency4
 
Transparency3
 
Transparency2
 
Transparency1
 
5.3.5 causal inference in research
 
5.3.4 reporting em
 
5.3.3 potential outcomes em
 
5.3.2 sufficient cause em
 
5.3.1 causal em
 
5.2.3 dags for selection bias
 
5.2.2 dags for confounding
 
5.1.3 hills criteria
 
5.1.2 counterfactual framework
 
5.1.1 sufficient component cause model
 
5.2.1 dags
 
4.4. effect modification
 
4.5. logistic regression
 
4.3.1. controlling confounding matching
 

Recently uploaded (20)

PDF
A systematic review of self-coping strategies used by university students to ...
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
01-Introduction-to-Information-Management.pdf
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
GDM (1) (1).pptx small presentation for students
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PDF
Computing-Curriculum for Schools in Ghana
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PPTX
Presentation on HIE in infants and its manifestations
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
Complications of Minimal Access Surgery at WLH
PPTX
Lesson notes of climatology university.
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PPTX
master seminar digital applications in india
A systematic review of self-coping strategies used by university students to ...
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
Chinmaya Tiranga quiz Grand Finale.pdf
01-Introduction-to-Information-Management.pdf
Final Presentation General Medicine 03-08-2024.pptx
GDM (1) (1).pptx small presentation for students
human mycosis Human fungal infections are called human mycosis..pptx
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
FourierSeries-QuestionsWithAnswers(Part-A).pdf
102 student loan defaulters named and shamed – Is someone you know on the list?
Computing-Curriculum for Schools in Ghana
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Supply Chain Operations Speaking Notes -ICLT Program
Presentation on HIE in infants and its manifestations
Microbial diseases, their pathogenesis and prophylaxis
Microbial disease of the cardiovascular and lymphatic systems
Complications of Minimal Access Surgery at WLH
Lesson notes of climatology university.
202450812 BayCHI UCSC-SV 20250812 v17.pptx
master seminar digital applications in india

4.1. introduction

  • 1. Threats to Validity from Confounding and Effect Modification •  Overview: Random vs. systematic error •  Confounding •  Effect Modification •  Logistic regression (time permitting) •  Special thanks for some of the materials in these lecture: –  Professor Jen Ahern (UCB) –  Professor Madhu Pai (McGilll—a former 250b GSI) 2014 Page 1 1
  • 2. 2014 Page 2 1 The cardinal rule of epidemiology • Remember that all results based on epidemiology studies are likely to be …
  • 3. 2014 Page 3 The cardinal rule of epidemiology (continued) • WRONG… – unless proper care has been taken to eliminate all sources of error in the estimate (…and sometimes even then the results will be wrong because of unknown sources of error) 2
  • 4. 2014 Page 4 Example: Confounding • A colleague with outside funding believes that cigarette smoke is not a “cause” (in any sense) of lung cancer but that exposure to matches (yes, matches) is the cause. This colleague has conducted a large case control study to test the null hypothesis: Ho: “Matches are not associated with lung cancer”. • What’s the rationale (in the Popperian sense) for stating the null hypothesis rather than the alternative: HA: “Matches are associated with lung cancer”. • What does the colleague hope to do (in terms of hypothesis testing) • What do you think of the term “associated” –would it be better to write “a cause of”?
  • 5. • “We can never finally prove our scientific theories, we can merely (provisionally) confirm or (conclusively) refute them.” – - Karl Popper Sir Karl Raimund Popper CH FBA FRS[4] (28 July 1902 – 17 September 1994) was an Austrian-British[5] philosopher and professor at the London School of Economics.[6] He is generally regarded o regarded as one of the greatest philosophers of science of the 20th century.[7][8] Popper is known for his rejection of the classical inductivist views on the scientific method, in favour of empirical falsification: regarded as one of the greatest philosophers of science of the 20th century.[7][8] (wikipedia.com) 2014 Page 5
  • 6. 2014 Page 6 10 Confounding: smoking, matches, and lung cancer • Your colleague has located 1000 cases of lung cancer, of whom 820 carry matches. • Among 1000 reference patients (selected randomly from a population with recently taken normal chest x-rays), 340 carry matches. • Strengths of the reference selection process? Weaknesses? • Describe the relationship between matches and lung cancer in your colleague’s data. • Would you like to analyze the data in any other fashion?
  • 7. 2014 Page 7 Confounding: smoking, matches, and lung cancer • Odds ratio = (820 * 660) / (180 * 340) • OR = 8.8 • 95% CI (7.2, 10.9) Cancer No cancer Matches 820 340 No matches 180 660
  • 8. 2014 Page 8 Confounding: smoking, matches, and lung cancer • You decide to look at the relationship between matches and lung cancer in the smokers separately from the non- smokers. • You find that among the 1000 cases, 900 are smokers and 810 (of the 900) carry matches • Among the 1000 reference patients, 300 are smokers and 270 (of the 300) carry matches • Calculate the relevant measure(s) of effect. • What should your colleague do about future funding?
  • 9. Confounding: smoking, matches, and lung cancer • ORpooled = 8.84 (7.2, 10.9) • ORsmokers = 1.0 (0.6, 1.5) • ORnonsmokers = 1.0 (0.5, 2.0) Pooled Cancer No cancer 820 180 Cancer 810 340 660 No cancer 270 Matches No Matches Smokers Matches No Matches Non-smoker Matches No Matches 2014 Page 9 90 Cancer 10 90 30 No cancer 70 630 13
  • 10. 2014 Page 10 Confounding: smoking, matches, and lung cancer • To be complete, you also decide to examine the relationship between smoking and lung cancer. • What tables should you construct to do this? 14
  • 11. Confounding: smoking, matches, and lung cancer ’ • ORpooled = 21.0 (16.3, 27.1) • ORmatches = 21.0 (10.5, 46.2) • ORno matches = 21.0 (12.9, 34.7) • Discuss your intuitions about the 95% CI s Pooled Cancer No cancer Cancer 810 Smoking No 900 300 Smoking 100 700 No cancer 270 Matches Smoking No Smoking No matches Smoking No Smoking 2014 Page 11 10 Cancer 90 90 70 No cancer 30 630 16
  • 12. Confounder? ? ? ? Unadjusted RR Exposure Disease ? Adjusted RR 19 2014 Page 12
  • 13. 2 BMJ 2004;329:868-869 (16 October) 2014 Page 13 Why is confounding so important in epidemiology? ● BMJ Editorial: “The scandal of poor epidemiological research” [16 October 2004] ● “Confounding, the situation in which an apparent effect of an exposure on risk is explained by its association with other factors, is probably the most important cause of spurious associations in observational epidemiology.”
  • 14. Overview 2014 Page 14 3 ● Causality is the central concern of epidemiology ● Confounding is the central concern with establishing causality ● Confounding can be understood using multiple different approaches ● A strong understanding of various approaches to confounding and its control is essential for all those who engage in health research