SlideShare a Scribd company logo
Modelling causal pathways in health
services, part 2
12/06/2015
Modelling
• Representations of the world
– Models of data and models of phenomena
• Make our assumptions clear and transparent
Why?
• For policy we need a causal effect
• Usually ATE or ATET
– E.g. 𝐸 𝑌 𝐷1 − 𝐸 𝑌 𝐷0
• Barriers:
– Observational data
– Can’t measure endpoints
• But data, even observational data, tell us something
Bayesian Causal Networks
Outline
• Interested in the effect X->Y
• Some information on 𝑝𝑞
• Lots of information on 𝑝
X Z Y
p q
Outline
• Interested in X->Y
• But confounded by 𝑢
• Can still identify causal effect by making use of 𝑍
X Z Y
u
Outline
• Model describes relationships between variables
• Can combine information on different data sources
Intervention
Upstream
endpoint
Patient
outcomes
Example: Computerised Physician
Order Entry
Example: Computerised Physician
Order Entry
CPOE ME ADE
𝑅𝑅 =
𝑃(𝐴𝐷𝐸|𝐶𝑃𝑂𝐸 = 1)
𝑃(𝐴𝐷𝐸|𝐶𝑃𝑂𝐸 = 0)
=
𝑃(𝐴𝐷𝐸|𝑀𝐸)𝑃(𝑀𝐸|𝐶𝑃𝑂𝐸 = 1)
𝑃(𝐴𝐷𝐸|𝑀𝐸)𝑃(𝑀𝐸|𝐶𝑃𝑂𝐸 = 0)
=
𝑃(𝑀𝐸|𝐶𝑃𝑂𝐸 = 1)
𝑃(𝑀𝐸|𝐶𝑃𝑂𝐸 = 0)
Using only studies with ADE endpoint Using studies with ADE and ME endpoint
Modelling causal pathways in health services part 2 - Sam Watson
Modelling causal pathways in health services part 2 - Sam Watson
Nuckols et al.
Modelling causal pathways in health services part 2 - Sam Watson
Modelling causal pathways in health services part 2 - Sam Watson
Modelling causal pathways in health services part 2 - Sam Watson
Weekend mortality
Weekend
admission
Errors Mortality
Health
Weekend mortality
• Many studies have examined the effect of weekend admission on
risk of mortality (at least 105).
• In the UK the estimated relative risk 1.1-1.2 (Meacock, Doran, and
Sutton, 2015, Freemantle et al., 2012)
• Confounded by patient health
Weekend mortality
• Examine data that measure day of admission, mortality, and errors
• SPI2 data
– Patients aged >65 with acute respiratory illness
• Crude mortality relative risk: 1.17 [0.79, 1.60]
• Adjusted (age, sex, number of comorbidities) RR: 1.19 [0.79, 1.75]
• Similar point estimates. Under powered (n=670)
Weekend mortality
• Front-door estimator
• 𝑃 𝑌 𝑊 = 𝑤 = 𝐸 𝑃 𝐸 𝑊 = 𝑤 𝑊′ 𝑃 𝑌 𝑊′, 𝐸 𝑃 𝑊′
• RR: 1.03 [1.00, 1.06]
Weekend mortality
• Assumption of no relationship between errors and health may be too
strong:
– Sicker patients more exposed to risk of error
– Sicker patients more likely to die, less exposed to risk of error
Weekend
admission
Errors Mortality
Health
Weekend mortality
• Examine performance of estimators under different assumptions
using simulated data
– Two types of individual: sick v healthy. Sick 4x more likely to die.
• Only when there is no unobserved confounding due to health is the
‘standard’ estimator preferred, even with fairly large relationship
between errors and health.
• No evidence of a difference in errors by weekend or by health in
SPI2 data.
Example: Weekend Consultants
Expert Elicitation
• What happens when there are no data?
• Can use expert elicitation.
Figure: Example group subjective prior,
from Yao et al. (2012) BMJ Qual Saf. See
also Lilford et al. (2014) BMC Health Serv
Res.
Conclusions

More Related Content

PDF
STARS_presentation_EthanNg_2016_pdf
PPT
Bateman bathsrr jan2013slides
PPTX
“ High Precision Analytics for Healthcare: Promises and Challenges” by Sriram...
PPTX
Medical data diagnosis
PPTX
Analysis of "A Predictive Analytics Primer" by Tom Davenport
PPTX
Benefits of AI and ML in healthcare
PPTX
Medical Writing
STARS_presentation_EthanNg_2016_pdf
Bateman bathsrr jan2013slides
“ High Precision Analytics for Healthcare: Promises and Challenges” by Sriram...
Medical data diagnosis
Analysis of "A Predictive Analytics Primer" by Tom Davenport
Benefits of AI and ML in healthcare
Medical Writing

What's hot (7)

PPTX
Navigating NHS Administrative Data
PPTX
What is statistics
PPTX
Panel on EHR Research in NZ Beyond 2014
PPTX
LeAnna Kent - Using Network Analysis to Detect Kickback Schemes Among Medical...
PDF
Prof Mendel Singer Big Data Meets Public Health and Medicine 2018 12-22
PDF
Filling the gaps in translational research
Navigating NHS Administrative Data
What is statistics
Panel on EHR Research in NZ Beyond 2014
LeAnna Kent - Using Network Analysis to Detect Kickback Schemes Among Medical...
Prof Mendel Singer Big Data Meets Public Health and Medicine 2018 12-22
Filling the gaps in translational research
Ad

Viewers also liked (15)

PPTX
Multi morbidity - the notion of tacit knowledge - Magdalena Skrybant and Celi...
PPTX
Welcome and introduction...The year that was - Prof Richard Lilford
PDF
Overview study on integrated care for chronic diseases - 11th February
PPTX
Modelling and Estimation
PPTX
Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...
PPS
Baby
PPTX
Clahrc ps cmeeting_21st_sept2015_spacer_project_af
PPTX
Publication bias in service delivery research: a critique - John Ovretveit
PPTX
Modelling causal pathways in health services part 1, Prof Richard Lilford
PPSX
PPTX
Clahrc ps cmeeting_21st_sept2015_spacer_project_kp
PPTX
Design choices for cluster randomised trials - Alan Girling
PDF
Observations and Reflections of my visit to Rolls-Royce in Derby - Nathalie M...
PDF
Oxford home study prospectus
PPS
Merhaba demek
Multi morbidity - the notion of tacit knowledge - Magdalena Skrybant and Celi...
Welcome and introduction...The year that was - Prof Richard Lilford
Overview study on integrated care for chronic diseases - 11th February
Modelling and Estimation
Magdalena Skrybant and Nathalie Maillard - Patient and Public Involvement and...
Baby
Clahrc ps cmeeting_21st_sept2015_spacer_project_af
Publication bias in service delivery research: a critique - John Ovretveit
Modelling causal pathways in health services part 1, Prof Richard Lilford
Clahrc ps cmeeting_21st_sept2015_spacer_project_kp
Design choices for cluster randomised trials - Alan Girling
Observations and Reflections of my visit to Rolls-Royce in Derby - Nathalie M...
Oxford home study prospectus
Merhaba demek
Ad

Similar to Modelling causal pathways in health services part 2 - Sam Watson (20)

PPTX
Statistics.pptx
PPTX
MBBS Teaching module biostatistics -3- presentation
PPT
Statistics basics for oncologist kiran
PPT
statistics introduction.ppt
PPTX
Presentation 1 data types and distributions1.pptx
PPT
Medical Statistics.ppt
PPTX
Heart Disease Prediction Analysis - Sushil Gupta.pptx
PDF
Heart Disease Classification Report: A Data Analysis Project
PDF
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
PDF
Clinical research ( Medical stat. concepts)
PDF
Applied use of CUSUMs in surveillance
PDF
Biostatistics and epidemiology 01stats20
PPTX
Epidemological methods
PPTX
Capstone Presentation.pptx
PPTX
Basic of Biostatisticsin the field of healthcare research.pptx
PDF
Statistics.pdf.pdf for Research Physiotherapy and Occupational Therapy
PDF
BASIC STATISTICS AND THEIR INTERPRETATION AND USE IN EPIDEMIOLOGY 050822.pdf
PPTX
Heart Disease Classification: Machine Learning Analysis
PPTX
Heart Disease Classification: Machine Learning Analysis
PPTX
Module7_RamdomError.pptx
Statistics.pptx
MBBS Teaching module biostatistics -3- presentation
Statistics basics for oncologist kiran
statistics introduction.ppt
Presentation 1 data types and distributions1.pptx
Medical Statistics.ppt
Heart Disease Prediction Analysis - Sushil Gupta.pptx
Heart Disease Classification Report: A Data Analysis Project
NLP Data Science Project Presentation:Predicting Heart Disease with NLP Data ...
Clinical research ( Medical stat. concepts)
Applied use of CUSUMs in surveillance
Biostatistics and epidemiology 01stats20
Epidemological methods
Capstone Presentation.pptx
Basic of Biostatisticsin the field of healthcare research.pptx
Statistics.pdf.pdf for Research Physiotherapy and Occupational Therapy
BASIC STATISTICS AND THEIR INTERPRETATION AND USE IN EPIDEMIOLOGY 050822.pdf
Heart Disease Classification: Machine Learning Analysis
Heart Disease Classification: Machine Learning Analysis
Module7_RamdomError.pptx

More from NIHR CLAHRC West Midlands (20)

PPTX
Emma Healey presentation on ENHANCE Project
PPTX
Alison Hipwell presentation at PPI Supervisory Committee meeting
PDF
Rapid qualitative analysis: does it deliver? - Beck Taylor
PDF
Shout Out for Youth Mental Health feedback - John Ovretveit
PDF
Towards a National Learning Health System - Aziz Sheikh
PDF
A century of health services development in Birmingham - Tim Jones
PDF
Dog-legs, Ladders and a CONSORT statement - Alan Girling and Karla Hemming
PPTX
4 - Further info - Setting up research in the NHS: practical and ethical cons...
PPTX
3 - UoB - Setting up research in the NHS: practical and ethical considerations
PPTX
2 CRN - Setting up research in the NHS: practical and ethical considerations
PPTX
1 - HRA - Setting up research in the NHS: practical and ethical considerations
PPTX
CLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom Marshall
PPTX
Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...
PPTX
Prof Tom Marshall - Introduction to the opportunties and support available to...
PPTX
The last fellowship... the next fellowship application
PPTX
Rapid qualitative analysis vs the 'traditional approach': early findings and ...
PPTX
Clahrc ps cmeeting_21st_sept2015_spacer_project_dt
PPTX
Clahrc ps cmeeting_21st_sept2015_spacer_project_cc
PPTX
Preventing Obesity in Pregnancy Study (POPS 2)
PPTX
Where's WALY - Aileen Clarke and Sian Taylor-Phillips
Emma Healey presentation on ENHANCE Project
Alison Hipwell presentation at PPI Supervisory Committee meeting
Rapid qualitative analysis: does it deliver? - Beck Taylor
Shout Out for Youth Mental Health feedback - John Ovretveit
Towards a National Learning Health System - Aziz Sheikh
A century of health services development in Birmingham - Tim Jones
Dog-legs, Ladders and a CONSORT statement - Alan Girling and Karla Hemming
4 - Further info - Setting up research in the NHS: practical and ethical cons...
3 - UoB - Setting up research in the NHS: practical and ethical considerations
2 CRN - Setting up research in the NHS: practical and ethical considerations
1 - HRA - Setting up research in the NHS: practical and ethical considerations
CLAHARC WM Capacity Development Strategy - Nathalie Maillard and Tom Marshall
Feedback from 'speed dating' - Postgrad / Early Career Researcher event 19th ...
Prof Tom Marshall - Introduction to the opportunties and support available to...
The last fellowship... the next fellowship application
Rapid qualitative analysis vs the 'traditional approach': early findings and ...
Clahrc ps cmeeting_21st_sept2015_spacer_project_dt
Clahrc ps cmeeting_21st_sept2015_spacer_project_cc
Preventing Obesity in Pregnancy Study (POPS 2)
Where's WALY - Aileen Clarke and Sian Taylor-Phillips

Recently uploaded (20)

PDF
Handout_ NURS 220 Topic 10-Abnormal Pregnancy.pdf
PPT
ASRH Presentation for students and teachers 2770633.ppt
PPTX
Transforming Regulatory Affairs with ChatGPT-5.pptx
PPT
HIV lecture final - student.pptfghjjkkejjhhge
PPT
Management of Acute Kidney Injury at LAUTECH
PPT
STD NOTES INTRODUCTION TO COMMUNITY HEALT STRATEGY.ppt
PPTX
Cardiovascular - antihypertensive medical backgrounds
PPTX
CEREBROVASCULAR DISORDER.POWERPOINT PRESENTATIONx
PPTX
Chapter-1-The-Human-Body-Orientation-Edited-55-slides.pptx
PPT
Obstructive sleep apnea in orthodontics treatment
PPTX
post stroke aphasia rehabilitation physician
PPTX
History and examination of abdomen, & pelvis .pptx
PDF
Intl J Gynecology Obste - 2021 - Melamed - FIGO International Federation o...
PPTX
POLYCYSTIC OVARIAN SYNDROME.pptx by Dr( med) Charles Amoateng
PPTX
anaemia in PGJKKKKKKKKKKKKKKKKHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH...
PPTX
SKIN Anatomy and physiology and associated diseases
DOCX
RUHS II MBBS Microbiology Paper-II with Answer Key | 6th August 2025 (New Sch...
PPTX
Neuropathic pain.ppt treatment managment
PPTX
Note on Abortion.pptx for the student note
PPTX
DENTAL CARIES FOR DENTISTRY STUDENT.pptx
Handout_ NURS 220 Topic 10-Abnormal Pregnancy.pdf
ASRH Presentation for students and teachers 2770633.ppt
Transforming Regulatory Affairs with ChatGPT-5.pptx
HIV lecture final - student.pptfghjjkkejjhhge
Management of Acute Kidney Injury at LAUTECH
STD NOTES INTRODUCTION TO COMMUNITY HEALT STRATEGY.ppt
Cardiovascular - antihypertensive medical backgrounds
CEREBROVASCULAR DISORDER.POWERPOINT PRESENTATIONx
Chapter-1-The-Human-Body-Orientation-Edited-55-slides.pptx
Obstructive sleep apnea in orthodontics treatment
post stroke aphasia rehabilitation physician
History and examination of abdomen, & pelvis .pptx
Intl J Gynecology Obste - 2021 - Melamed - FIGO International Federation o...
POLYCYSTIC OVARIAN SYNDROME.pptx by Dr( med) Charles Amoateng
anaemia in PGJKKKKKKKKKKKKKKKKHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH...
SKIN Anatomy and physiology and associated diseases
RUHS II MBBS Microbiology Paper-II with Answer Key | 6th August 2025 (New Sch...
Neuropathic pain.ppt treatment managment
Note on Abortion.pptx for the student note
DENTAL CARIES FOR DENTISTRY STUDENT.pptx

Modelling causal pathways in health services part 2 - Sam Watson

  • 1. Modelling causal pathways in health services, part 2 12/06/2015
  • 2. Modelling • Representations of the world – Models of data and models of phenomena • Make our assumptions clear and transparent
  • 3. Why? • For policy we need a causal effect • Usually ATE or ATET – E.g. 𝐸 𝑌 𝐷1 − 𝐸 𝑌 𝐷0 • Barriers: – Observational data – Can’t measure endpoints • But data, even observational data, tell us something
  • 5. Outline • Interested in the effect X->Y • Some information on 𝑝𝑞 • Lots of information on 𝑝 X Z Y p q
  • 6. Outline • Interested in X->Y • But confounded by 𝑢 • Can still identify causal effect by making use of 𝑍 X Z Y u
  • 7. Outline • Model describes relationships between variables • Can combine information on different data sources Intervention Upstream endpoint Patient outcomes
  • 10. CPOE ME ADE 𝑅𝑅 = 𝑃(𝐴𝐷𝐸|𝐶𝑃𝑂𝐸 = 1) 𝑃(𝐴𝐷𝐸|𝐶𝑃𝑂𝐸 = 0) = 𝑃(𝐴𝐷𝐸|𝑀𝐸)𝑃(𝑀𝐸|𝐶𝑃𝑂𝐸 = 1) 𝑃(𝐴𝐷𝐸|𝑀𝐸)𝑃(𝑀𝐸|𝐶𝑃𝑂𝐸 = 0) = 𝑃(𝑀𝐸|𝐶𝑃𝑂𝐸 = 1) 𝑃(𝑀𝐸|𝐶𝑃𝑂𝐸 = 0) Using only studies with ADE endpoint Using studies with ADE and ME endpoint
  • 18. Weekend mortality • Many studies have examined the effect of weekend admission on risk of mortality (at least 105). • In the UK the estimated relative risk 1.1-1.2 (Meacock, Doran, and Sutton, 2015, Freemantle et al., 2012) • Confounded by patient health
  • 19. Weekend mortality • Examine data that measure day of admission, mortality, and errors • SPI2 data – Patients aged >65 with acute respiratory illness • Crude mortality relative risk: 1.17 [0.79, 1.60] • Adjusted (age, sex, number of comorbidities) RR: 1.19 [0.79, 1.75] • Similar point estimates. Under powered (n=670)
  • 20. Weekend mortality • Front-door estimator • 𝑃 𝑌 𝑊 = 𝑤 = 𝐸 𝑃 𝐸 𝑊 = 𝑤 𝑊′ 𝑃 𝑌 𝑊′, 𝐸 𝑃 𝑊′ • RR: 1.03 [1.00, 1.06]
  • 21. Weekend mortality • Assumption of no relationship between errors and health may be too strong: – Sicker patients more exposed to risk of error – Sicker patients more likely to die, less exposed to risk of error Weekend admission Errors Mortality Health
  • 22. Weekend mortality • Examine performance of estimators under different assumptions using simulated data – Two types of individual: sick v healthy. Sick 4x more likely to die. • Only when there is no unobserved confounding due to health is the ‘standard’ estimator preferred, even with fairly large relationship between errors and health. • No evidence of a difference in errors by weekend or by health in SPI2 data.
  • 24. Expert Elicitation • What happens when there are no data? • Can use expert elicitation. Figure: Example group subjective prior, from Yao et al. (2012) BMJ Qual Saf. See also Lilford et al. (2014) BMC Health Serv Res.