SlideShare a Scribd company logo
DATA QUALITY MATTERS: EHR DATA
QUALITY, MACRA, AND IMPROVING
HEALTHCARE
2017
Michael Hogarth, MD, FACP, FACMI
Professor, Internal Medicine
Professor and Vice Chair, Dept. of Pathology and Laboratory Medicine
http://hogarth.ucdavis.edu
mahogarth@ucdavis.edu
Summary
Three Fundamental Questions:
 How is Medicare doing today?
 Why is MACRA here (and what is it exactly)?
 Why does clinical data quality matter?
Question 1
How is Medicare doing today?
US Healthcare is unsustainable
In 6 years, NHE will be 19.3% of $26T!!
This is a 60% increase in total expenditure
60% increase
What is Medicare?
Medicare Today -- A Runaway Train…
The widening gap between beneficiaries and contributors
2016 Medicare Trustee’s Report
2014: 43% of all healthcare in the US paid directly by government
Govt sponsor Percentage
Medicare 20%
Fed Medicaid 10%
State Medicaid 6%
VA/DOD/CHIP 4%
Public Health 3%
And you are loosing money…
Medicare Projection of Cost vs. Assets (solvency)
Costs exceed assets
~2022-2028
Oh by the way, US healthcare gets a ”D-”
Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare
Physician actions affect Medicare in many ways
Physicians prescribing decisions are far reaching…
Question 2
Why is MACRA here and
what is it exactly?
SGR
Introduced
What was wrong with the SGR?
• Fundamentally flawed
• Attempted to limit
expenditures on physician
services by restraining
payments without
limiting the growth in
volume and complexity
of the services provided
• In 2015, SGR would have
invoked a 24% fee
reduction for Medicare
providers
History of the “doc fixes”
Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare
What is the scope of MACRA?
The financial footprint
1,048,575 Providers
Physicians, PAs, clinical nurse specialists, anesthetists
The Medicare provider footprint today
~300,000
physicians
(2013)
The Importance of MACRA and beyond
 MACRA is the ‘start’ of an evolution towards value
based purchasing
 Value-based reimbursement requires managing
patients across multiple providers -- requires data
exchange between EHR systems
 Value-based reimbursement increases the need for
your organization to know where it stands
 High quality clinical care data
 Health analytics
MACRA’s two pathways
 MIPS: “Merit Based Incentive Payment Program”
 ~90% of practices will choose this option
 MIPS is a Modified fee-for-service
 Combines meaningful use with cost, quality, and clinical practice
improvement – A Composite Performance Score (CPS)
 APM: “Alternative Payment Model”
 Models that reduce costs and drive high quality
 Reporting is different than MIPS
 Incentives, NO penalties
https://www.greenwayhealth.com/blog/path-macra-paved-big-decisions/
Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare
Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare
Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare
Calculating Provider Payment
GPRO Quality Measures
Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare
Advancing Care Information
APM – Alternative Payment Model
Its not just Medicare…
ACO Lives Covered and Payer Distribution
Question 3
Why does data quality
matter?
c.2017 – Is data quality important?
Clinical Data Quality: What is it?
The 5 Dimensions of Clinical Data Quality
1) Completeness – is the EHR record complete?
2) Correcteness – Is an element in the EHR true?
3) Concordance – Is there agreement between elements in the
EHR, or between the EHR and another data source?
4) Plausability – Does an element make sense in light of other
knowledge at a given point in time?
5) Currency – Is a piece of data a relevant representation of
the patient at a given point in time?
6) Relevance/Fit-for-use – Are the elements needed for a
metric of high quality?
Data Quality
CompletenessCorrectness
Concordance Plausability
Relevance (fit for use) Currency
Context – A Key Factor in Data Quality
Healthcare -- ‘fit for purpose’ involving a population
context (usually a specific population)
Correctness and Completeness in early EHRs
“The Tethered Meta-Registry”
cohort inclusion through “tagging” with real-time rule-based algorithms
The UCD Tethered
Meta-Registry
- “Meta-Registry” – All
data for all registries
is in one repository
- “Tethered” – routine,
automated data
extraction from
source systems
- Computable cohorts –
algorithms “tag”
patients as being in
one or more registries
- Automated
dashboards and
reports
• “Meta Registry”
• Shared data dimensions / standardized definitions
Sepsis
Registry
Mobility
(ICU)
Registry
Diabetes
Registry
Transfusion
Registry
Source Data
“Tether”
EMR
Reporting
Database
Administrativ
e Data
Laboratory
Information
System
TMR Patient
TMR Encounters
TMR Flowsheets
TMR Procedures/Labs
TMR Medications
• Individual Registries
• Leverage “Meta Registry”
39
The UC Davis Health Tethered Meta Registry (TMR) Architecture and Data
Flow
2.2 Million
25 Million
100 Million
57 Million
16 Million
The UCDHS “Diabetes Registry” (4/7/2017)
Transfusions
Missing
data
Female + Prostate Cancer
UC-ReX: ~14M patient records (UCLA, UCSF, UCSD, UCD, UCI)
UCD: has 41 EHR records with
female gender and prostate cancer
diagnosis
Urine pregnancy tests from 2015-2017
17patients?
Diabetics and a glucose test
UCD: 17% of diabetics do not have a
glucose test result in their EHR
record
Surgery and Coagulation Testing
UCD: 61.1% of patients undergoing
surgery did not have a coagulation
test in their EHR record
Pregnancy tests
10pts?
Pregnancy tests in males…
24 males with urine
pregnancy testing
Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare
Distributed Analytics
Sending the analytics procedure to the data
visualization
Clarity
The Observational Medical Outcomes
Partnership (OMOP) Common Data
Model
and
Data Profiling (ACHILLES)
ACHILLES
What is Data Profiling?
• Systematic and generalizable method of
data quality assessment
• Can you answer the following questions
– Does your organization have a clinical data
repository?
– Does the group that manages this
repository implement data profiling in any
way?
– What kind of skill sets are required for a
group to optimally perform good data
profiling?
Aim of Research
Using OMOP and ACHILLES – profiling your data
75% of records
have unknown race?
Nobody is older than 85?
(1) Only have dx for pts. admitted after
1984?
(2) Someone is pre-admitted for 2020....
35 million procedures are “unknown” type?
We have a procedure for someone
To be admitted 12 years from now
Only 659,000 records have a diagnosis!!!
Births and Deaths “en masse”
• UCDHS – 2.3M patient records
• Created a histogram of “deceased” across months/years
• 26,000 patients “died” on Jan 1 1980...
– Nobody could remember why this was the case...
UCDHS pScanner data profiling with ACHILLES
Over 300,000 born in 1930?
Death/mortality
(UCDHS pScanner database)
Data Density
(UCDHS pScanner database)
Conditions “Heat Map” (Asthma)
Condition map – Breast Neoplasm
UC Health Patients Alive and >85
There were only 600,000 Californians
over 85 in 2010!
1.8M non-deceased and over
85 across UC Health
Who should own data quality?
https://gcn.com/articles/2016/07/13/data-quality-responsibility.aspx?admgarea=TC_BigData
Eastern Sierras
“The Range of Light”

More Related Content

PPTX
Big data in healthcare: an OTC case
PDF
Watson Health Closes Acquisition of Truven Health Analytics
PPTX
Using Big Data to Personalize the Healthcare Experience in Cancer, Genomics a...
PPTX
Introduction To Medical Data
PPTX
Data Quality in Healthcare: An Important Challenge
PPTX
Data Mining in Health Care
PDF
Big Data in Healthcare: Hype and Hope on the Path to Personalized Medicine
PPTX
Big Data and Smart Healthcare
Big data in healthcare: an OTC case
Watson Health Closes Acquisition of Truven Health Analytics
Using Big Data to Personalize the Healthcare Experience in Cancer, Genomics a...
Introduction To Medical Data
Data Quality in Healthcare: An Important Challenge
Data Mining in Health Care
Big Data in Healthcare: Hype and Hope on the Path to Personalized Medicine
Big Data and Smart Healthcare

What's hot (20)

PPTX
Big data in healthcare
PDF
Connected Health & Me - Matic Meglic - Nov 24th 2014
PPTX
7 keys to open doors at CVS
PPTX
Jennifer Horowitz EHR Adoption in Michigan & Nationwide
PPTX
Nursing informatics Tools
PPT
Connecting Patients, Providers and Payers John Halamka Keynote
PDF
Big data analytics in healthcare industry
PPTX
Population Health Management, Predictive Analytics, Big Data and Text Analytics
PDF
An Introduction to Clinical Informatics
PDF
Big implications of Big Data in healthcare
PPTX
Big Data applications in Health Care
PDF
Electronic Medical Records and Meaningful Use
PDF
Big Data Analytics in Health Care: A Review Paper
PPTX
Analytics in healthcare
PPT
A Consistent Nationwide Data Matching Strategy Donna Roach & Nancy Walker
PPTX
Big data in Healthcare & Life Sciences
PDF
Psdot 14 using data mining techniques in heart
PDF
Health 2.0 Boston 2015 Code-a-Thon - 1st Place Winner - HEALTHPartner
PPTX
HXR 2016: The Health IoT: Remote Care and Mobile Solutions -Manu Varma, Philips
PDF
1440 batarseh share
Big data in healthcare
Connected Health & Me - Matic Meglic - Nov 24th 2014
7 keys to open doors at CVS
Jennifer Horowitz EHR Adoption in Michigan & Nationwide
Nursing informatics Tools
Connecting Patients, Providers and Payers John Halamka Keynote
Big data analytics in healthcare industry
Population Health Management, Predictive Analytics, Big Data and Text Analytics
An Introduction to Clinical Informatics
Big implications of Big Data in healthcare
Big Data applications in Health Care
Electronic Medical Records and Meaningful Use
Big Data Analytics in Health Care: A Review Paper
Analytics in healthcare
A Consistent Nationwide Data Matching Strategy Donna Roach & Nancy Walker
Big data in Healthcare & Life Sciences
Psdot 14 using data mining techniques in heart
Health 2.0 Boston 2015 Code-a-Thon - 1st Place Winner - HEALTHPartner
HXR 2016: The Health IoT: Remote Care and Mobile Solutions -Manu Varma, Philips
1440 batarseh share
Ad

Similar to Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare (20)

PDF
xyramsoft.com-Data Quality In Healthcare.pdf
DOCX
Ahima data quality management model
PPTX
Clinical Data Collection: The Good, the Bad, the Beautiful
PPTX
The Many Lives of Data
PPTX
McGrath Health Data Analyst SXSW
PDF
white-paper-hc-saving-lives-data-quality-en-na-f04
PPTX
10th Annual Utah's Health Services Research Conference - Data: What's availab...
DOCX
Quality management system model
PDF
Performance Performance Dashboard
PPTX
Using Advanced Analytics for Value-based Healthcare Delivery
PPTX
Lecture 9 A
DOCX
Quality management model
PPTX
Late Binding in Data Warehouses
PDF
Data Management - a top Priority for Healthcare Practices
PDF
Sucessful Healthcare Organizations will be Data Driven
PPTX
Clinical Healthcare Data Analytics
PDF
Combining Patient Records, Genomic Data and Environmental Data to Enable Tran...
PDF
eBook - Data Analytics in Healthcare
PDF
Data-The-Steel-Thread-April-2016 (1)
PPTX
Late-Binding Data Warehouse - An Update on the Fastest Growing Trend in Healt...
xyramsoft.com-Data Quality In Healthcare.pdf
Ahima data quality management model
Clinical Data Collection: The Good, the Bad, the Beautiful
The Many Lives of Data
McGrath Health Data Analyst SXSW
white-paper-hc-saving-lives-data-quality-en-na-f04
10th Annual Utah's Health Services Research Conference - Data: What's availab...
Quality management system model
Performance Performance Dashboard
Using Advanced Analytics for Value-based Healthcare Delivery
Lecture 9 A
Quality management model
Late Binding in Data Warehouses
Data Management - a top Priority for Healthcare Practices
Sucessful Healthcare Organizations will be Data Driven
Clinical Healthcare Data Analytics
Combining Patient Records, Genomic Data and Environmental Data to Enable Tran...
eBook - Data Analytics in Healthcare
Data-The-Steel-Thread-April-2016 (1)
Late-Binding Data Warehouse - An Update on the Fastest Growing Trend in Healt...
Ad

More from Mike Hogarth, MD, FACMI, FACP (16)

PPTX
Big Data in Clinical Research
PPTX
EHR v2.0: Optimizing Usability and Utility
PPTX
Informatics in disease management: What will the future bring?
PPTX
Informatics and the merging of research and quality measures with bedside care
PPTX
Keep us safe: An overview of US public health informatics systems and archite...
PPTX
Taking Quantum Computing for a Spin: What is Imaginary and What is Real?
PPT
Linking Electronic Patient Records and Death Records: Challenges and Opportun...
PPTX
The OneSource Initiative: An Approach to Structured Sourcing of Key Clinical ...
PPTX
A Federal and California State Collaboration to Improve Vital Events Reporting
PPT
Classic Papers in Medical Informatics
PPTX
Public Health Information Systems and Data Standards in Public Health Informa...
PPT
Pathology Informatics: Past, Present, and Future
PPTX
Engaging Patients Electronically for Research and Education: Challenges and O...
PPTX
Best Practices in Clinical Systems Integration
PPT
Informatics Principles of Modern Institutional Bio-banking: The Road Ahead
PPTX
From Bits to Qubits: Can Medicine Benefit From Quantum Computing?
Big Data in Clinical Research
EHR v2.0: Optimizing Usability and Utility
Informatics in disease management: What will the future bring?
Informatics and the merging of research and quality measures with bedside care
Keep us safe: An overview of US public health informatics systems and archite...
Taking Quantum Computing for a Spin: What is Imaginary and What is Real?
Linking Electronic Patient Records and Death Records: Challenges and Opportun...
The OneSource Initiative: An Approach to Structured Sourcing of Key Clinical ...
A Federal and California State Collaboration to Improve Vital Events Reporting
Classic Papers in Medical Informatics
Public Health Information Systems and Data Standards in Public Health Informa...
Pathology Informatics: Past, Present, and Future
Engaging Patients Electronically for Research and Education: Challenges and O...
Best Practices in Clinical Systems Integration
Informatics Principles of Modern Institutional Bio-banking: The Road Ahead
From Bits to Qubits: Can Medicine Benefit From Quantum Computing?

Recently uploaded (20)

PPTX
1. Basic chemist of Biomolecule (1).pptx
PPTX
surgery guide for USMLE step 2-part 1.pptx
PDF
focused on the development and application of glycoHILIC, pepHILIC, and comm...
PPTX
PRESENTACION DE TRAUMA CRANEAL, CAUSAS, CONSEC, ETC.
PDF
Transcultural that can help you someday.
PPTX
Cardiovascular - antihypertensive medical backgrounds
PDF
SEMEN PREPARATION TECHNIGUES FOR INTRAUTERINE INSEMINATION.pdf
PDF
Cardiology Pearls for Primary Care Providers
PPTX
2 neonat neotnatology dr hussein neonatologist
PPTX
y4d nutrition and diet in pregnancy and postpartum
PPTX
CHEM421 - Biochemistry (Chapter 1 - Introduction)
PPTX
IMAGING EQUIPMENiiiiìiiiiiTpptxeiuueueur
PPTX
Human Reproduction: Anatomy, Physiology & Clinical Insights.pptx
PPTX
Reading between the Rings: Imaging in Brain Infections
PPTX
MANAGEMENT SNAKE BITE IN THE TROPICALS.pptx
PPTX
Neuropathic pain.ppt treatment managment
PPTX
ANATOMY OF MEDULLA OBLANGATA AND SYNDROMES.pptx
PPTX
Stimulation Protocols for IUI | Dr. Laxmi Shrikhande
PDF
Oral Aspect of Metabolic Disease_20250717_192438_0000.pdf
PPTX
ONCOLOGY Principles of Radiotherapy.pptx
1. Basic chemist of Biomolecule (1).pptx
surgery guide for USMLE step 2-part 1.pptx
focused on the development and application of glycoHILIC, pepHILIC, and comm...
PRESENTACION DE TRAUMA CRANEAL, CAUSAS, CONSEC, ETC.
Transcultural that can help you someday.
Cardiovascular - antihypertensive medical backgrounds
SEMEN PREPARATION TECHNIGUES FOR INTRAUTERINE INSEMINATION.pdf
Cardiology Pearls for Primary Care Providers
2 neonat neotnatology dr hussein neonatologist
y4d nutrition and diet in pregnancy and postpartum
CHEM421 - Biochemistry (Chapter 1 - Introduction)
IMAGING EQUIPMENiiiiìiiiiiTpptxeiuueueur
Human Reproduction: Anatomy, Physiology & Clinical Insights.pptx
Reading between the Rings: Imaging in Brain Infections
MANAGEMENT SNAKE BITE IN THE TROPICALS.pptx
Neuropathic pain.ppt treatment managment
ANATOMY OF MEDULLA OBLANGATA AND SYNDROMES.pptx
Stimulation Protocols for IUI | Dr. Laxmi Shrikhande
Oral Aspect of Metabolic Disease_20250717_192438_0000.pdf
ONCOLOGY Principles of Radiotherapy.pptx

Data Quality Matters: EHR Data Quality, MACRA, and Improving Healthcare

  • 1. DATA QUALITY MATTERS: EHR DATA QUALITY, MACRA, AND IMPROVING HEALTHCARE 2017 Michael Hogarth, MD, FACP, FACMI Professor, Internal Medicine Professor and Vice Chair, Dept. of Pathology and Laboratory Medicine http://hogarth.ucdavis.edu mahogarth@ucdavis.edu
  • 2. Summary Three Fundamental Questions:  How is Medicare doing today?  Why is MACRA here (and what is it exactly)?  Why does clinical data quality matter?
  • 3. Question 1 How is Medicare doing today?
  • 4. US Healthcare is unsustainable In 6 years, NHE will be 19.3% of $26T!! This is a 60% increase in total expenditure 60% increase
  • 6. Medicare Today -- A Runaway Train…
  • 7. The widening gap between beneficiaries and contributors 2016 Medicare Trustee’s Report
  • 8. 2014: 43% of all healthcare in the US paid directly by government Govt sponsor Percentage Medicare 20% Fed Medicaid 10% State Medicaid 6% VA/DOD/CHIP 4% Public Health 3%
  • 9. And you are loosing money…
  • 10. Medicare Projection of Cost vs. Assets (solvency) Costs exceed assets ~2022-2028
  • 11. Oh by the way, US healthcare gets a ”D-”
  • 13. Physician actions affect Medicare in many ways
  • 14. Physicians prescribing decisions are far reaching…
  • 15. Question 2 Why is MACRA here and what is it exactly?
  • 17. What was wrong with the SGR? • Fundamentally flawed • Attempted to limit expenditures on physician services by restraining payments without limiting the growth in volume and complexity of the services provided • In 2015, SGR would have invoked a 24% fee reduction for Medicare providers History of the “doc fixes”
  • 19. What is the scope of MACRA? The financial footprint 1,048,575 Providers Physicians, PAs, clinical nurse specialists, anesthetists The Medicare provider footprint today ~300,000 physicians (2013)
  • 20. The Importance of MACRA and beyond  MACRA is the ‘start’ of an evolution towards value based purchasing  Value-based reimbursement requires managing patients across multiple providers -- requires data exchange between EHR systems  Value-based reimbursement increases the need for your organization to know where it stands  High quality clinical care data  Health analytics
  • 21. MACRA’s two pathways  MIPS: “Merit Based Incentive Payment Program”  ~90% of practices will choose this option  MIPS is a Modified fee-for-service  Combines meaningful use with cost, quality, and clinical practice improvement – A Composite Performance Score (CPS)  APM: “Alternative Payment Model”  Models that reduce costs and drive high quality  Reporting is different than MIPS  Incentives, NO penalties https://www.greenwayhealth.com/blog/path-macra-paved-big-decisions/
  • 29. APM – Alternative Payment Model
  • 30. Its not just Medicare…
  • 31. ACO Lives Covered and Payer Distribution
  • 32. Question 3 Why does data quality matter?
  • 33. c.2017 – Is data quality important?
  • 34. Clinical Data Quality: What is it? The 5 Dimensions of Clinical Data Quality 1) Completeness – is the EHR record complete? 2) Correcteness – Is an element in the EHR true? 3) Concordance – Is there agreement between elements in the EHR, or between the EHR and another data source? 4) Plausability – Does an element make sense in light of other knowledge at a given point in time? 5) Currency – Is a piece of data a relevant representation of the patient at a given point in time? 6) Relevance/Fit-for-use – Are the elements needed for a metric of high quality? Data Quality CompletenessCorrectness Concordance Plausability Relevance (fit for use) Currency
  • 35. Context – A Key Factor in Data Quality
  • 36. Healthcare -- ‘fit for purpose’ involving a population context (usually a specific population)
  • 38. “The Tethered Meta-Registry” cohort inclusion through “tagging” with real-time rule-based algorithms The UCD Tethered Meta-Registry - “Meta-Registry” – All data for all registries is in one repository - “Tethered” – routine, automated data extraction from source systems - Computable cohorts – algorithms “tag” patients as being in one or more registries - Automated dashboards and reports
  • 39. • “Meta Registry” • Shared data dimensions / standardized definitions Sepsis Registry Mobility (ICU) Registry Diabetes Registry Transfusion Registry Source Data “Tether” EMR Reporting Database Administrativ e Data Laboratory Information System TMR Patient TMR Encounters TMR Flowsheets TMR Procedures/Labs TMR Medications • Individual Registries • Leverage “Meta Registry” 39 The UC Davis Health Tethered Meta Registry (TMR) Architecture and Data Flow 2.2 Million 25 Million 100 Million 57 Million 16 Million
  • 40. The UCDHS “Diabetes Registry” (4/7/2017)
  • 42. Female + Prostate Cancer UC-ReX: ~14M patient records (UCLA, UCSF, UCSD, UCD, UCI) UCD: has 41 EHR records with female gender and prostate cancer diagnosis
  • 43. Urine pregnancy tests from 2015-2017 17patients?
  • 44. Diabetics and a glucose test UCD: 17% of diabetics do not have a glucose test result in their EHR record
  • 45. Surgery and Coagulation Testing UCD: 61.1% of patients undergoing surgery did not have a coagulation test in their EHR record
  • 47. Pregnancy tests in males… 24 males with urine pregnancy testing
  • 49. Distributed Analytics Sending the analytics procedure to the data visualization
  • 50. Clarity The Observational Medical Outcomes Partnership (OMOP) Common Data Model and Data Profiling (ACHILLES) ACHILLES
  • 51. What is Data Profiling? • Systematic and generalizable method of data quality assessment • Can you answer the following questions – Does your organization have a clinical data repository? – Does the group that manages this repository implement data profiling in any way? – What kind of skill sets are required for a group to optimally perform good data profiling? Aim of Research
  • 52. Using OMOP and ACHILLES – profiling your data 75% of records have unknown race? Nobody is older than 85? (1) Only have dx for pts. admitted after 1984? (2) Someone is pre-admitted for 2020.... 35 million procedures are “unknown” type? We have a procedure for someone To be admitted 12 years from now Only 659,000 records have a diagnosis!!!
  • 53. Births and Deaths “en masse” • UCDHS – 2.3M patient records • Created a histogram of “deceased” across months/years • 26,000 patients “died” on Jan 1 1980... – Nobody could remember why this was the case... UCDHS pScanner data profiling with ACHILLES Over 300,000 born in 1930?
  • 57. Condition map – Breast Neoplasm
  • 58. UC Health Patients Alive and >85 There were only 600,000 Californians over 85 in 2010! 1.8M non-deceased and over 85 across UC Health
  • 59. Who should own data quality? https://gcn.com/articles/2016/07/13/data-quality-responsibility.aspx?admgarea=TC_BigData

Editor's Notes

  • #40: The TMR layer represents both raw and derived data. The derived data is the big value add. For example, each encounter is classified as a result of several raw data points. After this derivation, each patient record can be summarized with the number of classified events per time window.