SlideShare a Scribd company logo
Applying a User-Centered A
Design Approach to Improve
Data Use in Decision Making
Michelle Li
MEASURE Evaluation
Palladium
APHA
November 7, 2017
Presenter Disclosures
The following personal financial relationships
with commercial interests relevant to this
presentation existed during the past 12 months:
No relationships to disclose
Michelle Li
Functions and Goals of a Health System
(2000)
FUNCTIONS (6 Building Blocks) GOALS/OUTCOMES OF
THE SYSTEM
Stewardship
Commodities
Infrastructure
Service delivery
Financing
I
N
P
U
T
S
Health
Responsiveness
(the way people are
treated and the
environment)
Fairness in
financial
contribution
Quality
Coverage
Efficiency
Source: WHO, 2000.
3
Human resources
Information
Safety
Improving Information Systems
• Global
commitment to
accountability
• New data
resources
• Result is more
and better data
More Data = Better Decisions?
Problem Statement
How can we develop interventions that
address individual needs and barriers
to data use?
Methods
• Location: Two districts in
South Africa and
Tanzania
• Participants: data users
and data producers
• Immersion interviews
• Design workshops:
• Understand barriers
• Ideate and prototype
Design Framework
Adapted from Standord d.school
Empathy
• How can we put
ourselves into the
shoes of the data user?
• What are our data
user’s wants, needs
and interests?
• What are our data
user’s challenges and
pain points?
Empathy – Immersion interviews
• Observe and speak to people at their place of
work to understand beliefs, attitudes, and
behaviors around data use
• What do you love most about your job?
• Who is the best data user you know? Why are
they good at their job?
• What is the most important aspect of your
work? What role does data play in this?
Design Framework
Define – Workshop I Activities
Insights on Data Use Barriers
• Technical
• Adequate and timely provision of resources
• Low confidence in quality of data collected
• Lack of clarity on how data is used
• HIS systems are adequate, but not used to full potential.
There is no involvement of end users in the design of HIS
systems and tools.
• Tension between service provision and data tasks, especially at
lower levels
• Data collection tools are overly complicated and there is a lack
of prioritization of data needs
Insights on Data Use Barriers
• Behavioural
• Little top-down positive feedback on data
• Primary data collectors display lack of commitment and negative
attitudes toward data use
• Organizational
• Value of data for decision making is not well understood – more
emphasis on collection
• Desire exists for a culture of data use
• Lack of clarity, poor communication, and complex SOPs hinder data
sharing and use
Define: Creating Personas
Go
Getters
• LOVE data
• Hard workers and proactive in work
• Frustrated by environments that accept
lower performers
• Desire for perfection can push them to work long
hours and burn out
Hyper-
actives
• Full of energy
• Seek attention constantly
• Require very hands-on supervision
• Can be creative problem solvers, but requires focused
workplan to stay on task
Lazy
Dodgers
• Always “busy” but do not produce quality outputs
• Always miss deadlines and targets
• Flourish in an environment with no consequences
• Full of excuses and avoid responsibilities
Personas
Design Framework
Ideate – How might we?
Design Framework
Prototype
 UGUdoc.com: A digital portal
connecting health workers with
current and archived data, policy
docs, SOPs, and an AskMe bulletin
board to receive feedback on
specific facility and system
challenges
 What’s Up Health/Social Media: A
communication solution to
consolidate district/provincial data-
related communication
in one place to accelerate
messaging, and information
Prototypes – Improving Communication
Prototypes – Improving data use
at lower levels
 Data Use Score Cards: Rapid data
use assessment score cards targeted
to health facilities, to provide
feedback and encourage
competition for best performer
facilities
 Clinicians on Board: A clinician data
sensitization program focused on
including data management in
clinician KPAs and training for “using
data to manage”
 Champion Cascade: Rapidly
create a culture of data use by
appointing champions across
levels; develop a toolkit to
develop presentation,
facilitation, and supervision
styles and share good practice
tools through a What’s Up
Health communications system.
Champions are awarded based
on overall HIS performance of
their facilities.
Prototypes – Promoting Data Use
Champions
Strengths of the UCD Process
• Development of context specific solutions
• Build ownership with users
• Facilitates empathy between data users and data
producers
• Engaging and fun!
Lessons Learned
• Design workshops are an innovative facilitation tool
to engage people to discuss and brainstorm
solutions to data use challenges
• Agree on an action plan (with resources, timelines,
and responsibilities)for prototype testing
• Identify highly motivated people (i.e., data use
champions) to move prototypes forward
• Support participants who want to take up
facilitation techniques and activities in their own
work
Acknowledgements
• Tara Nutley (MEASURE Evaluation, Palladium)
• Amanda Makulec (MEASURE Evaluation, JSI)
• Cal Bruns and Jason Coetzee (Matchboxology)
• Roselyn Kareithi (MEASURE Evaluation – Strategic
Information for South Africa [SIFSA])
• Sono Kusekwa and Jackie Patrick (MEASURE
Evaluation – Tanzania)
This presentation was produced with the support of the United
States Agency for International Development (USAID) under the
terms of MEASURE Evaluation cooperative agreement AID-OAA-L-
14-00004. MEASURE Evaluation is implemented by the Carolina
Population Center, University of North Carolina at Chapel Hill in
partnership with ICF International; John Snow, Inc.; Management
Sciences for Health; Palladium; and Tulane University. Views
expressed are not necessarily those of USAID or the United States
government.
www.measureevaluation.org

More Related Content

PPT
Assessing M&E Systems For Data Quality
PPTX
Quality improvement in reproductive, maternal, newborn and child health
PPT
MEASURE Evaluation Data Quality Assessment Methodology and Tools
PPTX
Data Demand and Use : Facilitating the Use of Data to Inform Programs and Pla...
PPT
Assessment of Constraints to Data Use
PPTX
Data Demand and Use Training Materials
Assessing M&E Systems For Data Quality
Quality improvement in reproductive, maternal, newborn and child health
MEASURE Evaluation Data Quality Assessment Methodology and Tools
Data Demand and Use : Facilitating the Use of Data to Inform Programs and Pla...
Assessment of Constraints to Data Use
Data Demand and Use Training Materials

What's hot (20)

PPTX
Strengthening an Organization’s Capacity to Demand and Use Data
PPTX
Framework for Linking Data with Action
DOCX
vspicer resume 022017
PDF
Social Networks for Data Use: How we can leverage a world of connections to i...
PPT
Decision Support System Enabled Data Warehouses for Improving the Analytic Ca...
PDF
Ensuring data quality
PDF
Health Information System Performance Monitoring Tool
PPT
Using Data to Support the Most Vulnerable: An OVC Information Needs Framework
PDF
CCIH-2017-Monitoring-and-Evaluation-Preconference-Module-2
PPTX
Olivia Velez - Requirements Analysis for an mHealth Application with Midwive...
PPTX
Data Warehousing: Bridging Islands of Health Information Systems
PPT
JR's Lifetime Advanced Analytics
PPSX
AIDSRelief IQCare HMIS EMR
PPT
International Quality Clinical HIV/AIDS Registry tool
DOC
CV Anuj
PPT
What Makes a Good Performance Management Plan? A new tool for managers
PPT
AIDSRelief Futures Group
PPTX
ISCRAM Impact Evaluation
PDF
2015 iHT2 Health IT Beverly Hills Summit
PPTX
Data Visualization in Health
Strengthening an Organization’s Capacity to Demand and Use Data
Framework for Linking Data with Action
vspicer resume 022017
Social Networks for Data Use: How we can leverage a world of connections to i...
Decision Support System Enabled Data Warehouses for Improving the Analytic Ca...
Ensuring data quality
Health Information System Performance Monitoring Tool
Using Data to Support the Most Vulnerable: An OVC Information Needs Framework
CCIH-2017-Monitoring-and-Evaluation-Preconference-Module-2
Olivia Velez - Requirements Analysis for an mHealth Application with Midwive...
Data Warehousing: Bridging Islands of Health Information Systems
JR's Lifetime Advanced Analytics
AIDSRelief IQCare HMIS EMR
International Quality Clinical HIV/AIDS Registry tool
CV Anuj
What Makes a Good Performance Management Plan? A new tool for managers
AIDSRelief Futures Group
ISCRAM Impact Evaluation
2015 iHT2 Health IT Beverly Hills Summit
Data Visualization in Health
Ad

Similar to Applying a User-Centered Design Approach to Improve Data Use in Decision Making (20)

PDF
The Simpsons, Design, and Data Use
PPT
Promoting Methods for Using HIV/AIDS and Health Information for Decision Making
PPT
Opening Presentation Tara Why Now Final
PPTX
Part I-Achieving Universal Health Coverage: The Role of Routine Health Inform...
PPTX
Data Demand and Use Workshop
PPTX
NURSING-INFORMATICS-Chapter-16-Using-Information-in-Healthcare-Management.pptx
PPTX
Conducting High Impact Research
PPT
Creating a culture for data use: It takes a system strengthening approach
PPTX
Increasing District Level Evidence-based Decision Making in Cote d'Ivoire
DOCX
· define the terms sample and population and describe some of
PPTX
Information Products to Drive Decision Making
PPTX
HM404 Ab120916 ch06
PPT
Data utilization presentation conference 2010 (1)
PPT
Data utilization presentation conference 2010
PDF
Tips for generating and utilizing quality data reports using health it full s...
PDF
Visualizations with Empathy
PPT
Developing the Dashboard
PPT
Introduction to Routine Health Information System Slides
PDF
Business/Clinical Intelligence
PDF
GIEP - Be Well - Poster for Indo-Global Health Conference
The Simpsons, Design, and Data Use
Promoting Methods for Using HIV/AIDS and Health Information for Decision Making
Opening Presentation Tara Why Now Final
Part I-Achieving Universal Health Coverage: The Role of Routine Health Inform...
Data Demand and Use Workshop
NURSING-INFORMATICS-Chapter-16-Using-Information-in-Healthcare-Management.pptx
Conducting High Impact Research
Creating a culture for data use: It takes a system strengthening approach
Increasing District Level Evidence-based Decision Making in Cote d'Ivoire
· define the terms sample and population and describe some of
Information Products to Drive Decision Making
HM404 Ab120916 ch06
Data utilization presentation conference 2010 (1)
Data utilization presentation conference 2010
Tips for generating and utilizing quality data reports using health it full s...
Visualizations with Empathy
Developing the Dashboard
Introduction to Routine Health Information System Slides
Business/Clinical Intelligence
GIEP - Be Well - Poster for Indo-Global Health Conference
Ad

More from removed_62798267384a091db5c693ad7f1cc5ac (20)

PDF
Managing missing values in routinely reported data: One approach from the Dem...
PPTX
Use of Routine Data for Economic Evaluations
PPTX
Routine data use in evaluation: practical guidance
PPTX
Tuberculosis/HIV Mobility Study: Objectives and Background
PPTX
How to improve the capabilities of health information systems to address emer...
PPTX
LCI Evaluation Uganda Organizational Network Analysis
PPTX
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
PPTX
Understanding Referral Networks for Adolescent Girls and Young Women
PDF
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
PPTX
Local Capacity Initiative (LCI) Evaluation
PPTX
Development and Validation of a Reproductive Empowerment Scale
PPTX
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
PPTX
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
PPTX
Lessons Learned In Using the Most Significant Change Technique in Evaluation
PDF
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
PDF
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
PDF
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
PPTX
Lessons learned in using process tracing for evaluation
PPTX
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
PPTX
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Managing missing values in routinely reported data: One approach from the Dem...
Use of Routine Data for Economic Evaluations
Routine data use in evaluation: practical guidance
Tuberculosis/HIV Mobility Study: Objectives and Background
How to improve the capabilities of health information systems to address emer...
LCI Evaluation Uganda Organizational Network Analysis
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Understanding Referral Networks for Adolescent Girls and Young Women
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Local Capacity Initiative (LCI) Evaluation
Development and Validation of a Reproductive Empowerment Scale
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Lessons learned in using process tracing for evaluation
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics

Recently uploaded (20)

PPTX
Imaging of parasitic D. Case Discussions.pptx
PPTX
DENTAL CARIES FOR DENTISTRY STUDENT.pptx
PPTX
SKIN Anatomy and physiology and associated diseases
PPTX
JUVENILE NASOPHARYNGEAL ANGIOFIBROMA.pptx
PPT
1b - INTRODUCTION TO EPIDEMIOLOGY (comm med).ppt
PPTX
CEREBROVASCULAR DISORDER.POWERPOINT PRESENTATIONx
PPT
MENTAL HEALTH - NOTES.ppt for nursing students
PPTX
surgery guide for USMLE step 2-part 1.pptx
PPTX
15.MENINGITIS AND ENCEPHALITIS-elias.pptx
PDF
Medical Evidence in the Criminal Justice Delivery System in.pdf
PPTX
post stroke aphasia rehabilitation physician
PPTX
Note on Abortion.pptx for the student note
PPTX
Important Obstetric Emergency that must be recognised
PPT
HIV lecture final - student.pptfghjjkkejjhhge
PPT
OPIOID ANALGESICS AND THEIR IMPLICATIONS
PPTX
Acid Base Disorders educational power point.pptx
PPTX
ACID BASE management, base deficit correction
PDF
Therapeutic Potential of Citrus Flavonoids in Metabolic Inflammation and Ins...
PPTX
Stimulation Protocols for IUI | Dr. Laxmi Shrikhande
PPTX
Human Reproduction: Anatomy, Physiology & Clinical Insights.pptx
Imaging of parasitic D. Case Discussions.pptx
DENTAL CARIES FOR DENTISTRY STUDENT.pptx
SKIN Anatomy and physiology and associated diseases
JUVENILE NASOPHARYNGEAL ANGIOFIBROMA.pptx
1b - INTRODUCTION TO EPIDEMIOLOGY (comm med).ppt
CEREBROVASCULAR DISORDER.POWERPOINT PRESENTATIONx
MENTAL HEALTH - NOTES.ppt for nursing students
surgery guide for USMLE step 2-part 1.pptx
15.MENINGITIS AND ENCEPHALITIS-elias.pptx
Medical Evidence in the Criminal Justice Delivery System in.pdf
post stroke aphasia rehabilitation physician
Note on Abortion.pptx for the student note
Important Obstetric Emergency that must be recognised
HIV lecture final - student.pptfghjjkkejjhhge
OPIOID ANALGESICS AND THEIR IMPLICATIONS
Acid Base Disorders educational power point.pptx
ACID BASE management, base deficit correction
Therapeutic Potential of Citrus Flavonoids in Metabolic Inflammation and Ins...
Stimulation Protocols for IUI | Dr. Laxmi Shrikhande
Human Reproduction: Anatomy, Physiology & Clinical Insights.pptx

Applying a User-Centered Design Approach to Improve Data Use in Decision Making

  • 1. Applying a User-Centered A Design Approach to Improve Data Use in Decision Making Michelle Li MEASURE Evaluation Palladium APHA November 7, 2017
  • 2. Presenter Disclosures The following personal financial relationships with commercial interests relevant to this presentation existed during the past 12 months: No relationships to disclose Michelle Li
  • 3. Functions and Goals of a Health System (2000) FUNCTIONS (6 Building Blocks) GOALS/OUTCOMES OF THE SYSTEM Stewardship Commodities Infrastructure Service delivery Financing I N P U T S Health Responsiveness (the way people are treated and the environment) Fairness in financial contribution Quality Coverage Efficiency Source: WHO, 2000. 3 Human resources Information Safety
  • 4. Improving Information Systems • Global commitment to accountability • New data resources • Result is more and better data
  • 5. More Data = Better Decisions?
  • 6. Problem Statement How can we develop interventions that address individual needs and barriers to data use?
  • 7. Methods • Location: Two districts in South Africa and Tanzania • Participants: data users and data producers • Immersion interviews • Design workshops: • Understand barriers • Ideate and prototype
  • 8. Design Framework Adapted from Standord d.school
  • 9. Empathy • How can we put ourselves into the shoes of the data user? • What are our data user’s wants, needs and interests? • What are our data user’s challenges and pain points?
  • 10. Empathy – Immersion interviews • Observe and speak to people at their place of work to understand beliefs, attitudes, and behaviors around data use • What do you love most about your job? • Who is the best data user you know? Why are they good at their job? • What is the most important aspect of your work? What role does data play in this?
  • 12. Define – Workshop I Activities
  • 13. Insights on Data Use Barriers • Technical • Adequate and timely provision of resources • Low confidence in quality of data collected • Lack of clarity on how data is used • HIS systems are adequate, but not used to full potential. There is no involvement of end users in the design of HIS systems and tools. • Tension between service provision and data tasks, especially at lower levels • Data collection tools are overly complicated and there is a lack of prioritization of data needs
  • 14. Insights on Data Use Barriers • Behavioural • Little top-down positive feedback on data • Primary data collectors display lack of commitment and negative attitudes toward data use • Organizational • Value of data for decision making is not well understood – more emphasis on collection • Desire exists for a culture of data use • Lack of clarity, poor communication, and complex SOPs hinder data sharing and use
  • 16. Go Getters • LOVE data • Hard workers and proactive in work • Frustrated by environments that accept lower performers • Desire for perfection can push them to work long hours and burn out Hyper- actives • Full of energy • Seek attention constantly • Require very hands-on supervision • Can be creative problem solvers, but requires focused workplan to stay on task Lazy Dodgers • Always “busy” but do not produce quality outputs • Always miss deadlines and targets • Flourish in an environment with no consequences • Full of excuses and avoid responsibilities Personas
  • 18. Ideate – How might we?
  • 21.  UGUdoc.com: A digital portal connecting health workers with current and archived data, policy docs, SOPs, and an AskMe bulletin board to receive feedback on specific facility and system challenges  What’s Up Health/Social Media: A communication solution to consolidate district/provincial data- related communication in one place to accelerate messaging, and information Prototypes – Improving Communication
  • 22. Prototypes – Improving data use at lower levels  Data Use Score Cards: Rapid data use assessment score cards targeted to health facilities, to provide feedback and encourage competition for best performer facilities  Clinicians on Board: A clinician data sensitization program focused on including data management in clinician KPAs and training for “using data to manage”
  • 23.  Champion Cascade: Rapidly create a culture of data use by appointing champions across levels; develop a toolkit to develop presentation, facilitation, and supervision styles and share good practice tools through a What’s Up Health communications system. Champions are awarded based on overall HIS performance of their facilities. Prototypes – Promoting Data Use Champions
  • 24. Strengths of the UCD Process • Development of context specific solutions • Build ownership with users • Facilitates empathy between data users and data producers • Engaging and fun!
  • 25. Lessons Learned • Design workshops are an innovative facilitation tool to engage people to discuss and brainstorm solutions to data use challenges • Agree on an action plan (with resources, timelines, and responsibilities)for prototype testing • Identify highly motivated people (i.e., data use champions) to move prototypes forward • Support participants who want to take up facilitation techniques and activities in their own work
  • 26. Acknowledgements • Tara Nutley (MEASURE Evaluation, Palladium) • Amanda Makulec (MEASURE Evaluation, JSI) • Cal Bruns and Jason Coetzee (Matchboxology) • Roselyn Kareithi (MEASURE Evaluation – Strategic Information for South Africa [SIFSA]) • Sono Kusekwa and Jackie Patrick (MEASURE Evaluation – Tanzania)
  • 27. This presentation was produced with the support of the United States Agency for International Development (USAID) under the terms of MEASURE Evaluation cooperative agreement AID-OAA-L- 14-00004. MEASURE Evaluation is implemented by the Carolina Population Center, University of North Carolina at Chapel Hill in partnership with ICF International; John Snow, Inc.; Management Sciences for Health; Palladium; and Tulane University. Views expressed are not necessarily those of USAID or the United States government. www.measureevaluation.org