SlideShare a Scribd company logo
Conducting High Impact Research: Building data ownership and improving data use Tara Nutley, Theresa Hoke, Scott MorelandGlobal Health Metrics & Evaluation ConferenceMarch, 15 2011
Global Health ContextNeed to develop data-informed health policies, strategies  and interventions
Barriers to Data-informed Decision makingWeak link between research, program & policy processesDifferent ideologies, norms & valuesResearch – controlled, empirical, objectiveProgram – practical, urgency, actionPolicy – bargaining, lobbying, compromiseLow understanding, ownership and use of data
Strengthening Data-informed Decision Making Improve the research processConsider the program/policy context in planning phase Involve stakeholders throughout the research processMake data and results available & accessible Move beyond dissemination
Improving Access to Injectable Contraception in MadagascarReduce unmet contraceptive need 2007 pilot program to integrate    injectable services into     community-based family planning   distribution62 community-based workers trained to offer injectables
Can injectable contraception be safely provided by community workers?Data collection7 months post intervention - 61 CBWs, 25 supervisors and 303 clients interviewedResultsSafe, acceptable, feasable41% of acceptors - new family planning usersProgram scaled up from 4 to 68 districts
Steps - Research ProcessQuestion developmentProtocol developmentData collectionData analysisRecommendationsDissemination
Steps  - Research ProcessEnhancementsValue AddedID target data userSteering committeeTargeted priority information needs Question developmentID other  stakeholdersRoles / responsibilities Protocol developmentEnsured involvement and buy-inStakeholders participated in data collection  Data collectionIncreased study understanding
StepsEnhancementsValue AddedData interpretationLocal program contextincluded  Data AnalysisData use action plan  RecommendationsFeasible & actionable recommendations developedCommunication plan  DisseminationResults targeted to audiences
Strengthened Research ProcessIncreased ownership of dataGenerated useful, priority dataImproved understanding of study process & dataIncreased buy-in for recommendationsIncreased data useImproved health programs
Discussion QuestionCan a similar process be applied to multi-country research questions? Research questions that rely on secondary analysis?How can we ensure collaboration between data users and data producers without delaying and increasing the complexity of already complex processes.
Thank  You MEASURE Evaluation is funded by the U.S. Agency for International Development and is implemented by theCarolina Population Center at the University of North Carolina at Chapel Hill in partnership with Futures GroupInternational, ICF Macro, John Snow, Inc., Management Sciences for Health, and Tulane University. The views expressed in this presentation do not necessarily reflectthe views of USAID or the United States Government.

More Related Content

PPTX
Sally Redman | Early findings from SPIRIT
PPTX
Lessons learned in using process tracing for evaluation
PPTX
Data Demand and Use Workshop
PPTX
Bea Brown, Sax Institute
PPTX
Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...
PPT
Technical Consultation on Innovative Approaches to Evaluation within Global H...
PPTX
Lessons Learned In Using the Most Significant Change Technique in Evaluation
PPTX
Small grants, big opportunities: Using the small grants mechanism to build l...
Sally Redman | Early findings from SPIRIT
Lessons learned in using process tracing for evaluation
Data Demand and Use Workshop
Bea Brown, Sax Institute
Lessons and Approaches to Support the Capacity Strengthening Priorities of Lo...
Technical Consultation on Innovative Approaches to Evaluation within Global H...
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Small grants, big opportunities: Using the small grants mechanism to build l...

What's hot (20)

PPTX
Knowledge synthesis for policy and practice
PPTX
PPT
Monitoring Scale-up of Health Practices and Interventions
PDF
SURE: Helping get the most out of longitudinal data
PPS
USAID Goals and Objectives for MEASURE Evaluation Phase II (2004-2008)
PPTX
My Birth Control: Engaging Patients and Providers in Shared Decision-Making A...
 
PPTX
Information Products to Drive Decision Making
PPTX
Use of Routine Data for Economic Evaluations
PPT
Measuring and Evaluating Reproductive Health Initiatives
PPTX
Custom Country Tool: Global Application
PPT
Beyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
PPT
Models of evaluation in educational technology
PPS
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
PPTX
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
PDF
Social Networks for Data Use: How we can leverage a world of connections to i...
PPT
Elements of an effective hiv prevention program
PPTX
Patient Centered Care | Unit 9a Lecture
PPTX
Oct 23 CAPHC CPDSN Symposium - Jennifer McCallum
PDF
Intentional stakeholder outreach using Outcome Mapping: Ecosystem approaches ...
PPT
A Breast Cancer Patient Information & Support Program In A Managed Care E...
Knowledge synthesis for policy and practice
Monitoring Scale-up of Health Practices and Interventions
SURE: Helping get the most out of longitudinal data
USAID Goals and Objectives for MEASURE Evaluation Phase II (2004-2008)
My Birth Control: Engaging Patients and Providers in Shared Decision-Making A...
 
Information Products to Drive Decision Making
Use of Routine Data for Economic Evaluations
Measuring and Evaluating Reproductive Health Initiatives
Custom Country Tool: Global Application
Beyond Indicators and Reporting: M&E as a Systems Strengthening Intervention
Models of evaluation in educational technology
Measureing if Programs Make a Difference in the Lives of Orphans and Vulnerab...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Social Networks for Data Use: How we can leverage a world of connections to i...
Elements of an effective hiv prevention program
Patient Centered Care | Unit 9a Lecture
Oct 23 CAPHC CPDSN Symposium - Jennifer McCallum
Intentional stakeholder outreach using Outcome Mapping: Ecosystem approaches ...
A Breast Cancer Patient Information & Support Program In A Managed Care E...
Ad

Similar to Conducting High Impact Research: Building data ownership and improving data use (20)

PPTX
Conducting High Impact Research
PPTX
high-impact-research-session-1-2011.pptx
PPT
Evaluation Principles: Theory-Based, Utilization-Focused, Participatory
PPTX
Data Demand and Use : Facilitating the Use of Data to Inform Programs and Pla...
PPT
Thinking through ‘knowledge translation’
PPTX
Studying implementation 2017
PPT
PPTX
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
PPT
Process evaluation or workshop ghana2
PPT
Process Evaluation Handout
PPT
Process Evaluation: Documenting "How" and Understanding the "Why" of Implemen...
PPT
Building Skills to Advocate for Change with Health Data
PPTX
Mph thesis slides
PPT
Data utilization presentation conference 2010 (1)
PPTX
Developing a Framework and Approach for Measuring Success
PPTX
Global Alliance for Genomics & Health - Peter Goodhand
PPT
Using Goals To Assist In Strategic Planning Jan 09 V4
PPT
Monitoring the Scale-up of Family Planning Practices and Interventions
PPTX
Theoy of change .pptx.yfsdyfyfgufgyegeyfeugf
PPT
Evaluation: Lessons Learned for the Global Health Initiative
Conducting High Impact Research
high-impact-research-session-1-2011.pptx
Evaluation Principles: Theory-Based, Utilization-Focused, Participatory
Data Demand and Use : Facilitating the Use of Data to Inform Programs and Pla...
Thinking through ‘knowledge translation’
Studying implementation 2017
Monitoring and Evaluation at the Community Level : A Strategic Review of ME...
Process evaluation or workshop ghana2
Process Evaluation Handout
Process Evaluation: Documenting "How" and Understanding the "Why" of Implemen...
Building Skills to Advocate for Change with Health Data
Mph thesis slides
Data utilization presentation conference 2010 (1)
Developing a Framework and Approach for Measuring Success
Global Alliance for Genomics & Health - Peter Goodhand
Using Goals To Assist In Strategic Planning Jan 09 V4
Monitoring the Scale-up of Family Planning Practices and Interventions
Theoy of change .pptx.yfsdyfyfgufgyegeyfeugf
Evaluation: Lessons Learned for the Global Health Initiative
Ad

More from removed_62798267384a091db5c693ad7f1cc5ac (20)

PDF
Managing missing values in routinely reported data: One approach from the Dem...
PPTX
Routine data use in evaluation: practical guidance
PPTX
Tuberculosis/HIV Mobility Study: Objectives and Background
PPTX
How to improve the capabilities of health information systems to address emer...
PPTX
LCI Evaluation Uganda Organizational Network Analysis
PPTX
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
PPTX
Understanding Referral Networks for Adolescent Girls and Young Women
PDF
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
PPTX
Local Capacity Initiative (LCI) Evaluation
PPTX
Development and Validation of a Reproductive Empowerment Scale
PPTX
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
PPTX
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
PDF
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
PDF
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
PDF
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
PPTX
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
PPTX
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
PPTX
7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...
PPTX
Sexual Orientation and Gender Identity Measures for Global Survey Research
PPTX
What’s Next? Practical Implementation Lessons from the Partnership for HIV-Fr...
Managing missing values in routinely reported data: One approach from the Dem...
Routine data use in evaluation: practical guidance
Tuberculosis/HIV Mobility Study: Objectives and Background
How to improve the capabilities of health information systems to address emer...
LCI Evaluation Uganda Organizational Network Analysis
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Understanding Referral Networks for Adolescent Girls and Young Women
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Local Capacity Initiative (LCI) Evaluation
Development and Validation of a Reproductive Empowerment Scale
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
7 Steps to EnGendering Evaluations of HIV programs with Adolescent Girls and ...
Sexual Orientation and Gender Identity Measures for Global Survey Research
What’s Next? Practical Implementation Lessons from the Partnership for HIV-Fr...

Conducting High Impact Research: Building data ownership and improving data use

  • 1. Conducting High Impact Research: Building data ownership and improving data use Tara Nutley, Theresa Hoke, Scott MorelandGlobal Health Metrics & Evaluation ConferenceMarch, 15 2011
  • 2. Global Health ContextNeed to develop data-informed health policies, strategies and interventions
  • 3. Barriers to Data-informed Decision makingWeak link between research, program & policy processesDifferent ideologies, norms & valuesResearch – controlled, empirical, objectiveProgram – practical, urgency, actionPolicy – bargaining, lobbying, compromiseLow understanding, ownership and use of data
  • 4. Strengthening Data-informed Decision Making Improve the research processConsider the program/policy context in planning phase Involve stakeholders throughout the research processMake data and results available & accessible Move beyond dissemination
  • 5. Improving Access to Injectable Contraception in MadagascarReduce unmet contraceptive need 2007 pilot program to integrate injectable services into community-based family planning distribution62 community-based workers trained to offer injectables
  • 6. Can injectable contraception be safely provided by community workers?Data collection7 months post intervention - 61 CBWs, 25 supervisors and 303 clients interviewedResultsSafe, acceptable, feasable41% of acceptors - new family planning usersProgram scaled up from 4 to 68 districts
  • 7. Steps - Research ProcessQuestion developmentProtocol developmentData collectionData analysisRecommendationsDissemination
  • 8. Steps - Research ProcessEnhancementsValue AddedID target data userSteering committeeTargeted priority information needs Question developmentID other stakeholdersRoles / responsibilities Protocol developmentEnsured involvement and buy-inStakeholders participated in data collection Data collectionIncreased study understanding
  • 9. StepsEnhancementsValue AddedData interpretationLocal program contextincluded Data AnalysisData use action plan RecommendationsFeasible & actionable recommendations developedCommunication plan DisseminationResults targeted to audiences
  • 10. Strengthened Research ProcessIncreased ownership of dataGenerated useful, priority dataImproved understanding of study process & dataIncreased buy-in for recommendationsIncreased data useImproved health programs
  • 11. Discussion QuestionCan a similar process be applied to multi-country research questions? Research questions that rely on secondary analysis?How can we ensure collaboration between data users and data producers without delaying and increasing the complexity of already complex processes.
  • 12. Thank You MEASURE Evaluation is funded by the U.S. Agency for International Development and is implemented by theCarolina Population Center at the University of North Carolina at Chapel Hill in partnership with Futures GroupInternational, ICF Macro, John Snow, Inc., Management Sciences for Health, and Tulane University. The views expressed in this presentation do not necessarily reflectthe views of USAID or the United States Government.

Editor's Notes

  • #3: We are all acutely aware of the global health context and the immediate need for effective, efficient health policies, strategies and service interventions. Health issues have become increasingly complex necessitating quicker access to more and better data – to inform health decision makingHowever, the reality in many of the contexts where we work – this isn’t happening as often as it should Decision making often isn’t informed by existing data.
  • #4: Why is this? Why are we experiencing a research to practice gap?A myriad of reasons inhibit data informed decision making. One which is at the root of the problem is the – the weak link between research, program and policy processes.These processes are distinct, often function independently and are characterized by specific ideologies, norms and values.The research process is defined as controlled, empirical, objective and time consuming.On the other hand, the program process is based on practical solutions, urgency and action. Populations are waiting to be served.Whereas, the policy process is characterized by a bargaining, lobbying, accommodation and compromise.Ideally, research, policy and practice are mutually dependent partners to support advances in public health. In reality however, they do not easily work together because of their different and sometimes conflicting norms and values. The lack of interaction between the disciplines often translates into poor understanding of the research process and the data they generate, an insufficient ownership of data and ultimately, low use of the data in decision making.
  • #5: The question we need to ask ourselves is - What can be done to bridge the research to practice gap to improve use of data in decision making?A critical first step, is to expand the traditional research approach – As researchers we canFirstly,identify the program and/orpolicy improvement that the research is supporting. By identifyingthe programmatic and policy decisions that the research may influence we identify the primary consumers of the data. This allows us to respond directly to their information needs.Secondly, we can involve the data users - in the research process. By involving key program and policy stakeholders meaningfully we increase understanding of the research process. This heightened level of understanding translates into the resulting data being trusted by those that will use them.When data users trust the data collection process and resulting data they are more likely to make that data more available and accessible to others in their contexts. This forms the building blocks of data stewardship among the data users.And lastly, we need to challenge ourselves as researchers to go beyond study dissemination and ensure that the data we collect is linked to decision making processes. So, how does all of this play out in an actual research context?
  • #6: Let’s look at an example of where these recommendations were applied in MadagascarThe MOH in Madagascar was committed to reduce unmet contraceptive need among remote, rural populationsThey decided to experiment with using community based workers to provide DMPAThey trained 62 community-based workers from 13 rural communities to provide DMPATALK about how building ownership of the research process was particularly important in Mada because of the controversy surrounding the intervention.
  • #7: A study was designed around this pilot intervention to determine the safety, feasibility & acceptability of CBW distribution of injectable contraception.A single round of data collection approximately 7 months after intervention implementation. Trained interviewers conducted structured interviews with all CBD workers who initiated service delivery following training, as well as their supervisors attached to the public sector health center and the supporting NGO.They also interviewed five clients per CBD worker, and reviewed CBD workers’ administrative records reflecting matters like inventory management and accounting.All workers provided DMPA according to set safety standards, lay provision of DMPA was acceptable to workers, their clinical supervisors and clients, and that the provision of the new service attracted 41% new family planning users. The data were used by the Ministry of Health to scale-up the program from 13 to 27 districts in 2008 and to 68 districts today.Acceptance this rather controversial approach was an important moment in FP provision not just in Madagascar but in the world. Many countries would not even consider what seemed to be such a risky intervention.How did Madagascar succeed? How did study results get adopted and scaled up so readily?
  • #8: To describe what we did to enhance the research process, I have broken out the steps in the research process as you see on the slide. I’ll discuss what we added to each step to improve the linkage between with the research and program and policy processes.
  • #9: Let’s look at the first step. Study question development. Here we identified our target data user. We knew that if the study proved successful, we’d need to change clinical policies to guide the implementation of the new intervention. With this in mind we selected members for a steering committee to guide the research. This steering committee informed us of the specific data they’d need to do so.Next in the protocol development phase we conducted a thorough analysis of our secondary stakeholders. There were the individuals that would be affected by the change in policy. These people included not only clinical providers but also the professional medical associations that were not supportive of giving clinical responsibilities to lay health workers with limited medical training. We also identified community leaders as stakeholders because they were in a position to facilitate the uptake of the intervention in their communities – assuming positive study results. Also during the protocol development phase we identified meaningful involvement in the study process for some of our key stakeholders. For example we had high level decision makers in the MOH as co-investigators on the study responsible for drafting sections of the protocol. In the data collection phase we actively involved key stakeholders in the data collection process - such as district and national -level MOH staff Seeing the data collection process up close and participating actual data collection helped to increase study understanding and trust in the data being collected.
  • #10: During the data analysis phase we involved key stakeholders in interpreting the data. We asked for their input to contextualize the result. This discussion provided rich local context to the findings. This active participation of key data users in interpreting the results clarified any remaining confusion or questions about the data and build ownership of the results.During the recommendation development process, local stakeholders took the lead of this process. Their understanding of the local context and allowed them to develop feasible and actionable And lastly, during the dissemination process we implemented the communication plan that had been developed earlier in the study that allowed us to tailor our dissemination activities and target specific findings and recommendations to different audiences in formats that were appropriate, relevant and accessible to them.
  • #11: To conclude, the enhancements that we put in place to strengthen the research process contributed to an overall increase in the ownership of the study data by:Focusing on the data users information needs we generated the data needed for decision makingBy meaningfully involving the data users in the research, understanding of the research process and the data it generated was improvedThis led to an increased buy-in to move the recommendations into programmatic and policy changeAnd finally –contraceptive use among women in remote, rural areas of Madagascar was increased.