SlideShare a Scribd company logo
Measuring policy influence:
   like measuring thin air?
             John Young: j.young@odi.org.uk
       Arnaldo Pellini: a.pellini.ra@odi.org.uk
RAPID



 Power, Politics and evidence use




Knowledge intermediaries
and interactions                    Evidence production and
                                    communication
Policy processes are...

                                                   Cabinet
   Donors                          Policy
                                Formulation

                    Agenda                                   Parliament
                    Setting
                                                  Decision
                                                  Making
Civil Society


                    Monitoring and                        Ministries
                     Evaluation               Policy
                                         Implementation
          Private
          Sector
The Cynefn Framework




4
Policy change

    • Discursive: Client-
      focused services
    • Attitudinal: Farmers
      have good ideas
    • Procedural: Participatory
      approaches to service development
    • Content: UU20, UU25. New guidelines
    • Behavioural: Approach being applied in
      practice

5
Focus on behaviour change


Project
Team




Other
Actors
     Inputs   Activities   Outputs   Outcomes
                                      Outcome
                                      Outcomes
                                                  Impact
                                                 Impact
                                                 Impact




                                     Behaviour
 6                                    Change
RAPID Outcome Mapping Approach

                  Media strategy

                  Online
                  communications

                  Develop a network
                  or partnership

                  Academic research
                  communications

                  Policy advocacy
                  coalition


                  More research
Why do M&E?

• To learn about what works
• To manage better
• To account:
   – to donors
   – to recipients




8
Methods

• Classical case studies (IDRC, IFPRI)
• Episode studies (ODI/RAPID)
• Stories of Change (Denning)
• Micro-Narratives (Snowden)
• Impact matrices (Davies)
• Peer evaluations (CHSRF)
• Systematic reviews?
• RCTs?


9
Outcome Mapping

                          OUTCOME
                          MAPPING:
                          Building
                          Learning and
                          Reflection into
                          Development
                          Programs
                          Sarah Earl, Fred
                          Carden, and Terry
                          Smutylo
     http://www.idrc.ca/en/ev-9330-201-1-
     DO_TOPIC.html



10
Social Network Analysis




11
RAPID Outcome Assessment




12
A systematic approach
1. Strategy and direction –are you
   doing the right thing?
2. Management –are you doing what
   you planned to do?
3. Outputs – are the outputs
   appropriate for the audience?
4. Uptake – are people aware of your
   work?
5. Outcomes and impacts –are you
   having any impact?



13
M&E in ODI
Impact Logs & SoC




15
3ie PIM Project Evaluation Framework




16
TTI Evaluation Framework

More Related Content

PPTX
Module 6.D Implementation: project management
PPT
Oi cmel approach calp march 2015 final
PPT
Outcome Mapping: Monitoring and Evaluation Tool
PPT
06 Om At Training W Kshop Org Practices & Monitoring
PPTX
Build Your NGO: Monitoring & Evaluation
PDF
Module 6 Implementation: project management and monitoring
PPTX
Module 7: Monitoring and Evaluation Dima course content
PDF
INFLUENCE OF MONITORING AND EVALUATION TOOLS USAGE ON AGRICULTURAL PROJECT SU...
Module 6.D Implementation: project management
Oi cmel approach calp march 2015 final
Outcome Mapping: Monitoring and Evaluation Tool
06 Om At Training W Kshop Org Practices & Monitoring
Build Your NGO: Monitoring & Evaluation
Module 6 Implementation: project management and monitoring
Module 7: Monitoring and Evaluation Dima course content
INFLUENCE OF MONITORING AND EVALUATION TOOLS USAGE ON AGRICULTURAL PROJECT SU...

What's hot (20)

PPTX
Monitoring and evaluation frameworks logical framework
PPTX
Monitoring, Evaluation and Learning - services for Third Sector organisations
PPTX
Results-Based Management in UNDP
PPTX
Application of outcome mapping - Participatory monitoring and evaluation for ...
PPT
Rotary Foundation Cadre Training: Monitoring and Evaluation
PDF
Affinity Symposium Presentation - CES
PPT
Presentation Training on Result Based Management (RBM) for M&E Staff
PPT
RESULT BASED M&E in FFA-revised
PPTX
Monitoring indicators
PPT
Workshop: Monitoring, evaluation and impact assessment
PDF
Monitoring & Evaluation Framework - Fiinovation
PDF
Environmental Engagement Roadmap
PPTX
RBM Presentation
PPTX
Monitoring And Evaluation Presentation
PPTX
Result based management
PPTX
Results based planning and management
PPT
Results based management
PPTX
Logic Models and Theories of Change
PPT
Log Frames and Indicators for Result Based Management (IWC5 Presentation)
PPTX
Project Monitoring and Evaluation
Monitoring and evaluation frameworks logical framework
Monitoring, Evaluation and Learning - services for Third Sector organisations
Results-Based Management in UNDP
Application of outcome mapping - Participatory monitoring and evaluation for ...
Rotary Foundation Cadre Training: Monitoring and Evaluation
Affinity Symposium Presentation - CES
Presentation Training on Result Based Management (RBM) for M&E Staff
RESULT BASED M&E in FFA-revised
Monitoring indicators
Workshop: Monitoring, evaluation and impact assessment
Monitoring & Evaluation Framework - Fiinovation
Environmental Engagement Roadmap
RBM Presentation
Monitoring And Evaluation Presentation
Result based management
Results based planning and management
Results based management
Logic Models and Theories of Change
Log Frames and Indicators for Result Based Management (IWC5 Presentation)
Project Monitoring and Evaluation
Ad

Viewers also liked (8)

PPT
OM for policy influencing
PDF
Measuring policy influence: like measuring thin air?
PPT
Strategies to enhance research impact: Six lessons
PPT
Working with complexity: Six steps to enhance research
PPT
ODI Knowledge Policy and Power event presentation Harry Jones
PPT
A strategic approach to policy engagement for research organisations
PPT
Planning for impact: Basic communication strategies
OM for policy influencing
Measuring policy influence: like measuring thin air?
Strategies to enhance research impact: Six lessons
Working with complexity: Six steps to enhance research
ODI Knowledge Policy and Power event presentation Harry Jones
A strategic approach to policy engagement for research organisations
Planning for impact: Basic communication strategies
Ad

Similar to Monitoring & Evaluation - the RAPID approach (20)

PDF
Policy entrepreneurs and development entrepreneurs: a discussion with The Asi...
DOC
Action plan: Policy dialogue (Eastern and Southern Africa)
PDF
Monitoring and evaluation to improve fundraising bids
PDF
Evaluating Communication Programmes, Products and Campaigns: Training workshop
PPT
Social Return On Investment: Demonstrating value in homelessness services
PDF
Measuring the impact of your campaigns
PPT
Jy Recoup Mand E
PPT
Final final collaborating on outcomes 30 5 12
PDF
How to Conduct A Nationally Owned Governance Assessment
PPTX
From policy to impact - Serious Social Investing 2013
PPS
The value of engagement
PPT
Training day
PPTX
Malaria Policy and Advocacy
PPT
Strategic Knowledge Management for Monitoring and Evaluation Teams
PPTX
A Framework for Health IT Evaluation
PPTX
Monitoring and Evaluation
PPTX
InterAction - Rockefeller - TCC - GlobalGiving
PPTX
Osimo crossover-montenegro
Policy entrepreneurs and development entrepreneurs: a discussion with The Asi...
Action plan: Policy dialogue (Eastern and Southern Africa)
Monitoring and evaluation to improve fundraising bids
Evaluating Communication Programmes, Products and Campaigns: Training workshop
Social Return On Investment: Demonstrating value in homelessness services
Measuring the impact of your campaigns
Jy Recoup Mand E
Final final collaborating on outcomes 30 5 12
How to Conduct A Nationally Owned Governance Assessment
From policy to impact - Serious Social Investing 2013
The value of engagement
Training day
Malaria Policy and Advocacy
Strategic Knowledge Management for Monitoring and Evaluation Teams
A Framework for Health IT Evaluation
Monitoring and Evaluation
InterAction - Rockefeller - TCC - GlobalGiving
Osimo crossover-montenegro

More from ODI_Webmaster (8)

PPT
Exploring the Science of Complexity in Aid Policy and Practice
PPT
Review of Communications in DFID-funded Research Programme Consortia (RPCs)
PPT
Experience with the Governance and Transparency Fund
PPT
Lesson Learnt: South Asia Training of Trainers Workshop on Bridging Research ...
PDF
SMERU’s POLICY IMPACT ON SCHOOL OPERATIONAL ASSISTANCE (BOS) PROGRAM
PPT
Online Tools and Software For Dissemination
PPT
Lines Of Argument Presentation at Insights to Impact Meeting
PPT
Outcome Mapping for Insight to Impact Meeting
Exploring the Science of Complexity in Aid Policy and Practice
Review of Communications in DFID-funded Research Programme Consortia (RPCs)
Experience with the Governance and Transparency Fund
Lesson Learnt: South Asia Training of Trainers Workshop on Bridging Research ...
SMERU’s POLICY IMPACT ON SCHOOL OPERATIONAL ASSISTANCE (BOS) PROGRAM
Online Tools and Software For Dissemination
Lines Of Argument Presentation at Insights to Impact Meeting
Outcome Mapping for Insight to Impact Meeting

Recently uploaded (20)

PPTX
1. Introduction to Computer Programming.pptx
PDF
Enhancing emotion recognition model for a student engagement use case through...
PPTX
cloud_computing_Infrastucture_as_cloud_p
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
A comparative analysis of optical character recognition models for extracting...
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PDF
Encapsulation theory and applications.pdf
PPTX
A Presentation on Artificial Intelligence
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
Tartificialntelligence_presentation.pptx
PDF
August Patch Tuesday
PPTX
TLE Review Electricity (Electricity).pptx
PDF
DP Operators-handbook-extract for the Mautical Institute
PDF
Hybrid model detection and classification of lung cancer
PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
1. Introduction to Computer Programming.pptx
Enhancing emotion recognition model for a student engagement use case through...
cloud_computing_Infrastucture_as_cloud_p
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
A comparative analysis of optical character recognition models for extracting...
A comparative study of natural language inference in Swahili using monolingua...
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
A novel scalable deep ensemble learning framework for big data classification...
MIND Revenue Release Quarter 2 2025 Press Release
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Encapsulation theory and applications.pdf
A Presentation on Artificial Intelligence
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Tartificialntelligence_presentation.pptx
August Patch Tuesday
TLE Review Electricity (Electricity).pptx
DP Operators-handbook-extract for the Mautical Institute
Hybrid model detection and classification of lung cancer
Univ-Connecticut-ChatGPT-Presentaion.pdf
Encapsulation_ Review paper, used for researhc scholars

Monitoring & Evaluation - the RAPID approach

  • 1. Measuring policy influence: like measuring thin air? John Young: j.young@odi.org.uk Arnaldo Pellini: a.pellini.ra@odi.org.uk
  • 2. RAPID Power, Politics and evidence use Knowledge intermediaries and interactions Evidence production and communication
  • 3. Policy processes are... Cabinet Donors Policy Formulation Agenda Parliament Setting Decision Making Civil Society Monitoring and Ministries Evaluation Policy Implementation Private Sector
  • 5. Policy change • Discursive: Client- focused services • Attitudinal: Farmers have good ideas • Procedural: Participatory approaches to service development • Content: UU20, UU25. New guidelines • Behavioural: Approach being applied in practice 5
  • 6. Focus on behaviour change Project Team Other Actors Inputs Activities Outputs Outcomes Outcome Outcomes Impact Impact Impact Behaviour 6 Change
  • 7. RAPID Outcome Mapping Approach Media strategy Online communications Develop a network or partnership Academic research communications Policy advocacy coalition More research
  • 8. Why do M&E? • To learn about what works • To manage better • To account: – to donors – to recipients 8
  • 9. Methods • Classical case studies (IDRC, IFPRI) • Episode studies (ODI/RAPID) • Stories of Change (Denning) • Micro-Narratives (Snowden) • Impact matrices (Davies) • Peer evaluations (CHSRF) • Systematic reviews? • RCTs? 9
  • 10. Outcome Mapping OUTCOME MAPPING: Building Learning and Reflection into Development Programs Sarah Earl, Fred Carden, and Terry Smutylo http://www.idrc.ca/en/ev-9330-201-1- DO_TOPIC.html 10
  • 13. A systematic approach 1. Strategy and direction –are you doing the right thing? 2. Management –are you doing what you planned to do? 3. Outputs – are the outputs appropriate for the audience? 4. Uptake – are people aware of your work? 5. Outcomes and impacts –are you having any impact? 13
  • 15. Impact Logs & SoC 15
  • 16. 3ie PIM Project Evaluation Framework 16