February 13 | Monitoring and evaluating (M&E) of adaptation at national level
- 1. Page 1 Master class: Monitoring and evaluating (M&E) of adaptation at national level Stone Town, Zanzibar, 13 February 2019 Timo Leiter, Head of NAP Support and Climate Change Focal Point, GIZ Tanzania @TimoLeiter
- 2. Seite 214/02/2019 Outline Intro: what do you want to learn? Country example: Mexico Recap: Building blocks of adaptation M&E systems Hot topics in national adaptation M&E systems Peer exchange Moving forward COP24 outcomes Global Commission on Adaptation 2 hours M&E of the NAP process
- 3. Page 314/02/2019 Introduction What do you want to learn during this Master class? Please write it on a post-it note M&E of the NAP process
- 4. Seite 414/02/2019 Source: Leiter et al. (2017). Country-specific assessments of adaptation progress. In: UNEP Adaptation Gap Report 2017 Chapter 4. Mexico, Japan Vietnam Applicable to all countries with a NAP process as of October 2017 M&E of the NAP process
- 5. Seite 5M&E of the NAP process - GIZ's tools and experiences14/02/2019 Chapter 4 2017 Case studies: • Cambodia • Colombia • Moldova • South Africa
- 6. Seite 6 Case from Me 14/02/2019 Example: adaptation M&E in Mexico See also: Adaptation M&E in the Mexican State of Veracruz (Factsheet, 2017
- 7. Seite 7 Factsheets of national adaptation M&E systems 14.02.2019 UK Germany Mekong River Commission France Philippines Finland Mexico (state level) PPCR (global climate fund) Morocco Bolivia Kenya (2014) Cambodia Download under „M&E“ at First published 2014; updated 2017
- 8. Seite 8M&E of the NAP process - GIZ's tools and experiences14/02/2019 NAP Techncal Guidelines of 2012 are very brief on M&E LEG & Adaptation Committee partnered with GIZ & IISD to develop detailed supplementary guidelines on M&E
- 9. Seite 9 4 building blocks of national adaptation M&E systems 14/02/2019 •M&E focus (process or outcomes) •Data & information requirements •Adaptation-specific indicators • Resource needs •Institutional arrange- ments •Data management •Communi- cation of M&E findings •Policy context •M&E purpose •Target users M&E of the NAP process
- 10. Seite 1014/02/2019 Master class: Hot topics in national adaptation M&E • Specifying what exactly to monitor • Getting buy-in from various stakeholders • Deciding on the M&E methodology • Using adaptation indicators well • Linkages & synergies among M&E of NAP, NDCs, NatComs, etc • Communicating findings M&E of the NAP process
- 11. Seite 1114/02/2019 Specifying what exactly to monitor • Often vague, e.g. “monitoring resilience” • So what exactly should your national adaptation M&E focus on? Identifying information needs • Distinction between monitoring: • Process: Things that enable adaptation, e.g. capacity building • Outcomes: Actual adaptation results, e.g. efficient water use • Focus of M&E depends on: • M&E purpose • Available data/resources M&E of the NAP process What is the difference between information needs and indicators?
- 12. Seite 12M&E of the NAP process - GIZ's tools and experiences14/02/2019 Indicator Responsible Adaptation training strategy developed and implemented MoE NAP M&E system developed and implemented MoE System of financing and economic incentives for adaptation created and implemented. MoE Strategy to formulate adaptation polices by federal entities is elaborated MoE Initial indicators in Brazil‘s NAP Source: Translated from Brazil‘s NAP Executive Summary (May 2016)
- 13. Seite 13 Results chain Higher-level objective (e.g. society getting more resilient) Inputs Outputs Outcomes Impacts
- 14. Seite 1414/02/2019 Getting buy-in from stakeholders • Adaptation M&E usually involves a multitude of actors Need to get buy-in to ensure cooperation (i.e. from Ministries, Government agencies, data providers, other stakeholders) A clear mandate to develop an M&E system helps! (e.g. in Mexico’s or UK’s climate change law) Challenges • Stakeholders may not see the need for specific M&E of adaptation • Coordinating Ministry might have no mandate to address topic areas of other Ministries M&E of the NAP process
- 15. Seite 1514/02/2019 Role of an M&E methodology Defining what to measure and how • After clarifying the purpose of an M&E system: • Need to decide HOW to assess adaptation accordingly Specify the methodology to be used Countries are using different M&E methodologies • Theory of change / results chain (e.g. the Philippines) • Climate change impact/vulnerability chain (e.g. Morocco) • Stand-alone indicators (e.g. Germany) • Other / Mixed approach (e.g. UK, South Africa) M&E of the NAP process
- 16. Seite 1614/02/2019 How to choose a suitable methodology? Consider: • The purpose of the M&E system • The desired information • Available resources and capacities • The sustainability to sustain the M&E system over time Adjust to a country’s needs & context: • Each methodology can be adjusted to a country’s needs • It is possible to use a combination of methodologies o Different methodologies are not mutually exclusive M&E of the NAP process
- 17. Seite 17 Results chain Higher-level objective (e.g. society getting more resilient) Inputs Outputs Outcomes Impacts Assumptions!
- 18. Seite 1814/02/2019 Adaptation indicators M&E is more than indicators! There is no global universal adaptation metric Indicators don’t explain WHY or HOW change took place Indicators are only one part of M&E Supplement indicators with further information Leiter, T. & Pringle, P. (2018): • Pitfalls and potential of measuring climate adaptation through adaptation metrics. ResearchGate.net/ profile/Timo_Leiter Open access March 2018
- 19. Seite 19Examples of national adaptation progress assessment14/02/2019 Adaptation progress assessment in Brazil Explict NAP M&E report • Status of implementation compared to planning • Every Ministry has one page to summarize their progress: • Main achievements • Summary of actions • Next steps • Good example of process-based, non-indicator M&E.
- 20. Seite 20M&E of the NAP process14/02/2019 Adaptation reporting in the UK • Every 2 years: Report to Parliament on adaptation progress • For every priority risk area of the NAP, providing information on: • Is there a plan/policy? • Is action taking place? • Is it reducing vulnerability?
- 21. Seite 2114/02/2019 Try something new: beyond reports Choosing communication formats that reach different audiences • Infographics • Animated movies • Social media (Twitter) • And: use local languages! M&E of the NAP process Animated movie: • Translated in 13 languages • Over 100,000 views
- 22. Seite 22 14/02/2019 Linkages and synergies: implications for M&E How do these relate to each other? How can its M&E be linked? NatComs NDCs A-Coms NAP process BTR GST Domestic documents Biennal Update Reports Global Stocktake Adaptation Communi- cations National Communi- cations
- 23. Seite 23 Questions & answers 14/02/2019 M&E of the NAP process
- 24. Seite 2414/02/2019 Peer exchange 1. Which challenges are you currently facing in your country in the development or operationalization of a national adaptation M&E system? 2. What would be the main action that would need to be done next to advance your adaptation M&E system? Please note key points on cards. Time: 30 minutes. M&E of the NAP process
- 25. Seite 2514/02/2019 Conclusions • Country-specific adaptation M&E systems are already being developed in 40+ countries, but few yet fully operational • More to come, including through the NAP process • The adaptation M&E systems need to be tailored to the country context. A generic detailed format is not useful. • Experience shows: the development process is complex and takes time • Support may be required to develop and maintain the M&E systems • Country-specific adaptation M&E systems can provide useful information for domestic and international purposes M&E of the NAP process
- 26. Seite 2614/02/2019 Results from COP24 Paris Agreement Work Programme • Adaptation Communications • Elements got agreed upon • M&E included as voluntary element • Transparency Framework • Reporting on adaptation voluntary • Flexibility for LDCs/SIDS to report at their discretion • Global Stocktake • No details agreed on how adaptation will be assessed National adaptation M&E systems can provide useful information Adaptation M&E: Indicators, synergies & capacity needs – Timo Leiter
- 27. Seite 2714/02/2019 Opportunity: Feedback for background paper on adaptation metrics • Global Commission on Adaptation • Report to be launched at UN Summit in September 2017 • Has commissioned several background papers including one on adaptation metrics Looking for feedback on what the background note could include As “homework” from this Master class, I will follow up with you to get your feedback M&E of the NAP process
- 28. Seite 2814/02/2019 Further reading • GIZ & IISD (2015): Guidebook for the development of national CCA M&E systems. • GIZ & IISD (2014): Comparative analysis of 10 national adaptation M&E systems. • GIZ (2017): Adaptation M&E country factsheets • UNEP: Adaptation Gap Report 2017 • UNEP (2018). Adaptation metrics: perspectives on measuring, aggregating and comparing adaptation results. M&E of the NAP process
- 29. Seite 29M&E of the NAP process - GIZ's tools and experiences14/02/2019 Open access: researchgate.net/profile/Timo_Leiter
- 30. Seite 30 Thank you very much for your attention! 14/02/2019 M&E of the NAP process Timo.Leiter@giz.de T.L.Leiter@LSE.ac.uk @TimoLeiter