formseminar_module2.ppt
- 1. IPDET Module 2: Understanding the Issues Driving Development Evaluation
- 2. IPDET © 2009 2 Introduction • Overview of Evaluation in Developed and Developing Countries • Implications of Emerging Development Issues
- 3. IPDET © 2009 3 Evaluation in Developed Countries • Most of the 30 OECD countries have mature M&E systems • Earliest adopters had: – democratic political systems – strong empirical traditions – civil servants trained in social science – efficient administrative systems and institutions
- 4. IPDET © 2009 4 A Strong Evaluation Culture Exists when: 1. Evaluation takes place in many policy domains 2. Supply of evaluators on staff who have mastered methods of different specialized disciplines 3. National discourse exists on evaluation 4. Profession exists with own societies or meetings with discussion of norms and ethics (continued on next slide - 1 of 3)
- 5. IPDET © 2009 5 A Strong Evaluation Culture Exists when: (cont.) 5. Institutional arrangements exist in government for conducting evaluations and disseminating to decision makers 6. Institutional arrangements present in legislative bodies for conducting evaluations and disseminating them to decision makers (continued on next slide- 2 of 3)
- 6. IPDET © 2009 6 A Strong Evaluation Culture Exists when: (cont.) 7. An element of pluralism exists within each policy domain 8. Evaluation activities also take place within the supreme audit institution 9. Evaluations focus not only on technical production or relation between inputs and outputs but also on program or policy outcomes
- 7. 4 Stages towards Developing Evaluation Capacity (The Tavistock Institute) • Mandating evaluation • Coordinating evaluation • Institutionalizing evaluation • Toward an evaluation system IPDET © 2009 7
- 8. IPDET © 2009 8 Approaches • Whole-of-Government • Enclave • Mixed Skip Approach Details
- 9. IPDET © 2009 9 Whole-of-Government Approach • Adopted in some early M&E pioneer countries • Broad-based, comprehensive M&E at all levels of government • Millennium Development Goals created impetus • Challenging where different ministries are at different stages
- 10. IPDET © 2009 10 Enclave Approach • More limited, focus on one part or sector of government (a ministry or the cabinet) • Strategy: – begin at local, state, or regional governmental level – pilot evaluation systems in a few key ministries or agencies
- 11. IPDET © 2009 11 Mixed Approach • Blended whole-of-government and enclave approaches • Some areas have a comprehensive approach; others more sporadic attention
- 12. IPDET © 2009 12 Evaluation in Developing Countries • Face similar and different challenges • Weak political will slows progress • Difficulties in inter-ministerial cooperation and coordination can impede progress
- 13. IPDET © 2009 13 Evaluation Systems in Developing Countries • New evaluation systems need: – political will in the government – highly placed champions willing to assume political risks – credible institutions
- 14. IPDET © 2009 14 Developing Countries Need to: • Establish a foundation for evaluation – statistical systems and data, as well as budgetary systems • Routinely collect baseline information • Train officials in data collection, monitoring methods, and analysis
- 15. IPDET © 2009 15 Other Problems for Evaluation in Developing Countries • Two budget systems: – recurrent expenditures – capital/investment expenditures • Whole-of-Government approach may be too difficult at outset
- 16. Building Institutional Capacity for Evaluation • Aid organizations efforts can provide or create: – technical and financial assistance to build statistical systems – development networks • on-line computer networks • participatory communities (Development Gateway) IPDET © 2009 16
- 17. IPDET © 2009 17 Patton’s Recent Trends • Evaluation as a global public good • Growth of professional organizations, associations, and societies and establishing standards and guidelines • Beyond studies to streams (Rist) • Emerging complexity in evaluation • Move to more formative evaluation
- 18. IPDET © 2009 18 Emerging Issues Have Evaluation Implications • Globalization • Growing incidence of conflict • Terrorism and money laundering • Widening gap between rich and poor • More development players • Drive toward debt reduction • Focus on improved governance • Drive toward results-based, comprehensive, coordinated, and participatory development
- 19. IPDET © 2009 19 Items at Top of International Development Agenda • Begins with Millennium Development Goals
- 20. IPDET © 2009 20 Millennium Development Goals (MDG) and M&E 1. Eradicate extreme poverty and hunger 2. Achieve universal primary education 3. Promote gender equality and empower women 4. Reduce child mortality 5. Improve maternal health (continued on next slide)
- 21. IPDET © 2009 21 Millennium Development Goals (MDG) 6. Combat HIV/AIDs, malaria, and other diseases 7. Ensure environmental sustainability 8. Develop a global partnership for development • Driving developing countries to build statistical and evaluation capacity and systems • Development organizations called upon to provide technical assistance
- 22. Monterrey Consensus and M&E - 2002 • About more financing for development to achieve the MDGs • 170 countries, 50 heads of state • NO firm goals • Stressed mutual responsibilities and called on developing countries to improve policies and governance IPDET © 2009 22
- 23. Paris Declaration on Aid Effectiveness - 2005 • Agreed to increase efforts for managing aid to developing countries • 100+ ministers, heads of agencies and other senior officials • Monitorable actions and indicators to track progress towards effective aid • Five key principles: ownership, alignment, harmonization, managing for results, and mutual accountability IPDET © 2009 23
- 24. 2007 Survey of Paris Declaration Found: • Increased awareness and promoted dialogue to improve delivery of aid • Pace of progress in changing donor attitudes has been slow, transaction costs high • Need to strengthen development strategies IPDET © 2009 24
- 25. 2008 Survey of Paris Declaration and M&E Found: • Changing the way aid is delivered involves new costs • Should use performance assessment frameworks and results-oriented reporting • Need more credible monitoring systems IPDET © 2009 25
- 26. IPDET © 2009 26 The HIPC Initiative • Intended to reduce external debt to sustainable levels for countries pursuing economic and social policy reform • Endorsed by 180 countries, 41 countries receiving HIPC by 2007 • Linked to larger comprehensive national poverty reduction strategies
- 27. IPDET © 2009 27 HIPC and M&E • Driving creation of M&E capacity • Countries must commit to accountability and transparency through monitoring and evaluation • Grants raise new evaluation issues
- 28. IPDET © 2009 28 The Role of Foundations • Large foundations: (e.g. Gates, Ford, Buffet, Soras) • Now part of the dialogue on global/country/ sector-wide projects, programs, and policies • Designing and conducting evaluations • Foundation support for development must be considered in other evaluations
- 29. IPDET © 2009 29 Conflict Prevention and Postconflict Reconstruction • Currently conflict affects over 1 billion people • Most conflicts difficult to end and global costs are great • Poverty a cause and consequence of conflict • Postconflict reconstruction requires coordination of many development organizations and government sectors
- 30. IPDET © 2009 30 Conflict Prevention • Increased M&E emphasis on measuring change in: – social, ethnic, and religious communities and relations – governance and political institutions – human rights – security – economic structures and performance – the environment and natural resources – external factors
- 31. IPDET © 2009 31 Postconflict Reconstruction and M&E • Multisector programs funded by 50-80 bilateral and multilateral development organizations • Evaluators must examine the development organization coordination process • New areas for evaluation: – demining, demobilization, reintegration of ex- combatants, ways to prevent conflicts from erupting • Difficulty with attribution to any one organization
- 32. IPDET © 2009 32 Governance • Governance programs address: – anticorruption, public expenditure management, civil service reform, judicial reform, administration, decentralization, e-government and public services delivery • Several indices of corruption useful for M&E, e.g. Transparency International (TI) “Corruption Perception Index”
- 33. IPDET © 2009 33 Anti-Money Laundering and Terrorist Financing • Problem: – Converting or transferring proceeds of criminal activity with the intent to conceal or disguise the origin of the property – Serious and growing international problem • M&E Implication: – OECD Financial Action Task Force (FATF) on Money Laundering – Monitoring and evaluation is a part of the FATF mandate carried out multilaterally, by peer review, and by mutual evaluation
- 34. IPDET © 2009 34 Workers’ Remittances • Issue: money sent by workers at a distance to someone at home • Now: global remittance total greater than ODA assistance • Tend to be more stable than private capital flows with strong impact on poverty reduction • M&E Implication: development organizations find ways to track remittances, evaluators need to determine the relative impact
- 35. IPDET © 2009 35 Gender Mainstreaming • Gender: socially constructed roles ascribed to females and males • Gender analysis: determine the access to and control over resources by men and women (and systematic way to determine impacts of development on women and men)
- 36. IPDET © 2009 36 Gender and M&E • Gender equality and empowerment of women on MDG, specific goals, targets, indicators for countries • OECD’s DAC outlines guiding questions • Implications for gender part of all M&E – In design – In review
- 37. Private Sector Development (PSD) and Investment Climate • Measures: PSI, ODA, FDI, • PSD needed for poverty reduction • Issue is investment climate • Monitor and evaluate investment climate, e.g. Doing Business Database • Evaluate PSD on indicators, such as: – business performance – economic sustainability – environmental and social effects – private sector development IPDET © 2009 37
- 38. IPDET © 2009 38 Environmental and Social Sustainability • Corporate social responsibility (CSR): actively taking into account the economic, environmental and social impacts, and consequences of development activities • Equator Principles (2003, updated 2006) provides: – framework and standards for financing activities and outlines ways to determine, assess, and manage environmental and social risk – M&E focus
- 39. IPDET © 2009 39 Global Public Goods • Definition: Goods that are there for all to consume, where consumption by one person does not reduce the amount for others, e.g. languages, stories, history, clean air • Global public goods affect the entire world • Evaluation of global public goods is largely absent • Lack clear objectives and verifiable performance indicators • World Bank sourcebook
- 40. A Final Note…. IPDET © 2009 “Shoot for the moon. Even if you miss, you’ll land among the stars.” -- Les Brown 40 Questions?