Indicator Framework and Results
Download as PPTX, PDF0 likes52 views
The document discusses developing an indicator framework to measure progress towards achieving the UN Sustainable Development Goals (SDGs) at the subnational level in OECD regions and cities. It describes a process of co-designing the indicator framework with stakeholders, identifying relevant targets and indicators, defining end values for indicators, and developing a composite index for each SDG. Preliminary results are presented showing the distance of OECD regions from the 2030 end values by goal. A new online tool is introduced that will provide overviews and data for selected regions and cities to monitor their progress relative to country and OECD averages.
Indicator Framework and Results
- 1. 2nd OECD Roundtable on Cities and Regions for the SDGs Bonn, Germany. December 9, 2019 Paolo Veneri Head of Territorial Analysis and Statistics paolo.veneri@oecd.org A TERRITORIAL APPROACH TO THE SDGs: INDICATOR FRAMEWORK AND RESULTS
- 2. SDGs require the participation of every level of government and sector of society to be achieved 1. Local Governments need to know where they stand today against the 2030 Agenda 2. Monitoring progress over time, relative to country and to other peer regions and cities 3. Promoting an informed dialogue across levels of government and sectors of society, as well as partnerships and cooperation between regions and cities Why to measure the SDGs at the subnational level?
- 3. Measuring SDGs at the subnational level requires selecting the appropriate scale of analysis – While some indicators have to be measured within administrative boundaries (e.g., gender balance in local government), – … other indicators are more relevant following a functional urban approach (e.g., transport accessibility) – Regions: first administrative tier of subnational government or TL2 Large Regions. • Coverage: 600+ TL2 Large Regions of 48 countries (36 OECD and 12 partners) – Cities: Metropolitan areas or Functional Urban Areas of more than 250K people. • Coverage: 600+ FUAs of 33 OECD countries and Colombia At which subnational scale?
- 4. • First workshop on indicators, with pilots (March, 2019). Main conclusions: – Need to combine international comparable indicators with context-specific indicators – Indicators to raise awareness and promote policy dialogue (not just to create rankings) – Preference for disaggregated data; when using indexes, always show individual indicators • Second workshop on indicators, with pilots, OECD delegates and stakeholders (DG- Regio, JRC, SDSN, UCLG, WCCD and many more) (May, 2019). Technical discussion: – For indicators without a predetermined “End value” for 2030, how to define these values? – For a composite index by SDG, how to normalise and aggregate indicators? • Feedback from pilots on OEDC indicator framework (May, 2019). – Assessing relevance of indicators to help measuring the SDGs in Regions and Cities – Suggesting indicators to fill the data gaps Co-designing the OECD indicator framework
- 5. • i) What targets and indicators are relevant at the subnational scale? – Place-relevant vs. place-neutral • ii) What targets and indicators are relevant in OECD countries? – Developed vs. developing country Identifying SDG Targets and Indicators for OECD Regions and Cities based on UN Global Indicator Framework Place - relevant OECD relevant OECD Place-relevant
- 6. • Regional Explorer https://stats.oecd.org/OECDregionalstatistics/#story=0 • Regional Well-being http://www.oecdregionalwellbeing.org • Metro Explorer http://measuringurban.oecd.org/ Where did we get the data? OECD Regional and Metropolitan databases (but not only) Regional- covers first and second administrative tier of subnational government Metropolitan- covers functional urban areas of more than 250 thousand inhabitants
- 7. Additional data sources to bridge identified gaps A new section in the WPTI Questionnaire Obesity rate Pupils and students enrolment Women victims of physical or sexual violence (%); and Women Mayors (%) Population connected to at least secondary wastewater treatment (%) Final energy consumption per capita Municipal waste that is recycled (%) Data from other sources or modelled • GHS Grids: Built-up area growth relative to population growth • Gallup World Poll: Feeling of Safety (%) (among others) • World Database on Protected Areas: Protected terrestrial and coastal areas • OECD-ITF Database: Performance of public transport network (among others) • Global Database of Power Plants: Percent of electricity that comes from coal (among others)
- 8. 120+ indicators to measure 61/103 targets identified as “very relevant” for regions and cities in OECD % of OECD-relevant SDGs Targets with at least one indicator for Regions and Cities
- 9. • Defining “End-values” (UN, WHO, OECD, other experts) – Some indicators have predefined end-values: Absolute values or relative to initial levels. – Certain indicators have not a clear “positive” sense, but still informative. How do we define the end-values of indicators with a clear “positive” sense? Our approach: • Relative to peer’s performances: average of best performing regions, the “best region” of each country. • Specific end-values based on OECD outcomes • How to communicate the results in a simple way? Our approach: A Composite Index by SDG (while individual indicators are always available) • Normalise indicators from 0 to 100 where 100 is end value. • The composite index is the average of the normalised indicators. Measuring the distance to the SDGs: our approach
- 10. Spotlight on preliminary (aggregate) results for “TL2 regions” Distance of OECD Regions to the end values for 2030, by Goal Share of regions that have not achieved the end values for 2030, by goal
- 11. One example for cities (metropolitan areas) 17% of cities have achieved the end values of both exposure to air pollution lower than 10 µg/m³ and an equal or lower growth rate in land consumption with respect to population growth. Note: Lagging cities are the cities that have not yet achieved the end values. Between parentheses: number of lagging cities over number of cities with available data. The index for Goal 11 on Sustainable cities combines the indicators of – i) difference between land consumption rate and population growth rate, and – ii) average exposure to particulate matter 2.5 (PM2.5)
- 12. A new OECD online tool on Localising the SDGs data
- 13. Overview of selected region or city, relative to country This example does not use real data
- 14. Overview of selected region or city, relative to OECD This example does not use real data
- 15. THANK YOU For more information: Marcos.DiazRamirez@oecd.org Stefano.Marta@oecd.org Paolo.Veneri@oecd.org • Oe.cd/sdgs-local • @OECD_Local
- 16. • How is your region or city using SDGs indicators to raise awareness and promote dialogue across levels of government and sectors of society? • How is your region or city using SDGs indicators for policy making (e.g., prioritization, planning, budgeting, monitoring, etc.)? • How could the OECD localized indicator framework for SDGs better support your region or city in its policy making process? Questions for discussion
Editor's Notes
- #3: -Most SDG Targets are already related to the responsibilities, objectives and daily work of local authorities -Local governments can link the global goals with local communities 1. Local Governments need to know where they stand Today with respect to the 2030 Agenda –To redefine priorities, adapt local development plans, strategies and budgeting 2. Monitoring progress over time, relative to country and to other peer regions and cities -Assess outcomes and policy effectiveness over time (adapt to changing reality and megatrends) 3. Promoting an informed dialogue across levels of government and sectors of society -Shaping evidence-based policies and strategies to achieve the SDGs though a multistakeholder platform -Strengthening trust in institutions through transparency and efficient use of resources 4. Enhancing partnerships and cooperation (Sharing best practices) -Data can be the common language of stakeholders to define better policies for SGDs
- #4: 5 LAC countries: Argentina, Brazil, Colombia, Costa Rica and Peru 5 EU28 countries: Bulgaria, Romania, Croatia, Cyprus and Malta TL2 large regions are defined as the first administrative tier of subnational government and consists of 400 OCDE large regions. For EU countries TL2 are equivalent to NUTS2, with the exception of Belgium, Germany and the United Kingdom for which TL2=NUTS1 (TL3 small regions are composed of 2 241 small regions , TL3 = NUTS3 for EU countries) Definition of FUA vs Administrative city
- #5: Need to combine international comparable indicators with context-specific indicators Internal and external function of the OECD localised indicator framework Indicators to raise awareness and promote policy dialogue (not just to create rankings) The OECD indicator framework will allow to compare peer cities and regions and identify strengths and weaknesses to improve local and regional development policies – the overall goal is not to say that one city is better than the other How to define end values? – for subnational governments it is usually a political decision: OECD can help by creating objective criteria based on experts and knowledge. The OECD uses objective rules for all OECD regions and cities, e.g., based on experts on the subject (WHO for health: air pollution, maternal mortality, etc.) or by looking at best possible outcomes of sample (the average of best performer region or city by country).
- #6: When UN indicator not available look for proxies (available or to produce) -At this stage of the project: Privilege proxy with good OECD coverage over exact UN indicator with very low coverage e.g., % that believes corruption is spread throughout the government proxy for 16.5 Substantially reduce corruption and bribery We also look at what other agencies are doing to localise the SDGs (OECD/SDD, Eurostat, JRC, UCLG, etc.) and at the existing literature The OECD estimates that 100 out of the 169 SDGs targets require the full engagement and participation of subnational governments to be achieved in all OECD regions and cities.
- #7: 398 Subnational administrations (TL2) 2,251 Tier 3 subnational administrations (TL3) Classification of TL3 regions: Based on rurality Based on relation to a functional urban area 649 Functional urban areas 250k+ inhabitants Coverage from 2000-2016 Coverage 33 OECD countries + Colombia
- #8: Obesity rate is the percentage of population 15 years old or more with a Body Mass Index (BMI)>30 kg/m2. Pupils and student enrolment in public or private institutions by age group (5-14, 15-19, 20-29,30-39, >40, and Total). Share of women aged 15 years old or more who experienced physical and sexual violence within 12 last months. Final energy consumption in households per capita (in kg of oil equivalent). Percentage of population connected to wastewater treatment systems with at least secondary treatment. Recycled waste: waste that undergoes material or other forms of recycling (including energy recovery and composting).
- #9: The OECD estimates that at least 103 out of the 169 SDGs targets require the full engagement and participation of subnational governments to be achieved in all OECD regions and cities. Process to develop the framework: I) What targets and indicators are relevant at the subnational scale? Place-relevant vs. place-neutral ii) What targets and indicators are relevant in OECD countries? Developed vs. developing country At Which Scale? Regions: first administrative tier of subnational government or TL2 Large Regions. Coverage: 600+ TL2 Large Regions of 48 countries (36 OECD and 12 partners): 400 OECD TL2 large Regions + TL2 large Regions of 5 LAC countries, 5 EU28 countries, Tunisia and Russia Cities: Metropolitan areas or Functional Urban Areas of more than 250K people. Coverage: 600+ FUAs of 33 OECD countries and Colombia 628 OECD FUAs + FUAs of Colombia + Combination of Functional and Administrative Data. Figure on % of sub-national targets with indicators for regions and cities -More than 120 indicators that allow to cover at least one aspect of each of the 17 SDGs for both regions and cities -However, the coverage is higher for regions than for cities. While 113 indicators (covering 60% of the SDG Subnational Targets) are available for regions, only 48 indicators (covering 33% of the SDG Subnational Targets) are currently available for cities. -The coverage also varies across goals. Whereas Goals 3, 16 and 8 have indicators for at least 70% of the selected Targets, Goals 12, 13 and 14 have indicators for less than one third of the selected Targets.
- #10: Absolute value: -3.2 Reduce infant mortality to as low as 25 deaths per 1000 live births (SDG), -11.6.2 PM 2.5 pollution to less than 10 micrograms per cubic meter (WHO), -16.1 Homicide rates to 0 (OECD) Relative to initial value: -1.2 Reduce % people living in relative poverty by half Relative to OECD: -8.2 Achieve higher levels of economic productivity -16.6 % of people that has confidence in the national government Informative: -2.3 Double the agricultural productivity? -9.2.2 Manufacturing employment as a proportion of total employment How to communicate results in a simple way? We have selected 100 Targets, around 100 indicators for 1200+ Regions and Cities A Composite Index by goal? Each indicator is normalized From 0 to 100, where end-value is 100 The composite index is the average of
- #11: The average distance of OECD regions to the end values for 2030 varies across the 17 Goals and ranges from 25 to 60% of the total possible distance to achieve the desired outcomes. The average distance of a region or city to an end value is the remaining trajectory the region or city has to travel as a percent of the longest distance a region or city could face in a given indicator or index. While the average distance to achieve Goals 8 “Decent work”, 11 “Sustainable cities”, 16 “Peace and Institutions”, and 1 “No poverty” is on average less than 30% of the total possible trajectory, Goals 13 “Climate action”, 9 “Industry and innovation”, and 14 “Life below water” are, on average, slightly above halfway from the end values. In Goal 10 (Reduced inequalities), Goal 12 (Responsible consumption), Goal 3 (Good health) and Goal 17 (Partnerships for SDGs), regions are, on average, one third of the way to reach the end values for 2030 In all the 17 Goals, at least 75% of OECD regions have not achieved the end values for 2030. Not a single region in the OECD has achieved the end values set for Goal 5 on gender equality (which requires a 0 gender gap in both employment rate and part-time job incidence), and only around 12% of OECD regions have achieved the end values of Goal 11 on “Sustainable cities” and Goal 12 on “Responsible consumption” (both Goals with two indicators). The figure (second figure in the slide) also presents the average distance of the lagging regions – regions that have not achieved the end value – by Goal. Goal 13 (Climate action), 9 (Industry and innovation), 14 (Life below water) and 7 (Clean energy) display the largest distances to the end values for lagging regions, with an average distance above the 50%. Goal 7 about clean energy displays high regional disparities in distances to the objective. While 15% of the regions have completed the Goal’s end value (therefore having a distance to travel equal to zero), the remaining 85% of regions are halfway to the end values for 2030 (i.e., 75% of electricity coming from renewable energy and 0% of electricity coming from coal).
- #12: Going beyond national averages, this framework allows to identify, by country, which regions and cities have achieved the end values for 2030 (of the available indicators) and which ones are lagging behind – and by how much. The index for Goal 11 on Sustainable cities combines the indicators of i) difference (instead of ratio) between land consumption rate and population growth rate, and ii) average exposure to particulate matter 2.5 (PM2.5) It is worth noting that the end values for these two indicators were not set based on the performance of the best regions or cities, but on experts’ recommendations. For example, the end value for exposure to air pollution was set at 10 or less micrograms per cubic metre, based on the recommendations of the World Health Organisation (WHO, 2006). While the end value for the gap between land consumption rate and population growth rate was established as zero, implying that the land consumption rate should follow the growth path of the population. The average distance for the lagging cities towards the goal is of 28 points (from 0 to 100)