Indices of Social Development - Ellen Webbink - IndSocDev
Download as PPT, PDF1 like915 views
This document discusses social development indices and their organization on the website IndSocDev.org. It covers five aspects of social development that are measured: civic activism, clubs and associations, inter-group cohesion, interpersonal safety and trust, and gender equality. Indicators from over 25 independent sources are aggregated using a matching percentiles methodology to provide index scores for over 200 countries. Examples of how the indices can be applied include analyzing trends over time in gender equality and relationships between indices like gender equality and infant mortality.
Indices of Social Development - Ellen Webbink - IndSocDev
- 1. Indices of Social Development Open Data for Development Camp 13 May 2011 Ellen Webbink webbink@iss.nl/ isd@iss.nl Irene van Staveren Arjan de Haan Roberto Foa
- 2. Contents Why social development indices ? IndSocDev.org – a demonstration How the indices are composed Examples of applications Questions and comments
- 3. Why does social development matter? Social development is about putting people at the centre of development 1995 Copenhagen Summit Social development much more than health, education child welfare -> glue that keeps society together “ behaviours, norms, conventions that pattern human interaction” (thus also: structures markets and governance)
- 4. Why should we measure it ? Social development usually terrain of more qualitative methods and disciplines Measurements of development have been broadening: steel, GDP, HDI, Governance, happiness IndSocDev = last mile in this sequence The promise: - systematise and compare different aspects of social development - relate those to other development outcomes - trends over time
- 5. What did we decide to measure Design on basis of iterative process of expert discussions + comparison with available data IndSocDev focus on five aspects (indices) of social development, based on: 200 indicators from 25 reputable and independent data sources, aggregated into Indices using ‘matching percentiles’
- 6. Matching percentiles & how we cover 200 countries Combining sources more reliable than single source (minimum 3 sources) Many indicators limited coverage between 15 and 200 Aggregating and comparing allows to enhance coverage – details explained later Progressively more reliable
- 7. Civic activism : social norms, organisations, practices which facilitate citizen involvement in public policies and decisions Examples of questions % people participated in demonstration, petition, boycott % people with access to radio, TV, newspaper Density international organisations Civicus civil society rating … .. related sources World Values Survey, regional barometers barometers / ITU Global Civil Society Civicus
- 8. For example: Civic Activism Scores for Middle East and North Africa
- 9. 2) Clubs and associations: strength of ties to neighbourhood and associational life (voluntary groups, time with clubs, community meets, development associations) Examples of questions % people using free time for groups and associations % people members of clubs Spent time socialising % people state people ‘generally help one another’ … .. related sources Latinobarometer, WVS barometers, WVS, World Values Survey ICVS
- 10. 3) Inter-group cohesion: relations of cooperation and respect between predominant identity groups in a society Examples of questions Incidences of riots, terrorist acts Levels ethnic/religious tension Group disparities and discrimination Proportion people who reject others as neighbours … .. related sources Databanks, EIU ICRG Minorities at Risk, Fund for Peace World Values Survey
- 11. 4) Interpersonal safety and trust: extent that individuals feel they can rely on people they have not met before Examples of questions % people experienced theft, robbery etc. % people that feel safe Perception people can be trusted, are fair Crime as business constraint … .. related sources Afrobarometer, ICVS, Interpol ICVS Barometers, World Value Survey World Development Indicators
- 12. 5) Gender equality: extent to which women face the same opportunities and constraints with family, work, society Examples of questions Perceptions equality of rights and opportunities Rating economic rights Ratio of women in education, labour force Wage rates … .. related sources barometers, WVS CIRI WDI ILO
- 13. www.IndSocDev.org how does it work ?
- 21. Methodology ISD combines over 200 indicators from 25 independent and reputable sources Uses ‘matching percentiles’ method used for Corruptions Perceptions Index Lambsdorff 1999 www.transparency.org/policy_research/surveys_indices/cpi/2010/in_detail#4 Rationale for matching percentiles Combination of sources measuring same phenomenon more reliable than each source separately Indices broaden the coverage compared to single source Minimum 3 independent sources to develop index Note: 2010 data reported but is still incomplete
- 22. Matching percentiles – Step 1 If multiple questions in one source, average is calculated e.g., access to radio, TV, newspapers ISD uses rankings – not all sources use these, most use regular scores e.g., % people responding Produce a rank from the scores: 0 – 1 (standardization) For example, 1 st indicator Civic Activism: participation in demonstrations
- 23. Step 1:Standardising % of people participated in demonstrations (World Values Survey) Botswana 28 % Nigeria 25 % Tanzania 10% Burundi 3 % Congo 2 % Botswana Nigeria Tanzania Burundi Congo, DR Other countries 0.24 0.22 0.08 0.05 0.04 participation in demonstrations, petitions, boycotts - Rank 1 2 3 4 5
- 24. Step 2 2nd source: s cores from second indicator (from different source) matched to first (‘master’) indicator based on ranking of shared countries in the master indicator Each additional indicator adjusts the ranking in order to reduce the uncertainty of the earlier rankings: with more indicators you simply broaden the basis of measurement of the index For example, an additional indicator could be: “ attending meetings”
- 25. Matching Equally Ranked Values Botswana Nigeria Tanzania Burundi Congo, DR Other countries 0.24 0.22 0.08 0.05 0.04 Botswana Tanzania Nigeria Burundi Congo, DR 0.24 0.22 0.08 0.05 0.04 % respondent participation in demonstrations, petitions, boycotts (WVS) Respondent has often attended meetings of a local development association (Afrobarometer)
- 26. Step 3: averaging matching scores to obtain index Var1 Var2 Matching Score Var3 Matching Score Var4 Matching Score Index Botswana 0.24 0.4 0.22 0.4 0.05 0.5 0.24 0.170 Nigeria 0.22 0.5 0.24 0.5 0.08 0.4 0.22 0.180 Tanzania 0.08 0.3 0.08 0.6 0.22 0.3 0.08 0.127 Burundi 0.05 0.2 0.05 0.7 0.24 N.A 0.145 Congo, DR 0.04 0.1 0.04 N.A. N.A N.A
- 27. Etcetera …. We repeat the same procedure with different choice of master variable ( random score 0 – 1) 1,000 times (“bootstrapping”) Reducing random error with each iteration To arrive at a final score for the index with a standard error obtained from the reiterations Index score for a country is only produced if at least 3 independent sources for that country are available
- 28. Which in example produces: 2005 data (real data)
- 29. How do we know we can trust matching percentiles ? robustness
- 30. Comparison of Matching Percentiles vs. Imputation Methods Civic Activism
- 31. Factor analysis civic activism
- 32. IndSocDev examples of applications
- 33. Trends Over Time Rising Gender Equality in the Middle East, 1990-2007
- 34. Mapping gender equality in Africa Levels of gender equality in Southern and Eastern Africa are higher than their GDP would lead us to expect.
- 35. Gender Equality in Africa
- 36. Interpersonal Safety and Trust – Latin America and Caribbean
- 37. Residual Scatter Plot between gender equity and infant mortality, after controlling for: log GDP/capita, log GDP/capita 2 , female progression to secondary school (%), civic engagement, governance (Voice and Accountability), HIV-AIDS infection rate p = 0.000*** Gender Equality and Infant Mortality
- 38. Partial Correlation (Residual Plot) between Intergroup Cohesion and (log) rate of deaths from natural disasters.
- 39. Thank you ! Do let us know what you think www.IndSocDev.org
Editor's Notes
- #21: We now provide some detail on the method of aggregation, the Matching Percentiles
- #31: In the first place, we compared the outcome of matching percentiles with the much more laborious imputation method This produced very similar results, which we show here for the Index Civic Activism, and other Indices had similar results
- #32: Secondly, factor analysis was deployed, to assess the appropriateness of the indices drawn a priori from the social development indicators database based on a purely statistical criterion Factor analysis reduces the number of variables on the basis of similarity. The factors extracted from the total set of social development indicators replicate to a remarkable degree the social development indices. In other words, our distinction between 5 indices is quite similar to the one that would result from a factor analysis in which all underlying indicators would be used: very similar indices would come out, here shown for civic activism
- #34: First, we can show trends over time, for example shown here for positive changes of gender equity in the Middle East
- #38: And similar for other indicators, such as infant mortality