SlideShare a Scribd company logo
Open data for aid and
development
Rupert Simons
April 27, 2016
Source: World Development Report 2016
We’ve all heard of big data
Cellphone subscriptions
worldwide
billion
0.7
7
2000 2015
Gigabytes of data produced
every day
billion
2.5
2000 2015
<0.1
But data is often poor or non-existent in countries
where you need it most
Managing the Ebola crisis
• Where are the patients?
• Where are the
ambulances?
• Have the health workers
been paid?
Source: Nature, FT
Estimating the size of the
economy
• Did Nigeria’s GDP really double
in two years?
• ‘Middle income’ countries pay
more to borrow from the World
Bank, but less in the market
0
1000
2000
3000
4000
Nigeria GDP, USD per capita
Publish What You Fund reviewed the quality of
data produced by major aid donors
10
25
65
Activity level data
(28 indicators)
Organisation level
data (8 indicators)
Commitment to
transparency (3
indicators)
We worked with
people from
46agencies in
22 countries
and 36
independent
reviewers and CSOs
100
To assess 39 indicators of
data on aid and
development
Maximum possible
score
Over a data collection
period of 14 weeks
What we found: Aid is getting more
transparent
4 7
105
8
8
16
16
16
16
15
726
22
5
2013 Index 2014 Index 2016 Index
Very Poor
Poor
Fair
Good
Very Good
Source: Aid Transparency Index 2013-16
Performance of agencies in the Index
Total 67 68 46
Ten donors met the Busan
commitment in full:
• UNDP
• U.S. – MCC
• UNICEF
• UK – DFID
• The Global Fund
• World Bank – IDA
• IADB
• AsDB
• Sweden
• AfDB
300+
Nearly 400 organisations are now publishing to
IATI
Number of IATI publishers by type
2011-15
Source: IATI annual report 2015
The norm is gradually shifting from annual
reporting to quarterly, monthly or real time
Annual reporting
• Companies House/ Charity Commission returns
• OECD-DAC Credit Reporting Statistics (for official donors)
• Annual report on website (usually in PDF)
Regular updating
• Monthly or quarterly publication
• Machine-readable and web formats
• Edit for confidentiality
Real-time data sharing
• Uploaded automatically
• Daily decision-making
• Limited editing
Some governments are using the data
NGOs are using it too,
for example:
Source: IATI, Development Gateway
IATI import system
in use
IATI import system
under development
IATI partner country
Most people outside government are not
Source: d-portal.org, 2016 Aid Transparency Index
Partly because it’s not
easy to use
Partly because they don’t
know it’s there
Partly because the data
is of poor quality
“Even stakeholders that
regularly search for aid
information, like civil
society watchdog
organizations and
parliamentarians, were not
aware of the available data
sources.”
USAID aid transparency
pilot assessment, July
201513% of activities in
Ghana had a location
specified
Meanwhile, civic registration and
administrative data lags far behind
Source: Development Initiatives “Data Revolution in Africa”
82
45
33 29
22
13
9
40
29
13
18
9
9 15
38
58 60
78
Census Household
survey
Poverty
census
Agricultural
census
Birth
statistics
Death
statistics
Recent (last 10
years for census,
last 3-5 years for
survey)
Out of date
Unusable or
unavailable
Quality and availability of data in African countries,
percentage of countries
Estimates for closing data gaps range widely,
with $100-200 million per year as the median
Source: Brookings; CGD; SDSN
17-66
Cost of building and maintaining statistical systems to
monitor the Sustainable Development Goals
USD million per year
100-
200
1,100
900- 1,000
>10,000
New money
Existing aid
Own resources
Not specified
So what should we do about it?
• A perspective from the INGO Accountability Charter
• What do you think?
• Publish What You Fund perspective
• Data quality
• Awareness
• Tools

More Related Content

PDF
Civic Engagement Research at Facebook
PDF
Data standards for watchdogs: making a difference in Central and Eastern Europe
PDF
Mobile civic tech in low-income countries: taking stock
PPTX
Big data, big stories big interventions :How evidence based stories influenc...
PPTX
Exodus Lessons Learned H4Dip Stanford 2016
PPTX
Team 621 Hacking for Diplomacy week 8
PPT
Global pulse technology
PPT
Global pulse use case
Civic Engagement Research at Facebook
Data standards for watchdogs: making a difference in Central and Eastern Europe
Mobile civic tech in low-income countries: taking stock
Big data, big stories big interventions :How evidence based stories influenc...
Exodus Lessons Learned H4Dip Stanford 2016
Team 621 Hacking for Diplomacy week 8
Global pulse technology
Global pulse use case

What's hot (20)

PPTX
Elections in the digital age
KEY
Citizen Experience Design
PPT
AU SOC 2010 Bootcamp
PDF
Open Government: Policy,Technology, and Community in the US & Canada
PPT
Government Citizen Engagement Survival Guide
PPTX
Civic Engagement in the Digital Age
PPTX
Healthy City presentation in Monterey & Salinas 3.14.12
PDF
Open data for social change & the SDGs
PPTX
Bringing Parliament to the People: building engagement in the democratic process
PPTX
Social Media, Civic Engagement, and Participation in the Digital Age
PDF
Using Machine Learning to Analyse Radio Content in Uganda
PDF
Visible Government
PDF
Catalyzing Civic Innovation/Data webinar
PPTX
Uploading Your Own Data Onto v5
PDF
Know4 drr shadrock_roberts_may2015
PPTX
Including the Human in Humanitarian Big Data
PPTX
Network mapping with School of Data
PPT
Schaffer
PPTX
Tech futures for charities
PPTX
Gerard McCarthy Digital tools for evaluation
Elections in the digital age
Citizen Experience Design
AU SOC 2010 Bootcamp
Open Government: Policy,Technology, and Community in the US & Canada
Government Citizen Engagement Survival Guide
Civic Engagement in the Digital Age
Healthy City presentation in Monterey & Salinas 3.14.12
Open data for social change & the SDGs
Bringing Parliament to the People: building engagement in the democratic process
Social Media, Civic Engagement, and Participation in the Digital Age
Using Machine Learning to Analyse Radio Content in Uganda
Visible Government
Catalyzing Civic Innovation/Data webinar
Uploading Your Own Data Onto v5
Know4 drr shadrock_roberts_may2015
Including the Human in Humanitarian Big Data
Network mapping with School of Data
Schaffer
Tech futures for charities
Gerard McCarthy Digital tools for evaluation
Ad

Viewers also liked (6)

PPT
Creative presentation tools
PDF
Memes, Memes Everywhere
PDF
A Complete Guide To The Best Times To Post On Social Media (And More!)
PDF
FontShop - Typography
PDF
People Don't Care About Your Brand
PDF
Go Viral on the Social Web: The Definitive How-To guide!
Creative presentation tools
Memes, Memes Everywhere
A Complete Guide To The Best Times To Post On Social Media (And More!)
FontShop - Typography
People Don't Care About Your Brand
Go Viral on the Social Web: The Definitive How-To guide!
Ad

Similar to Open data for aid and development (20)

PPTX
Berlin presentation
PPTX
Working with IATI - Mark Brough - Publish What you Fund
PDF
Data-Driven Storytelling
PPT
Nfg 2006 Annual Report
PDF
CAF World Giving Index 2017
PPTX
Better governance through visualizing government data
PPTX
Implementing the SDGs in a Changing World
PDF
CAF World Giving Index 2016
PDF
Key Facts on Global Private Philanthropy for Development (3-Oct-2017)
PDF
New LSA Research, LSA|15 Preview
PDF
Digital 2015 Egypt (January 2015)
PDF
Halo Report Q2 2014
PPT
Making the United Nations more open and transparent - Thomas Melin
PPTX
Is Development Aid Dead? By Johannes Jütting, Executive Head, PARIS21
PDF
Decent work
PDF
SocialCops and UN Papua New Guinea: Presentation for Data Stocktaking Workshop
PPTX
NTC 2015 - Reuse of Open & Big Data for Sustainable Services for Social Good
PPTX
Future World Giving - Recognising the potential of middle class giving
PPTX
Impact of covid 19 on social enterpises
PDF
Digital 2015 Nigeria (January 2015)
Berlin presentation
Working with IATI - Mark Brough - Publish What you Fund
Data-Driven Storytelling
Nfg 2006 Annual Report
CAF World Giving Index 2017
Better governance through visualizing government data
Implementing the SDGs in a Changing World
CAF World Giving Index 2016
Key Facts on Global Private Philanthropy for Development (3-Oct-2017)
New LSA Research, LSA|15 Preview
Digital 2015 Egypt (January 2015)
Halo Report Q2 2014
Making the United Nations more open and transparent - Thomas Melin
Is Development Aid Dead? By Johannes Jütting, Executive Head, PARIS21
Decent work
SocialCops and UN Papua New Guinea: Presentation for Data Stocktaking Workshop
NTC 2015 - Reuse of Open & Big Data for Sustainable Services for Social Good
Future World Giving - Recognising the potential of middle class giving
Impact of covid 19 on social enterpises
Digital 2015 Nigeria (January 2015)

More from mysociety (20)

PPTX
Regulating Access to Information - Alex Parsons, mySociety (UK)
PPTX
Watch this space (and pay for it): Alaveteli-driven exposure of the misuse of...
PDF
What are the effects of OpenStreetMapping on the mappers themselves? - Aishwo...
PDF
#PlanTech and the geospatial ecosystem - Ben Fowkes (Delib)
PDF
Open data for local self governance: learnings from five Ukrainian cities - N...
PPTX
Digital Champions: community led development monitoring in Tanzania - Janet C...
PDF
Don’t build it: a practical guide for those building Civic Tech - Luke Jordan...
PPTX
It takes two: when citizens and Congress Members deliberate online - Samantha...
PDF
Understanding the small hurdles that block community engagement, with behavio...
PPTX
Our COVID consultation journey: from a small initiative to the desk of the pr...
PDF
Keeping track of open data in times of political change - David Zamora (Open ...
PDF
Civic tech vs. illicit pharmacies - Ibraheem Saleem (Code for Pakistan)
PDF
Find that Charity: a tool to help find charities and improve charity data - D...
PPTX
Civic tech for smartphone beginners: is the future binary? - Arran Leonard (I...
PDF
How to monitor emergency procurement with open data: lessons from 12 countrie...
PDF
Accountability through petitions: Elections 2019 - Gaston Wright & Leandro As...
PDF
Openly available air quality data: not just blue-sky thinking - Sruti Modekur...
PPTX
How to last in civic tech (especially now) - Matthew Stempeck & Micah L. Sifr...
PPT
Future of tech and democracy at the city of Reykjavík - Sigurlaug Anna Jóhann...
PPTX
Lessons learned from building democracy’s database - Stacy Henderson (Cicero,...
Regulating Access to Information - Alex Parsons, mySociety (UK)
Watch this space (and pay for it): Alaveteli-driven exposure of the misuse of...
What are the effects of OpenStreetMapping on the mappers themselves? - Aishwo...
#PlanTech and the geospatial ecosystem - Ben Fowkes (Delib)
Open data for local self governance: learnings from five Ukrainian cities - N...
Digital Champions: community led development monitoring in Tanzania - Janet C...
Don’t build it: a practical guide for those building Civic Tech - Luke Jordan...
It takes two: when citizens and Congress Members deliberate online - Samantha...
Understanding the small hurdles that block community engagement, with behavio...
Our COVID consultation journey: from a small initiative to the desk of the pr...
Keeping track of open data in times of political change - David Zamora (Open ...
Civic tech vs. illicit pharmacies - Ibraheem Saleem (Code for Pakistan)
Find that Charity: a tool to help find charities and improve charity data - D...
Civic tech for smartphone beginners: is the future binary? - Arran Leonard (I...
How to monitor emergency procurement with open data: lessons from 12 countrie...
Accountability through petitions: Elections 2019 - Gaston Wright & Leandro As...
Openly available air quality data: not just blue-sky thinking - Sruti Modekur...
How to last in civic tech (especially now) - Matthew Stempeck & Micah L. Sifr...
Future of tech and democracy at the city of Reykjavík - Sigurlaug Anna Jóhann...
Lessons learned from building democracy’s database - Stacy Henderson (Cicero,...

Recently uploaded (20)

PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPT
Teaching material agriculture food technology
DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
MYSQL Presentation for SQL database connectivity
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Spectroscopy.pptx food analysis technology
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PPTX
sap open course for s4hana steps from ECC to s4
PDF
Empathic Computing: Creating Shared Understanding
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
Cloud computing and distributed systems.
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
KodekX | Application Modernization Development
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Teaching material agriculture food technology
The AUB Centre for AI in Media Proposal.docx
MYSQL Presentation for SQL database connectivity
NewMind AI Weekly Chronicles - August'25 Week I
“AI and Expert System Decision Support & Business Intelligence Systems”
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Understanding_Digital_Forensics_Presentation.pptx
Network Security Unit 5.pdf for BCA BBA.
20250228 LYD VKU AI Blended-Learning.pptx
Spectroscopy.pptx food analysis technology
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
sap open course for s4hana steps from ECC to s4
Empathic Computing: Creating Shared Understanding
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Cloud computing and distributed systems.
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Encapsulation_ Review paper, used for researhc scholars
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
KodekX | Application Modernization Development

Open data for aid and development

  • 1. Open data for aid and development Rupert Simons April 27, 2016
  • 2. Source: World Development Report 2016 We’ve all heard of big data Cellphone subscriptions worldwide billion 0.7 7 2000 2015 Gigabytes of data produced every day billion 2.5 2000 2015 <0.1
  • 3. But data is often poor or non-existent in countries where you need it most Managing the Ebola crisis • Where are the patients? • Where are the ambulances? • Have the health workers been paid? Source: Nature, FT Estimating the size of the economy • Did Nigeria’s GDP really double in two years? • ‘Middle income’ countries pay more to borrow from the World Bank, but less in the market 0 1000 2000 3000 4000 Nigeria GDP, USD per capita
  • 4. Publish What You Fund reviewed the quality of data produced by major aid donors 10 25 65 Activity level data (28 indicators) Organisation level data (8 indicators) Commitment to transparency (3 indicators) We worked with people from 46agencies in 22 countries and 36 independent reviewers and CSOs 100 To assess 39 indicators of data on aid and development Maximum possible score Over a data collection period of 14 weeks
  • 5. What we found: Aid is getting more transparent 4 7 105 8 8 16 16 16 16 15 726 22 5 2013 Index 2014 Index 2016 Index Very Poor Poor Fair Good Very Good Source: Aid Transparency Index 2013-16 Performance of agencies in the Index Total 67 68 46 Ten donors met the Busan commitment in full: • UNDP • U.S. – MCC • UNICEF • UK – DFID • The Global Fund • World Bank – IDA • IADB • AsDB • Sweden • AfDB
  • 6. 300+ Nearly 400 organisations are now publishing to IATI Number of IATI publishers by type 2011-15 Source: IATI annual report 2015
  • 7. The norm is gradually shifting from annual reporting to quarterly, monthly or real time Annual reporting • Companies House/ Charity Commission returns • OECD-DAC Credit Reporting Statistics (for official donors) • Annual report on website (usually in PDF) Regular updating • Monthly or quarterly publication • Machine-readable and web formats • Edit for confidentiality Real-time data sharing • Uploaded automatically • Daily decision-making • Limited editing
  • 8. Some governments are using the data NGOs are using it too, for example: Source: IATI, Development Gateway IATI import system in use IATI import system under development IATI partner country
  • 9. Most people outside government are not Source: d-portal.org, 2016 Aid Transparency Index Partly because it’s not easy to use Partly because they don’t know it’s there Partly because the data is of poor quality “Even stakeholders that regularly search for aid information, like civil society watchdog organizations and parliamentarians, were not aware of the available data sources.” USAID aid transparency pilot assessment, July 201513% of activities in Ghana had a location specified
  • 10. Meanwhile, civic registration and administrative data lags far behind Source: Development Initiatives “Data Revolution in Africa” 82 45 33 29 22 13 9 40 29 13 18 9 9 15 38 58 60 78 Census Household survey Poverty census Agricultural census Birth statistics Death statistics Recent (last 10 years for census, last 3-5 years for survey) Out of date Unusable or unavailable Quality and availability of data in African countries, percentage of countries
  • 11. Estimates for closing data gaps range widely, with $100-200 million per year as the median Source: Brookings; CGD; SDSN 17-66 Cost of building and maintaining statistical systems to monitor the Sustainable Development Goals USD million per year 100- 200 1,100 900- 1,000 >10,000 New money Existing aid Own resources Not specified
  • 12. So what should we do about it? • A perspective from the INGO Accountability Charter • What do you think? • Publish What You Fund perspective • Data quality • Awareness • Tools

Editor's Notes

  • #4: One of the key objectives of the aid transparency agenda is to provide aid information in a way that can be used by partner country governments, particularly so it can be included in their own budget cycle.   Requires intelligent partnership between governments. Responsibilities lie on both donors and recipients – donors need to give their information in a timely and standardised fashion. Recipients need to make sure that their aid management processes are well linked to their actual budget processes. In 2007, this took eight months of manual data collection, and another six months to visualise aid flows and the domestic budget in Uganda. In time, IATI will allow us to do this at the click of a button. Some surprising results: only one half of non-budget support aid was being reported to the govt (and therefore reflected in its budget). Well over 50% of the health budget was coming from aid project funding. This should have informed aid programming discussions at sector working groups, but politically sensitive (and at the time, not open data).
  • #5: This is a domestic process too. Takes international commitments to the domestic agenda.
  • #7: Since organisations first started publishing in 2011, over 300 have published data to the IATI Standard. These include International NGOs, bilateral and multi-lateral donors, private sector, foundations and research organisations. NGOs make up a considerable number of publishers, in part due to IATI reporting being made a funding requirement by some donors. UK, Germany, U.S., WB, AFDB, Sweden, Netherlands, Australia, Canada to name a few. UK - Department for Environment, Food and Rural Affairs UK - Department for International Development (DFID) UK - Department for Work and Pensions UK - Department of Energy and Climate Change UK - Department of Health Government United Kingdom UK - Foreign & Commonwealth Office UK – Home Office This means that the standard can accommodate a number of users and publishers. Diversity of those publishing to IATI makes this achievable. What does it mean to publish to IATI. Not a hugely technical effort but rather extracting data from the source and putting into the common format.
  • #8: This is a domestic process too. Takes international commitments to the domestic agenda.
  • #10: One of the key objectives of the aid transparency agenda is to provide aid information in a way that can be used by partner country governments, particularly so it can be included in their own budget cycle.   Requires intelligent partnership between governments. Responsibilities lie on both donors and recipients – donors need to give their information in a timely and standardised fashion. Recipients need to make sure that their aid management processes are well linked to their actual budget processes. In 2007, this took eight months of manual data collection, and another six months to visualise aid flows and the domestic budget in Uganda. In time, IATI will allow us to do this at the click of a button. Some surprising results: only one half of non-budget support aid was being reported to the govt (and therefore reflected in its budget). Well over 50% of the health budget was coming from aid project funding. This should have informed aid programming discussions at sector working groups, but politically sensitive (and at the time, not open data).
  • #11: One of the key objectives of the aid transparency agenda is to provide aid information in a way that can be used by partner country governments, particularly so it can be included in their own budget cycle.   Requires intelligent partnership between governments. Responsibilities lie on both donors and recipients – donors need to give their information in a timely and standardised fashion. Recipients need to make sure that their aid management processes are well linked to their actual budget processes. In 2007, this took eight months of manual data collection, and another six months to visualise aid flows and the domestic budget in Uganda. In time, IATI will allow us to do this at the click of a button. Some surprising results: only one half of non-budget support aid was being reported to the govt (and therefore reflected in its budget). Well over 50% of the health budget was coming from aid project funding. This should have informed aid programming discussions at sector working groups, but politically sensitive (and at the time, not open data).
  • #12: One of the key objectives of the aid transparency agenda is to provide aid information in a way that can be used by partner country governments, particularly so it can be included in their own budget cycle.   Requires intelligent partnership between governments. Responsibilities lie on both donors and recipients – donors need to give their information in a timely and standardised fashion. Recipients need to make sure that their aid management processes are well linked to their actual budget processes. In 2007, this took eight months of manual data collection, and another six months to visualise aid flows and the domestic budget in Uganda. In time, IATI will allow us to do this at the click of a button. Some surprising results: only one half of non-budget support aid was being reported to the govt (and therefore reflected in its budget). Well over 50% of the health budget was coming from aid project funding. This should have informed aid programming discussions at sector working groups, but politically sensitive (and at the time, not open data).
  • #13: One of the key objectives of the aid transparency agenda is to provide aid information in a way that can be used by partner country governments, particularly so it can be included in their own budget cycle.   Requires intelligent partnership between governments. Responsibilities lie on both donors and recipients – donors need to give their information in a timely and standardised fashion. Recipients need to make sure that their aid management processes are well linked to their actual budget processes. In 2007, this took eight months of manual data collection, and another six months to visualise aid flows and the domestic budget in Uganda. In time, IATI will allow us to do this at the click of a button. Some surprising results: only one half of non-budget support aid was being reported to the govt (and therefore reflected in its budget). Well over 50% of the health budget was coming from aid project funding. This should have informed aid programming discussions at sector working groups, but politically sensitive (and at the time, not open data).