The opportunities and challenges of data for public good
0 likes750 views
The document discusses data for public good and the opportunities and challenges involved. It notes that data infrastructure is needed to deliver public good through data. There are almost endless opportunities to use data for public services, policy, and citizen benefits. However, challenges include legacy systems, data silos, unclear governance, and risk aversion. As a case study, it outlines how the UK Census 2021 addressed index faced challenges but showed progress on using data better, with lessons for continued public sector transformation.
The opportunities and challenges of data for public good
- 1. 1 ElasticON Europe The opportunities and challenges of data for the public good Heather Savory NED and Business Advisor, UK Parliament's Information Authority and Former Director General for Data Capability, Office for National Statistics, UK
- 2. 2 Data for public good
- 3. 3 What is “public good” ? It is either or both: • a commodity or service that is provided without profit to all members of a society, either by the government or by a private individual or organisation • the benefit or well-being of the public
- 4. 4 It is a capital mistake to theorise before one has data. Insensibly one begins to twist facts to suit theories, instead of theories to suit facts. - Sir Arthur Conan Doyle, Shelock Holmes Why do we need data?
- 5. 5 Delivering public good with data Data Infrastructure Core Reference Data Innovation Academic Research Statistics & Economic Analysis Better Policy Design Business-facing Services Citizen-facing Services
- 7. 7 Data for Public Good – almost endless opportunities …. Transport solutions - DfT/MOOVIT Open Bus Data Health applications - NHS Track and trace Environmental data - Flood warnings Business Services - Start Up Loan Application Heath and Social Care - Better joined-up services Sustainable Development - UN SDG reporting Citizen permits - Blue Badge Parking Statistics - Economic and social indicators
- 8. 8 Challenges
- 9. 9 The data subject’s identity (whether person or organisation) is protected, information is kept confidential and secure. Confidentiality, data security The use of data has clear benefits for users and serves the public good. Public Good 9 The risks and limits of new technologies are considered and there is sufficient human oversight so that methods employed are consistent with recognised standards of integrity and quality. Methods and Quality The access, use and sharing of data is transparent, and is communicated clearly and accessibly to the public. Transparency The views of the public are considered in light of the data used and the perceived benefits of the research. Public views & engagement Data used and methods employed are consistent with legal requirements such as the DPA, the Human Rights Act, the SRSA and the common law duty of confidence. Legal Compliance Ethics – Principles (ONS)
- 10. 10 Legacy – public sector transformation is slow • Data literacy at senior levels • Legacy technologies; data in operational silos • Multiple versions of the truth • Barriers to data sharing – some cultural, some practical • Risk aversion - highly political environment • Ownership rights can be unclear • Data principles, architecture and standards lacking • Security and access rules – privacy by design is needed • Governance and business rules
- 11. 11 There is progress A topical case study ….
- 12. First digital Census of England and Wales Sunday - 21st March 2021 Access codes sent to every houshold address in the UK - using an address index
- 13. And difficult PR … Errors in addresses cause problems …. Which impacts all-important public trust in the Census
- 14. Census Address Index: -Goal is 100% accuracy -Complex to achieve -Multiple data sources -Probabalistic matching frame
- 15. Census Address Index: probabilistic Address Frame • Communal Establishments important, and a real challenge • Data Sources: - Address Index - Business Index - Administrative Data - Clerical data Prison
- 16. Census 2021 Address Index Matching
- 17. 17 The future? • Public sector now has: • Better awareness of the opportunity • More examples of success • A more demanding public • Covid-19 pandemic has highlighted the value of using data better • Track and trace • Nightly case numbers • Big data to confirm reduction in traffic flows • National Data Strategy • Published December 2020 https://www.gov.uk/government/publications/uk-national-data-strategy/national-data-strategy
- 18. You helped make the Census 2021 Address Index happen Thank You! If you have questions or comments please join the live Q&A Session which will start directly after this talk – please see today’s agenda for detail