Knoware-Open Data-SUNZ12: Clare Somerville and Trish O'Kane
- 1. Open Data Clare Somerville Selena Smeaton Trish O’Kane
- 2. Everyone has the right to information 2
- 3. Everyone has the right to information EIS 3
- 4. Everyone has the right to information 4
- 5. What is it? Why Risks? do it? Open data What Who’s about doing NZ? it?
- 6. “Open data is the idea that certain data should be available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control” Wikipedia
- 7. 7
- 8. USA • data.gov May 2009 UK • data.gov.uk Sep 2009 Norway • data.norge.no Apr 2010 Australia • data.gov.au Mar 2011 Kenya • opendata.go.ke Jul 2011 Netherlands • data.overheid.nl NZ • data.govt.nz Aug 2011 Chile • datos.gob.cl Italy • data.gov.it Spain • datos.gob.es Uruguay • datos.gub.uy Nov 2011 France • data.gouv.fr Dec 2011 Brazil • dados.gov.br Dec 2011 Who? Where? When?
- 9. Move paper documents to the internet • PDFs, Word documents • Saves printing or mail • Not great to extract info Add metadata • Documents enhanced • Raw data, visualisations, sort, filter etc Programmatic access • Data can be loaded into programs for big data research Levels of useability
- 11. NZ Declaration on Open and Transparent Government “Building on NZ’s democratic tradition, the government commits to actively releasing high value public data. The government holds data on behalf of the NZ public. We release it to enable the private and community sectors to use it to grow the economy, strengthen our social and cultural fabric, and sustain our environment. We release it to encourage business and community involvement in government decision making” 8 August 2011
- 12. Principle Description Open For public access Protected Personal info Readily available Discoverable, accessible, online Trusted & authoritative Accurate, relevant, timely, consistent, authoritative single source Well managed Held by government on behalf of public Reasonably priced Free Reusable Highest possible granularity; reusable; machine readable; metadata Data & Information Management Principles
- 13. NZ Priorities
- 14. NZ Priorities
- 15. Explore finances More transparent How government spends Increase the data’s value Feedback loop - $ saved; better projects Engage citizens in government Info to citizens in tough economic times Individual salaries; payments to vendors Massachusetts Open Checkbook
- 16. Transparency ◦ Access data used by council in decision making; use it for additional social value Participation ◦ Analyse, propose ideas, gain insights; enrich lives of individuals and community Collaboration ◦ Suggest ideas about additional data; apps that could use the data; improving access Ireland (Fingal)
- 17. Build Accountability participation Promote Transparency economic Open Data innovation … the reasons why
- 18. Consistency Meaning Risks Quality Usage
- 19. Public money was used to Data belongs to fund the work everyone so should be freely available In science - more discovery Facts can’t be is related to copyrighted better access Arguments to data for Open Data
- 20. Intro What are other countries doing? What is NZ doing? Challenges, risks, opportunities What do we need to do to prepare? Agenda
- 21. 21
- 22. 22
- 23. 23
- 24. 24
- 25. Recently sought input into the US Open Government National Action Plan ◦ Measures? ◦ Minimum standards for participation? ◦ How to compare participation? ◦ Effective technology and tools? US National Action Plan
- 26. 26
- 27. Make data freely available to the public, developers and business - and charge where appropriate Be a centre of excellence and expertise in collecting, managing storing and distributing data Be a vehicle which will attract private investment. 27
- 29. €250bn across Europe every year 29
- 30. 30
- 31. Intro What are other countries doing? What is NZ doing? Challenges, risks, opportunities What do we need to do to prepare? Agenda
- 32. 2005 India and Germany 2002 Japan and Mexico 2000 United Kingdom 1998 South Korea 1997 Ireland and Thailand 1992 Hungary 1982 Australia, Canada, New Zealand 1978 France, Netherlands 1970 Denmark, Norway 1966 United States 1917,1951 Finland 18th Century Sweden Freedom of information legislation
- 33. OIA vs Open Data
- 34. Data.govt.nz
- 35. NZ Open Government will be asking public service agencies: What do you And has Not personal hold on behalf Not confidential high of the public value Not classified impact that is Economic and social Transparency and democratic Efficiency “If you get away from people and businesses then it’s easier”
- 36. And also asking: What information have you released? What have you not released because of insurmountable barriers? Quality issues are not a barrier to release “If it’s good enough for business use then it’s good enough to release” Archives NZ are also investigating high-value information
- 38. Intro What are other countries doing? What is NZ doing? Challenges, risks, opportunities What do we need to do to prepare? Agenda
- 39. Third parties and mashups Third parties
- 40. Opengovt.org.nz
- 41. Classic mash-up
- 42. No census? Use other sources
- 44. Caveat for data supplied. ◦ The data supplied is an extract from the SMS fire incident reporting system maintained by the New Zealand Fire Service. It is not complete statistical data and should not be relied on for statistical analysis. ◦ A full incident report can be provided on request under the Official Information Act. Fire Incident Summary Data
- 45. Bob Inc Example: Motor Vehicle registration
- 46. 1998 Privacy Commissioner: “We would like to see a closer relationship between the purposes of the register and the release of information from it, such as when information is needed to enforce the law, to gather statistics, and to develop transport policy.
- 47. 8 years later…
- 48. 2010
- 49. Bob Inc Since May 2011
- 50. MVR Information about individuals post May 2011
- 51. Gazetted Access Authorisations “access to names & addresses of persons: - who are currently registered in respect of a motor vehicle(s); and - who have not instructed the Registrar of Motor Vehicles to withhold their details. Speer, Speer & Associates Limited “… address information associated with specific registration plate numbers to assist with research on customer distribution patterns around shopping centres.” Until 30 Nov 2016
- 54. Intro What are other countries doing? What is NZ doing? Challenges, risks, opportunities What do we need to do to prepare? Agenda
- 55. What to do to prepare? Accreted over time…
- 56. Know your legislation Establish principles and defend them Know what you have released before and why you released it What would you restrict and why? Be prepared for Open Government questions ◦ Before you are asked ◦ Before you publish Mandate and principles
- 57. Know what you’ve got
- 58. Know what you shouldn’t have Data collected but not needed ◦ Data sets legitimately shared but… ◦ Application forms that ask for … ◦ Do you really need to? Legacy datasets without owners? Duplicates of data ◦ Your own ◦ From other agencies
- 59. Triage and isolate Which data or information seems fine seems dodgy must not be shared Identify, isolate or filter information that shouldn’t be shared
- 60. Manage your data & information Principle: Reusable ◦ Highest possible granularity; reusable; machine readable; metadata 4 reasons we keep data… Governance Standards, policies Metadata Structure the unstructured Data lifecycle management Disposal
- 61. We’re just getting started Plenty of opportunities… …many challenges We don’t know exactly what lies ahead… ..but we can prepare. 1.5+ million vacancies…apply soon! In conclusion
- 62. Open Data Clare.Somerville@knoware.co.nz Selena Smeaton@knoware.co.nz Trish O’Kane@knoware.co.nz © The Knowledge Warehouse Ltd, 2012