The Next Generation of Open Data
1 like1,034 views
The document discusses the need for the next generation of open data to move beyond current practices. It argues that open data should follow principles of the open web by being open source, using open standards, and having a federated structure. Specifically, it advocates for open data portals from different organizations that are interconnected, use of common metadata, technology and file standards, and for open data to support a variety of uses and users beyond just transparency. The goal is for open data to enable innovation, be integrated into workflows, and help build smarter cities and governments. It calls on data scientists and others to help realize this vision of next generation open data.
The Next Generation of Open Data
- 1. THE NEXT GENERATION OF OPEN DATA JOEL NATIVIDAD (@JQNATIVIDAD) East - Boston - May 2016
- 5. Not all is right in Open Data Land…
- 6. Dave Guarino, CfA Fellow
- 7. Anthea Watson Strong, Google
- 8. Waldo Jaquith, US ODI
- 9. Mark Headd
- 11. No Revisions No Near Real-Time No Context No Stories No Small Data No Answers No Collaboration No Conversations Stale Data No/little Metadata Not Institutionalized Additional Burden Innovation Tax #FancyFTPServer
- 12. FIRST, A STORY ABOUT THE WEB
- 13. In the mid-90s, during the early days of the Web, AOL helped America get Online...
- 14. Most Annoying Tech Product - PC World 2007
- 15. OVER $300 MILLION. :) AT ONE POINT, 50% OF THE CD’S PRODUCED WORLDWIDE HAD AN AOL LOGO ON IT. Jan Brandt AOL Head of Marketing HOW MUCH DID AOL SPEND?
- 22. AOL's Walled Garden and it did get a lot of Americans online! (27 million at its peak)
- 23. …and then came the Open Web with BILLIONS of users and a Vibrant Ecosystem
- 25. …would these companies have been possible in AOL's walled garden? & countless more!!!
- 26. So what has this got to do with Open Data?!
- 27. We are ready for #NextGenOpenData #BeyondTransparency
- 28. …following the same principles of the Open Web
- 29. #NextGenOpenData • Open Source • Open Standards • Federated • Infrastructure • Open Knowledge
- 30. #NextGenOpenData is Open Source • Ecosystem • Data Publishers / Other Cities & Agencies • Curators • Users • Developers • Third-Party Vendors • No Innovation Tax Don’t penalize me for using the system • Allow users to “Scratch Itches” Innovation without Permission • #BuildWithNotFor Let me Build it with Ecosystem partners, not just one vendor
- 31. #NextGenOpenData is “Open Standards”
- 32. #NextGenOpenData is “Open Standards” • Metadata Standards • Project Open Data • DCAT, Data Packages, etc. • schema.org, permitdata.org • Technology Standards • SQL - not dialect, real queries • Linux - OS standard • AWS - market standard • File Standards • JSON, GeoJSON • CSV • little to no PDFs • Data Standards • ISO 8601 date format • WGS84 - lat/longs “Open Standards” are pragmatic, widely-deployed, simple standards
- 33. An “open standard” got you here today!
- 34. A pragmatic standards success!
- 35. schema.org
- 37. Cities that Work like the Web Instead of one big data portal, each jurisdiction/organization will have a hosted mini-portal, as they know their data best and each jurisdiction can be tailored to their needs/ workflows. Boston Globe Suffolk County Boston NGO Business Improvement District Metropolitan Area Planning Council Boston University Cambridge City Council DOiTT Public Library Fire Dept Police Dept MIT Neighborhood Assoc Small City 1 Transit Authority DOT NGO 1 NGO 2 CfA Brigade Hubway Barnstable Somerville Web of Data
- 38. #NextGenOpenData is Infrastructure • Not a #FancyFTPServer • Use Best-of-Breed tools allow me to use 3rd-party tools, not just your tools ("Not invented here") • Can support Transactional Workloads to build Smart City/Gov systems • IT-friendly
- 40. Standard Gauge
- 41. The Standard Gauge accelerated the Industrial Revolution
- 42. …the same way Elevator, Plumbing & Building Standards redefined the City
- 43. #NextGenOpenData is Open Knowledge Open Data that is Useful, Usable, and Used
- 44. #NextGenOpenData is Open Knowledge • Useful, Usable & Used • Agencies (It has to be USEFUL to Agencies!!!) • Researchers • Journalists • Developers (Internal & External) • YOU! • Integrated into day-to-day Workflow beyond transparency/data publishing • Curated/Linked • “Small Data” answers - usable insights/KPIs, not raw data
- 45. Dave Guarino, CfA Fellow & with best-of-breed ETL tools! ing
- 46. Anthea Watson Strong, Google Ate !!!
- 47. Waldo Jaquith, US ODI Coz it helps me work more efficiently! CULTURE CHANGED!!!
- 48. Mark Headd ❤
- 49. #NextGenOpenData will help us build the 21st Century Connected Govt we expect & deserve
- 50. ...and you have a role in building our Shared Future!
- 51. THE BEST MINDS OF MY GENERATION ARE THINKING ABOUT HOW TO MAKE PEOPLE CLICK ADS. THAT SUCKS. Jeff Hammerbacher co-founder Cloudera CALL TO ACTION TO DATA SCIENTISTS
- 52. Trust in Wall Street is also Low
- 55. Thanks! jnatividad@opengov.com • @jqnatividad • opengov.com YOU can Help Build the Smart Cities of our Future with #NextGenOpenData East - Boston - May 2016