Raw data in, Insights out - CKANcon 2015
0 likes438 views
The document discusses challenges with open data and how to generate insights from raw data. It presents several tools like OpenRefine, FME, and Pentaho Kettle that can be used to clean and enrich raw data fed into a CKAN data portal. The document then describes how the enriched and contextualized data can be used to generate customized dashboards, apps, and websites to provide insights and compare jurisdictions using key performance indicators. It pitches a service called "Raw Data In, Insights Out" that can help publish open data, maintain data feeds, and generate ready-made or custom dashboards and reports.
Raw data in, Insights out - CKANcon 2015
- 1. Raw Data In, Insights Out Joel Natividad @jqnatividad CKANCon 2015
- 3. Context
- 7. Not all is right in OpenData Land
- 8. Dave Guarino, CfA Fellow
- 9. Anthea Watson Strong, Google
- 10. Waldo Jaquith, US ODI
- 11. Mark Headd
- 13. No Revisions No Near Real-Time No Context No Stories No Small Data #FancyFTPServer
- 14. Raw Data In • OpenRefine Extension • FME • Pentaho Kettle • Third-party Connectors
- 20. back
- 21. FME CKAN Writer
- 26. back
- 27. Insights Out • Dogfooding Data Enricher • Application Generator Framework • CartoDB Integration • Discourse Integration • Key Place Indicators
- 30. App Generator Framework Generate apps and websites automatically from any combination of datasets or API queries in CKAN+.
- 33. CONFIDENTIAL – Jan 2015 34
- 34. CONFIDENTIAL – Jan 2015 35
- 35. CONFIDENTIAL – Jan 2015
- 38. CONFIDENTIAL – Jan 2015 Compare Jurisdictions And since we follow open standards, its possible to compute & compare indicators across jurisdictions.
- 40. Customizable Indicator Dashboards We start with ISO 37120 indicators, but you can define your own indicators based on issues and perspectives you care about.
- 47. “Raw Data In, Insights Out” as a Service
- 48. OPEN DATA IN CONTEXT DATA • Hyperlocal Data/Maps Enriched census data sliced for your jurisdiction. • Key Place Indicator™ Data Hyperlocal Indicators based on ISO 37120 standard. • Up-to-Data™ Service Datafeeds for your open data portal to keep it up-to-date! • Data Enrichment Your data cleaned, enriched and contextualized. • Custom Data Feeds Let us wrangle that Data for you. DASHBOARDS • Ready-made, self-service Dashboards with your/our Data. • Custom dashboards designed to your specifications. • Platform-agnostic. Works with any datasource. DATA PUBLISHING • Powered by CKAN with value- added Data & Dashboard extensions. • ETL connectors, CartoDB integration, Application Generator Framework & more! It all starts with Great Data. Otherwise, your data portal is just an #OverpricedFancyFileServer. Ontodia helps put your open data to work with the following products & services: visit CivicDashboards.com for more information
- 49. Thanks! visit CivicDashboards.com for more information (Early June 2015)