A Broader Data Management Strategy with DKAN
- 1. A Broader Data Management Strategy with DKAN
- 3. Data Management Strategy What is Data Management Strategy? ● Data management strategy is the process of planning or creating strategies/plans for handling the data created, stored, managed and processed by an organization. ● A data management strategy is the foundation of any data management program. The strategy provides both the framework and the architecture that will last throughout the life of your program. ● When you are choosing a framework ensure the foundation is built on solid rock.
- 4. Baseline of a Healthy Data Management Program Framework ● Current-state and future-state reference architectures ● Integration strategies ● Delivery model ● Adoption strategy ● Communication plan ● Data management maturity model and road map
- 5. Data Management Strategy with DKAN
- 6. Data Management Strategy with DKAN ● Dkan is one of the most popular Open Source Open Data Platform. ● DKAN supports broader Data Management Strategies with tools that simplify and streamline data migration, storage, and usability. ● The tools are designed to be straightforward so that you don’t need to be a technical expert to use them. ● Migrate open data efficiently and effectively, store your data, and improve the overall usability of your data.
- 7. What is DKAN? DKAN is Open Data Platform Then What is Open Data Platform? Hey! wait... What is Open Data?
- 8. Open Data Platform Relationship between Open Data Platform and Big Data ● The Open Data Platform (ODP) is primarily designed to advance the collaboration and innovation of big data technologies ● ODP is help to big data developers in creating big data applications on a common platform.
- 9. Open Data Platform What is Open Data? ● Open data is the idea that some data should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control. ● It is similar to concepts such as Open Source, Open Hardware, Open Government, Open knowledge.
- 10. Open Data Platform How it became more popular? ● It came more popular with the launch of Open Government Data (“Open Data”) initiatives adopted by some of the world superpowers. ○ Example : USA — data.gov UK — data.gov.uk India — data.gov.in
- 11. Market Leaders of Open Data Platforms Most of these Open Data implementations were based on popular Open Data Platforms / frameworks already available in the market. ● CKAN ● DKAN ● Socrata ● Junar
- 13. DKAN ● DKAN is a open data platform with a full suite of cataloging, publishing and visualization features that allows governments, nonprofits and universities to easily publish data to the public. DKAN is maintained by CivicActions. ● DKAN is a Drupal-based open data portal based on CKAN, the first widely adopted open source open data portal software. CKAN stands for Comprehensive Knowledge Archive Network.
- 14. Benefits of DKAN DKAN is licensed under the GNU General Public License, version 2 (or later): ● Most popular free and open source license (GPLv2) ● Anyone can use it for without paying a licensing fee ● Can be used for any purpose (government and commercial) ● Prevents vendor lock-in, encourages competition among support suppliers ● Encourages cooperative community to share improvements without partnership or purchase contracts ● Future development is responsive to active community members
- 15. Features of DKAN ● Community driven feature development ● Manage diverse data sets ● Advanced visualization tools ● Mature user interface and workflow ● Metadata, tags, categorization ● Topics, taxonomy ● Search ● User permissions/controls ● Data stories ● Data harvesting ● Data uploader/store ● Engagement, social sharing ● Charts, graphs ● GIS, maps ● Integrated CMS, blogs ● Multi-lingual translation ● Open source code base ● Cloud-ready ● and more
- 16. DKAN sites A partial list of DKAN sites around the world ● Multinational ○ United Nations (Open Data System Inventory) http://data.un.org/ ○ The World Bank http://climatesmartplanning.org ● United States of America ○ National Democratic Institute https://nditech.org/project/dkan ○ California https://data.ca.gov ● Europe ○ Cambridgeshire, UK http://opendata.cambridgeshireinsight.org.uk ● Asia and Oceania ○ Urban Data Challenge, Japan http://udct-data.aigid.jp ● Africa ○ South Africa http://data.gov.za
- 17. DKAN Installation There two blogs written by Mr. Supun Bandara (Associate Tech Lead | Cloud Developer): ● How to Deploy the Dkan Product on an AWS EC2 - https://medium.com/@supunbandara06/how-to- deploy-the-dkan-product-on-an-aws-ec2- ccacc667f065 ● Implementing an Open Data Platform using DKan on AWS - http://auxenta.com/blog_implementing_an_open_da ta_platform_using_DKan_on_AWS.html
- 19. The Open Data publishing process from start-to-finish Flowchart of the Open Data publishing process.
- 20. Data Organized by DKAN All open data catalogs built on DKAN are organized by Datasets, Resources and Groups. ● Datasets are collections of resources, with some descriptive metadata ● Resources are just files. They can be any kind of file, but often they are CSV files, spreadsheets or some other kind of tabular data file. ● Organizations create datasets and upload resources. ● Data consumers can browse datasets and sometimes see visualizations of resources.
- 21. Create Dataset in DKAN
- 26. Visualization of DKAN Dataset ● Add Chart
- 32. DKAN API
- 33. DKAN API ● Login ● Get Session ● Create Datasets ● Delete Datasets ● Update Datasets ● Add a file to Resource ● Retrieve the resource to check the file field
- 34. References ● Dkan Web Site - https://getdkan.org/ ● How to Deploy the Dkan Product on an AWS EC2 - https://medium.com/@supunbandara06/how-to-deploy-the-dkan-product- on-an-aws-ec2-ccacc667f065 ● DKAN Documentation - https://dkan.readthedocs.io/en/latest/ ● Building Your Data Management Strategy - https://tdwi.org/articles/2016/10/27/building-your-data-management- strategy.aspx
- 35. Thanks! By: Dinothan Muthulingam Software Engineer
Editor's Notes
- #4: Definition of Data Management Strategy
- #5: Thing to consider when we are choosing a Data Management Program framework.
- #7: Why Data Management Strategy with DKAN
- #9: Why Open Data Platform with Big Data
- #10: Definition of Open Data
- #11: How it became more popular?
- #12: Some Market leader of Open data platform
- #14: Definition of DKAN, Drupal is a CMS framwork like Wordpress
- #15: Why DKAN?
- #16: DKAN features
- #17: DKAN sites
- #18: DKAN Installation
- #19: If you installed, You will get this page in your browser.
- #20: Common Open Data Publishing Process
- #21: How to store files in DKAN
- #23: Create Dataset in DKAN
- #24: Add Resources to Dataset
- #25: Dataset preview with resources
- #26: List of Datasets
- #28: Add Chart to visualize your Dataset
- #30: Select your Chart suitable to your resources
- #31: Final customization of Chart
- #32: Chart that created
- #34: DKAN has a REST API, You can give those requests to access DKAN site