Open Data Challenges and Opportunities
4 likes541 views
This document discusses open data and provides an overview of key concepts. It begins with defining open data as data that can be freely used, modified, and shared by anyone for any purpose. Next, it explores why data is opened, including for transparency, participation, and innovation. The document then outlines how to open data using the 5 star deployment scheme. It also evaluates the current state of open data globally using the Global Open Data Index. Finally, the document discusses potential business models and applications that can emerge from open data, including information services, data mining, and more.
Open Data Challenges and Opportunities
- 3. Outlines • Prelude • 2W2H – What is open data? – Why “open” data? – How to “open” data? – “How open” is now? • Business Model & Applications • Conclusion – What can we participate? 3
- 9. John Naisbitt (Jan. 15, 1929 ~) American author and public speaker in the area of futures studies. 9
- 11. DIKW Pyramid (DIKW金字塔) DIKW Pyramid Explained https://www.youtube.com/watch?v=6VmxaaVwmdI 11
- 12. Data is at the root of all science and engineering developments. Data alone is interesting but when it is analyzed, it becomes a powerful tool A knowledge‐based society is a key driver for socio‐economic growth, but the knowledge will have to be more accessible, more relevant and localized DIKW MODEL 12
- 14. Data is the New Oil (1/4) • Clive Humby, UK Mathemetician and architect of Tesco’s Clubcard, 2006: “Data is the new oil. It’s valuable, but if unrefined it cannot really be used. It has to be changed into gas, plastic, chemicals, etc to create a valuable entity that drives profitable activity; so must data be broken down, analyzed for it to have value.” 14
- 16. Open means ... • “Open means anyone can freely access, use, modify, and share for any purpose (subject, at most, to requirements that preserve provenance and openness).” • “Open data and content can be freely used, modified, and shared by anyone for any purpose” http://opendefinition.org/od/2.1/en/ 16
- 17. Where Is Open Data From? • Open data is primarily from – Science, research – Government, Public Sector • Some data is NOT open data – patents, things with copyright , Health information , medical records , data required for authorization 17
- 20. By Law • In Taiwan: 政府資訊公開法, 2005/12/28 •The Freedom of Government Information Law 第 7 條 下列政府資訊，除依第十八條規定限制公開或不予提供者外，應主動公開 ： 一、條約、對外關係文書、法律、緊急命令、中央法規標準法所定之命令、法規命 令及地方自治法規。 二、政府機關為協助下級機關或屬官統一解釋法令、認定事實、及行使裁量權，而 訂頒之解釋性規定及裁量基準。 三、政府機關之組織、職掌、地址、電話、傳真、網址及電子郵件信箱帳號。 四、行政指導有關文書。 五、施政計畫、業務統計及研究報告。 六、預算及決算書。 七、請願之處理結果及訴願之決定。 八、書面之公共工程及採購契約。 九、支付或接受之補助。 十、合議制機關之會議紀錄。 前項第五款所稱研究報告，指由政府機關編列預算委託專家、學者進行之報告或派赴國外從事考察、進 修、研究或實習人員所提出之報告。第一項第十款所稱合議制機關之會議紀錄，指由依法獨立行使職權 之成員組成之決策性機關，其所審議議案之案由、議程、決議內容及出席會議成員名單。 20
- 21. By law • In USA – 1966, Freedom of Information Act (FOIA) passed – 2006, Federal Funding Accountability and Transparency Act (FFATA) enacted – 2014, Digital Accountability and Transparency Act (DATA Act) enacted http://www.datafoundation.org/state‐of‐the‐union‐of‐open‐data‐2016/ 21
- 22. And because... • Usually, It belongs to everybody • Usually, it’s been paid with public money • It generates economic value • It creates better citizens • It promotes transparency (governments, science, corporations, …) 22
- 23. Benefit of open government data • Transparency and democratic control • Participation • Self‐empowerment • Improved or new private products and services • Innovation • Improved efficiency of government services • Improved effectiveness of government services • Impact measurement of policies • New knowledge from combined data sources and patterns in large data volumes 23
- 26. Challenges... • Releasing Data • Fund or support competitions • Contributing knowledge and skills: by offering tools, technical support and advice • Forming a taskforce to tackle local/global problems 26
- 30. 5 Star Schema for Open Data • Tim Berners‐Lee, the inventor of the Web and Linked Data initiator, suggested a 5‐ star deployment scheme for Open Data. http://5stardata.info 30
- 33. Global Open Data Index http://index.okfn.org • An annual effort to measure the state of open government data around the world. • Open data measurement is still new and experimental field. 33
- 34. GODI ‐ Methodology • A research question • Like any other benchmarking tool, the GODI tries to answer the question: – “What is the state open data around the world?” – “Which country ranks best on open data? Who is the least/most open country?” – “ What is the most open dataset? What is the least open dataset?” • The first Open Data Index was released on October 28, 2013. 34
- 35. Datasets the full list of datasets for 2015 National Statistics (國家統計) Company Register (公司註冊) Government Budget (政府預算) Location datasets (位置資料集) Government Spending (政府支出) Government procurement tenders (past and present) (政府採購招標) Legislation (立法) Water Quality (水質) Election Results (選舉結果) Weather forecast (天氣預報) National Map (國家地圖) Land Ownership (土地所有權) Pollutant Emissions (污染物排放) http://index.okfn.org/methodology 35
- 38. World • United Nations, http://data.un.org • World Bank, http://data.worldbank.org • European Data Portal, http://ww.europeandataportal.eu • U.S. Government’s open data, http://Data.gov • U.K. Government’s open data, http://Data.gov.uk 38
- 39. data.un.org 39
- 41. Data.gov 41
- 42. Taiwan • 台灣政府資料開放平臺 – http://data.gov.tw/ • Data.Taipei臺北市政府資料開放平台 – http://data.taipei/ • Open Data臺中市政府資料開放平台 – http://data.taichung.gov.tw/ • 高雄市政府資料開放平台 – http://data.kaohsiung.gov.tw/Opendata/ • 經濟部工業局 資料服務產業應用推動計畫 – http://opendata.tca.org.tw/ 42
- 43. data.gov.tw 43
- 44. data.taipei 44
- 46. Science & Research • Dbpedia, http://wiki.dbpedia.org • Open Science Data Cloud, https://www.opensciencedatacloud.org/ • UCI Machine Learning Repository: Data Sets, https://archive.ics.uci.edu/ml/datasets.html • The OpenScience Project ‐ Open source scientific software, http://www.openscience.org/ 46
- 49. “Open Data is going to help launch more startups. It’s going to help launch more businesses … It’s going to help more entrepreneurs come up with products and services that we haven’t even imagined yet.” US President Barack Obama, May 9, 2013 49
- 50. Charging? Free is the default! • Taxpayer has already paid for most data • Economic gain maximised when priced at marginal cost of distribution – Raw data free – Possible small service charge for reliable API • Sales revenue not material to most agencies • Sales administration typically >25% of revenue Exception: where data collected for sale ‧“Public task" data free," value added" charged 50Andrew Stott. Experience, Business Models and Case Study of Open Data in UK, Jan 2012
- 51. 51 Clear, common, licensing approach • “Open” licence essential for unrestricted re‐use • Clarity vital, especially for businesses • Common licensing for all Government data valuable • UK OGL – free to reuse – with attribution – without misrepresentation • CC‐BY a good alternative 51
- 53. Properties of Open data 53 Data Easy to Use & Re‐use Re‐purpose, Re‐distribution Data Easy to Find & Search Data free to use for anyoneOpen Accessible Available Searchable Discoverable Source: Open Data at World Bank, 2011 • machine-readable(機器可判讀) • complete(完整) • raw/disaggregate(原始) • open file format(公開檔案格式)
- 57. 57
- 58. Emerging Business Models Models already seen in UK: Cleansing and Organizing Data Information Services to the Public Data Mining Operational Efficiency/Optimization Financial Products Customer Attraction and Retention Data Broking 58 Source: Andrew Stott, Experience, Business Models and Case Study of Open Data in UK (2012.01.18)
- 59. 59
- 61. INTERNATIONAL 61
- 64. Where are the jobs? • http://www.where‐are‐the‐jobs.com/app.php • Data Provided by US Department of Labor 64
- 67. TAIWAN 67
- 68. G0V 零時政府 http://g0v.tw/zh‐TW/ • 中央政府總預算視覺化 – budget.g0v.tw • 立委投票指南 – http://vote.ly.g0v.tw/ 68
- 73. TOOLS 73
- 74. Web Tools • D3 Data‐Driven Documents – https://d3js.org/ • JavaScript Charts & Maps – https://www.amcharts.com/ • Online visualization service – plotdb.com • Create your free data map – https://datamaps.co/ • Predict Through Location – https://carto.com/ 74
- 75. Applications for DV (data visualization) or BI (Business Intelligence) • Tableau – http://www.tableau.com • Microsoft Power BI – https://powerbi.microsoft.com 75
- 76. Lists • Top Data Visualization Software Products – http://www.capterra.com/data‐visualization‐ software • Open Data Tools – http://opendata‐tools.org • The 38 best tools for data visualization – http://www.creativebloq.com/design‐tools/data‐ visualization‐712402 76
- 77. CONCLUSION 77
- 78. Benefits of Open Data • Performance can be enhanced • The economy can benefit • Social welfare can be improved https://www.europeandataportal.eu/en/using‐data/benefits‐of‐open‐data 78
- 80. 80
- 81. 81
- 83. 83
- 84. Sustainable Development Goals and Open Data • The United Nations (UN) has developed a set of action‐oriented goals to achieve global sustainable development by 2030. • The 17 Sustainable Development Goals (SDGs) were developed by an Open Working Group of 30 member states over a two‐year process. • To balance the three dimensions of sustainable development: the economic, social and environmental. http://blogs.worldbank.org/ic4d/sustainable‐development‐goals‐and‐open‐data 84
- 86. 86