Open Data, Open Opportunity, Open to Progress
0 likes279 views
The document discusses open data and its opportunities. It defines internal, closed data that organizations keep private versus open data that is freely available to the public. Examples of open data portals from the US, UK, Taiwan, Thailand and Hong Kong are provided. The document also discusses how open data can benefit governments and businesses when combined with big data and how it creates opportunities for data science projects. Issues around what types of data should be open and the ongoing debate on open data are also summarized.
Open Data, Open Opportunity, Open to Progress
- 1. Open Data, Open Opportunity, Open to Progress Korkrid Akepanidtaworn Data Science Society LSE Students’ Union December 7, 2016 Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 1 / 27
- 2. Outline 1 Internal Data 2 Open Data 3 Data for Your Projects 4 Open Data Debate Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 2 / 27
- 3. Internal Data Internal Data Organizational or Closed Data The disclosure of data is not permissible as it may harm the company or a particular group. The IT department of the company generally imposes data governance and permissibility. Some examples are: sales databases/CRM, marketing data, customer complaints, customer service records, and government data (that is linked to national security.) Another closed data that may be more familiar to you is academic dataset. The data ethical issue comes into play with regard to the request of data from professors or authors, which is subject to academic plagiarism. Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 3 / 27
- 4. Internal Data Data Governance in the Organization Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 4 / 27
- 5. Internal Data Organizational Data Workflow Many business organizations use SAS as the main analytics software Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 5 / 27
- 6. Internal Data Examples of Organizational Data Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 6 / 27
- 7. Internal Data Closed Data Several mechanisms restrict access to or reuse of data. They include: Making data available for a charge. Compilation in databases or websites to which only registered members or customers can have access. Use of a proprietary or closed technology or encryption which creates a barrier for access. Copyright forbidding (or obfuscating) re-use of the data, including the use of ”no derivatives” requirements. Patent forbidding re-use of the data (for example the 3-dimensional coordinates of some experimental protein structures have been patented). Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 7 / 27
- 8. Open Data The Concept of Open Data Open data is the idea that some data should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control. The goals of the open data movement are similar to those of other ”open” movements such as open source, open hardware, open content and open access. Some examples are: Data.gov (USA), Data.gov.uk.(UK), Data.gov.au (Australia) Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 8 / 27
- 9. Open Data Open Data Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 9 / 27
- 10. Open Data Open Data, Open Decisions, and Open Services Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 10 / 27
- 11. Open Data Data.gov (USA) Data.gov is a U.S. government website launched in late May 2009 by the then Federal Chief Information Officer (CIO) of the United States, Vivek Kundra. Data.gov aims to improve public access to high value, machine readable datasets generated by the Executive Branch of the Federal Government. A variety of available data e.g. agriculture, climate, consumer, eco-system, energy, finance, and health. Total data is 193,059 datasets (up to Dec 6, 2016) Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 11 / 27
- 12. Open Data Data.gov (USA) Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 12 / 27
- 13. Open Data NYC Open Data: State-Level Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 13 / 27
- 14. Open Data Open Data in Taiwan Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 14 / 27
- 15. Open Data Open Data in Thailand Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 15 / 27
- 16. Open Data Open Data in Hong Kong Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 16 / 27
- 17. Open Data Open Data, Open Govt, and Big Data Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 17 / 27
- 18. Open Data 5Vs Pillars of Big Data Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 18 / 27
- 19. Open Data What Types of Data Should be Open? Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 19 / 27
- 20. Open Data Open Data, Open Opportunity, Open to Progress Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 20 / 27
- 21. Open Data Open Ecosystem Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 21 / 27
- 22. Open Data Data to Insight Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 22 / 27
- 23. Open Data Open Data Barometer Governments are still failing to provide ”enough information in an accessible form to their citizens and businesses” according to the 2013 open data index published today by the Open Knowledge Foundation. Countries are ranked on the availability and accessibility of information in ten key areas; government spending, election results, transport timetables, pollution levels, government budget, company register, national statistics, legislation, postcodes and availability of a high level copy of a national map. The UK and US lead on open government data according to the index. (1 and 2 respectively!) There are still key areas for improvement. The UK Electoral Commission doesn’t allow open reuse of election data for example, whilst in the US there is no federal dataset that contains all corporate registrations. Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 23 / 27
- 24. Open Data Further Resources of Open Data What is Open Data? (Open Data Institute) Global Open Data Index Global Census on Open Data Index An introduction to open data, Sally Jenkinson Nationale Smart City-Tagung: Open Data und Open Government Data for Everyone: Using Open Data to Unlock Germany’s Innovative Potential How do Open Data contribute to a Local Open Government? Open Data: Open Your Mind Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 24 / 27
- 25. Data for Your Projects External Data Quandl — Financial Data — Economic Data — Open Data 19 Free Public Data Sets For Your First Data Science Project Data for Empirical Exercises and Test Bank Transportation Data US Flight Data NBA Player Analysis Dataset OKCupid hacker scripts, data, etc Awesome Public Datasets, GitHub Repository Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 25 / 27
- 26. Open Data Debate Discussion of Open Data The debate on Open Data is still evolving. The best open government applications seek to empower citizens, to help small businesses, or to create value in some other positive, constructive way. Opening government data is only a way-point on the road to improving education, improving government, and building tools to solve other real world problems. What are your thoughts on open data? Is this a good idea for the government, businesses, and academics? Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 26 / 27
- 27. Open Data Debate Open Data, Open Opportunity, Open to Progress Korkrid Akepanidtaworn (LSESU) Open Data, Open Opportunity, Open to Progress December 7, 2016 27 / 27