Big Data
Download as PPTX, PDF1 like1,074 views
Big data refers to large volumes of high velocity, variety and veracity information that require advanced methods to enable analysis and insights. It is data produced from many sources, including social media interactions, website activity, photos, videos and more. Companies and governments collect and analyze big data to improve services, facilitate operations, seek new business models and boost effectiveness. However, big data also raises privacy and surveillance concerns when collected by governments. The future will see big data continue growing rapidly in size and analytical capabilities, while also facing increasing debates around security, privacy and the environmental impacts of data processing.
Big Data
- 1. Data Charles Mok, Legislative Councilor (IT) 21.08.2013
- 2. Wh- is big data? •What •Who •When •Where •Why •How
- 3. What is big data? Gartner Group definition: "Big data is high volume, high velocity, and/or high variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimization." Plus, high veracity suggested by other experts
- 4. High Volume? KBMBGBTBPBEBZB Google NC data center Approximate Data Volume in the world 2013: up to 3.6 ZB (zettabytes) 400billion feature length HD movies
- 5. High Velocity? Every 60 seconds on Facebook there are: • 510,000 posted comments • 293,000 status updates • 136,000 uploaded photos 30 billion pieces of content are shared each month 20 million Facebook apps are installed per day From 2012 statistic,
- 6. High Velocity? (Cont.) Twitter 190,000,000 tweets are sent on average per day The record is 25,088tweets per second Require high processing power
- 7. High variety? Any type of data, meaningful data & meaningless data (if you think so…) Images Documents Browserhistory GPS location Browsing habitMedical history Transaction record Opendata Wi-Fi signal Share Logistic
- 8. High veracity? How do you trust on the data? Does it simply mean a like? Or… it actually means VS
- 9. a.k.a • Cloud computing • Web analytics • Data mining • Data discovery
- 10. Who are producing big data? YOU & I
- 11. When? Every search Like Follow Upload a photo Accept permissions (mobile app / online service) Every browseOnline shopping Post a status Share
- 12. Who benefit from big data? YOU & I Service providers improve their service through collecting more data.
- 13. Who can make use of big data? • ISPs • Utilities • Government • Corporations • Academic • Everyone who can collect and access to data With more than 1,000 universities
- 14. Where do they store/process big data?
- 15. Why do they use big data? • Provide better consumer experience • Facilitate corporate operation • Seek for a new business model • Risk and financial management • Boosting effectiveness • Government Surveillance
- 16. Why do they use big data? Win an election Obama did it in 2012
- 17. How to make use of Big Data? • 2008: Social Media • 2012: Add big data • Decide how to approach voters • Top targets: unsubscribed list back in 2008 • Different message scripts for different demographic groups • Phone call & email • Predict turnout • Simulating election 66,000 times result per night • Reallocating resource in each states
- 18. How does it work? • Visualizing Big Data • Concept on how to analyze data • Power BI for Office 365 Demo
- 19. WhenOpenData meets Big Data–DoNo Evil Do No Evil (起你底) • HK ICT Award 2013: • Best Lifestyle Silver Award • Over 2 million local litigation records from the courts of Hong Kong dating as far back as 1990 for civil cases and 2004 for criminal cases.
- 20. • Comment from judge panel： • This mobile application integrates an extensive database with a highly user-friendly search engine, allowing users to easily conduct legal background search of companies or targeted persons in an instant and economical way. This demonstrates a good combination of mobile technology and ICT technology. WhenOpenData meets Big Data–Do No Evil
- 21. • One-station background analysis on • Potential employee • Business partner • Future son in law • Government Officials?? WhenOpenData meets Big Data–Do No Evil
- 22. Abuse of Big Data? Example: NSA /CIA surveillance programs Privacy? Right to know? Big brother of the new era? Beyond commercial abuses, also by governments Ongoing debate: Negative impact to U.S. cloud vendors
- 23. Future of Big Data • Keep growing: in size and analytical power • Growing security concerns • More conflicts in privacy issues • Data processing requires more electricity than lighting network all over the world in 2035
- 24. THE END Facebook: Charles Mok B / page: Charles Mok 2012 Twitter: Charlesmok Linkedin: Charlesmok Website:charlesmok.hk Email: charlesmok@charlesmok.hk