Course 1 - Introduction to Big Data by Toon Vanagt ( #BigDataBXL)
1 like264 views
The document presents an overview of big data, its characteristics, sources, and its strategic importance for businesses, emphasizing the necessity of transforming big data into actionable insights for enhanced decision-making. It discusses various applications such as fraud detection, targeted advertising, and patient monitoring, while highlighting the potential challenges faced in managing big data. Additionally, it notes the relevance of tools like mTurk for accessing human intelligence tasks and insights derived from interconnected IoT devices.
Course 1 - Introduction to Big Data by Toon Vanagt ( #BigDataBXL)
- 1. Slides by Gabriela Antunes Vieira
- 2. Course by TOON VANAGT Founder and managing director of several internet startups Co-founder and board member of Fintech Belgium Chairman of Open Knowledge Belgium Tech entrepreneur, lean startup coach & angel investor Toon Vanagt Datanews ICT manager SME of the year 2002 @Toon Betacowork co-owner (get your free trial ! )
- 3. What is Big Data ? How is it classified ? Where does it come from ? And why is it important ?1 2 3 INTRODUCTION THE 5 Vs OF DATA BIG DATA TECHNOLOGY The main characteristics of Big Data Big Data Technologies Landscape 4 5 HOW BIG DATA BECOMES SMART DATA SOME EXAMPLES Turning Big Data into value. .
- 4. • What is Big Data ? • Classification of data Sources of Data • The Importance of Big Data
- 5. Course by TOON VANAGT Data in our 21st century is like oil in the 18th Century: an immensely, untapped valuable asset…
- 6. Course by TOON VANAGT Big data refers to data sets that are too large or complex for traditional data- processing application software to adequately deal with
- 7. Course by TOON VANAGT The importance of Big Data relies on how a company utilizes their collected data. If you can’t turn this data into value, it’s useless. Better understanding of customers Optimization is processes Improve security Improve performance
- 8. Course by TOON VANAGT MTurk aims to make accessing human intelligence simple, scalable, and cost-effective. Businesses or developers needing tasks done (called Human Intelligence Tasks or “HITs”) can use the robust MTurk API to access thousands of high quality, global, on-demand Workers—and then programmatically integrate the results of that work directly into their business processes and systems. MTurk enables developers and businesses to achieve their goals more quickly and at a lower cost than was previously possible.
- 9. Course by TOON VANAGT Data that has been organized into a formatted repository, typically a database, so that its elements can be made addressable for more effective processing and analysis Information that either does not have a pre-defined data model or is not organized in a pre-defined manner. A form of structured data that does not conform with the formal structure of data models but nonetheless markers to separate semantic elements and enforce hierarchies of records and fields within the data.
- 10. Course by TOON VANAGT • Images, Videos, audios … • Social Media Facebook, Twitter, Youtube, Instagram… • Public, private or third party cloud platforms • Data publicly available on the web •Data Generated from interconnection of IOT devices MEDIA CLOUD WEB MACHINE DATA TRANSACTIONAL •Product ID, Distribution, Payements …
- 11. Course by TOON VANAGT
- 12. Course by TOON VANAGT Move up the information ladder by asking users/patients for input Combine, correlate and improve quality of data sets Bring new value from raw (open) data sets Visualise in new ways Mine deeper to dig out “insights” (not just basic statistics) Any company can now run its “own Google” Bring new value from raw (open) data sets Mine deeper to dig out “insights” (not just basic statistics) Any company can now run its “own Google”
- 13. • Volume • Velocity • Variety • Veracity • Value
- 14. Course by TOON VANAGT
- 15. Course by TOON VANAGT Open data is any content or info that people are free to use, re-use and redistribute — without any legal, technological or social Publically accessible data from websites, social networks, blogs, news feeds, product feeds (ecommerce) and more. Re-use is often not formalized and implicit… Authentication/secured access is required to use proprietary corporate data , personal data or device data
- 16. • Big Data Landscape • Big Data Tools • Process
- 17. Course by TOON VANAGT
- 18. Course by TOON VANAGT
- 19. Course by TOON VANAGT Many (open source) big data tools can be relatively cheap building blocks of your ‘refinery’
- 20. Course by TOON VANAGT https: //bit.ly/2GszxZF
- 21. • Smart Data Applications • How to start smart ? • Big Data Challenges
- 22. Course by TOON VANAGT Fraud detection / Prevention Targeted ads, product placement, brand sentiment analysis Patient monitoring, Patient Care… Proactive equipment repair, power and consumption matching Bandwidth allocation, Cell Tower diagostics … Proactive maintenance, Decreasing time, supply planning … Outbreak detection, network intrusion detection … Route and time planning, traffic monitoring …
- 23. Course by TOON VANAGT • Could an expert help to sense- check your results ? • Can you validate hypotheses ? • What further Data do you need ? • What data do you have ? • How is it used ? • Do you have the expertise to manage your data ? • What data do you have and how is it used ? • Are you being specific enough ?
- 26. Course by TOON VANAGT
- 27. Course by TOON VANAGT Users' weight, height, heart rate, ovulation cycles and other data were shared The information is collected in real time Data is sent to FB via its Software Development Kit, open source software tools that can be used by devs to create mobile apps These apps use a Facebook analytics tool called App Events lets developers track user activity on FB
- 28. Course by TOON VANAGT Retailers are spending lots of time analyzing your data to determine how to sell you even more. Target, has figured out how to successfully use shopper data to determine if an individual is having a baby and when. Everyone provides data through customer IDs tied to personally identifiable information (PII) such as credit cards, emails, and loyalty card numbers Using shopping behavior data, Target could assign a pregnancy prediction score to customers based on the purchase and purchase volume of about 25 different products in-store, regardless of baby registries. The Target advertising team started to use the mix and match technique that still allows for proper targeting without freaking out customers
- 29. Course by TOON VANAGT The Global Heat Map is published by the GPS tracking company Strava It is made up by sticking together the locations and activities of people who use fitness devices like Fitbits Strava fitness map accidentally revealed the location of secret military bases in war zones in the Middle East by tracking soldiers' movements
- 30. Course by TOON VANAGT