Introduction to BIG DATA part 01
Download as PPTX, PDF1 like198 views
This document provides an introduction to big data, including what it is, where it comes from, and its key characteristics. It discusses the 3Vs of big data - volume, velocity, and variety. Volume refers to the large size of big data in peta bytes. Velocity means data is available in real-time. Variety means data comes from various structured, unstructured, and semi-structured sources. Other characteristics discussed are valence, which is the connectedness of big data, and veracity, which refers to the uncertainty and noise in data. The document outlines how big data looks and provides references for further information.
Introduction to BIG DATA part 01
- 1. Introduction to BIG DATA Part – 01 Nadeesha Thilakarathne
- 2. Content • What is BIG DATA • From Where it Comes • 3V's of Big Data • Velocity • Variety • Volume • Characteristics of Big Data • Valance • Veracity • How Big Data Looks • References 2
- 3. What is BIG DATA • Data which are very large in size BIG DATA >1015 3
- 4. From Where it Comes 4
- 5. Variety 3V's of Big Data… Volume Velocity 3V’s 5
- 6. Velocity • The data is increasing at a very fast rate • Yesterday data is not recent anymore 6
- 7. Variety 7 DATA Structured 1. Databases 2. Data warehouses 3. Enterprise systems (CRM,ERP) Unstructured 1. Analog Data 2. GPS tracking information 3. Audio/video streams Semi – Structured 1. XML 2. Email
- 8. Volume • The amount of data which we deal with is of very large size of Peta bytes. 8
- 9. 3V's of Big Data… • Volume: big data doesn't sample; it just observes and tracks what happens • Velocity: big data is often available in real-time • Variety: big data draws from text, images, audio, video; plus it completes missing pieces through data fusion 9
- 10. Characteristics of Big Data • Volume • Variety • Velocity • Valance • Veracity 10 New Vs come into the action with new challenges
- 11. Valance • Connectedness’ of Big data 11 More connections among data Increase the Complexity of data analysis
- 12. Veracity • The quality of captured data can vary greatly, affecting accurate analysis • Simply say ,“Uncertainty of Data” • Refers to the biases, noises, abnormality in data • Trustworthinessand Truthfulnessmatters 12
- 13. How Big Data Looks 13
- 14. References • Big Data – What is Big Data – 3 Vs of Big Data – Volume, Velocity and Variety – Day 2 of 21 • WIKIPEDIA – Big Data • Educationalresearchtechniques – Characteristics of Big Data 14
- 15. 15 A BIGTHANK YOU …