SlideShare a Scribd company logo

Big Data – General Introduction

E
EMC

The document provides an overview of big data, detailing its definition, importance, and the technologies used for big data analysis. Key concepts include the 'v's of big data—volume, variety, velocity, and veracity—and technologies such as MapReduce, Hadoop Distributed File System, and NoSQL databases. It highlights the significance of big data in business analytics and scientific research.

TechnologyBusiness
1 of 14
1
2
3
4
5
6
7
8
9
10
11
12
13
14
1© Copyright 2013 EMC Corporation. All rights reserved. Big Data – General Introduction - Vignesh Gopalan , IIG
2© Copyright 2013 EMC Corporation. All rights reserved. Agenda Big Data – Definition Importance of Big Data Technologies used in Big Data Analysis
3© Copyright 2013 EMC Corporation. All rights reserved. Big Data – A Definition Volume Variety Velocity Veracity The ‘V’s of Big Data
4© Copyright 2013 EMC Corporation. All rights reserved. Why is Big Data Important? Business Analytics Big Science like LHC, Gene Sequencing Programs Big Government
5© Copyright 2013 EMC Corporation. All rights reserved. Big Data – Technologies Primer MapReduce computation framework and Hadoop Distributed File System Distributed databases NoSQL technologies
6© Copyright 2013 EMC Corporation. All rights reserved. MapReduce Published by Google Scalable Fault-Tolerant Batch Computation in parallel A distributed computation framework
7© Copyright 2013 EMC Corporation. All rights reserved. MapReduce Consists of two functions operating on key-value pairs. Map – performs filtering and sorting Reduce - performs summary operation on Map step results. … continued
8© Copyright 2013 EMC Corporation. All rights reserved. Map Reduce… Image Courtesy – Big Data by Nathan Marz , James Warren, Manning Publications
9© Copyright 2013 EMC Corporation. All rights reserved. Map Reduce… Image Courtesy – Big Data by Nathan Marz , James Warren, Manning Publications
10© Copyright 2013 EMC Corporation. All rights reserved. Distributed File System Distributed and scalable file system Highly Available Intrinsically aware of Map and Reduce jobs Supports horizontal and vertical partitioning HDFS – Hadoop Distributed File System
11© Copyright 2013 EMC Corporation. All rights reserved. HDFS Architecture Image Courtesy – Big Data by Nathan Marz , James Warren, Manning Publications
12© Copyright 2013 EMC Corporation. All rights reserved. Apache Hadoop Open Source implementation of MapReduce + DFS Image Courtesy – Wikipedia
13© Copyright 2013 EMC Corporation. All rights reserved. NoSQL Databases Highly optimized key-value stores No ACID Guarantees. Eventual consistency Fault-Tolerant, Distributed architecture. Amazon Dynamo, Redis are examples. A distributed computation framework
Big Data – General Introduction

More Related Content

PPTX
EMC Academic Alliance overview
EMC
 
PPTX
INDUSTRY-LEADING TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUD
EMC
 
PDF
EMC Big Data | Hadoop Starter Kit | EMC Forum 2014
EMC
 
PDF
EMC Starter Kit - IBM BigInsights - EMC Isilon
Boni Bruno
 
PPTX
Cloud Infrastructure and Services (CIS) - Webinar
EMC
 
PPTX
Emc vi pr software defined storage
solarisyougood
 
PDF
Scale-Out Data Lake with EMC Isilon
EMC
 
PPTX
EMC config Hadoop
solarisyougood
 
EMC Academic Alliance overview
EMC
 
INDUSTRY-LEADING TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUD
EMC
 
EMC Big Data | Hadoop Starter Kit | EMC Forum 2014
EMC
 
EMC Starter Kit - IBM BigInsights - EMC Isilon
Boni Bruno
 
Cloud Infrastructure and Services (CIS) - Webinar
EMC
 
Emc vi pr software defined storage
solarisyougood
 
Scale-Out Data Lake with EMC Isilon
EMC
 
EMC config Hadoop
solarisyougood
 

What's hot (20)

PPTX
EMC Isilon Solutions for Data Archives
solarisyougood
 
PDF
Transform Your Business with Big Data Storage
EMC
 
PPTX
EMC isilon for -media-and-entertainment-sales-deck
solarisyougood
 
PDF
White Paper: Best Practices for Data Replication with EMC Isilon SyncIQ
EMC
 
PPTX
7. emc isilon hdfs enterprise storage for hadoop
Taldor Group
 
PDF
White Paper: EMC Isilon OneFS Operating System
EMC
 
PDF
EMC IT's Journey to the Private Cloud: A Practitioner's Guide
EMC
 
PDF
White Paper: EMC Isilon OneFS — A Technical Overview
EMC
 
PDF
EMC Academic Alliance Presentation
Haitham El-Ghareeb
 
PDF
The Future of Storage : EMC Software Defined Solution
RSD
 
PPTX
EMC ScaleIO Overview
walshe1
 
PPTX
Emc isilon overview
solarisyougood
 
PPTX
Emc vi pr data services
solarisyougood
 
PPTX
Emc isilon technical deep dive workshop
solarisyougood
 
PDF
Building Hadoop-as-a-Service with Pivotal Hadoop Distribution, Serengeti, & I...
EMC
 
PDF
Transforming Mission Critical Applications
Cenk Ersoy
 
PDF
EMC ViPR Services Storage Engine Architecture
EMC
 
PDF
S104875 nightmares-dreams-spectrum-control-jburg-v1809h
Tony Pearson
 
PPSX
EMC-ISILON_MphasiS_Walk_through
prakashjjaya
 
PDF
Journey to the Software Defined Data Center: EMA Research Results Revealed
Enterprise Management Associates
 
EMC Isilon Solutions for Data Archives
solarisyougood
 
Transform Your Business with Big Data Storage
EMC
 
EMC isilon for -media-and-entertainment-sales-deck
solarisyougood
 
White Paper: Best Practices for Data Replication with EMC Isilon SyncIQ
EMC
 
7. emc isilon hdfs enterprise storage for hadoop
Taldor Group
 
White Paper: EMC Isilon OneFS Operating System
EMC
 
EMC IT's Journey to the Private Cloud: A Practitioner's Guide
EMC
 
White Paper: EMC Isilon OneFS — A Technical Overview
EMC
 
EMC Academic Alliance Presentation
Haitham El-Ghareeb
 
The Future of Storage : EMC Software Defined Solution
RSD
 
EMC ScaleIO Overview
walshe1
 
Emc isilon overview
solarisyougood
 
Emc vi pr data services
solarisyougood
 
Emc isilon technical deep dive workshop
solarisyougood
 
Building Hadoop-as-a-Service with Pivotal Hadoop Distribution, Serengeti, & I...
EMC
 
Transforming Mission Critical Applications
Cenk Ersoy
 
EMC ViPR Services Storage Engine Architecture
EMC
 
S104875 nightmares-dreams-spectrum-control-jburg-v1809h
Tony Pearson
 
EMC-ISILON_MphasiS_Walk_through
prakashjjaya
 
Journey to the Software Defined Data Center: EMA Research Results Revealed
Enterprise Management Associates
 
Ad

Viewers also liked (17)

PDF
EMC & OpenStack: A View From Within
EMC
 
PPTX
Integumentary Terms
tahearn40
 
PDF
Recovered file 1
vicolombia
 
PPTX
Prototipo
Neftaly Niño Villarreal
 
PDF
Conclave
Vinay Kumar Bhati
 
PDF
Insaat kursu-pendik
sersld54
 
PDF
InDA Brochure India
Vinay Kumar Bhati
 
PDF
What a dude born in 1888 taught me about design.
Kylie Timpani
 
PPTX
Spain
stephenmoore1010
 
PDF
SLG_EMC
Frank Schulz
 
PDF
Building the Case for New Technology Have Inspiration, Will Travel ...
Society of Women Engineers
 
PPTX
EMC World 2016 - code.01 Everything as Code - How did we get here?
{code}
 
PPTX
iNARTE Presentation to EMC Symposium 2016
Scott Paton
 
PPT
Dell corporation ltd
Chetan Mahawar
 
PPTX
EMC World 2016 Summary (Part 1)
Robert Alexander Vargas
 
PPT
EMC Documentum Enterprise Content Management 6.5
Emirates Computers
 
PDF
Unit 7 Book
butcher665
 
EMC & OpenStack: A View From Within
EMC
 
Integumentary Terms
tahearn40
 
Recovered file 1
vicolombia
 
Prototipo
Neftaly Niño Villarreal
 
Conclave
Vinay Kumar Bhati
 
Insaat kursu-pendik
sersld54
 
InDA Brochure India
Vinay Kumar Bhati
 
What a dude born in 1888 taught me about design.
Kylie Timpani
 
Spain
stephenmoore1010
 
SLG_EMC
Frank Schulz
 
Building the Case for New Technology Have Inspiration, Will Travel ...
Society of Women Engineers
 
EMC World 2016 - code.01 Everything as Code - How did we get here?
{code}
 
iNARTE Presentation to EMC Symposium 2016
Scott Paton
 
Dell corporation ltd
Chetan Mahawar
 
EMC World 2016 Summary (Part 1)
Robert Alexander Vargas
 
EMC Documentum Enterprise Content Management 6.5
Emirates Computers
 
Unit 7 Book
butcher665
 
Ad

Similar to Big Data – General Introduction (20)

PDF
Getting started with Hadoop on the Cloud with Bluemix
Nicolas Morales
 
PPTX
Big Data Hadoop (Overview)
Rohit Srivastava
 
PPTX
Big Data
Rohit Srivastava
 
PDF
Bigdata and Hadoop Bootcamp
Spotle.ai
 
PDF
Semantic web meetup 14.november 2013
Jean-Pierre König
 
PPTX
Bar camp bigdata
Uppisatish Ag
 
PDF
Hadoop Overview
EMC
 
PPTX
Fundamentals of big data analytics and Hadoop
Archana Gopinath
 
PPTX
big data and hadoop
ahmed alshikh
 
PPTX
Big data analytics - hadoop
Vishwajeet Jadeja
 
PPTX
Big data Presentation
himanshu arora
 
PPTX
Bw tech hadoop
Mindgrub Technologies
 
PPTX
BW Tech Meetup: Hadoop and The rise of Big Data
Mindgrub Technologies
 
PPTX
Big Data and Hadoop
MaulikLakhani
 
PDF
Hadoop 101
EMC
 
PPTX
Hadoop_EcoSystem slide by CIDAC India.pptx
migbaruget
 
PDF
Introduction to Big Data and Hadoop using Local Standalone Mode
inventionjournals
 
PDF
Hadoop
Veera Sundari
 
PDF
Research on big data
Roby Chen
 
PDF
Research ON Big Data
mysqlops
 
Getting started with Hadoop on the Cloud with Bluemix
Nicolas Morales
 
Big Data Hadoop (Overview)
Rohit Srivastava
 
Big Data
Rohit Srivastava
 
Bigdata and Hadoop Bootcamp
Spotle.ai
 
Semantic web meetup 14.november 2013
Jean-Pierre König
 
Bar camp bigdata
Uppisatish Ag
 
Hadoop Overview
EMC
 
Fundamentals of big data analytics and Hadoop
Archana Gopinath
 
big data and hadoop
ahmed alshikh
 
Big data analytics - hadoop
Vishwajeet Jadeja
 
Big data Presentation
himanshu arora
 
Bw tech hadoop
Mindgrub Technologies
 
BW Tech Meetup: Hadoop and The rise of Big Data
Mindgrub Technologies
 
Big Data and Hadoop
MaulikLakhani
 
Hadoop 101
EMC
 
Hadoop_EcoSystem slide by CIDAC India.pptx
migbaruget
 
Introduction to Big Data and Hadoop using Local Standalone Mode
inventionjournals
 
Hadoop
Veera Sundari
 
Research on big data
Roby Chen
 
Research ON Big Data
mysqlops
 

More from EMC (20)

PDF
Cloud Foundry Summit Berlin Keynote
EMC
 
PPTX
EMC GLOBAL DATA PROTECTION INDEX
EMC
 
PDF
Transforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIO
EMC
 
PDF
Citrix ready-webinar-xtremio
EMC
 
PDF
EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES
EMC
 
PPTX
EMC with Mirantis Openstack
EMC
 
PPTX
Modern infrastructure for business data lake
EMC
 
PDF
Force Cyber Criminals to Shop Elsewhere
EMC
 
PDF
Pivotal : Moments in Container History
EMC
 
PDF
Data Lake Protection - A Technical Review
EMC
 
PDF
Mobile E-commerce: Friend or Foe
EMC
 
PDF
Virtualization Myths Infographic
EMC
 
PDF
Intelligence-Driven GRC for Security
EMC
 
PDF
The Trust Paradox: Access Management and Trust in an Insecure Age
EMC
 
PDF
EMC Technology Day - SRM University 2015
EMC
 
PDF
EMC Academic Summit 2015
EMC
 
PDF
Data Science and Big Data Analytics Book from EMC Education Services
EMC
 
PDF
Using EMC Symmetrix Storage in VMware vSphere Environments
EMC
 
PDF
Using EMC VNX storage with VMware vSphereTechBook
EMC
 
PDF
2014 Cybercrime Roundup: The Year of the POS Breach
EMC
 
Cloud Foundry Summit Berlin Keynote
EMC
 
EMC GLOBAL DATA PROTECTION INDEX
EMC
 
Transforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIO
EMC
 
Citrix ready-webinar-xtremio
EMC
 
EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES
EMC
 
EMC with Mirantis Openstack
EMC
 
Modern infrastructure for business data lake
EMC
 
Force Cyber Criminals to Shop Elsewhere
EMC
 
Pivotal : Moments in Container History
EMC
 
Data Lake Protection - A Technical Review
EMC
 
Mobile E-commerce: Friend or Foe
EMC
 
Virtualization Myths Infographic
EMC
 
Intelligence-Driven GRC for Security
EMC
 
The Trust Paradox: Access Management and Trust in an Insecure Age
EMC
 
EMC Technology Day - SRM University 2015
EMC
 
EMC Academic Summit 2015
EMC
 
Data Science and Big Data Analytics Book from EMC Education Services
EMC
 
Using EMC Symmetrix Storage in VMware vSphere Environments
EMC
 
Using EMC VNX storage with VMware vSphereTechBook
EMC
 
2014 Cybercrime Roundup: The Year of the POS Breach
EMC
 

Recently uploaded (20)

PDF
Encapsulation theory and applications.pdf
gurumoop
 
PPTX
Programs and apps: productivity, graphics, security and other tools
4mqw9zch22
 
PPT
Teaching material agriculture food technology
LiaRayya
 
PPTX
Understanding_Digital_Forensics_Presentation.pptx
ImranKhan423233
 
PDF
Unlocking AI with Model Context Protocol (MCP)
Brian McKeiver
 
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
PPTX
MYSQL Presentation for SQL database connectivity
Swati270511
 
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
SynapseIndia
 
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
blackmambaettijean
 
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
SandeepSingh286037
 
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
23bcla24
 
PPTX
Cloud computing and distributed systems.
kkkkkhan
 
PPTX
sap open course for s4hana steps from ECC to s4
sreeni2106invites
 
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
ZubinRadhakrishnan
 
PDF
MIND Revenue Release Quarter 2 2025 Press Release
MIND CTI
 
PDF
cuic standard and advanced reporting.pdf
SimoneTitaniumTomase
 
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
Encapsulation theory and applications.pdf
gurumoop
 
Programs and apps: productivity, graphics, security and other tools
4mqw9zch22
 
Teaching material agriculture food technology
LiaRayya
 
Understanding_Digital_Forensics_Presentation.pptx
ImranKhan423233
 
Unlocking AI with Model Context Protocol (MCP)
Brian McKeiver
 
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
MYSQL Presentation for SQL database connectivity
Swati270511
 
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
SynapseIndia
 
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
blackmambaettijean
 
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
Agricultural_Statistics_at_a_Glance_2022_0.pdf
SandeepSingh286037
 
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
23bcla24
 
Cloud computing and distributed systems.
kkkkkhan
 
sap open course for s4hana steps from ECC to s4
sreeni2106invites
 
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
“AI and Expert System Decision Support & Business Intelligence Systems”
ZubinRadhakrishnan
 
MIND Revenue Release Quarter 2 2025 Press Release
MIND CTI
 
cuic standard and advanced reporting.pdf
SimoneTitaniumTomase
 
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 

Big Data – General Introduction

  • 1. 1© Copyright 2013 EMC Corporation. All rights reserved. Big Data – General Introduction - Vignesh Gopalan , IIG
  • 2. 2© Copyright 2013 EMC Corporation. All rights reserved. Agenda Big Data – Definition Importance of Big Data Technologies used in Big Data Analysis
  • 3. 3© Copyright 2013 EMC Corporation. All rights reserved. Big Data – A Definition Volume Variety Velocity Veracity The ‘V’s of Big Data
  • 4. 4© Copyright 2013 EMC Corporation. All rights reserved. Why is Big Data Important? Business Analytics Big Science like LHC, Gene Sequencing Programs Big Government
  • 5. 5© Copyright 2013 EMC Corporation. All rights reserved. Big Data – Technologies Primer MapReduce computation framework and Hadoop Distributed File System Distributed databases NoSQL technologies
  • 6. 6© Copyright 2013 EMC Corporation. All rights reserved. MapReduce Published by Google Scalable Fault-Tolerant Batch Computation in parallel A distributed computation framework
  • 7. 7© Copyright 2013 EMC Corporation. All rights reserved. MapReduce Consists of two functions operating on key-value pairs. Map – performs filtering and sorting Reduce - performs summary operation on Map step results. … continued
  • 8. 8© Copyright 2013 EMC Corporation. All rights reserved. Map Reduce… Image Courtesy – Big Data by Nathan Marz , James Warren, Manning Publications
  • 9. 9© Copyright 2013 EMC Corporation. All rights reserved. Map Reduce… Image Courtesy – Big Data by Nathan Marz , James Warren, Manning Publications
  • 10. 10© Copyright 2013 EMC Corporation. All rights reserved. Distributed File System Distributed and scalable file system Highly Available Intrinsically aware of Map and Reduce jobs Supports horizontal and vertical partitioning HDFS – Hadoop Distributed File System
  • 11. 11© Copyright 2013 EMC Corporation. All rights reserved. HDFS Architecture Image Courtesy – Big Data by Nathan Marz , James Warren, Manning Publications
  • 12. 12© Copyright 2013 EMC Corporation. All rights reserved. Apache Hadoop Open Source implementation of MapReduce + DFS Image Courtesy – Wikipedia
  • 13. 13© Copyright 2013 EMC Corporation. All rights reserved. NoSQL Databases Highly optimized key-value stores No ACID Guarantees. Eventual consistency Fault-Tolerant, Distributed architecture. Amazon Dynamo, Redis are examples. A distributed computation framework