SlideShare a Scribd company logo
Big Data in Telecom
Tilani Gunawardena
1
• Introduction
• BigDatainTelecom
• ProgrammingModel
Content
2
Big Data Everywhere!
• Lots of data is being collected
and warehoused
– Web data, e-commerce
– purchases at department/
grocery stores
– Bank/Credit Card
transactions
– Social Network
– Sensor data
– IoT data
3
How much data?
• Google processes 20 PB a day (2008)
• Walmart handles more than 1 million customer
transactions every hour.
• Facebook ingests 500 terabytes of new data every day.
• eBay has 6.5 PB of user data + 50 TB/day (5/2009)
• Boeing 737 will generate 240 terabytes of flight data
during a single flight across the US.
640K ought to be
enough for anybody.
4
Data sets whose size is beyond the ability
of typical database software tools to
capture, store, manage, and analyze
5
What is Big Data?
6
Big Data
• Exabyte , Zettabyte of data
• Big Data is not about the size of the data,
it’s about the value within the Big Data
Big Data
7
The Structure of Big Data
• Structured
– Most traditional data sources
• Semi-structured
– XML,JSON
• Unstructured
– FB logs, web chats, Youtube
8
Types of Telecommunication Data
• Call Detail Data
– average call duration
– Average call originated/generated
– Call period
– Call to/from different area code
• Network Data
– Complex configuration of equipment
– Error Generation
– To support network management function
• Customer Data
– Database information of customers
– Name, age, address, telephone, subscription type
9
What to do with these data?
• Aggregation and Statistics
– Data warehouse and OLAP
• Indexing, Searching, and Querying
– Keyword based search
– Pattern matching (XML/RDF)
• Knowledge discovery
– Data Mining
– Statistical Modeling
10
Big Data Analytics
• Examining large amount of data
• Knowledge discovery/Appropriate information
–Data Mining
–Statistical Modeling
• Identification of hidden patterns, unknown
correlations
• Competitive advantage
• Better business decisions: strategic and
operational
• Effective marketing, customer satisfaction,
increased revenue 11
Key Business Application Categories
in Telecom Big Data Analytics
• Customer Experience Enhancement
• Network Optimization
• Operational Analytics
• Data Monetization
12
Big Data Analytics: Customer
Experience Enhancement
• Targeted Marketing & Personalization
– personalized product offerings (ex: personalized data top-
up plans)
• Predictive Churn Analytic
– address “at risk” customers
• Customer Journey Analytics
– Customer’s interactions at various stages of the lifecycle to
promote tailored offerings and campaigns.
• Proactive Care
– Identify issues and fix it or offer a solution before it
impacts the customer
– ex: Telkomsel, in Indonesia build a proactive dashboard’
for their high value customers
13
Big Data Analytics: Network Optimization
• Network Capacity Planning & Optimization
– Network usage, subscriber density, along with traffic and location data
– More accurately monitor, manage and forecast network capacity
• Network Investment Planning
– Future connectivity needs, strategic objectives, forecasted traffic, customer
experience etc
– ensure they are investing their CAPEX(Capital expenditure) in the right spots
– Ex: how and where they can expand high-speed broadband services to
customers within sri lanka
• Real-Time Network Analytics :
– real-time data collected from the cell towers, events occurring in the network
can proactively respond to network failures and outages helping them save
millions
14
Big Data Analytics: Operational Analytics
• Revenue Leakage & Assurance
– Analyze many years data instead few months
– Identify new revenue opportunities
• Cyber Security & Information Management
• Customer Care Optimization
15
Big Data Analytics: Data Monetization
• Data Analytics as a Service (DAaaS)
– retail, financial services, advertising, healthcare, public
services and other customer-facing businesses.
– Ex: customer footfall analytics which is helping retail chains
decipher who is visiting their stores and when
– trffic patterns and bottlenecks,
• IoT & M2M Analytics
– The number of connected objects representing the IoT
ecosystem is expected to reach 50 Billion by 2020
• New Revenue Engine
16
Hadoop and Big data
• Wont fit on a Single computer
• Distributed Data
• Distributed Data =Faster Computation
• Telecom Service Providers adopt Hadoop &
big data analytics solutions to turn their data
into valuable business insights
17
• MapReduce is a programming model for processing and
generating large data sets
• MapReduce was used to completely regenerate Google's
index of the World Wide Web.
• Hadoop which allows applications to run using the
MapReduce algorithm.
MapReduce
• Users implement interface of 2 function
– Map
– Reduce
• Map( in-key,in-value) (Out-key,intermediate-value) list
• Reduce(Out-key,intermediate-value list) out_value list
18
MapReduce Workflow
19
Big Data Vendors
20
Big Data and Cloud Computing
• Cloud computing is the use of computing
resources (hardware and software) that are
delivered as a service over a network
• In Business View: When it’s smarter to rent
than to buy…..
– ”If you only need milk, would you buy a cow? “
21
Thank You !
22

More Related Content

PPTX
Big Data ppt
PPT
Data is the new oil
PPTX
Big Data analytics
PDF
Big Data & Analytics (Conceptual and Practical Introduction)
PPTX
Presentation on Big Data
PPTX
Real time analytics
PDF
Data Framework Design
PPTX
Netflix Recommender System : Big Data Case Study
Big Data ppt
Data is the new oil
Big Data analytics
Big Data & Analytics (Conceptual and Practical Introduction)
Presentation on Big Data
Real time analytics
Data Framework Design
Netflix Recommender System : Big Data Case Study

What's hot (20)

PDF
Big Data
PDF
Data strategy demistifying data
PPT
Gartner: Seven Building Blocks of Master Data Management
PDF
Data Catalogs Are the Answer – What is the Question?
PDF
Data Engineering Basics
PDF
Future of Data Engineering
PPTX
Data Governance Best Practices
PDF
Big Data Architecture
PPT
Introduction to Data Mining
PPTX
Big data analytics
PDF
Data Governance Best Practices, Assessments, and Roadmaps
ODP
Introduction To Data Warehousing
PPTX
Snowflake Overview
PPTX
Building a Big Data Pipeline
PPTX
Big Data Analytics
PDF
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
PPTX
Data Mining: Graph mining and social network analysis
PDF
Solution Architecture And Solution Security
PDF
Big data Analytics
Big Data
Data strategy demistifying data
Gartner: Seven Building Blocks of Master Data Management
Data Catalogs Are the Answer – What is the Question?
Data Engineering Basics
Future of Data Engineering
Data Governance Best Practices
Big Data Architecture
Introduction to Data Mining
Big data analytics
Data Governance Best Practices, Assessments, and Roadmaps
Introduction To Data Warehousing
Snowflake Overview
Building a Big Data Pipeline
Big Data Analytics
Data Privatisation, Data Anonymisation, Data Pseudonymisation and Differentia...
Data Mining: Graph mining and social network analysis
Solution Architecture And Solution Security
Big data Analytics
Ad

Similar to Big data in telecom (20)

PPTX
Big Data, Trends,opportunities and some case studies( Mahmoud Khosravi)
PDF
uae views on big data
PPTX
Big data in telecom
PDF
Big data & advanced analytics in Telecom: A multi-billion-dollar revenue oppo...
PPTX
big data analytics pgpmx2015
PPTX
Big data session five ( a )f
PPTX
What Your Competitors Are Already Doing with Big Data
PDF
Strategyzing big data in telco industry
PDF
Big Data and the Telecom Industry
PDF
Lecture 1-big data engineering (Introduction).pdf
PPTX
Big data
PDF
MapR Enterprise Data Hub Webinar w/ Mike Ferguson
PPTX
Big data telecom
PPTX
Big data Analytics
PDF
Impacto del Big Data en la empresa española
PDF
Big Data Analytics Powerpoint Presentation Slides
PPTX
Big Data in Business Application use case and benefits
PDF
Big Data Analytics PowerPoint Presentation Slides
Big Data, Trends,opportunities and some case studies( Mahmoud Khosravi)
uae views on big data
Big data in telecom
Big data & advanced analytics in Telecom: A multi-billion-dollar revenue oppo...
big data analytics pgpmx2015
Big data session five ( a )f
What Your Competitors Are Already Doing with Big Data
Strategyzing big data in telco industry
Big Data and the Telecom Industry
Lecture 1-big data engineering (Introduction).pdf
Big data
MapR Enterprise Data Hub Webinar w/ Mike Ferguson
Big data telecom
Big data Analytics
Impacto del Big Data en la empresa española
Big Data Analytics Powerpoint Presentation Slides
Big Data in Business Application use case and benefits
Big Data Analytics PowerPoint Presentation Slides
Ad

More from Tilani Gunawardena PhD(UNIBAS), BSc(Pera), FHEA(UK), CEng, MIESL (20)

PDF
Introduction to data mining and machine learning
PPTX
Cheetah:Data Warehouse on Top of MapReduce
PPTX
Interpreting the Data:Parallel Analysis with Sawzall
Introduction to data mining and machine learning
Cheetah:Data Warehouse on Top of MapReduce
Interpreting the Data:Parallel Analysis with Sawzall

Recently uploaded (20)

PPTX
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
PPTX
OOP with Java - Java Introduction (Basics)
PPTX
additive manufacturing of ss316l using mig welding
PPTX
Geodesy 1.pptx...............................................
PPTX
Unit 5 BSP.pptxytrrftyyydfyujfttyczcgvcd
PDF
Model Code of Practice - Construction Work - 21102022 .pdf
PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PPTX
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
PPTX
MET 305 MODULE 1 KTU 2019 SCHEME 25.pptx
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PPTX
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
PPTX
Lecture Notes Electrical Wiring System Components
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
PPTX
Recipes for Real Time Voice AI WebRTC, SLMs and Open Source Software.pptx
PDF
Well-logging-methods_new................
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
Sustainable Sites - Green Building Construction
PPTX
Internet of Things (IOT) - A guide to understanding
PPT
Drone Technology Electronics components_1
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
OOP with Java - Java Introduction (Basics)
additive manufacturing of ss316l using mig welding
Geodesy 1.pptx...............................................
Unit 5 BSP.pptxytrrftyyydfyujfttyczcgvcd
Model Code of Practice - Construction Work - 21102022 .pdf
Embodied AI: Ushering in the Next Era of Intelligent Systems
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
MET 305 MODULE 1 KTU 2019 SCHEME 25.pptx
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
Lecture Notes Electrical Wiring System Components
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
Recipes for Real Time Voice AI WebRTC, SLMs and Open Source Software.pptx
Well-logging-methods_new................
UNIT-1 - COAL BASED THERMAL POWER PLANTS
Sustainable Sites - Green Building Construction
Internet of Things (IOT) - A guide to understanding
Drone Technology Electronics components_1
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...

Big data in telecom

  • 1. Big Data in Telecom Tilani Gunawardena 1
  • 2. • Introduction • BigDatainTelecom • ProgrammingModel Content 2
  • 3. Big Data Everywhere! • Lots of data is being collected and warehoused – Web data, e-commerce – purchases at department/ grocery stores – Bank/Credit Card transactions – Social Network – Sensor data – IoT data 3
  • 4. How much data? • Google processes 20 PB a day (2008) • Walmart handles more than 1 million customer transactions every hour. • Facebook ingests 500 terabytes of new data every day. • eBay has 6.5 PB of user data + 50 TB/day (5/2009) • Boeing 737 will generate 240 terabytes of flight data during a single flight across the US. 640K ought to be enough for anybody. 4
  • 5. Data sets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze 5
  • 6. What is Big Data? 6
  • 7. Big Data • Exabyte , Zettabyte of data • Big Data is not about the size of the data, it’s about the value within the Big Data Big Data 7
  • 8. The Structure of Big Data • Structured – Most traditional data sources • Semi-structured – XML,JSON • Unstructured – FB logs, web chats, Youtube 8
  • 9. Types of Telecommunication Data • Call Detail Data – average call duration – Average call originated/generated – Call period – Call to/from different area code • Network Data – Complex configuration of equipment – Error Generation – To support network management function • Customer Data – Database information of customers – Name, age, address, telephone, subscription type 9
  • 10. What to do with these data? • Aggregation and Statistics – Data warehouse and OLAP • Indexing, Searching, and Querying – Keyword based search – Pattern matching (XML/RDF) • Knowledge discovery – Data Mining – Statistical Modeling 10
  • 11. Big Data Analytics • Examining large amount of data • Knowledge discovery/Appropriate information –Data Mining –Statistical Modeling • Identification of hidden patterns, unknown correlations • Competitive advantage • Better business decisions: strategic and operational • Effective marketing, customer satisfaction, increased revenue 11
  • 12. Key Business Application Categories in Telecom Big Data Analytics • Customer Experience Enhancement • Network Optimization • Operational Analytics • Data Monetization 12
  • 13. Big Data Analytics: Customer Experience Enhancement • Targeted Marketing & Personalization – personalized product offerings (ex: personalized data top- up plans) • Predictive Churn Analytic – address “at risk” customers • Customer Journey Analytics – Customer’s interactions at various stages of the lifecycle to promote tailored offerings and campaigns. • Proactive Care – Identify issues and fix it or offer a solution before it impacts the customer – ex: Telkomsel, in Indonesia build a proactive dashboard’ for their high value customers 13
  • 14. Big Data Analytics: Network Optimization • Network Capacity Planning & Optimization – Network usage, subscriber density, along with traffic and location data – More accurately monitor, manage and forecast network capacity • Network Investment Planning – Future connectivity needs, strategic objectives, forecasted traffic, customer experience etc – ensure they are investing their CAPEX(Capital expenditure) in the right spots – Ex: how and where they can expand high-speed broadband services to customers within sri lanka • Real-Time Network Analytics : – real-time data collected from the cell towers, events occurring in the network can proactively respond to network failures and outages helping them save millions 14
  • 15. Big Data Analytics: Operational Analytics • Revenue Leakage & Assurance – Analyze many years data instead few months – Identify new revenue opportunities • Cyber Security & Information Management • Customer Care Optimization 15
  • 16. Big Data Analytics: Data Monetization • Data Analytics as a Service (DAaaS) – retail, financial services, advertising, healthcare, public services and other customer-facing businesses. – Ex: customer footfall analytics which is helping retail chains decipher who is visiting their stores and when – trffic patterns and bottlenecks, • IoT & M2M Analytics – The number of connected objects representing the IoT ecosystem is expected to reach 50 Billion by 2020 • New Revenue Engine 16
  • 17. Hadoop and Big data • Wont fit on a Single computer • Distributed Data • Distributed Data =Faster Computation • Telecom Service Providers adopt Hadoop & big data analytics solutions to turn their data into valuable business insights 17
  • 18. • MapReduce is a programming model for processing and generating large data sets • MapReduce was used to completely regenerate Google's index of the World Wide Web. • Hadoop which allows applications to run using the MapReduce algorithm. MapReduce • Users implement interface of 2 function – Map – Reduce • Map( in-key,in-value) (Out-key,intermediate-value) list • Reduce(Out-key,intermediate-value list) out_value list 18
  • 21. Big Data and Cloud Computing • Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over a network • In Business View: When it’s smarter to rent than to buy….. – ”If you only need milk, would you buy a cow? “ 21