SlideShare a Scribd company logo
Yassine LASRI - Product Manager
Septembre 26, 2019
Introducing Elastic Stack for
Telecom Analytics
2
Yassine LASRI
Product Manager - Analytics
Synapticiel (www.synapticiel.co)
Telecoms Engineer
+12, Senior Architect BSS/OSS, Analytics
Revenue Assurance & Fraud Management
@ylasri
@lasri
3
Housekeeping & Logistics
Attendees are automatically muted when joining Zoom
Ask questions for us in the Zoom chat during the webinar
Slides & Recording will be available after the webinar
Q/A will be at the end of the webinar
4
Agenda
1) Telecom Data Challenges.
2) Quick Elastic Stack Overview.
3) High Level Architecture Example.
4) Demo
5) Q/A
5
TelecomData Challenges
Network Operations
Subscribers Behavior
Complex & Diverse
Events Data Sources
Valuable
Business insights
Major Challenges
Network Optimizing
QoS & SLA, CEM
Fraud (Assurance)
Smart Marketing
Product Innovation
6
NoSQL is better at
“scaling out” than RDBMS
Issue #2 : Capex & Opex Cost
Example : Oracle's Enterprise Edition Plus Business
Intelligence Suite lists at $221,2500 per processor How do you build
Distributed
H. Scalable,
Search/Analytics
platform ?
Issue #1 : RDBMS fails to support Big Data
Scaling "out" with RDBMS is not possible
Open Source NoSQL
Elastic Stack Overview
7
8
ELASTICSEARCH
High Level Architecture
9
Anatomy of Logstash Pipeline
Multiples sources (S&U)
Network Logs
Mediation Files
Queues
Beats
RDBMS
….
Multiples Transformations
Normalization
Enrichment
Corrélations
Aggregation
Pseudonymization
….
Multiples Outputs
Files Distribution
Elasticsearch Ingest
….
10
Elastic Stack {Demo}
Demo Use Case/Context :
Generated full 24H prepaid voice charging events (Ercicsson CCN node)
Simulate medium Operator
Stages:
High Level example of logstash pipeline
Kibana data discovery, visualization & dashboarding
Elasticsearch data frames & entity-centric index (Starting version 7.3.0)
Yassine LASRI - Product Manager
Septembre 26, 2019
Webinar : Introducing Elastic
Stack for Telecom Analytics
(Q&A Session)
12
Encrypted communications (inside/outside cluster)
Built-in authentication realms & IP-based authorization
Role-based access control (Index, Document & Field level access)
Security is free, starting in
versions 6.8.0 and 7.1.0
Role-based access control (RBAC)
Access can be restricted to resources :
Indices
Aliases
Documents
Fields
Users
Cluster
13
14
X-Pack Open Code
15
Elastic Stack Features
16
Elasticsearch Scaling
16
17
Elasticsearch Resiliency/HA
PUT /cortex_ocs_data
{
"settings" : {
"index.default_pipeline": "cortex_data_ingest",
"index" : {
"number_of_shards" : 5,
"number_of_replicas" : 1,
"refresh_interval" : "10s"
}
},
"mappings": {
"properties": {
"@timestamp": {"type": "date"},
"event_id": {"type": "keyword"},
"event_type": {"type": "keyword"},
"caller_party_number": {"type": "keyword"},
"called_party_number": {"type": "keyword"},
"duration": {"type": "long"}
}
}
}
18
Elasticsearch CCR/DR
19
Elasticsearch CCR/DR
20
Elasticsearch CCR/DR
21
Elasticsearch CCR/DR
22
Analytics for The Network
Dominate Telco Deployments
In order to understand where vendors are gaining traction with
products which included Advanced analytics, AI and Automation
(A3), it is useful to look beyond the vendor PowerPoint ☺ - at
published case studies and press releases.
Main Findings
45% of the press releases/case studies related to the network
36% specifically to network management and assurance
The relative maturity of using ML in campaign management and the
reduction in hype around consumer chatbots meant that there was less
case study materials seen in this 2018/19 analysis period than might be
expected.
Increased activity was seen in field service workforce management, the
contact center and digital channels.
Source : https://charlottepatrick.uk/most-popular-a3-projects-in-2018-19/
23
Beats (Logs & Security Analytics)
Audit data Auditbeat
Log files Filebeat
Cloud data Functionbeat
Availability Heartbeat
Systemd Linux journals Journalbeat
Metrics Metricbeat
Network traffic Packetbeat
Windows event logs Winlogbeat
24
Logstash Input
25
Logstash Filter
26
Logstash Output
27
Logstash Pipeline

More Related Content

PDF
Empowering agencies using Elastic as a Service inside Government
PPTX
Elastic community Abidjan #225 meetup 08 May 2021
PDF
Monitoring and Securing a Geo-Dispersed Data Center at Hill AFB
PPTX
IoT meets AI in the Clouds
PDF
Achieving cyber mission assurance with near real-time impact
PDF
The Elastic Evolution of CenturyLink’s Network Management System
PDF
Countering Threats with the Elastic Stack at CERDEC/ARL
PDF
Building Resilient and Scalable Data Pipelines by Decoupling Compute and Storage
Empowering agencies using Elastic as a Service inside Government
Elastic community Abidjan #225 meetup 08 May 2021
Monitoring and Securing a Geo-Dispersed Data Center at Hill AFB
IoT meets AI in the Clouds
Achieving cyber mission assurance with near real-time impact
The Elastic Evolution of CenturyLink’s Network Management System
Countering Threats with the Elastic Stack at CERDEC/ARL
Building Resilient and Scalable Data Pipelines by Decoupling Compute and Storage

What's hot (20)

PDF
Loading Data into Azure SQL DW (Synapse Analytics)
PDF
Elastic @ Adobe: Making Search Smarter with Machine Learning at Scale
PDF
Search for all with Elastic Enterprise Search
PDF
Migrate and Modernize Hadoop-Based Security Policies for Databricks
PPTX
Aeris + Cassandra: An IOT Solution Helping Automakers Make the Connected Car ...
PDF
Keynote: Looping through data, insight, and action
PDF
Elastic at KPN
PDF
ECS: Delivering Better Cyber Intelligence and Compliance
PDF
Meetup introduction to elastic stack - search at scale - skilledfield slide...
PDF
Infrastructure monitoring made easy, from ingest to insight
PPTX
Azure synapse analytics overview elasta cloud3
PDF
CSG’s Journey with Elastic
PDF
Modernizing deployment in any environment with Elastic
PDF
Kubernetes Jakarta Meetup 010 - Service Mesh Observability with Kiali
PDF
How eStruxture Data Centers is Using ECE to Rapidly Scale Their Business
PPTX
Blockchain in Practice
PDF
Powering Postbank Group’s Data-driven Strategy
PPTX
CI/CD for a Data Platform
PDF
Big Data Day LA 2016/ NoSQL track - Architecting Real Life IoT Architecture, ...
PDF
Search for All with Elastic Enterprise Search
Loading Data into Azure SQL DW (Synapse Analytics)
Elastic @ Adobe: Making Search Smarter with Machine Learning at Scale
Search for all with Elastic Enterprise Search
Migrate and Modernize Hadoop-Based Security Policies for Databricks
Aeris + Cassandra: An IOT Solution Helping Automakers Make the Connected Car ...
Keynote: Looping through data, insight, and action
Elastic at KPN
ECS: Delivering Better Cyber Intelligence and Compliance
Meetup introduction to elastic stack - search at scale - skilledfield slide...
Infrastructure monitoring made easy, from ingest to insight
Azure synapse analytics overview elasta cloud3
CSG’s Journey with Elastic
Modernizing deployment in any environment with Elastic
Kubernetes Jakarta Meetup 010 - Service Mesh Observability with Kiali
How eStruxture Data Centers is Using ECE to Rapidly Scale Their Business
Blockchain in Practice
Powering Postbank Group’s Data-driven Strategy
CI/CD for a Data Platform
Big Data Day LA 2016/ NoSQL track - Architecting Real Life IoT Architecture, ...
Search for All with Elastic Enterprise Search
Ad

Similar to Webinar elastic stack {on telecom} english webinar part (1) (20)

PDF
What's new at Elastic: Update on major initiatives and releases
PDF
What's new at Elastic: Update on major initiatives and releases
PDF
Keynote: Elastic Observability evolution and vision
PDF
Elastic Stack keynote
PDF
Elastic Observability keynote
PDF
Combining Logs, Metrics, and Traces for Unified Observability
PPTX
ELK Solutions Enablement Session - 17th March'2020
PPTX
Elasticsearch meetup final_2014_04
PDF
Public sector keynote
PDF
Keynote : évolution et vision d'Elastic Observability
PDF
Capgemini: Observability within the Dutch government
PDF
Cloud-native application monitoring powered by Riverbed and Elasticsearch
PDF
Explore Elasticsearch and Why It’s Worth Using
PDF
Realizing your AIOps goals with machine learning in Elastic
PDF
The Elastic clients: Recent developments
PDF
Keynote: Making search better, faster, easier
PDF
Elasticsearch: From development to production in 15 minutes
PDF
Observability at scale: Hear from the Elastic Cloud SRE team
PDF
Managing the Elastic Stack at Scale
PDF
[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...
What's new at Elastic: Update on major initiatives and releases
What's new at Elastic: Update on major initiatives and releases
Keynote: Elastic Observability evolution and vision
Elastic Stack keynote
Elastic Observability keynote
Combining Logs, Metrics, and Traces for Unified Observability
ELK Solutions Enablement Session - 17th March'2020
Elasticsearch meetup final_2014_04
Public sector keynote
Keynote : évolution et vision d'Elastic Observability
Capgemini: Observability within the Dutch government
Cloud-native application monitoring powered by Riverbed and Elasticsearch
Explore Elasticsearch and Why It’s Worth Using
Realizing your AIOps goals with machine learning in Elastic
The Elastic clients: Recent developments
Keynote: Making search better, faster, easier
Elasticsearch: From development to production in 15 minutes
Observability at scale: Hear from the Elastic Cloud SRE team
Managing the Elastic Stack at Scale
[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...
Ad

Recently uploaded (20)

PPTX
Strings in CPP - Strings in C++ are sequences of characters used to store and...
PPTX
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PPT
Project quality management in manufacturing
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
PPTX
additive manufacturing of ss316l using mig welding
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PPTX
web development for engineering and engineering
PDF
composite construction of structures.pdf
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PDF
Model Code of Practice - Construction Work - 21102022 .pdf
PDF
PPT on Performance Review to get promotions
PPTX
Internet of Things (IOT) - A guide to understanding
PPTX
Construction Project Organization Group 2.pptx
PPTX
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
Strings in CPP - Strings in C++ are sequences of characters used to store and...
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
Project quality management in manufacturing
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
additive manufacturing of ss316l using mig welding
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
web development for engineering and engineering
composite construction of structures.pdf
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
UNIT-1 - COAL BASED THERMAL POWER PLANTS
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
Model Code of Practice - Construction Work - 21102022 .pdf
PPT on Performance Review to get promotions
Internet of Things (IOT) - A guide to understanding
Construction Project Organization Group 2.pptx
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd

Webinar elastic stack {on telecom} english webinar part (1)

  • 1. Yassine LASRI - Product Manager Septembre 26, 2019 Introducing Elastic Stack for Telecom Analytics
  • 2. 2 Yassine LASRI Product Manager - Analytics Synapticiel (www.synapticiel.co) Telecoms Engineer +12, Senior Architect BSS/OSS, Analytics Revenue Assurance & Fraud Management @ylasri @lasri
  • 3. 3 Housekeeping & Logistics Attendees are automatically muted when joining Zoom Ask questions for us in the Zoom chat during the webinar Slides & Recording will be available after the webinar Q/A will be at the end of the webinar
  • 4. 4 Agenda 1) Telecom Data Challenges. 2) Quick Elastic Stack Overview. 3) High Level Architecture Example. 4) Demo 5) Q/A
  • 5. 5 TelecomData Challenges Network Operations Subscribers Behavior Complex & Diverse Events Data Sources Valuable Business insights Major Challenges Network Optimizing QoS & SLA, CEM Fraud (Assurance) Smart Marketing Product Innovation
  • 6. 6 NoSQL is better at “scaling out” than RDBMS Issue #2 : Capex & Opex Cost Example : Oracle's Enterprise Edition Plus Business Intelligence Suite lists at $221,2500 per processor How do you build Distributed H. Scalable, Search/Analytics platform ? Issue #1 : RDBMS fails to support Big Data Scaling "out" with RDBMS is not possible Open Source NoSQL
  • 9. 9 Anatomy of Logstash Pipeline Multiples sources (S&U) Network Logs Mediation Files Queues Beats RDBMS …. Multiples Transformations Normalization Enrichment Corrélations Aggregation Pseudonymization …. Multiples Outputs Files Distribution Elasticsearch Ingest ….
  • 10. 10 Elastic Stack {Demo} Demo Use Case/Context : Generated full 24H prepaid voice charging events (Ercicsson CCN node) Simulate medium Operator Stages: High Level example of logstash pipeline Kibana data discovery, visualization & dashboarding Elasticsearch data frames & entity-centric index (Starting version 7.3.0)
  • 11. Yassine LASRI - Product Manager Septembre 26, 2019 Webinar : Introducing Elastic Stack for Telecom Analytics (Q&A Session)
  • 12. 12 Encrypted communications (inside/outside cluster) Built-in authentication realms & IP-based authorization Role-based access control (Index, Document & Field level access) Security is free, starting in versions 6.8.0 and 7.1.0
  • 13. Role-based access control (RBAC) Access can be restricted to resources : Indices Aliases Documents Fields Users Cluster 13
  • 17. 17 Elasticsearch Resiliency/HA PUT /cortex_ocs_data { "settings" : { "index.default_pipeline": "cortex_data_ingest", "index" : { "number_of_shards" : 5, "number_of_replicas" : 1, "refresh_interval" : "10s" } }, "mappings": { "properties": { "@timestamp": {"type": "date"}, "event_id": {"type": "keyword"}, "event_type": {"type": "keyword"}, "caller_party_number": {"type": "keyword"}, "called_party_number": {"type": "keyword"}, "duration": {"type": "long"} } } }
  • 22. 22 Analytics for The Network Dominate Telco Deployments In order to understand where vendors are gaining traction with products which included Advanced analytics, AI and Automation (A3), it is useful to look beyond the vendor PowerPoint ☺ - at published case studies and press releases. Main Findings 45% of the press releases/case studies related to the network 36% specifically to network management and assurance The relative maturity of using ML in campaign management and the reduction in hype around consumer chatbots meant that there was less case study materials seen in this 2018/19 analysis period than might be expected. Increased activity was seen in field service workforce management, the contact center and digital channels. Source : https://charlottepatrick.uk/most-popular-a3-projects-in-2018-19/
  • 23. 23 Beats (Logs & Security Analytics) Audit data Auditbeat Log files Filebeat Cloud data Functionbeat Availability Heartbeat Systemd Linux journals Journalbeat Metrics Metricbeat Network traffic Packetbeat Windows event logs Winlogbeat