SlideShare a Scribd company logo
ADVANCED TOOLS IN REAL TIME ANALYTICS
AND AI IN CUSTOMER SUPPORT
TOM ŽUMER
MILAN SIMAKOVIĆ
AGENDA
• Lambda architecture
• Stream processing pipeline
• Apache Kafka
• Realtime data processors
• Graphic ETL tools
• AI in Customer support
AGENDA
www.ibis-instruments.com
What we do
SOFTWARE
DEVELOPMENT
Our products
SOLUTIONS IPI – Ibis
Performance
Insights
FOI -
Field
Operation
s
Insights
Description
Ibis
Risk Analytics
Technologi
es
iCEM Mobile Network
Advanced
Analytics (5G)
Machine
Learning use cases
Ibis
Data Lake
E2E Network
monitoring and
analytics solution.
Deep monitoring for:
Docsis/HFC, IPDR, PNM,
WiFi optimization, MPL
S,
UPS, DSL, GPON, TR069,
Mobile Network.
Centralized
monitoring and
control of Field
Operations.
Analytics over
measurement data.
Risk analysis for
banks:
- Calculation of
IFRS9 in one
system.
-Scoring/Rating
tool.
- EWS tool.
Ibis Data Lake - a
reference
architecture for
implementing
Data Lake by Ibis
best practice,
allows data-based
innovation.
A modern solution
for managing
customer
experience based on
analytics for
Telecommunication
providers and other
industries.
An advanced
mobile network
analysis, with a
focus on today's
and future
challenges.
Realization of
different use cases
based on machine
learning such as:
- Churn prevention,
- Smart pricing
- Next best offer.
Work in progress
Advanced tools in real time analytics and AI in customer support - Milan Simakovic, Tom Zumer
Usecases
DWH
Card
transactions
Shopping
Realtime
processing
Overdraft
?
Credit
card?
Realtime credits – Is it
possible?
LAMBDAARCHITECTURE
LAMBDA ARCHITECTURE
DWH
Data
ingestion /
integration
Data storing (Data lake) Data access and
processing
Data visualization
Realtime
Real-Time
Stream Processing
Data lake (HDFS)
NoSQL (HBase)
Relational (Kudu)
Data analytics

Batch processing
(MapReduce, Hive Pig,
Spark, Hue)
SQL (Impala)
Search (SOLR)
Machine Learning, Data
mining, Statistics
Collaboration,
Data exploaration
Batch
Shell
Python Perl
Custom
Visualizations
CRM
Campaign
mgmt
SMSC
Call center
IVR
Realtime Integrations
BI
CDH
Unified Services (Resource management – YARN, Security – Sentry and Record) Kerberos – authentication
Workflow scheduler
Integrated data management and governance – Cloudera navogator Cluster management – Cloudera
manager
IBIS DATA
LAKE ARCHITECTURE
A STREAM PROCESSING PIPELINE
ASTREAMPROCESSINGPIPELINE
collect log analyze serve and store
Advanced tools in real time analytics and AI in customer support - Milan Simakovic, Tom Zumer
source: Pluralsight
REAL TIME PROCESSING
• Process continuous data streams
• Reduce time increase
information value
• Filter only useful bits
• Streaming is a much more natural
model
REALTIMEPROCESSING
APACHE FLINK
• Framework and distributed processing
engine
• Process Unbounded and Bounded Data
• Leverage In-Memory Performance
• Building Blocks for Streaming Applications
• How does Flink support data pipelines?
APACHEFLINK
APACHE BEAM
APACHEBEAM
• open source unified programming model to define and
execute data processing pipelines
ETLs be like…
ETLsbelike…
Advanced tools in real time analytics and AI in customer support - Milan Simakovic, Tom Zumer
NifiFlow
TomŽumer
AGENDA
•Implementation of AI in customer support
www.creapro.si
EKWB
• EKWB is a premium liquid cooling manufacturer
• Founded in 1999 by Edvard König
• Their products are available in more than 30 countries worldwide
• EKWB offers a full range of products for end users and enterprise as well
• Some of the products are cooling systems (CPU and GPU), fittings, radiators,
water blocks, reservoirs, pumps
EKWB
• EKWB uses Zendesk customer
support software
• It offers interactions between
customers and EKWB support team
through so called tickets
• Customers create tickets where they
describe their questions with EKWB
products/orders
Zendesk
ZENDESK
Tickets
• Tickets are resolved by EKWB support groups
• There are two EKWB support groups:
• Technical
• Shipping
• There are three different categories of tickets:
• Technical
• Shipping
• AND GENERAL!!!
TICKETS
Challenges
Manual assignment of tickets to
support groups
Faster reply time to more critical
tickets
Which agent is going to reply
unassigned tickets
CHALLENGES
Solution
• Automatic ticket classification to Support or Technical
team
• Calculation of ticket priority
• Algorithm for automatic ticket assignment
SOLUTION
IS IT REALLY ?!?
84%
57%
25%
91%
55%
30%
Workflow process
WORKFLOWPROCESS
Support Team Classification
• Challenges:
• Preparing training and test set
• Validation of results
• Implementation of model in working process
• It‘s a NLP problem!
• We used BERT embeddings for text
representations
• Model classifies tickets with SVM algorithm
• We achieved balanced accuracy of 89,33%!
SUPPORTTEAMCLASSIFICATION
AND WE ARE IMPROVING
IT!!!
Automatic Priority Calculation
• Goal was to prepare ticket priority
evaluation
• EKWB team had to mark tickets on
scale 1-5 for few months!
• Tickets need to be ranked by their
priority so that tickets with higher
priority are solved sooner
• QUESTION: classification || regression?
• Model evaluates ticket on scale 1-100%
PRIORITYCALCULATION
4 5
6,4% 40,2
%
5
34,7%
Automatic Agent Assignment
• Who is going to solve next ticket?
• Person with the least tickets?
• Person with least high priority tickets?
• How to know which agent is active?
• Our system smartly assigns tickets to one of
active agents
• Trying to find balance
AGENTASSIGNMENT
Future Work
• Dockerize everything!!!
• Automatic cancelation of orders based on tickets
• Connection with ERP system
• Automatic responses
(or at least semi automatic)
• DEEP THOUGHT
*Hitchhikers guide to the galaxy
FUTUREWORK
THANK YOU.
Automation is driving the decline
of banal and repetitive tasks.
- Amber Rudd

More Related Content

PPTX
Automation anywhere
PPTX
Finance Hosting Benefits
PPTX
How to Quickly Create Effective Plant-Floor Screens
PPTX
Design Like a Pro: Alarm Management
PPTX
Webinar: APPSeCONNECT Product Release 2018 - A Sneak Peek at Cloud Integration
PPTX
Abhaya_Resume_Summary
PPTX
Wetzel - Utilizing Technology Session - SCASFAA 50th
PPTX
Orsyp Dollar Universe - Performance Management for SAP
Automation anywhere
Finance Hosting Benefits
How to Quickly Create Effective Plant-Floor Screens
Design Like a Pro: Alarm Management
Webinar: APPSeCONNECT Product Release 2018 - A Sneak Peek at Cloud Integration
Abhaya_Resume_Summary
Wetzel - Utilizing Technology Session - SCASFAA 50th
Orsyp Dollar Universe - Performance Management for SAP

What's hot (20)

PPTX
Top 5 .NET Challenges, Performance Monitoring Tips & Tricks
PPTX
Securely Monitor Critical Systems From Anywhere
PDF
Reconnect17 PeopleSoft Supply Chain Management SIG Meeting
PDF
Business Analytics as a Service
PPTX
10 Steps to Architecting a Sustainable SCADA System
PDF
Document Capture: Never Touch a Document Again
PPTX
Unified Reactive Platform
PPTX
Boost Operational Efficiency with New OEE Software
PPTX
Holistic Approach To Monitoring
PDF
Webinar Slides: How Samsung ARTIK Serves Global IoT Customers in the Cloud
PDF
AppSphere 15 - Performance and Scalability Optimizations - Xerox Government H...
PPTX
Technology insights: Decision Science Platform
PPTX
Webinar: Salesforce Customization using Visualforce and Lightning Component F...
PDF
How to Manage Cloud Based Computing Products #pcdub
PPTX
Migrate to platform of your choice
PPTX
12 Ways to Use PLCs & SQL Databases Together
PDF
Tips on Moving from Sage 300 Financial Reporter to Sage Intelligence
PPTX
The Path to a Pain-Free Control System Upgrade
PPTX
Sap solution manager 7.0 by knack it training
PPTX
Automation anywhere interview question
Top 5 .NET Challenges, Performance Monitoring Tips & Tricks
Securely Monitor Critical Systems From Anywhere
Reconnect17 PeopleSoft Supply Chain Management SIG Meeting
Business Analytics as a Service
10 Steps to Architecting a Sustainable SCADA System
Document Capture: Never Touch a Document Again
Unified Reactive Platform
Boost Operational Efficiency with New OEE Software
Holistic Approach To Monitoring
Webinar Slides: How Samsung ARTIK Serves Global IoT Customers in the Cloud
AppSphere 15 - Performance and Scalability Optimizations - Xerox Government H...
Technology insights: Decision Science Platform
Webinar: Salesforce Customization using Visualforce and Lightning Component F...
How to Manage Cloud Based Computing Products #pcdub
Migrate to platform of your choice
12 Ways to Use PLCs & SQL Databases Together
Tips on Moving from Sage 300 Financial Reporter to Sage Intelligence
The Path to a Pain-Free Control System Upgrade
Sap solution manager 7.0 by knack it training
Automation anywhere interview question
Ad

Similar to Advanced tools in real time analytics and AI in customer support - Milan Simakovic, Tom Zumer (20)

PPTX
SplunkLive! Utrecht 2016 - NXP
PPTX
Integrating IBM Z and IBM i Operational Intelligence Into Splunk, Elastic, an...
PDF
Presentacion day f-core v1.2.1.2-technical - english
PDF
ITMAGINATION - competences, facts, technologies, clients
ODP
Decisions Management use case : Telecom Customer Support Automation
PPTX
A machine learning and data science pipeline for real companies
PPT
Informix & IWA : Operational analytics performance
PDF
Productionising Machine Learning Models
PDF
Dances with bits - industrial data analytics made easy!
PDF
Moving a Fraud-Fighting Random Forest from scikit-learn to Spark with MLlib, ...
PDF
i feature :: intelligent machining systems (ENG)
PPT
Paktel
PDF
A Practical Guide to Selecting a Stream Processing Technology
PDF
Opus Overview Deck - October 2024_ClientReady.pdf
PPTX
Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...
PDF
Lessons Learned from Building Enterprise APIs (Gustaf Nyman)
PDF
Hitech_Esoft_Brochure
PDF
The Pursuit of Happiness: Building a Scalable Pipeline Using Apache Spark and...
PPTX
VTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
PDF
Digital transformation slideshare
SplunkLive! Utrecht 2016 - NXP
Integrating IBM Z and IBM i Operational Intelligence Into Splunk, Elastic, an...
Presentacion day f-core v1.2.1.2-technical - english
ITMAGINATION - competences, facts, technologies, clients
Decisions Management use case : Telecom Customer Support Automation
A machine learning and data science pipeline for real companies
Informix & IWA : Operational analytics performance
Productionising Machine Learning Models
Dances with bits - industrial data analytics made easy!
Moving a Fraud-Fighting Random Forest from scikit-learn to Spark with MLlib, ...
i feature :: intelligent machining systems (ENG)
Paktel
A Practical Guide to Selecting a Stream Processing Technology
Opus Overview Deck - October 2024_ClientReady.pdf
Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...
Lessons Learned from Building Enterprise APIs (Gustaf Nyman)
Hitech_Esoft_Brochure
The Pursuit of Happiness: Building a Scalable Pipeline Using Apache Spark and...
VTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
Digital transformation slideshare
Ad

More from Institute of Contemporary Sciences (20)

PDF
First 5 years of PSI:ML - Filip Panjevic
PPTX
Building valuable (online and offline) Data Science communities - Experience ...
PPT
Data Science Master 4.0 on Belgrade University - Drazen Draskovic
PPTX
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
PPTX
Solving churn challenge in Big Data environment - Jelena Pekez
PDF
Application of Business Intelligence in bank risk management - Dimitar Dilov
PPTX
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
PPTX
Recommender systems for personalized financial advice from concept to product...
PPTX
Complex AI forecasting methods for investments portfolio optimization - Pawel...
PPTX
From Zero to ML Hero for Underdogs - Amir Tabakovic
PDF
Data and data scientists are not equal to money david hoyle
PPSX
The price is right - Tomislav Krizan
PPTX
When it's raining gold, bring a bucket - Andjela Culibrk
PPTX
Reality and traps of real time data engineering - Milos Solujic
PPTX
Sensor networks for personalized health monitoring - Vladimir Brusic
PDF
Improving Data Quality with Product Similarity Search
PPTX
Prediction of good patterns for future sales using image recognition
PPTX
Using data to fight corruption: full budget transparency in local government
PPTX
Geospatial Analysis and Open Data - Forest and Climate
PPTX
Machine Learning-Driven Injury Prediction for a Professional Sports Team
First 5 years of PSI:ML - Filip Panjevic
Building valuable (online and offline) Data Science communities - Experience ...
Data Science Master 4.0 on Belgrade University - Drazen Draskovic
Deep learning fast and slow, a responsible and explainable AI framework - Ahm...
Solving churn challenge in Big Data environment - Jelena Pekez
Application of Business Intelligence in bank risk management - Dimitar Dilov
Trends and practical applications of AI/ML in Fin Tech industry - Milos Kosan...
Recommender systems for personalized financial advice from concept to product...
Complex AI forecasting methods for investments portfolio optimization - Pawel...
From Zero to ML Hero for Underdogs - Amir Tabakovic
Data and data scientists are not equal to money david hoyle
The price is right - Tomislav Krizan
When it's raining gold, bring a bucket - Andjela Culibrk
Reality and traps of real time data engineering - Milos Solujic
Sensor networks for personalized health monitoring - Vladimir Brusic
Improving Data Quality with Product Similarity Search
Prediction of good patterns for future sales using image recognition
Using data to fight corruption: full budget transparency in local government
Geospatial Analysis and Open Data - Forest and Climate
Machine Learning-Driven Injury Prediction for a Professional Sports Team

Recently uploaded (20)

PPTX
climate analysis of Dhaka ,Banglades.pptx
PPTX
oil_refinery_comprehensive_20250804084928 (1).pptx
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PDF
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
PDF
Fluorescence-microscope_Botany_detailed content
PDF
Galatica Smart Energy Infrastructure Startup Pitch Deck
PPT
Reliability_Chapter_ presentation 1221.5784
PPTX
Moving the Public Sector (Government) to a Digital Adoption
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PDF
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
PDF
Launch Your Data Science Career in Kochi – 2025
PPTX
IB Computer Science - Internal Assessment.pptx
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPT
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
PPTX
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
PPTX
Supervised vs unsupervised machine learning algorithms
PDF
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PPTX
MODULE 8 - DISASTER risk PREPAREDNESS.pptx
climate analysis of Dhaka ,Banglades.pptx
oil_refinery_comprehensive_20250804084928 (1).pptx
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
Fluorescence-microscope_Botany_detailed content
Galatica Smart Energy Infrastructure Startup Pitch Deck
Reliability_Chapter_ presentation 1221.5784
Moving the Public Sector (Government) to a Digital Adoption
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
Launch Your Data Science Career in Kochi – 2025
IB Computer Science - Internal Assessment.pptx
Introduction-to-Cloud-ComputingFinal.pptx
IBA_Chapter_11_Slides_Final_Accessible.pptx
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
Supervised vs unsupervised machine learning algorithms
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
Data_Analytics_and_PowerBI_Presentation.pptx
MODULE 8 - DISASTER risk PREPAREDNESS.pptx

Advanced tools in real time analytics and AI in customer support - Milan Simakovic, Tom Zumer

  • 1. ADVANCED TOOLS IN REAL TIME ANALYTICS AND AI IN CUSTOMER SUPPORT TOM ŽUMER MILAN SIMAKOVIĆ
  • 2. AGENDA • Lambda architecture • Stream processing pipeline • Apache Kafka • Realtime data processors • Graphic ETL tools • AI in Customer support AGENDA www.ibis-instruments.com
  • 4. Our products SOLUTIONS IPI – Ibis Performance Insights FOI - Field Operation s Insights Description Ibis Risk Analytics Technologi es iCEM Mobile Network Advanced Analytics (5G) Machine Learning use cases Ibis Data Lake E2E Network monitoring and analytics solution. Deep monitoring for: Docsis/HFC, IPDR, PNM, WiFi optimization, MPL S, UPS, DSL, GPON, TR069, Mobile Network. Centralized monitoring and control of Field Operations. Analytics over measurement data. Risk analysis for banks: - Calculation of IFRS9 in one system. -Scoring/Rating tool. - EWS tool. Ibis Data Lake - a reference architecture for implementing Data Lake by Ibis best practice, allows data-based innovation. A modern solution for managing customer experience based on analytics for Telecommunication providers and other industries. An advanced mobile network analysis, with a focus on today's and future challenges. Realization of different use cases based on machine learning such as: - Churn prevention, - Smart pricing - Next best offer. Work in progress
  • 8. Data ingestion / integration Data storing (Data lake) Data access and processing Data visualization Realtime Real-Time Stream Processing Data lake (HDFS) NoSQL (HBase) Relational (Kudu) Data analytics Batch processing (MapReduce, Hive Pig, Spark, Hue) SQL (Impala) Search (SOLR) Machine Learning, Data mining, Statistics Collaboration, Data exploaration Batch Shell Python Perl Custom Visualizations CRM Campaign mgmt SMSC Call center IVR Realtime Integrations BI CDH Unified Services (Resource management – YARN, Security – Sentry and Record) Kerberos – authentication Workflow scheduler Integrated data management and governance – Cloudera navogator Cluster management – Cloudera manager IBIS DATA LAKE ARCHITECTURE
  • 9. A STREAM PROCESSING PIPELINE ASTREAMPROCESSINGPIPELINE collect log analyze serve and store
  • 12. REAL TIME PROCESSING • Process continuous data streams • Reduce time increase information value • Filter only useful bits • Streaming is a much more natural model REALTIMEPROCESSING
  • 13. APACHE FLINK • Framework and distributed processing engine • Process Unbounded and Bounded Data • Leverage In-Memory Performance • Building Blocks for Streaming Applications • How does Flink support data pipelines? APACHEFLINK
  • 14. APACHE BEAM APACHEBEAM • open source unified programming model to define and execute data processing pipelines
  • 18. TomŽumer AGENDA •Implementation of AI in customer support www.creapro.si
  • 19. EKWB • EKWB is a premium liquid cooling manufacturer • Founded in 1999 by Edvard König • Their products are available in more than 30 countries worldwide • EKWB offers a full range of products for end users and enterprise as well • Some of the products are cooling systems (CPU and GPU), fittings, radiators, water blocks, reservoirs, pumps EKWB
  • 20. • EKWB uses Zendesk customer support software • It offers interactions between customers and EKWB support team through so called tickets • Customers create tickets where they describe their questions with EKWB products/orders Zendesk ZENDESK
  • 21. Tickets • Tickets are resolved by EKWB support groups • There are two EKWB support groups: • Technical • Shipping • There are three different categories of tickets: • Technical • Shipping • AND GENERAL!!! TICKETS
  • 22. Challenges Manual assignment of tickets to support groups Faster reply time to more critical tickets Which agent is going to reply unassigned tickets CHALLENGES
  • 23. Solution • Automatic ticket classification to Support or Technical team • Calculation of ticket priority • Algorithm for automatic ticket assignment SOLUTION IS IT REALLY ?!? 84% 57% 25% 91% 55% 30%
  • 25. Support Team Classification • Challenges: • Preparing training and test set • Validation of results • Implementation of model in working process • It‘s a NLP problem! • We used BERT embeddings for text representations • Model classifies tickets with SVM algorithm • We achieved balanced accuracy of 89,33%! SUPPORTTEAMCLASSIFICATION AND WE ARE IMPROVING IT!!!
  • 26. Automatic Priority Calculation • Goal was to prepare ticket priority evaluation • EKWB team had to mark tickets on scale 1-5 for few months! • Tickets need to be ranked by their priority so that tickets with higher priority are solved sooner • QUESTION: classification || regression? • Model evaluates ticket on scale 1-100% PRIORITYCALCULATION 4 5 6,4% 40,2 % 5 34,7%
  • 27. Automatic Agent Assignment • Who is going to solve next ticket? • Person with the least tickets? • Person with least high priority tickets? • How to know which agent is active? • Our system smartly assigns tickets to one of active agents • Trying to find balance AGENTASSIGNMENT
  • 28. Future Work • Dockerize everything!!! • Automatic cancelation of orders based on tickets • Connection with ERP system • Automatic responses (or at least semi automatic) • DEEP THOUGHT *Hitchhikers guide to the galaxy FUTUREWORK
  • 29. THANK YOU. Automation is driving the decline of banal and repetitive tasks. - Amber Rudd