SlideShare a Scribd company logo
2019.10.17
Asset Performance
Management using
Druid
BISTel 임정호 수석
APM… 이게 뭐죠?Part.1
산업군 전반의
1. What is APM? (2) 생산라인의 조립 로봇
(3) 물류센터의 컨베이어 벨트 모터
(1) 반도체 제조라인의 반송기
자산의 잔존수명 예측 & 예지정비
2. What is Asset?
Asset Performance Management
Flink
Metatron
Druid
Kafka
Docker
Kubernetes
AdvancedAPM
IndustrialIoTreal timehealth monitoring& analytics
Stream Flows
Metatron Asset Performance Management with IIoT
CloudService
CloudInfrastructure
DockerContainer (K8S)
Sensor data
Motor
sensing
data
Network
device
Robot
3rd-PartyIIoTEDGE
Devicesensordatacollect/datatransformation/monitoring
…
IIoT EDGE
APM Cloud Env.
Health Alarm
& monitoring
Model
Manager
Predictive
analytics
Asset meta
management
Collaborated
Prescription
Docker App
Management
Container Operation
& Management
Metatron eco.
Asset meta
Connector
Job
monitoring
Flow(Pipeline)
Management
Flink
Pipeline
Flink
Pipeline
Flink
Pipeline
Flink
Pipeline1. Data Stream Analysis
Discovery
Data Source
Management
Data Source
Explorer(Search)
Notebook
Connector
Cube(druid)
3. Visualization for raw & analyzed data2. Request for raw & analyzed data
metatron ecosystem APIGateway
APM… 뭘 할 수 있나요?Part.2
Fault Detectio
n
Fault
Classification
Dashboard
RUL Predictio
n
Real-Time
Monitoring
Data Analytics
• Rule-based Model
• Machine Learning based FD Model
• Domain-based Model (Current data)
• Multivariate Model (Statistical Model)
# Index
Data Source
Real-Time Summary
1 Fault Detection ●
2 SPC ●
3 Variation Detection ●
4 Parameter RUL ●
Phase1
Threshold by
Machine
Learning
Alarm Message
Phase2
Phase3
Fault Detectio
n
Fault
Classification
Dashboard
RUL Predictio
n
Real-Time
Monitoring
Data Analytics
• Parameter
• Asset Score
• Asset Alarm
Fault Detectio
n
Fault
Classification
Dashboard
RUL Predictio
n
Real-Time
Monitoring
Data Analytics
< Summary View >
• Total Asset Status
• Latest Alarm History
• Worst Performing Assets
• Worst Performing Parameters
< Asset Statistics >
• Total Asset Status
• Asset List
• Asset Status
• Parameter Analysis
• Remaining Useful Life (RUL)
• Total Alarm Count
< Alarm Statistics >
• Alarm Status Distribution
• Alarm Count
• Top5 Assets
• Top5 Parameters
• Top5 Subscribers
Fault Detectio
n
Fault
Classification
Dashboard
RUL Predictio
n
Real-Time
Monitoring
Data Analytics
Fault Classification using Vibration Spectrum Data
RMS Trend Chart
Spectrum Chart
Time Wave Chart
Vibration Data
Fault Detectio
n
Fault
Classification
Dashboard
RUL Predictio
n
Real-Time
Monitoring
Data Analytics
• Root Cause Analysis • Asset Matching
Motor #
7
Motor #
9
Motor #
2
Motor #
8
Fault Detectio
n
Fault
Classification
Dashboard
RUL Predictio
n
Real-Time
Monitoring
Data Analytics
Failure
Now Prediction for Failure
RUL: 10 days
Red : Linear Regression Model
Blue : Prediction Line
Green : Upper & Lower prediction interval
Druid… 어떻게 사용하나요?Part.3
Asset
Asset
Asset Template
 Type
 Custom attribute
(property)
 Asset Model (for score)
 Parameter Group (Sensor)
 Parameter Configuration
Create fromTemplate
MetatronIIoTEDGE
Source
(Kafka)
Sink
(Kafka)
Transform
Window
Aggregation
Model
Notification
Alarm
(Kafka)
Score
(Kafka)
Data(Stream) FlowPipeline metatron Discovery
Alarm
Score
Trace
Data Source
Mgmt.
1. Request tocollecttheasset data
2. Create stream pipeline
3. Create datasourcefromkafka
Asset
Kafka indexingservice
Kafka indexingservice
Kafkaindexingservice
Asset template A Asset template B
* Asset A-1
* Asset A-2 …
* Asset B-1
* Asset B-2 …
3rd-PartyIIoTEDGE
Source
(RAW DATA)
Transform
Model #1
Alarm
Alarm
(Kafka)
Asset
Score
Data(Stream) FlowPipeline
metatron Discovery
(Druid)
Alarm
Score
Trace
Trans Set #1
Transform Trans Set #N
Model #2
Model #N
3rd-PartyApp
Model #N
TransformRuleTask
Model EvaluationTask
AlarmRule Task
Kafka indexingservice
Kafka indexingservice
Kafka indexingservice
Alarm… 가짜가 있다!!!Part.4
AlarmDatasource
AlarmDatasource
AlarmGroup -MariaDB
AlarmDetail (Alarm Group)
AlarmGroup -MariaDB
Confidential
Copyright © 2018 BISTel,Inc. All rights reserved.
Thank You
BISTel Tower, 128 Baumoe-ro, Seocho-gu, Seoul, Korea
82 2 597 0911
marketing@bistel.com
www.bistel.com

More Related Content

PDF
Apache Spark and future of advanced analytics
PDF
Bigdata Machine Learning Platform
PPTX
Driverless Machine Learning Web App
PDF
Automated Time Series Analysis using Deep Learning, Ray and Analytics Zoo
PDF
Master the RETE algorithm
PDF
Building Interpretable & Secure AI Systems using PyTorch
PDF
Intelligent Monitoring
PDF
“A Distributed Operational and Informational Technological Stack”
Apache Spark and future of advanced analytics
Bigdata Machine Learning Platform
Driverless Machine Learning Web App
Automated Time Series Analysis using Deep Learning, Ray and Analytics Zoo
Master the RETE algorithm
Building Interpretable & Secure AI Systems using PyTorch
Intelligent Monitoring
“A Distributed Operational and Informational Technological Stack”

Similar to Asset performance management using Druid by Eric Lim, Bistel (20)

PPTX
Stabilising the jenga tower
PDF
Stabilizing the Jenga tower: Scaling out Ceilometer
PPTX
V like Velocity, Predicting in Real-Time with Azure ML
PDF
TimeSeries Machine Learning - PyData London 2025
PDF
SRE Certification and SRE Courses Online in India – Visualpath.pdf
PPT
“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools
PPTX
PreMonR - A Reactive Platform To Monitor Reactive Application
PPTX
DevOps Powered by Splunk
PPT
No[1][1]
PPTX
Instana Customer Presentation for apm monitoring
PDF
High Availability HPC ~ Microservice Architectures for Supercomputing
PDF
Proactive ops for container orchestration environments
PDF
Detecting Hacks: Anomaly Detection on Networking Data
PDF
Considerations for Abstracting Complexities of a Real-Time ML Platform, Zhenz...
PDF
YOW2018 Cloud Performance Root Cause Analysis at Netflix
PDF
Advanced Open IoT Platform for Prevention and Early Detection of Forest Fires
DOCX
AF-2599-P.docx
PPT
13 monitor-analyse-system
PPTX
Detecting Hacks: Anomaly Detection on Networking Data
PDF
Making Runtime Data Useful for Incident Diagnosis: An Experience Report
Stabilising the jenga tower
Stabilizing the Jenga tower: Scaling out Ceilometer
V like Velocity, Predicting in Real-Time with Azure ML
TimeSeries Machine Learning - PyData London 2025
SRE Certification and SRE Courses Online in India – Visualpath.pdf
“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools
PreMonR - A Reactive Platform To Monitor Reactive Application
DevOps Powered by Splunk
No[1][1]
Instana Customer Presentation for apm monitoring
High Availability HPC ~ Microservice Architectures for Supercomputing
Proactive ops for container orchestration environments
Detecting Hacks: Anomaly Detection on Networking Data
Considerations for Abstracting Complexities of a Real-Time ML Platform, Zhenz...
YOW2018 Cloud Performance Root Cause Analysis at Netflix
Advanced Open IoT Platform for Prevention and Early Detection of Forest Fires
AF-2599-P.docx
13 monitor-analyse-system
Detecting Hacks: Anomaly Detection on Networking Data
Making Runtime Data Useful for Incident Diagnosis: An Experience Report
Ad

More from Metatron (6)

PPTX
Realtime data processing with Flink and Druid by Youngpyo Lee, SKT
PPTX
[Metatron Discovery ex-pack] Anomaly Detection
PDF
[DDC 2018] Metatron 오픈소스화 및 생태계 구축 (SKT 이정룡, 김지호)
PDF
[DDC 2018] Democratize AI - Intelligent Cloud & Intelligent Edge (Microsoft, ...
PDF
[DDC 2018] 제조분야 AI/ML 적용 사례 (Bistel, 김현진)
PDF
[DDC 2018] 통신 데이터 분석환경 구축사례 (SKT, 홍태희)
Realtime data processing with Flink and Druid by Youngpyo Lee, SKT
[Metatron Discovery ex-pack] Anomaly Detection
[DDC 2018] Metatron 오픈소스화 및 생태계 구축 (SKT 이정룡, 김지호)
[DDC 2018] Democratize AI - Intelligent Cloud & Intelligent Edge (Microsoft, ...
[DDC 2018] 제조분야 AI/ML 적용 사례 (Bistel, 김현진)
[DDC 2018] 통신 데이터 분석환경 구축사례 (SKT, 홍태희)
Ad

Recently uploaded (20)

PDF
Global Data and Analytics Market Outlook Report
PPT
Predictive modeling basics in data cleaning process
PPTX
A Complete Guide to Streamlining Business Processes
PPTX
modul_python (1).pptx for professional and student
PDF
How to run a consulting project- client discovery
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PPTX
Introduction to Inferential Statistics.pptx
PPTX
SAP 2 completion done . PRESENTATION.pptx
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PDF
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
PPTX
Market Analysis -202507- Wind-Solar+Hybrid+Street+Lights+for+the+North+Amer...
PDF
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
PPTX
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
PPTX
STERILIZATION AND DISINFECTION-1.ppthhhbx
PPTX
IMPACT OF LANDSLIDE.....................
PPTX
retention in jsjsksksksnbsndjddjdnFPD.pptx
PDF
Data Engineering Interview Questions & Answers Batch Processing (Spark, Hadoo...
PDF
[EN] Industrial Machine Downtime Prediction
PPTX
QUANTUM_COMPUTING_AND_ITS_POTENTIAL_APPLICATIONS[2].pptx
PPTX
Managing Community Partner Relationships
Global Data and Analytics Market Outlook Report
Predictive modeling basics in data cleaning process
A Complete Guide to Streamlining Business Processes
modul_python (1).pptx for professional and student
How to run a consulting project- client discovery
Acceptance and paychological effects of mandatory extra coach I classes.pptx
Introduction to Inferential Statistics.pptx
SAP 2 completion done . PRESENTATION.pptx
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
Market Analysis -202507- Wind-Solar+Hybrid+Street+Lights+for+the+North+Amer...
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
STERILIZATION AND DISINFECTION-1.ppthhhbx
IMPACT OF LANDSLIDE.....................
retention in jsjsksksksnbsndjddjdnFPD.pptx
Data Engineering Interview Questions & Answers Batch Processing (Spark, Hadoo...
[EN] Industrial Machine Downtime Prediction
QUANTUM_COMPUTING_AND_ITS_POTENTIAL_APPLICATIONS[2].pptx
Managing Community Partner Relationships

Asset performance management using Druid by Eric Lim, Bistel