SlideShare a Scribd company logo
The Data Science behind Predictive
Maintenance in Connected Vehicles
Esther Vasiete
Srivatsan Ramanujam
Pivotal Data Science
Data Engineers Guild - Meetup
June-21, 2016
Picture credit (from L to R):
http://www.techlicious.com/blog/ericsson-mobility-report-internet-connected-devices/
http://www.mdpi.com/1424-8220/14/10/19260/htm
http://www.thehindubusinessline.com/info-tech/other-gadgets/care-for-a-connected-car/article5777444.ece
Devices are Increasingly Connected
The Data Science behind Predictive Maintenance for Connected Vehicles
How can these connected devices in our home be smart enough to make daily
life easier?
How does this…
…become this?
By recognizing this
And by processing this
Sensors + Other Unstructured Data
How can we know a tree has
fallen on a power line before
the residents complain?
How can we use data
to help prevent
accidents like the Macondo Disaster ?
Gene Sequencing
Smart Grids
COST TO SEQUENCE
ONE GENOME
HAS FALLEN FROM
$100M IN 2001
TO $10K IN 2011
TO $1K IN 2014
READING SMART METERS
EVERY 15 MINUTES IS
3000X MORE
DATA INTENSIVE
Stock Market
Social Media
FACEBOOK UPLOADS
250 MILLION
PHOTOS EACH DAY
In all industries billions of data points represent
opportunities for the Internet of Things
Oil Exploration
Video Surveillance
OIL RIGS GENERATE
25000
DATA POINTS
PER SECOND
Medical Imaging
Mobile Sensors
To realize this opportunity requires the right tools and
techniques
Problem
Formulation
Modeling Step
Data StepApps Step
The Data Science behind Predictive Maintenance for Connected Vehicles
Data Lake
Ingest
Business Levers
Dashboard/App
PL/X
Modeling•  Data cleaning
•  Data Exploration
•  Feature
Engineering
Model Validation
Feedback loop for
continuous
model improvement
Driver and
Vehicle Meta
Data
Data Ingestion
Platform
✔
✔ ✔ ✔ ✔✔ ✔ ✔
Data to Apps
Data Science
Use-cases for connected cars
1
Data Science Use-Cases
1
●  Predictive Car Maintenance
‒  More accurately predict part failure
‒  Optimize part repair and replacement schedule
●  Leveraging Driving Behaviour
‒  Useful to differentiate insurance pricing based on driving
style
‒  Optimize car design
●  Improving GPS Systems
‒  Establish baseline for traffic congestion
‒  Create more meaningful metrics for routing
‒  Infer public transportation effects on traffic
‒  Predict how long incidents would take to clear
●  Predictive Power for Assistance
Systems
‒  Optimize fuel efficiency
‒  Predict the future state of a car in the next 2
minutes (starts, stops, emergency braking)
●  Traffic Light Assistance
‒  Signal timing of traffic lights
‒  Crowd sourcing of traffic signals
‒  Optimize traffic light patterns to reduce congestion
Preventive Maintenance for
Connected Vehicles
1
On-Board Diagnostics
Diagnostic Trouble Codes (DTC)
Unscheduled repairs
AB1029 – Power steering pump replacement
CT3408 – Wheel alignment
Solving the preventive maintenance problem
Automakers
Customer
Satisfaction
Auto Repairs
Data Sources for Predictive Maintenance
VIN
Timestamp
DTC Code
Odometer
Speed
Acceleration
Engine Temperature
Engine Torque GPS
Coordinates
etc.
VIN
Date vehicle in
Date vehicle out
Repair code
Parts replaced
Warranty claims
Repair Comments
Vehicle Sensor Data Vehicle Repairs Data
Predicting Job Type from Diagnostic Trouble Codes
(DTCs)
Time
Job Type:
Transmission
Job Type:
Transmission
Engine
Job Type:
Regular check
DTC: B DTC:
B,
P, C
DTC: U
DTC: B DTC: B
DTC:
B, P, C, U
DTC:
P, B, U
DTC: P DTC: B DTC:
B,P
DTC:
B,P
Can the DTCs
observed here predict
this Job Type?
Can the DTCs observed
here predict this Job
Type?
Can the DTCs observed
here predict this Job
Type?
Predicting Job Type: a multi-class classification
problem
DF
12
10
DF
12
15
DF
29
80
AB
10
29
AB
16
22
AB
16
25
AB
86
22
CT
34
02
CT
34
08
CT
35
60
CT
24
09
Vehicle
Features
Two-stage Hierarchical Classification Framework
Vehicle
Features
DF
12
10
DF
12
15
DF
29
80
AB
10
29
AB
16
22
AB
16
25
AB
86
22
CT
34
02
CT
34
08
CT
35
60
CT
24
09
Model Parallelism
One or more job on the same day
Multi-labeling problem
One-vs-rest classifiers
built in parallel
1
0
0
1
0 1
0
Class 1
Class 2
Class 3
One-vs-Rest Classification
Red vs.
Non Red
On Segment 1
Green vs.
Non Green
On Segment 2
Blue vs.
Non Blue
On Segment N
•  Predictive maintenance problems are challenging because
DTC signals are not always symptomatic of an ensuing
repair.
•  Given the hierarchical nature of repair codes, we built a two
stage hierarchical classification framework comprising a top-
down cascade of classifiers.
•  Major system jobs can be predicted earlier to the repair
date.
Key Takeaways
Reference Architecture
%%publish
model info.
/
Microservices
(Spring Boot)
/load_model
/score_model
Spring Cloud Data Flow
vehicle data (streaming)
connector
exploratory data
analysis & model
training
Rabbit/Kafka
source
training (offline)
scoring (online)
/
web or mobile app dashboard
The Data Science behind Predictive Maintenance for Connected Vehicles

More Related Content

PDF
Girls Who Code in Data Science
PPTX
Data Science for predictive maintenance in connected vehicles
PDF
Smart Railways Predicative Maintenance of Door Subsystem
PDF
Smart traffic management system
PPTX
Automated Vehicles: lead or follow
PDF
SmartParking: A Secure and Intelligent Parking System Using NOTICE
PDF
Data management for OCMS and infra-electrical depots
PPTX
Intelligent Traffic monitoring System
Girls Who Code in Data Science
Data Science for predictive maintenance in connected vehicles
Smart Railways Predicative Maintenance of Door Subsystem
Smart traffic management system
Automated Vehicles: lead or follow
SmartParking: A Secure and Intelligent Parking System Using NOTICE
Data management for OCMS and infra-electrical depots
Intelligent Traffic monitoring System

What's hot (19)

PPTX
PDF
Smart Parking
PDF
All Aboard With Sendyne
DOCX
Smart traffic managment system real time (stmsrt)
PDF
Smart Fleet Management with IoT
PDF
Automotive Cybersecurity Challenges for Automated Vehicles: Jonathan Petit
PPTX
OOAD (1)
DOCX
Smart parking system
PDF
Smart parking
PPTX
Collision Communication System
PDF
Autonomous Driving, provable safety and scalability design principles - Erez ...
DOCX
A low cost and noninvasive system for the measurement and detection of faulty...
PPTX
Smart parking
PDF
Autonomous vehicles: becoming economically feasible through improvements in l...
PDF
IOT Based Smart Parking System
DOCX
Abstract
PDF
Smart parking system
PPSX
Oracle Embedded Connected Vehicle
PDF
IRJET- Smart Parking : Parking Occupancy Monitoring and Visualisation Syst...
Smart Parking
All Aboard With Sendyne
Smart traffic managment system real time (stmsrt)
Smart Fleet Management with IoT
Automotive Cybersecurity Challenges for Automated Vehicles: Jonathan Petit
OOAD (1)
Smart parking system
Smart parking
Collision Communication System
Autonomous Driving, provable safety and scalability design principles - Erez ...
A low cost and noninvasive system for the measurement and detection of faulty...
Smart parking
Autonomous vehicles: becoming economically feasible through improvements in l...
IOT Based Smart Parking System
Abstract
Smart parking system
Oracle Embedded Connected Vehicle
IRJET- Smart Parking : Parking Occupancy Monitoring and Visualisation Syst...
Ad

Viewers also liked (20)

PPTX
Data Science for Connected Vehicles
PDF
An Analytics Platform for Connected Vehicles
PPTX
Chattanooga sme oee down time presentation
PDF
Oee on hana overall equipment effectiveness overview aug 2012 (2)
PPT
Oee Explained
PDF
Cwin16 tls-faurecia predictive maintenance
PDF
Benefits of Collecting OEE Data with Production Tracking Software
PPT
Predictive Maintenance
PPTX
Integrating OEE and Process Improvement
PDF
Cortana Analytics Workshop: Predictive Maintenance in the IoT Era
PPTX
Design For OEE (DFOEE)
PPTX
Microservices: The Future-Proof Framework for IoT
PPTX
Predictive Maintenance by analysing acoustic data in an industrial environment
PPTX
MONETIZING THE CONNECTED CAR, Citi 2013 Connected Car Symposium
PPTX
Predictive Maintenance
PDF
The 7 deadly sins of Overall Equipment Effectiveness (OEE)
PDF
The Science of Predictive Maintenance: IBM's Predictive Analytics Solution
PDF
Oee guide
PPTX
6 OEE overview
Data Science for Connected Vehicles
An Analytics Platform for Connected Vehicles
Chattanooga sme oee down time presentation
Oee on hana overall equipment effectiveness overview aug 2012 (2)
Oee Explained
Cwin16 tls-faurecia predictive maintenance
Benefits of Collecting OEE Data with Production Tracking Software
Predictive Maintenance
Integrating OEE and Process Improvement
Cortana Analytics Workshop: Predictive Maintenance in the IoT Era
Design For OEE (DFOEE)
Microservices: The Future-Proof Framework for IoT
Predictive Maintenance by analysing acoustic data in an industrial environment
MONETIZING THE CONNECTED CAR, Citi 2013 Connected Car Symposium
Predictive Maintenance
The 7 deadly sins of Overall Equipment Effectiveness (OEE)
The Science of Predictive Maintenance: IBM's Predictive Analytics Solution
Oee guide
6 OEE overview
Ad

Similar to The Data Science behind Predictive Maintenance for Connected Vehicles (20)

PDF
IRJET- IoT based Smart BLACK BOX System
PDF
SMART E-TOLL SYSTEM
PDF
IoT based E-vehicle monitoring system using sensors and imaging processing a...
PDF
G041024547
PDF
IRJET- Smart Card Based Automated Toll Plaza System
PDF
IRJET- A Methodology: Iot Based Drowsy Driving Warning and Traffic Collis...
PDF
IRJET- Intelligent Traffic Management System
PDF
SMART SOLUTION FOR RESOLVING HEAVY TRAFFIC USING IOT
PDF
IRJET- Smart Vehicle with Crash Detection and Emergency Vehicle Dispatch with...
PPTX
CAV Smart Work Zones
PPTX
TEAM A edivhjdhiyitidoodotiiztkygkyoyozt.pptx
PDF
Autonomous Vehicles: Technologies, Economics, and Opportunities
PDF
Design and Implementation of Car Black box for Evidence Collection System to ...
PDF
IRJET- Congestion Reducing System through Sensors, Image Processors and Vanet...
PDF
VEHICLE TO VEHICLE COMMUNICATION FOR ACCIDENT-AVOIDANCE SYSTEM
PDF
A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...
PDF
IRJET - Electronic Turnpike Automation System with Penalty Analyzer
PDF
ppt of v2v.pdf last year final project entc
PDF
IRJET- Traffic Sign Recognition for Autonomous Cars
PDF
IRJET- Computerized Vehicle Number Plate Recognition and Fine Generation
IRJET- IoT based Smart BLACK BOX System
SMART E-TOLL SYSTEM
IoT based E-vehicle monitoring system using sensors and imaging processing a...
G041024547
IRJET- Smart Card Based Automated Toll Plaza System
IRJET- A Methodology: Iot Based Drowsy Driving Warning and Traffic Collis...
IRJET- Intelligent Traffic Management System
SMART SOLUTION FOR RESOLVING HEAVY TRAFFIC USING IOT
IRJET- Smart Vehicle with Crash Detection and Emergency Vehicle Dispatch with...
CAV Smart Work Zones
TEAM A edivhjdhiyitidoodotiiztkygkyoyozt.pptx
Autonomous Vehicles: Technologies, Economics, and Opportunities
Design and Implementation of Car Black box for Evidence Collection System to ...
IRJET- Congestion Reducing System through Sensors, Image Processors and Vanet...
VEHICLE TO VEHICLE COMMUNICATION FOR ACCIDENT-AVOIDANCE SYSTEM
A survey paper on Optimal Solution on Vehicular Adhoc Network for Congestion ...
IRJET - Electronic Turnpike Automation System with Penalty Analyzer
ppt of v2v.pdf last year final project entc
IRJET- Traffic Sign Recognition for Autonomous Cars
IRJET- Computerized Vehicle Number Plate Recognition and Fine Generation

Recently uploaded (20)

PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PPTX
Business Ppt On Nestle.pptx huunnnhhgfvu
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PPTX
oil_refinery_comprehensive_20250804084928 (1).pptx
PPTX
climate analysis of Dhaka ,Banglades.pptx
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PPTX
STUDY DESIGN details- Lt Col Maksud (21).pptx
PDF
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
PPT
ISS -ESG Data flows What is ESG and HowHow
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPTX
Database Infoormation System (DBIS).pptx
PPTX
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
PDF
Foundation of Data Science unit number two notes
PPTX
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
1_Introduction to advance data techniques.pptx
PPTX
Introduction to machine learning and Linear Models
PPTX
Qualitative Qantitative and Mixed Methods.pptx
PDF
annual-report-2024-2025 original latest.
PPT
Reliability_Chapter_ presentation 1221.5784
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
Business Ppt On Nestle.pptx huunnnhhgfvu
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
oil_refinery_comprehensive_20250804084928 (1).pptx
climate analysis of Dhaka ,Banglades.pptx
Introduction-to-Cloud-ComputingFinal.pptx
STUDY DESIGN details- Lt Col Maksud (21).pptx
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
ISS -ESG Data flows What is ESG and HowHow
IBA_Chapter_11_Slides_Final_Accessible.pptx
Database Infoormation System (DBIS).pptx
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
Foundation of Data Science unit number two notes
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
1_Introduction to advance data techniques.pptx
Introduction to machine learning and Linear Models
Qualitative Qantitative and Mixed Methods.pptx
annual-report-2024-2025 original latest.
Reliability_Chapter_ presentation 1221.5784

The Data Science behind Predictive Maintenance for Connected Vehicles

  • 1. The Data Science behind Predictive Maintenance in Connected Vehicles Esther Vasiete Srivatsan Ramanujam Pivotal Data Science Data Engineers Guild - Meetup June-21, 2016
  • 2. Picture credit (from L to R): http://www.techlicious.com/blog/ericsson-mobility-report-internet-connected-devices/ http://www.mdpi.com/1424-8220/14/10/19260/htm http://www.thehindubusinessline.com/info-tech/other-gadgets/care-for-a-connected-car/article5777444.ece Devices are Increasingly Connected
  • 4. How can these connected devices in our home be smart enough to make daily life easier?
  • 5. How does this… …become this? By recognizing this And by processing this Sensors + Other Unstructured Data
  • 6. How can we know a tree has fallen on a power line before the residents complain?
  • 7. How can we use data to help prevent accidents like the Macondo Disaster ?
  • 8. Gene Sequencing Smart Grids COST TO SEQUENCE ONE GENOME HAS FALLEN FROM $100M IN 2001 TO $10K IN 2011 TO $1K IN 2014 READING SMART METERS EVERY 15 MINUTES IS 3000X MORE DATA INTENSIVE Stock Market Social Media FACEBOOK UPLOADS 250 MILLION PHOTOS EACH DAY In all industries billions of data points represent opportunities for the Internet of Things Oil Exploration Video Surveillance OIL RIGS GENERATE 25000 DATA POINTS PER SECOND Medical Imaging Mobile Sensors
  • 9. To realize this opportunity requires the right tools and techniques Problem Formulation Modeling Step Data StepApps Step
  • 11. Data Lake Ingest Business Levers Dashboard/App PL/X Modeling•  Data cleaning •  Data Exploration •  Feature Engineering Model Validation Feedback loop for continuous model improvement Driver and Vehicle Meta Data Data Ingestion Platform ✔ ✔ ✔ ✔ ✔✔ ✔ ✔ Data to Apps
  • 12. Data Science Use-cases for connected cars 1
  • 13. Data Science Use-Cases 1 ●  Predictive Car Maintenance ‒  More accurately predict part failure ‒  Optimize part repair and replacement schedule ●  Leveraging Driving Behaviour ‒  Useful to differentiate insurance pricing based on driving style ‒  Optimize car design ●  Improving GPS Systems ‒  Establish baseline for traffic congestion ‒  Create more meaningful metrics for routing ‒  Infer public transportation effects on traffic ‒  Predict how long incidents would take to clear ●  Predictive Power for Assistance Systems ‒  Optimize fuel efficiency ‒  Predict the future state of a car in the next 2 minutes (starts, stops, emergency braking) ●  Traffic Light Assistance ‒  Signal timing of traffic lights ‒  Crowd sourcing of traffic signals ‒  Optimize traffic light patterns to reduce congestion
  • 15. On-Board Diagnostics Diagnostic Trouble Codes (DTC) Unscheduled repairs AB1029 – Power steering pump replacement CT3408 – Wheel alignment
  • 16. Solving the preventive maintenance problem Automakers Customer Satisfaction Auto Repairs
  • 17. Data Sources for Predictive Maintenance VIN Timestamp DTC Code Odometer Speed Acceleration Engine Temperature Engine Torque GPS Coordinates etc. VIN Date vehicle in Date vehicle out Repair code Parts replaced Warranty claims Repair Comments Vehicle Sensor Data Vehicle Repairs Data
  • 18. Predicting Job Type from Diagnostic Trouble Codes (DTCs) Time Job Type: Transmission Job Type: Transmission Engine Job Type: Regular check DTC: B DTC: B, P, C DTC: U DTC: B DTC: B DTC: B, P, C, U DTC: P, B, U DTC: P DTC: B DTC: B,P DTC: B,P Can the DTCs observed here predict this Job Type? Can the DTCs observed here predict this Job Type? Can the DTCs observed here predict this Job Type?
  • 19. Predicting Job Type: a multi-class classification problem DF 12 10 DF 12 15 DF 29 80 AB 10 29 AB 16 22 AB 16 25 AB 86 22 CT 34 02 CT 34 08 CT 35 60 CT 24 09 Vehicle Features
  • 20. Two-stage Hierarchical Classification Framework Vehicle Features DF 12 10 DF 12 15 DF 29 80 AB 10 29 AB 16 22 AB 16 25 AB 86 22 CT 34 02 CT 34 08 CT 35 60 CT 24 09
  • 21. Model Parallelism One or more job on the same day Multi-labeling problem One-vs-rest classifiers built in parallel 1 0 0 1 0 1 0 Class 1 Class 2 Class 3 One-vs-Rest Classification Red vs. Non Red On Segment 1 Green vs. Non Green On Segment 2 Blue vs. Non Blue On Segment N
  • 22. •  Predictive maintenance problems are challenging because DTC signals are not always symptomatic of an ensuing repair. •  Given the hierarchical nature of repair codes, we built a two stage hierarchical classification framework comprising a top- down cascade of classifiers. •  Major system jobs can be predicted earlier to the repair date. Key Takeaways
  • 23. Reference Architecture %%publish model info. / Microservices (Spring Boot) /load_model /score_model Spring Cloud Data Flow vehicle data (streaming) connector exploratory data analysis & model training Rabbit/Kafka source training (offline) scoring (online) / web or mobile app dashboard