SlideShare a Scribd company logo
Architecting IoT systems with
Machine Learning
Rudradeb Mitra | https://www.linkedin.com/in/mitrar/
Data Science Summer Conference
The vision of IoT by Intel https://www.youtube.com/watch?v=rnDey89wp_M&t=31s
How many of you live in this home?
Data Summer Conf 2018, “Architecting IoT system with Machine Learning (ENG)” — Rudradeb Mitra, Product Mentor at Google Developers
What do I want talk about?
• How to build consumer adopted IoT products?
• Through stories of my experiences
• Some problems you can solve!
My 15 years on and off affair with IoT
connecting the dots...
2003, Bremen, Germany
RoboCup Japan
2003, Bremen, Germany
To solar adoption through satellite images
The story of IoT from 2003-2018
IoT
So what went wrong...
Consumer IoT systems
Database
View data
What are the problems?
• Viewing past data has almost no value
• Most IoT startups ended up just collecting big data
• Very few killer applications which creates x5-x10 value
Hidden cost of IoT
Relational Data Time series 'Big' Data
(activity, time)(name, address)
Relational legacy
data
Big data (eg time-series data)
Database
eg. Postgres
Database
eg. Mongo,
Casandra
Application logic (to split and combine data into
relational / non-relational part)
User Query
SQL query Time series
data query
Database architecture of IoT
@copyright: Rudradeb Mitra
Data Volume and Speed
@copyright: Rudradeb Mitra
For adoption technology needs to cross
the chasm
• You have to solve a real problem for them.
Build painkillers, not vitamins!
So how to cross the chasm?
Let me tell you a story...story from one of my startup
Driver’s app
Record a trip Trip feedback
Goals &
challenges
Rewards
Results
Over 4Mkm driving data
IoT Architecture
Database
Engagement
Add a switch to turn off/onView Trip
• Incentivizing

• Nudging 

• Not forced
What is missing?
Do you think majority will adopt?
Data Summer Conf 2018, “Architecting IoT system with Machine Learning (ENG)” — Rudradeb Mitra, Product Mentor at Google Developers
When there is nothing else, Machine Learning comes to rescue!
What is Machine Learning?
• "learn patterns from data without explicitly being programmed"
Why is Machine Learning useful?
Data Summer Conf 2018, “Architecting IoT system with Machine Learning (ENG)” — Rudradeb Mitra, Product Mentor at Google Developers
IoT Architecture with Machine Learning
Database
Gamification
Social Engagement
Add a switch to turn off/onView Trip
Predictive +
Analytics
Machine Learning
Algo
@copyright: Rudradeb Mitra
What are the values?
• Find risky drivers and adjust their premiums so that majoity pay less
• Predict short and long term future to make roads safer by changing
behaviors
Lets see using Machine Learning (esp. Neural Nets)
1. Can we find patterns of risky drivers?
Patterns of risky drivers - Clustering
Picture taken from: http://www.ai-junkie.com/ann/som/som1.html
Find patterns in data
Self Organizing Maps (Clustering)
0.1
0.3
- Euclidean Distance between
training vector and weights
- The best match node is selected
- Adjust weights of neighboring nodes
to match this weight
0.55
0.15
0.31
0.49
Training
Data
0.6
0.9
0.8
@copyright: Rudradeb Mitra
Picture taken from http://www.ai-junkie.com/ann/som/som1.html
Most risky drivers
Most safe drivers
For the driving example
And how is that helpful?
• Premiums can be adjusted according to driving behavior and thus
majority will end up paying less
2. Can we go further and predict short term future?
word2vec- Predicting next word
word2vec
- Does not understand words or
grammar
How
Feeling
You
Are
Today
Input words
embeddings
Predicted next word
Hidden
Layer
Output word
embedding
Word2vec Word embeddings
X.WI.WO
Example
word xi
N= 2
0
0
0
1
0 0.3 0 0.7 0 ... 0
0.1
0.77
0.39
.
.
0 0.29 0 0.55 0 ...0.3
0.5
0
Wi =
Wo =
Word embedding for Xi = X. Wi . Wo
Word embedding Xi = [0.33 ... 0.64 ]
0
0
0
1
X =
word2vec - 2d space
- Output matrix to 2
dimension using Principal
component Analysis
Picture taken from https://www.lucypark.kr/courses/2015-ba/text-mining.html
Germany - France + Paris
= Berlin
Prediction for drivers
score acceleration on Friday
score braking on Friday
word2vec
- Using the semantic association
between orders
(Product ID)
(Predicted score on
Sunday)
score braking on Saturday
score speed on Saturday
And how is that helpful?
• Advance short term warnings making roads safer and saving lifes
3. And what about long term future?
RNN
Y0
X0
RNN
Y1
X1
RNN
Y2
X2
RNN
Y3
X3
RNN
Y4
X4
Long Short Term Memory
Cell state
Picture taken from http://colah.github.io/posts/2015-08-Understanding-LSTMs/
NN NN NN
f
NN
Forget
gate
Input
gate
Output
gate
New information
Forget an old
information
Updated
information
added
@copyright: Rudradeb Mitra
LSTM
cell
LSTM
cell
LSTM
cell
Score Score Score
Driving history
Time 1 Time 2 Time 3
@copyright: Rudradeb Mitra
And how is that helpful?
• Provide nudging techniques to change behaviors
To summarize
• Roads safer
• Adjust premiums saving money
• Incentive to good behaviors
Who will benefit
• Majority of people like you and me, who are GOOD drivers!
What other applications are out there?
03/06/2010
2010, Prague, Czech Republic
What can we achieve?
• Machine Learning can predict your future consumption (short term,
long term).
• If I know how much I will consume, I can save money and save
electricity!
Who will benefit
to people who have been left behind...
Decentralized solar energy
Output
Fully
connected
pooled
feature maps
pooled
feature maps
feature
maps
feature
maps
Input
image
32x32
Convolutions
6@28x28
Subsampling Convolutions Subsampling
6@14x14 16@10x10 16@5x5
Convolutional Neural Networks
Who will benefit
to people who have been left behind...
Healthcare
Database
Gamification
Add a switch to turn off
Not to punish, social encouragement
Learning Algorithm
@copyright: Rudradeb Mitra
What can we achieve?
• If I know advance health warning, I can save lives!
• Medical cost can do down
Retail
Future
@copyright: Rudradeb Mitra
IoT needs Machine Learning
for adoption
Feel free to contact:

https://www.linkedin.com/in/mitrar/

mitra.rudradeb@gmail.com

More Related Content

PPTX
Helsinki 20180314 v2
PPTX
Helsinki 20180314 v5
PPTX
Tutorial helsinki 20180313 v1
PPTX
Helsinki 20180314 v6
PDF
Big data analytics and building intelligent applications
PPTX
Helsinki 20180314 v7
PDF
Human-in-the-loop in IoT Systems
PDF
Machine Learning and Internet of Things
Helsinki 20180314 v2
Helsinki 20180314 v5
Tutorial helsinki 20180313 v1
Helsinki 20180314 v6
Big data analytics and building intelligent applications
Helsinki 20180314 v7
Human-in-the-loop in IoT Systems
Machine Learning and Internet of Things

What's hot (9)

PDF
Cognitive IoT using DeepLearning on data parallel frameworks like Spark & Flink
PDF
Soumith Chintala at AI Frontiers: A Dynamic View of the Deep Learning World
PDF
Big Data Expo 2015 - Itility Grasduinen in data met machine learning
PDF
Machine Learning for Everyone
PPTX
Introduction to machine learning november 25, 2017
PDF
Machine Learning Meetup SOF: Intro to ML
PDF
AI Basics for Professionals to Help Begin Their AI Journey
PPT
Computer Sciences Lab
PDF
Hoe een efficiënte Machine of Deep Learning backend ontwikkelen?
Cognitive IoT using DeepLearning on data parallel frameworks like Spark & Flink
Soumith Chintala at AI Frontiers: A Dynamic View of the Deep Learning World
Big Data Expo 2015 - Itility Grasduinen in data met machine learning
Machine Learning for Everyone
Introduction to machine learning november 25, 2017
Machine Learning Meetup SOF: Intro to ML
AI Basics for Professionals to Help Begin Their AI Journey
Computer Sciences Lab
Hoe een efficiënte Machine of Deep Learning backend ontwikkelen?
Ad

Similar to Data Summer Conf 2018, “Architecting IoT system with Machine Learning (ENG)” — Rudradeb Mitra, Product Mentor at Google Developers (20)

PPTX
rsec2a-2016-jheaton-morning
PDF
Predictive Analytics to the rescue of IoT
PPTX
Introduction-to-Artificiefgerwgergtergeteetetgfger gfrner jf ergejg kjg byurk...
PPTX
The deep learning technology on coco framework
PDF
Notes from Coursera Deep Learning courses by Andrew Ng
PDF
Data Mining algorithms PPT with Overview explanation.
PPTX
Advanced Analytics and Data Science Expertise
PPTX
Applications of machine learning
PDF
لموعد الإثنين 03 يناير 2022 143 مبادرة #تواصل_تطوير المحاضرة ال 143 من المباد...
PDF
Machine_Learning_with_MATLAB_Seminar_Latest.pdf
PDF
Big Data & Artificial Intelligence
PDF
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017
PPTX
Applications of artificial intelligence
PDF
Predictive Maintenance Using Recurrent Neural Networks
PPTX
Machine learning applications nurturing growth of various business domains
PDF
Big data 2.0, deep learning and financial Usecases
PDF
Provectus - main machine learning systems and their usage
PDF
TRAFFIC FORECAST FOR INTELLECTUAL TRANSPORTATION SYSTEM USING MACHINE LEARNING
PDF
Using Deep Learning to do Real-Time Scoring in Practical Applications
PDF
Moving Forward with AI - as presented at the Prosessipäivät 2018
rsec2a-2016-jheaton-morning
Predictive Analytics to the rescue of IoT
Introduction-to-Artificiefgerwgergtergeteetetgfger gfrner jf ergejg kjg byurk...
The deep learning technology on coco framework
Notes from Coursera Deep Learning courses by Andrew Ng
Data Mining algorithms PPT with Overview explanation.
Advanced Analytics and Data Science Expertise
Applications of machine learning
لموعد الإثنين 03 يناير 2022 143 مبادرة #تواصل_تطوير المحاضرة ال 143 من المباد...
Machine_Learning_with_MATLAB_Seminar_Latest.pdf
Big Data & Artificial Intelligence
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017
Applications of artificial intelligence
Predictive Maintenance Using Recurrent Neural Networks
Machine learning applications nurturing growth of various business domains
Big data 2.0, deep learning and financial Usecases
Provectus - main machine learning systems and their usage
TRAFFIC FORECAST FOR INTELLECTUAL TRANSPORTATION SYSTEM USING MACHINE LEARNING
Using Deep Learning to do Real-Time Scoring in Practical Applications
Moving Forward with AI - as presented at the Prosessipäivät 2018
Ad

More from Provectus (20)

PPTX
Choosing the right IDP Solution
PPTX
Intelligent Document Processing in Healthcare. Choosing the Right Solutions.
PPTX
Choosing the Right Document Processing Solution for Healthcare Organizations
PPTX
MLOps and Data Quality: Deploying Reliable ML Models in Production
PPTX
AI Stack on AWS: Amazon SageMaker and Beyond
PPTX
Feature Store as a Data Foundation for Machine Learning
PPTX
MLOps and Reproducible ML on AWS with Kubeflow and SageMaker
PPTX
Cost Optimization for Apache Hadoop/Spark Workloads with Amazon EMR
PPTX
ODSC webinar "Kubeflow, MLFlow and Beyond — augmenting ML delivery" Stepan Pu...
PDF
"Building a Modern Data platform in the Cloud", Alex Casalboni, AWS Dev Day K...
PDF
"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...
PDF
"Automating AWS Infrastructure with PowerShell", Martin Beeby, AWS Dev Day Ky...
PDF
"Analyzing your web and application logs", Javier Ramirez, AWS Dev Day Kyiv 2...
PDF
"Resiliency and Availability Design Patterns for the Cloud", Sebastien Storma...
PDF
"Architecting SaaS solutions on AWS", Oleksandr Mykhalchuk, AWS Dev Day Kyiv ...
PDF
"Developing with .NET Core on AWS", Martin Beeby, AWS Dev Day Kyiv 2019
PDF
"How to build real-time backends", Martin Beeby, AWS Dev Day Kyiv 2019
PDF
"Integrate your front end apps with serverless backend in the cloud", Sebasti...
PDF
"Scaling ML from 0 to millions of users", Julien Simon, AWS Dev Day Kyiv 2019
PPTX
How to implement authorization in your backend with AWS IAM
Choosing the right IDP Solution
Intelligent Document Processing in Healthcare. Choosing the Right Solutions.
Choosing the Right Document Processing Solution for Healthcare Organizations
MLOps and Data Quality: Deploying Reliable ML Models in Production
AI Stack on AWS: Amazon SageMaker and Beyond
Feature Store as a Data Foundation for Machine Learning
MLOps and Reproducible ML on AWS with Kubeflow and SageMaker
Cost Optimization for Apache Hadoop/Spark Workloads with Amazon EMR
ODSC webinar "Kubeflow, MLFlow and Beyond — augmenting ML delivery" Stepan Pu...
"Building a Modern Data platform in the Cloud", Alex Casalboni, AWS Dev Day K...
"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...
"Automating AWS Infrastructure with PowerShell", Martin Beeby, AWS Dev Day Ky...
"Analyzing your web and application logs", Javier Ramirez, AWS Dev Day Kyiv 2...
"Resiliency and Availability Design Patterns for the Cloud", Sebastien Storma...
"Architecting SaaS solutions on AWS", Oleksandr Mykhalchuk, AWS Dev Day Kyiv ...
"Developing with .NET Core on AWS", Martin Beeby, AWS Dev Day Kyiv 2019
"How to build real-time backends", Martin Beeby, AWS Dev Day Kyiv 2019
"Integrate your front end apps with serverless backend in the cloud", Sebasti...
"Scaling ML from 0 to millions of users", Julien Simon, AWS Dev Day Kyiv 2019
How to implement authorization in your backend with AWS IAM

Recently uploaded (20)

PPTX
climate analysis of Dhaka ,Banglades.pptx
PDF
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
PPTX
Introduction to Knowledge Engineering Part 1
PDF
Business Analytics and business intelligence.pdf
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PDF
Mega Projects Data Mega Projects Data
PPTX
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PPTX
Computer network topology notes for revision
PDF
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PPTX
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
PPTX
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
PPTX
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
PDF
.pdf is not working space design for the following data for the following dat...
PDF
Lecture1 pattern recognition............
PPTX
Introduction to machine learning and Linear Models
climate analysis of Dhaka ,Banglades.pptx
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
Introduction to Knowledge Engineering Part 1
Business Analytics and business intelligence.pdf
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
Mega Projects Data Mega Projects Data
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
Data_Analytics_and_PowerBI_Presentation.pptx
Computer network topology notes for revision
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
.pdf is not working space design for the following data for the following dat...
Lecture1 pattern recognition............
Introduction to machine learning and Linear Models

Data Summer Conf 2018, “Architecting IoT system with Machine Learning (ENG)” — Rudradeb Mitra, Product Mentor at Google Developers