SlideShare a Scribd company logo
Fahim Kawsar
Internet of Things Research
Network Driven Behaviour Modelling for Connected Living
Everything is Connected
2 Questions
Internet is all about Human Experience not Bits and Bytes!
What Human Experience will be defined by an IoT enabled World?
1980
1990
2000
2010
2014
7
8 5
6
If everything is connected why would you need a device?
Sense
Learn
Act
Zero Interaction and Zero UI and Ubiquitous Awareness
WiFi is the most Pervasive Sensor Network. Its available literally everywhere.
To what extent can we leverage existing wireless network as a sensing modality to understand
human context?
To what extent can we leverage existing wireless network as a platform for connected objects?
Sensorless Sensing with Wireless
Network
People-People
Interaction
Wireless network is the key fabric for designing connected human experiences
People-Object
Interaction
People-Content
Interaction
People-People
Interaction
People-Object
Interaction
People-Content
Interaction
”Energy Efficient Scheduling for Mobile Push Notifications”. MobiQuitous 2015
Push Notifications
 Network Driven Behaviour Modelling for Designing User Centred IoT Services
 Network Driven Behaviour Modelling for Designing User Centred IoT Services
 Network Driven Behaviour Modelling for Designing User Centred IoT Services
Push Notification and RRC State Machine
A mobile device is in the CELL_DCH state for a specific time period (which is called tail time)
without any or small data transmission after a data session, and this tail time corresponds to
60%of the total energy consumed by UE.
Bringing the Network into the Story
1 1 1 0
1 0 1 0
1 0 1 0
0 0 0 0
0 0 1 0
1 1 1 0
Day j-4 Day j-3 Day j-2 Day j-1
Look up day, Nl=4
T
12:00
12:01
12:02
.
.
.
.
23: 59
2 Selected Candidate Days
1
1
1
?
?
?
Day jc
Lookupwindow(Lk)
DSj-4=0.6 DSj-4=0.7
Over 75% of
network activity can be
predicted with accuracy
of over 80%
Discovering the Human Routine
Average
latency is 157
seconds.
±15% energy
can be saved by
buffering
notifications.
ô
RNC UE
UTRAN
GGSN SGSN
CN
Internet
Burst Detector
Deep Packet Inspector
Notification
Detector
Notification Scheduler
Prediction
Model
NS
Request
TTL
TTL
Push to Model
For Update
Request
Scheduler
People-People
Interaction
People-Object
Interaction
People-Content
Interaction
”Sensing WiFi Network for Personal IoT Analytics”. IoT 2015
Waste Pollution Traffic
Quantified Self Quantified Home Quantified City
Search for physical objects’ location and state is one of the basic services that provides foundation for many applications.
22
What we learnt in the past
Dedicated Sensing Infrastructure (ZigBee, RFID, Mote, etc.)
High deployment and management costs
Search range is limited to the smart phones’ proximity
Bluetooth Discovery with Smart Phone
23
Can WiFi network be used as a platform for personal IoT analytics?
Research Objective
Premise
Connected objects’ movement data extracted from WiFi network signals carries vital
information to model their spatio-temporal usage pattern
24
ôMobile Object Tags
Static Object Tags
Home Node
- Proximity Ranging Service
- Data Storage Service
EF5
Personal Object AnalyticsQuery Server
Anchor Points Query Service
Index Service
System Architecture
System Components
Object Tags
Attached to physical objects and emit the location and state-of-use of the physical objects.
Home Node
Hosted in the residential home gateways, provide proximity ranging service, and stores objects data.
Query Server
Hosted in the cloud, maintains persistent connection with home node and provides query interface to
personal analytics applications.
25
Prototype Personal IoT Analytics Application
“Quantify the Spatio-Temporal Usage of Personal Object”
IoT Analytics
G
26
Things Dashboard
Dashboard
• Shows realtime usage status
(pointer up or down)
• Offers search capability
27
Locate and Query Physical Objects
Timeline View
• Offers recent spatio-temporal
usage information
28
Realtime Insights on Spatio-Temporal Usage
Insight View
• Offers aggregated spatio-
temporal usage information
29
Gerd Kortuem and Fahim Kawsar "Market-based User Innovation
for the Internet of Things"; Internet of Things 2010 Conference
Afra Mashhadi, Fahim Kawsar, and Utku Acer
“Human Data Interaction in IoT: The Ownership Aspect;". The
IEEE World Forum on Internet of Things 2014
You Own Your Data, You Sell Your Data
• Our cloudlet based design scheme coupled with WiFi management frame based data transport
offer implicit privacy and data protection as Data remains in the home gateway and this provides
users with the control of their own data to do whatever they want to do with them – delete, sell
or share.
• An advantage of these design schemes is that, it opens up opportunity for wilful monetisation of
personal data
30
People-People
Interaction
People-Object 

Interaction
People-Content
Interaction
”Tiny Habits in the Giant Enterprise: Understanding the Dynamics of a Quantified Workplace”. UbiComp 2015
”Detecting Human Encounters from WiFi Radio Signals”. MUM 2015
Quantified Enterprise
Active Badge - Xerox | Cambridge U
That Privacy Thingy!
 Network Driven Behaviour Modelling for Designing User Centred IoT Services
Happiness Badge - Hitachi
Sociometer Badge - MIT
Spontaneous Interactions
Key to Flow of Ideas
A third of team performance can be
predicted merely by the number of Face
to Face exchanges among team
members.
The “data signature” of natural leaders
can be discovered.
Daily Productivity and Creativity can be
rightly assessed.
 Network Driven Behaviour Modelling for Designing User Centred IoT Services
“Only of large companies can make meaningful predictions about their workforces,
while can accurately predict business metrics such as budgets, financial
results, and expenses”
4%
90%
- Bersin Research
Employee Survey
Quantified Self Quantified Team Quantified Enterprise
People
Analytics
Productivity
Management
Space
Management
People
á
n
Places
7
Activity
Quantified Enterprise
Understand and quantify how people interact and work together
in the real enterprise for personal, group and larger
organisation efficiency.
• Personal Interaction Reflection
• Personal Network Scale and Diversity
• Personal Time and Activity Management
• Personal Connection Extension
For Employees
• Quantifying Collaboration
• Discover Emerging Leaders
• Build High Performance Team
• Develop Empathic Relationship
For Employers
• Predictive Maintenance
• Better Space Arrangement & Management
• Personalised Space Recommendation
• Better Resource Management
For Building Managers
Implications
A Network and Small Data Driven Solution
Smart Badge
Maps and Sensors
EF5
Enterprise Applications
ôQuantified Enterprise
Platform
Advanced Models
and Algorithms
API
Real time, network-based
indoor localisation
50x reduction in deployment and management cost
30x reduction in energy expenditure of mobile devices 



Radio Signal
Capturing
Copresence
Detection
Interaction
Inference
A network-centric
architecture that captures
existing radio signals (WiFi
probes) from the user’s
device.
Co-location detection based on
similarity of wireless channel
propagation characteristics.
An empirically defined model
grounded upon sociology
theories, by leveraging the size
and duration of the encounter.
Accuracy (Precision)
60%of Encounters Detected
90%
Location to Face to Face Interaction
Behaviour Modelling
Extracting high order behavioural traits
Location -> Face to Face Interaction
Location -> Personality
F2F Encounter Diversity, Number, Frequency, regularity and Spatial Behaviour are used to extract Big Five
Personality Traits
Location -> Happiness
Spatial Behaviour and Movement Trajectory are used to estimate Physical Activeness and then map to mental
wellbeing (baseline Happiness Index Survey)
This has been used to build connectivity graph and show collaboration intensity in the application.
Personal Application Experience
People
Analytics
á
Self Quantification @ Workspace
Timeline of Face to Face Interactions
Realtime Recommendation to New Contacts
Locating Colleagues and Empty Rooms at Realtime
Happiness Map of the Workspace
Playful Visualisation of the Workplace Mood
Collaboration Uncovered
Insights from Quantified Bell Labs (Dublin and Antwerp) Workplaces
3Secrets Revealed
Its all about
Relationship
Key to Engagement is the
visualisation of the
relationship structure
Subtle Hints
Users awareness of their collaboration
nature is crucial, however presentation
needs to subtle but meaningful
Recommend
Opportunities
Users are willing to compromise their
privacy when the value is higher.
Recommendations of right opportunities
are key to create that value
53
54
By 2018, two million employees will be required to wear health and
fitness tracking devices as a condition of employment.
- Gartner’s Prediction
Other Application Areas
55
Measuring Customer Happiness
Designing Experience for Future Conferences
30
Billion
Market Size
Monitoring Children’s Interaction and Detecting Early Signs of Autism
Monitoring Elderly People’s Interaction, Detecting Early Depression
Monitoring Depression and Bi-Polar Patients
People-People
Interaction
Wireless network is the key fabric for designing connected human experiences
People-Object
Interaction
People-Content
Interaction
Claudio Forlivesi Utku Acer
Afra Mashhadi
Fahim Kawsar
Akhil Mathur
Marc Van Den BroeckGeert Vanderhulst Marc Godon
Nic Lane Sourav Bhattacharaya Aidan Boran
Credit goes to …
Thank You
Fahim Kawsar
@raswak
eMail: fahim.kawsar@bell-labs.com

More Related Content

PDF
Quantified Workplace: Redefining Future Workplace Experience
PDF
Network Intelligence Driven Human Behavior Modeling
PDF
Designing UX for the Internet of Things
PDF
Sensing WiFi Network for Personal IoT Analytics
PDF
UbiComp 2013 Talk on Device Dynamics at Home
PDF
IoT 2010 Talk on System Infrastructure for the Internet of Things.
PDF
IoT 3.0 : Connected Living in an Everything-Digital World
PDF
Creative Media Days 2012 Talk on Opportunistic Activity Modeling
Quantified Workplace: Redefining Future Workplace Experience
Network Intelligence Driven Human Behavior Modeling
Designing UX for the Internet of Things
Sensing WiFi Network for Personal IoT Analytics
UbiComp 2013 Talk on Device Dynamics at Home
IoT 2010 Talk on System Infrastructure for the Internet of Things.
IoT 3.0 : Connected Living in an Everything-Digital World
Creative Media Days 2012 Talk on Opportunistic Activity Modeling

What's hot (20)

PDF
Earables for Personal-scale Behaviour Analytics
PDF
Research Talk at Bell Labs - IoT System Architecture and Interactions
PDF
The Story of Happy Brussels
PPTX
Arpan pal u world2012
PDF
The rise of digital humanitarianism
PDF
ACC-2012, Bangalore, India, 28 July, 2012
PPTX
Future of Technology in Social Media
PDF
IRJET- Gesture Recognition using Sixth Sense Technology
PDF
u world 2012, Dalian, China
PDF
The internet of things
PPTX
IndianaJS - Building spatially aware web sites for the Web of Things
PPTX
Getting Started with the Internet of Things - Allianz Hackrisk Hackathon 29/...
PPTX
Crowdsensing
PPTX
Internet of Things
PPT
Semantic Technologies for the Internet of Things: Challenges and Opportunities
PDF
Mobile Crowdsensing with Mobile Agents
PDF
Evanta 2018 msp big 3 tech
PDF
ambient-computing
PPTX
9/23 Top 5 Deep Learning
PDF
Now & Next - Mediacom
Earables for Personal-scale Behaviour Analytics
Research Talk at Bell Labs - IoT System Architecture and Interactions
The Story of Happy Brussels
Arpan pal u world2012
The rise of digital humanitarianism
ACC-2012, Bangalore, India, 28 July, 2012
Future of Technology in Social Media
IRJET- Gesture Recognition using Sixth Sense Technology
u world 2012, Dalian, China
The internet of things
IndianaJS - Building spatially aware web sites for the Web of Things
Getting Started with the Internet of Things - Allianz Hackrisk Hackathon 29/...
Crowdsensing
Internet of Things
Semantic Technologies for the Internet of Things: Challenges and Opportunities
Mobile Crowdsensing with Mobile Agents
Evanta 2018 msp big 3 tech
ambient-computing
9/23 Top 5 Deep Learning
Now & Next - Mediacom
Ad

Similar to Network Driven Behaviour Modelling for Designing User Centred IoT Services (20)

PDF
Computational Behaviour Modelling for the Internet of Things
PDF
Internet of Things - The Tip of the Iceberg or The Tipping Point
PPTX
Cps innovation lab kolkata iiest
PPTX
Io t research_arpanpal_iem
PDF
120": Future trends in IoT
PPTX
Group 4 IT INfrastructure Group presentation Final [Auto-saved].pptx
PPTX
Internet of Things
PDF
Sean gately internet of things
PPTX
Analytics as-a-service-io t-asia-arpanpal_sanitized
PDF
Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...
PPTX
Foresight Analytics
PPTX
Internet of Things
PPTX
Industrial Internet of Things (IIoT) – Exploring Career and Business Opportun...
PPTX
Analytics as-a-service-io t-asia-arpanpal
PDF
Future of m2 m iot m2m forum cee - vienna - 9 june 2015 lr
PDF
Dynamic clouds and networks without infrastructure
PDF
Making Meaningful Design with the Internet of Things
PPTX
EiTESAL IOT DAY 26-10-2016
PDF
Contextual Complexity in Meaningful Consent
PDF
The Internet of Things to 2020 (GSA white paper, October 2015)
Computational Behaviour Modelling for the Internet of Things
Internet of Things - The Tip of the Iceberg or The Tipping Point
Cps innovation lab kolkata iiest
Io t research_arpanpal_iem
120": Future trends in IoT
Group 4 IT INfrastructure Group presentation Final [Auto-saved].pptx
Internet of Things
Sean gately internet of things
Analytics as-a-service-io t-asia-arpanpal_sanitized
Understanding the Impact of Personal Feedback on Face-to-Face Interactions in...
Foresight Analytics
Internet of Things
Industrial Internet of Things (IIoT) – Exploring Career and Business Opportun...
Analytics as-a-service-io t-asia-arpanpal
Future of m2 m iot m2m forum cee - vienna - 9 june 2015 lr
Dynamic clouds and networks without infrastructure
Making Meaningful Design with the Internet of Things
EiTESAL IOT DAY 26-10-2016
Contextual Complexity in Meaningful Consent
The Internet of Things to 2020 (GSA white paper, October 2015)
Ad

Recently uploaded (20)

PDF
Approach and Philosophy of On baking technology
PDF
Getting Started with Data Integration: FME Form 101
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
Empathic Computing: Creating Shared Understanding
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Encapsulation theory and applications.pdf
PPTX
A Presentation on Artificial Intelligence
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
Approach and Philosophy of On baking technology
Getting Started with Data Integration: FME Form 101
Reach Out and Touch Someone: Haptics and Empathic Computing
20250228 LYD VKU AI Blended-Learning.pptx
Programs and apps: productivity, graphics, security and other tools
NewMind AI Weekly Chronicles - August'25-Week II
Empathic Computing: Creating Shared Understanding
Diabetes mellitus diagnosis method based random forest with bat algorithm
Spectral efficient network and resource selection model in 5G networks
Building Integrated photovoltaic BIPV_UPV.pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Encapsulation theory and applications.pdf
A Presentation on Artificial Intelligence
SOPHOS-XG Firewall Administrator PPT.pptx
Group 1 Presentation -Planning and Decision Making .pptx
The Rise and Fall of 3GPP – Time for a Sabbatical?
Per capita expenditure prediction using model stacking based on satellite ima...
MIND Revenue Release Quarter 2 2025 Press Release
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Mobile App Security Testing_ A Comprehensive Guide.pdf

Network Driven Behaviour Modelling for Designing User Centred IoT Services

  • 1. Fahim Kawsar Internet of Things Research Network Driven Behaviour Modelling for Connected Living
  • 4. Internet is all about Human Experience not Bits and Bytes!
  • 5. What Human Experience will be defined by an IoT enabled World?
  • 7. If everything is connected why would you need a device?
  • 8. Sense Learn Act Zero Interaction and Zero UI and Ubiquitous Awareness
  • 9. WiFi is the most Pervasive Sensor Network. Its available literally everywhere.
  • 10. To what extent can we leverage existing wireless network as a sensing modality to understand human context? To what extent can we leverage existing wireless network as a platform for connected objects? Sensorless Sensing with Wireless Network
  • 11. People-People Interaction Wireless network is the key fabric for designing connected human experiences People-Object Interaction People-Content Interaction
  • 17. Push Notification and RRC State Machine A mobile device is in the CELL_DCH state for a specific time period (which is called tail time) without any or small data transmission after a data session, and this tail time corresponds to 60%of the total energy consumed by UE.
  • 18. Bringing the Network into the Story
  • 19. 1 1 1 0 1 0 1 0 1 0 1 0 0 0 0 0 0 0 1 0 1 1 1 0 Day j-4 Day j-3 Day j-2 Day j-1 Look up day, Nl=4 T 12:00 12:01 12:02 . . . . 23: 59 2 Selected Candidate Days 1 1 1 ? ? ? Day jc Lookupwindow(Lk) DSj-4=0.6 DSj-4=0.7 Over 75% of network activity can be predicted with accuracy of over 80% Discovering the Human Routine
  • 20. Average latency is 157 seconds. ±15% energy can be saved by buffering notifications. ô RNC UE UTRAN GGSN SGSN CN Internet Burst Detector Deep Packet Inspector Notification Detector Notification Scheduler Prediction Model NS Request TTL TTL Push to Model For Update Request Scheduler
  • 22. Waste Pollution Traffic Quantified Self Quantified Home Quantified City Search for physical objects’ location and state is one of the basic services that provides foundation for many applications. 22
  • 23. What we learnt in the past Dedicated Sensing Infrastructure (ZigBee, RFID, Mote, etc.) High deployment and management costs Search range is limited to the smart phones’ proximity Bluetooth Discovery with Smart Phone 23
  • 24. Can WiFi network be used as a platform for personal IoT analytics? Research Objective Premise Connected objects’ movement data extracted from WiFi network signals carries vital information to model their spatio-temporal usage pattern 24
  • 25. ôMobile Object Tags Static Object Tags Home Node - Proximity Ranging Service - Data Storage Service EF5 Personal Object AnalyticsQuery Server Anchor Points Query Service Index Service System Architecture System Components Object Tags Attached to physical objects and emit the location and state-of-use of the physical objects. Home Node Hosted in the residential home gateways, provide proximity ranging service, and stores objects data. Query Server Hosted in the cloud, maintains persistent connection with home node and provides query interface to personal analytics applications. 25
  • 26. Prototype Personal IoT Analytics Application “Quantify the Spatio-Temporal Usage of Personal Object” IoT Analytics G 26
  • 27. Things Dashboard Dashboard • Shows realtime usage status (pointer up or down) • Offers search capability 27
  • 28. Locate and Query Physical Objects Timeline View • Offers recent spatio-temporal usage information 28
  • 29. Realtime Insights on Spatio-Temporal Usage Insight View • Offers aggregated spatio- temporal usage information 29
  • 30. Gerd Kortuem and Fahim Kawsar "Market-based User Innovation for the Internet of Things"; Internet of Things 2010 Conference Afra Mashhadi, Fahim Kawsar, and Utku Acer “Human Data Interaction in IoT: The Ownership Aspect;". The IEEE World Forum on Internet of Things 2014 You Own Your Data, You Sell Your Data • Our cloudlet based design scheme coupled with WiFi management frame based data transport offer implicit privacy and data protection as Data remains in the home gateway and this provides users with the control of their own data to do whatever they want to do with them – delete, sell or share. • An advantage of these design schemes is that, it opens up opportunity for wilful monetisation of personal data 30
  • 31. People-People Interaction People-Object 
 Interaction People-Content Interaction ”Tiny Habits in the Giant Enterprise: Understanding the Dynamics of a Quantified Workplace”. UbiComp 2015 ”Detecting Human Encounters from WiFi Radio Signals”. MUM 2015
  • 33. Active Badge - Xerox | Cambridge U
  • 36. Happiness Badge - Hitachi
  • 38. Spontaneous Interactions Key to Flow of Ideas A third of team performance can be predicted merely by the number of Face to Face exchanges among team members. The “data signature” of natural leaders can be discovered. Daily Productivity and Creativity can be rightly assessed.
  • 40. “Only of large companies can make meaningful predictions about their workforces, while can accurately predict business metrics such as budgets, financial results, and expenses” 4% 90% - Bersin Research Employee Survey
  • 41. Quantified Self Quantified Team Quantified Enterprise People Analytics Productivity Management Space Management People á n Places 7 Activity Quantified Enterprise Understand and quantify how people interact and work together in the real enterprise for personal, group and larger organisation efficiency.
  • 42. • Personal Interaction Reflection • Personal Network Scale and Diversity • Personal Time and Activity Management • Personal Connection Extension For Employees • Quantifying Collaboration • Discover Emerging Leaders • Build High Performance Team • Develop Empathic Relationship For Employers • Predictive Maintenance • Better Space Arrangement & Management • Personalised Space Recommendation • Better Resource Management For Building Managers Implications
  • 43. A Network and Small Data Driven Solution Smart Badge Maps and Sensors EF5 Enterprise Applications ôQuantified Enterprise Platform Advanced Models and Algorithms API Real time, network-based indoor localisation 50x reduction in deployment and management cost 30x reduction in energy expenditure of mobile devices 
 

  • 44. Radio Signal Capturing Copresence Detection Interaction Inference A network-centric architecture that captures existing radio signals (WiFi probes) from the user’s device. Co-location detection based on similarity of wireless channel propagation characteristics. An empirically defined model grounded upon sociology theories, by leveraging the size and duration of the encounter. Accuracy (Precision) 60%of Encounters Detected 90% Location to Face to Face Interaction
  • 45. Behaviour Modelling Extracting high order behavioural traits Location -> Face to Face Interaction Location -> Personality F2F Encounter Diversity, Number, Frequency, regularity and Spatial Behaviour are used to extract Big Five Personality Traits Location -> Happiness Spatial Behaviour and Movement Trajectory are used to estimate Physical Activeness and then map to mental wellbeing (baseline Happiness Index Survey) This has been used to build connectivity graph and show collaboration intensity in the application.
  • 48. Timeline of Face to Face Interactions
  • 50. Locating Colleagues and Empty Rooms at Realtime
  • 51. Happiness Map of the Workspace
  • 52. Playful Visualisation of the Workplace Mood
  • 53. Collaboration Uncovered Insights from Quantified Bell Labs (Dublin and Antwerp) Workplaces 3Secrets Revealed Its all about Relationship Key to Engagement is the visualisation of the relationship structure Subtle Hints Users awareness of their collaboration nature is crucial, however presentation needs to subtle but meaningful Recommend Opportunities Users are willing to compromise their privacy when the value is higher. Recommendations of right opportunities are key to create that value 53
  • 54. 54 By 2018, two million employees will be required to wear health and fitness tracking devices as a condition of employment. - Gartner’s Prediction
  • 57. Designing Experience for Future Conferences 30 Billion Market Size
  • 58. Monitoring Children’s Interaction and Detecting Early Signs of Autism
  • 59. Monitoring Elderly People’s Interaction, Detecting Early Depression
  • 60. Monitoring Depression and Bi-Polar Patients
  • 61. People-People Interaction Wireless network is the key fabric for designing connected human experiences People-Object Interaction People-Content Interaction
  • 62. Claudio Forlivesi Utku Acer Afra Mashhadi Fahim Kawsar Akhil Mathur Marc Van Den BroeckGeert Vanderhulst Marc Godon Nic Lane Sourav Bhattacharaya Aidan Boran Credit goes to …
  • 63. Thank You Fahim Kawsar @raswak eMail: fahim.kawsar@bell-labs.com