SlideShare a Scribd company logo
Real-time Multimedia Monitoring in
Large-Scale Wireless Multimedia Sensor
    Networks: Research Challenges
    Joint work by:
    M.Cesana, A.Redondi – Politecnico di Milano
    N. Tiglao, A. Grilo – INESC-ID/INOV/IST
    J. M. Barcelo-Ordinas, M. Alaei – Universitat Politecnica de Catalunya
    P. Todorova – Fraunhofer FOKUS
MWMSN Project

   Multi-tier Wireless Multimedia Sensor
  Networks
   Goal: To enable support for enhanced
  monitoring and tracking applications through
  multimedia visual/audio wireless sensor nodes




                  NGI 2012, Karlskrona, Sweden    2
Outline

   Introduction
   Real-time multimedia monitoring applications
   Efficient delivery of visual data in WMSNs
     MAC Layer
     Network Layer
     Transport Layer
   Research challenges and final discussion




                    NGI 2012, Karlskrona, Sweden   3
Introduction
  WSN equipped with multimedia sensors give
 birth to WMSN.

  They enable a new class of monitoring
 applications, but demanding in terms of:
    computational resources
    energy resources

  Need for innovative solutions:
    combination/optimization techniques at
   the different layers of the protocol stack
                     NGI 2012, Karlskrona, Sweden   4
Real-Time Multimedia Monitoring

  Supervised monitoring (Image/Video-based)
    Delivery of compressed image/video flows,
   analyzed by a human operator

    Low bitrate achievable with complex encoders
   (e.g. H.264/AVC), not supported by WMSN

    Suitable solutions: Object-based approaches,
   Distributed Video Coding

    Challenge: Successful implementation of these
   techniques
                    NGI 2012, Karlskrona, Sweden     5
Real-Time Multimedia Monitoring

  Unsupervised monitoring (Feature-based)
    Use visual features to describe the underlying pixel
   content

    Suitable for a broad range of monitoring tasks
   (e.g., object recognition, face detection…)

    Main challenges:
       Coding of visual features
       Low-complexity feature extraction algorithms
       Rate-accuracy models for resources allocation

                     NGI 2012, Karlskrona, Sweden       6
MAC Layer

  Main requirements for video streaming
 over WMSN:
    Steady-flow of information
    Delay-bounded delivery of packets

  As a consequence, the MAC layer has to:
    support reliable communication
    be QoS-aware
    save as much energy as possible



                    NGI 2012, Karlskrona, Sweden   7
MAC Layer – available solutions

  Available solutions to tune QoS metrics:
    Power control
    Traffic class differentiation (Q-MAC)
    Contention-free vs. contention-based approaches
    Duty-cycling control
    Queuing and scheduling mechanisms
    Error control mechanisms

  For WMSN, most important features are:
    Intra/Inter-node traffic class differentiation
    Node synchronization (duty-cycling control)

                     NGI 2012, Karlskrona, Sweden      8
MAC Layer – available solutions




                 NGI 2012, Karlskrona, Sweden   9
Network Layer: Routing
 Traditional solutions for WSN focused on energy
consumption
 In the WMSN case, need also for real-time
delivery
 Desirable features
    Traffic differentiation and joint-optimization of
   multiple QoS goals
    Resource balancing
    Fast adaptation to change in monitoring conditions
    Support to in-network processing / cross-layer opt.
    Scalability
    Energy-harvesting awareness
                     NGI 2012, Karlskrona, Sweden      10
Network Layer – available solutions




                 NGI 2012, Karlskrona, Sweden   11
Transport Layer
 Similarly to the network layer case, available
solutions are not suitable for WMSN.

 Design guidelines
    Differentiated reliability
    Trade-off between reliability/timeliness
    Media-centric collaborative reliability
    Congestion control
    Cross-layer optimization



                      NGI 2012, Karlskrona, Sweden   12
Transport Layer – available solutions




                  NGI 2012, Karlskrona, Sweden   13
Collaborative Sensing in WMSN
 Multimedia nodes are characterized by a
directional sensing model (FoV)

 They can be grouped basing on their common
sensing coverage

 Several challenges
    Directional coverage
    Clustering / Scheduling
    Collaboration protocols

                     NGI 2012, Karlskrona, Sweden   14
Conclusions and Research Challenges
 Application Layer (feature-based):
   Novel coding techniques
   Practical implementations
 MAC Layer
   Service differentiation
   Dynamic duty-cycling control
 Network Layer:
   In-network processing
   Energy harvesting
 Transport Layer
   Media-centric reliability
   Cross-layer optimization with routing
                     NGI 2012, Karlskrona, Sweden   15
Thank your for your attention!




          NGI 2012, Karlskrona, Sweden   16
Project Members
   M. Cesana, A. Redondi – {cesana,
  redondi}@elet.polimi.it
      Multimedia coding, Application
   N. Tiglao, A. Grilo – {nestor.tiglao,
  antonio.grilo}@inesc-id.pt
      Routing and Transport
   J. M. Barcelo-Ordinas, M. Alaei –
  {joseb,malaei}@ac.upc.edu
      MAC Layer
   P. Todorova –
  petia.todorova@fokus.fraunhofer.de
      Collaborative Sensing
                     NGI 2012, Karlskrona, Sweden   17

More Related Content

PPTX
WSN-Routing Protocols Energy Efficient Routing
PPTX
Wireless Sensor Networks
PDF
IoT Networking
PPT
Adhoc and Sensor Networks - Chapter 08
PPTX
Seminar ppt fog comp
PPT
Wireless Sensor Networks
PPTX
presentation on Edge computing
PPTX
WSN-Routing Protocols Energy Efficient Routing
Wireless Sensor Networks
IoT Networking
Adhoc and Sensor Networks - Chapter 08
Seminar ppt fog comp
Wireless Sensor Networks
presentation on Edge computing

What's hot (20)

PPTX
WSN network architecture -Sensor Network Scenarios & Transceiver Design Consi...
PDF
LPWAN technology overview
PPTX
Wireless sensor network applications
PPT
Energy efficient routing protocol
PPT
Localization in wsn
PDF
PPT
WSN IN IOT
PPTX
Wireless sensor networks
PPTX
Wlan wireless network
PPTX
IoT Cloud architecture
PPTX
Thesis-Final-slide
PPTX
Introduction to SDN and NFV
PPT
Sensor networks
PPTX
IOT System.pptx
PPTX
wireless network IEEE 802.11
PPT
Integrated services digital network (isdn)
PPTX
What is Socket?
PPT
Sensor Protocols for Information via Negotiation (SPIN)
PPT
Module 3 INTERNET OF THINGS
PPTX
Vlans (virtual local area networks)
WSN network architecture -Sensor Network Scenarios & Transceiver Design Consi...
LPWAN technology overview
Wireless sensor network applications
Energy efficient routing protocol
Localization in wsn
WSN IN IOT
Wireless sensor networks
Wlan wireless network
IoT Cloud architecture
Thesis-Final-slide
Introduction to SDN and NFV
Sensor networks
IOT System.pptx
wireless network IEEE 802.11
Integrated services digital network (isdn)
What is Socket?
Sensor Protocols for Information via Negotiation (SPIN)
Module 3 INTERNET OF THINGS
Vlans (virtual local area networks)
Ad

Viewers also liked (18)

PPTX
wireless sensor network my seminar ppt
PPT
A smart Multi-hop hierarchical routing protocol for Efficient VIdeo communica...
PPTX
WIRELESS Visual SENSOR NETWORK
PDF
Wireless Multimedia Networks Survey
PPTX
Visual Sensor Network & Coverage Issue
PPT
Electronic voting machine
PDF
Biometric voting system
PPTX
PPTX
Biometric Voting System
PPTX
Electronic Voting Machine
PPT
Black box of Aircraft
PPTX
Fingerprint based voting machine ppt
PPTX
Biometric Voting System
PPT
Organic LED(O LED)
PPTX
Black box
PPT
Network Security
PDF
Network Security Presentation
PPTX
wireless sensor network
wireless sensor network my seminar ppt
A smart Multi-hop hierarchical routing protocol for Efficient VIdeo communica...
WIRELESS Visual SENSOR NETWORK
Wireless Multimedia Networks Survey
Visual Sensor Network & Coverage Issue
Electronic voting machine
Biometric voting system
Biometric Voting System
Electronic Voting Machine
Black box of Aircraft
Fingerprint based voting machine ppt
Biometric Voting System
Organic LED(O LED)
Black box
Network Security
Network Security Presentation
wireless sensor network
Ad

Similar to Wireless Multimedia Sensor Networks (20)

PDF
Bde sc3 2nd_workshop_2016_10_04_p10_maja_skrjanc
PDF
A survey of multimedia streaming in
PDF
Using ICN to simplify data delivery, mobility management and secure transmission
 
PPT
Traffic Classification
PPTX
TDMA Cluster-based MAC for VANETs (TC-MAC)
PDF
Ieee projects 2011 ns 2 SBGC ( Trichy, Madurai, Chennai, Dindigul, Natham, Pu...
PDF
Hybrid Red Deer Algorithm with Physical Unclonable Function for Security Enha...
PDF
Hybrid Red Deer Algorithm with Physical Unclonable Function for Security Enha...
PDF
Ieee projects 2012 for cse
PDF
Algorithm Solved IEEE Projects 2012 2013 Java @ Seabirdssolutions
PDF
Ieee projects 2012 for cse
PDF
Hao_Qin_Presentation-秦博士.pdf
PDF
SDN-Based Enhancements to QoS and Data Quality in Multi-Tenanted Data Center ...
PPTX
Mmsys slideshare-intel-nokia
PDF
Intrusion Detection and Countermeasure in Virtual Network Systems Using NICE ...
PDF
The optical backbone evolution in the TLC operator infrastructures
PDF
Ieee 2016 cs project topics list mtech
PPTX
Overview of Sensors project
PDF
IEEE 2014 NS2 Projects
PDF
IEEE 2014 NS2 Projects
Bde sc3 2nd_workshop_2016_10_04_p10_maja_skrjanc
A survey of multimedia streaming in
Using ICN to simplify data delivery, mobility management and secure transmission
 
Traffic Classification
TDMA Cluster-based MAC for VANETs (TC-MAC)
Ieee projects 2011 ns 2 SBGC ( Trichy, Madurai, Chennai, Dindigul, Natham, Pu...
Hybrid Red Deer Algorithm with Physical Unclonable Function for Security Enha...
Hybrid Red Deer Algorithm with Physical Unclonable Function for Security Enha...
Ieee projects 2012 for cse
Algorithm Solved IEEE Projects 2012 2013 Java @ Seabirdssolutions
Ieee projects 2012 for cse
Hao_Qin_Presentation-秦博士.pdf
SDN-Based Enhancements to QoS and Data Quality in Multi-Tenanted Data Center ...
Mmsys slideshare-intel-nokia
Intrusion Detection and Countermeasure in Virtual Network Systems Using NICE ...
The optical backbone evolution in the TLC operator infrastructures
Ieee 2016 cs project topics list mtech
Overview of Sensors project
IEEE 2014 NS2 Projects
IEEE 2014 NS2 Projects

More from Nestor Michael Tiglao (7)

PDF
The State of Mobile Computing and Internet
PPTX
Creative Engineering Breakthroughs
PDF
Correlation Analysis of Temperature Measurements from Wireless Sensor Nodes
PDF
On the Optimization and Comparative Evaluation of a Reliable and Efficient Ca...
PDF
Cross-Layer Caching Based Optimization for Wireless Multimedia Sensor Networks
PDF
Transport Layer Caching Mechanisms and Optimization
PDF
The State of Mobile Computing and Internet
Creative Engineering Breakthroughs
Correlation Analysis of Temperature Measurements from Wireless Sensor Nodes
On the Optimization and Comparative Evaluation of a Reliable and Efficient Ca...
Cross-Layer Caching Based Optimization for Wireless Multimedia Sensor Networks
Transport Layer Caching Mechanisms and Optimization

Recently uploaded (20)

PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPTX
sap open course for s4hana steps from ECC to s4
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
Machine Learning_overview_presentation.pptx
PDF
Encapsulation theory and applications.pdf
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Encapsulation_ Review paper, used for researhc scholars
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Per capita expenditure prediction using model stacking based on satellite ima...
sap open course for s4hana steps from ECC to s4
Network Security Unit 5.pdf for BCA BBA.
Reach Out and Touch Someone: Haptics and Empathic Computing
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Assigned Numbers - 2025 - Bluetooth® Document
The Rise and Fall of 3GPP – Time for a Sabbatical?
Machine Learning_overview_presentation.pptx
Encapsulation theory and applications.pdf
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
The AUB Centre for AI in Media Proposal.docx
20250228 LYD VKU AI Blended-Learning.pptx
Unlocking AI with Model Context Protocol (MCP)
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
NewMind AI Weekly Chronicles - August'25-Week II
“AI and Expert System Decision Support & Business Intelligence Systems”

Wireless Multimedia Sensor Networks

  • 1. Real-time Multimedia Monitoring in Large-Scale Wireless Multimedia Sensor Networks: Research Challenges Joint work by: M.Cesana, A.Redondi – Politecnico di Milano N. Tiglao, A. Grilo – INESC-ID/INOV/IST J. M. Barcelo-Ordinas, M. Alaei – Universitat Politecnica de Catalunya P. Todorova – Fraunhofer FOKUS
  • 2. MWMSN Project  Multi-tier Wireless Multimedia Sensor Networks  Goal: To enable support for enhanced monitoring and tracking applications through multimedia visual/audio wireless sensor nodes NGI 2012, Karlskrona, Sweden 2
  • 3. Outline  Introduction  Real-time multimedia monitoring applications  Efficient delivery of visual data in WMSNs  MAC Layer  Network Layer  Transport Layer  Research challenges and final discussion NGI 2012, Karlskrona, Sweden 3
  • 4. Introduction  WSN equipped with multimedia sensors give birth to WMSN.  They enable a new class of monitoring applications, but demanding in terms of:  computational resources  energy resources  Need for innovative solutions:  combination/optimization techniques at the different layers of the protocol stack NGI 2012, Karlskrona, Sweden 4
  • 5. Real-Time Multimedia Monitoring  Supervised monitoring (Image/Video-based)  Delivery of compressed image/video flows, analyzed by a human operator  Low bitrate achievable with complex encoders (e.g. H.264/AVC), not supported by WMSN  Suitable solutions: Object-based approaches, Distributed Video Coding  Challenge: Successful implementation of these techniques NGI 2012, Karlskrona, Sweden 5
  • 6. Real-Time Multimedia Monitoring  Unsupervised monitoring (Feature-based)  Use visual features to describe the underlying pixel content  Suitable for a broad range of monitoring tasks (e.g., object recognition, face detection…)  Main challenges:  Coding of visual features  Low-complexity feature extraction algorithms  Rate-accuracy models for resources allocation NGI 2012, Karlskrona, Sweden 6
  • 7. MAC Layer  Main requirements for video streaming over WMSN:  Steady-flow of information  Delay-bounded delivery of packets  As a consequence, the MAC layer has to:  support reliable communication  be QoS-aware  save as much energy as possible NGI 2012, Karlskrona, Sweden 7
  • 8. MAC Layer – available solutions  Available solutions to tune QoS metrics:  Power control  Traffic class differentiation (Q-MAC)  Contention-free vs. contention-based approaches  Duty-cycling control  Queuing and scheduling mechanisms  Error control mechanisms  For WMSN, most important features are:  Intra/Inter-node traffic class differentiation  Node synchronization (duty-cycling control) NGI 2012, Karlskrona, Sweden 8
  • 9. MAC Layer – available solutions NGI 2012, Karlskrona, Sweden 9
  • 10. Network Layer: Routing  Traditional solutions for WSN focused on energy consumption  In the WMSN case, need also for real-time delivery  Desirable features  Traffic differentiation and joint-optimization of multiple QoS goals  Resource balancing  Fast adaptation to change in monitoring conditions  Support to in-network processing / cross-layer opt.  Scalability  Energy-harvesting awareness NGI 2012, Karlskrona, Sweden 10
  • 11. Network Layer – available solutions NGI 2012, Karlskrona, Sweden 11
  • 12. Transport Layer  Similarly to the network layer case, available solutions are not suitable for WMSN.  Design guidelines  Differentiated reliability  Trade-off between reliability/timeliness  Media-centric collaborative reliability  Congestion control  Cross-layer optimization NGI 2012, Karlskrona, Sweden 12
  • 13. Transport Layer – available solutions NGI 2012, Karlskrona, Sweden 13
  • 14. Collaborative Sensing in WMSN  Multimedia nodes are characterized by a directional sensing model (FoV)  They can be grouped basing on their common sensing coverage  Several challenges  Directional coverage  Clustering / Scheduling  Collaboration protocols NGI 2012, Karlskrona, Sweden 14
  • 15. Conclusions and Research Challenges  Application Layer (feature-based):  Novel coding techniques  Practical implementations  MAC Layer  Service differentiation  Dynamic duty-cycling control  Network Layer:  In-network processing  Energy harvesting  Transport Layer  Media-centric reliability  Cross-layer optimization with routing NGI 2012, Karlskrona, Sweden 15
  • 16. Thank your for your attention! NGI 2012, Karlskrona, Sweden 16
  • 17. Project Members  M. Cesana, A. Redondi – {cesana, redondi}@elet.polimi.it  Multimedia coding, Application  N. Tiglao, A. Grilo – {nestor.tiglao, antonio.grilo}@inesc-id.pt  Routing and Transport  J. M. Barcelo-Ordinas, M. Alaei – {joseb,malaei}@ac.upc.edu  MAC Layer  P. Todorova – petia.todorova@fokus.fraunhofer.de  Collaborative Sensing NGI 2012, Karlskrona, Sweden 17