SlideShare a Scribd company logo
STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications  Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration with   Anandha Gopalan  (University of Pittsburgh, Imperial College) and   Jerry Zhao, Adel Youssef (Google, Inc.)
Motivation: Real-Time Geo-Centric Sensor Network Applications Globally deployed sensor around the globe. Clusters of sensors forming networks. Mobile users roaming across the networks. Real-time   geo-centric   ad-hoc  queries issued from within or nearby the queried area. The sensor network is responsible of answering these queries directly from the sensors rather than from base stations. Examples:  Bronx Zoo cluster. Disaster management cluster.
Motivation: Real-Time Geo-Centric Sensor Network Applications
Data Storage Options in Sensor Networks Base Station Storage: Events are sent to base stations where queries are issued and evaluated. Best suited for continuous queries. In-Network Storage (INS): Events are stored in the sensor nodes. Best suited for ad-hoc queries. All previous INS schemes were Data-Centric Storage (DCS) schemes.
In-Network Data-Centric Storage (DCS) Mainly to answer range queries. Quality of Data (QoD) of ad-hoc queries. Assign a value-range of readings for each sensor. Examples: Distributed Hash Tables (DHT) [Shenker et. al., HotNets’02] Geographic Hash Tables (GHT) [Ratnasamy et. al., WSNA’02] Distributed Index for Multi-dimensional data (DIM) [Li et. al., SenSys’03, Aly et. al., DMSN’05, MOBIQUITOUS’06] K-D Tree based Data-Centric Storage (KDDCS) [Aly et. al., CIKM’06]
STDCS Overview Motivation: No previous INS schemes adopting geo-centric storage. Expected techniques may be:  Local storage. Spatial storage Design Goal: Load-Balancing of storage load among sensors Differences from previous schemes: Temporally evolving spatial indexing scheme to balance query load among sensors. Dynamic query hotspot detection and decomposition.
Roadmap Motivation: Real-Time Geo-Centric applications. Background: Data-Centric Storage (DCS). Problem Statement: Real-Time Geo-Centric Storage. Scheme Overview: STDCS. STDCS Components Local Virtual address assignment Spatio-Temporal data indexing. Point-to-point data delivery. Query processing. Adaptive hotspot decomposition. Experimental Results Conclusions
STDCS Components: Local Virtual Address Assignment
STDCS Components:  Spatio-Temporal Data Indexing
STDCS Components:  Reading Delivery and Querying
STDCS Components: Adaptive Hotspot Decomposition Motivation: Dynamic query hotspots as time progresses. Observation: Recurrent querying scenarios across the day, the week, etc. Technique: Continuously keeping track of hotspots using the Average Querying Frequency (AQF) metric. Dynamically chaning the switching time to decompose hotspots.
Roadmap Motivation: Real-Time Geo-Centric applications. Background: Data-Centric Storage (DCS). Problem Statement: Real-Time Geo-Centric Storage. Scheme Overview: STDCS. STDCS Components Local Virtual address assignment Spatio-Temporal data indexing. Point-to-point data delivery. Query processing. Adaptive hotspot decomposition. Experimental Results Conclusions
Simulation Description Compare:   STDCS, local storage, spatial indexing. A cluster of stationary sensors (with random locations). Each sensor senses a reading each 10 min. Sensor reading = 1 packet. Sensor capacity = 20 readings (packets)  Multiple mobile users. A query: random sensor, radius, and type.  Two phases:  initialization (3 hours of readings) & running (1 day of readings and queries). Metrics:  throughput, energy level, node deaths.
Experimental Results: STDCS vs. Query Hotspots
Experimental Results: STDCS vs. Query Hotspots
Experimental Results: Switching Time Effect
Experimental Results: Switching Time vs. Node Deaths
Experimental Results: Adaptive Hotspot Decomposition
Conclusions STDCS:  A real-time geo-centric data storage scheme. A new concept of spatio-temporal data indexing. Ability to dynamically cope with dynamic loads and query hotspots.
Acknowledgment This work has been partly supported by: Google, Inc. The “Secure CITI: A Secure Critical Information Technology Infrastructure for Disaster Management (S-CITI)” project funded through the ITR Medium Award ANI-0325353 from the National Science Foundation (NSF). For more information, please visit:  http://www.cs.pitt.edu/s-citi/
Thank You Questions ?

More Related Content

PPTX
Stanford/SLAC Cryo-EM Computing and Storage, Yee-Ting Li
PPTX
Usage Patterns to Provision for Scientific Experiments in Clouds
PPTX
Health & Status Monitoring (2010-v8)
PDF
Distributed Near Real-Time Processing of Sensor Network Data Flows for Smart ...
PDF
What Are Science Clouds?
PPTX
Open Science Data Cloud - CCA 11
PPTX
Open Science Data Cloud (IEEE Cloud 2011)
DOCX
A TIME EFFICIENT APPROACH FOR DETECTING ERRORS IN BIG SENSOR DATA ON CLOUD
Stanford/SLAC Cryo-EM Computing and Storage, Yee-Ting Li
Usage Patterns to Provision for Scientific Experiments in Clouds
Health & Status Monitoring (2010-v8)
Distributed Near Real-Time Processing of Sensor Network Data Flows for Smart ...
What Are Science Clouds?
Open Science Data Cloud - CCA 11
Open Science Data Cloud (IEEE Cloud 2011)
A TIME EFFICIENT APPROACH FOR DETECTING ERRORS IN BIG SENSOR DATA ON CLOUD

What's hot (20)

PDF
The Matsu Project - Open Source Software for Processing Satellite Imagery Data
PPTX
prj exam
PPTX
Bionimbus Cambridge Workshop (3-28-11, v7)
PPTX
A time efficient approach for detecting errors in big sensor data on cloud
PDF
A time efficient approach for detecting errors in big sensor data on cloud
PPT
Large Scale On-Demand Image Processing For Disaster Relief
PPT
Analysis_of_Remote_Sensing_Quantitative_Inversion_in_Cloud_Computing.ppt
PPT
Semantics in Sensor Networks
PPTX
Grid'5000: Running a Large Instrument for Parallel and Distributed Computing ...
PDF
Paper444012-4014
PDF
Application of Lotka-Volterra model to analyse Cloud behavior and optimise re...
PDF
Introduction to Big Data and Science Clouds (Chapter 1, SC 11 Tutorial)
PPTX
AI at Scale for Materials and Chemistry
PDF
Using parallel hierarchical clustering to
PDF
Architectures for Data Commons (XLDB 15 Lightning Talk)
PPTX
XGSN: An Open-source Semantic Sensing Middleware for the Web of Things
PPTX
Materials Data Facility: Streamlined and automated data sharing, discovery, ...
PPTX
GSN Global Sensor Networks for Environmental Data Management
PPT
X-GSN in OpenIoT SummerSchool
PDF
Modern Scientific Data Management Practices: The Atmospheric Radiation Measur...
The Matsu Project - Open Source Software for Processing Satellite Imagery Data
prj exam
Bionimbus Cambridge Workshop (3-28-11, v7)
A time efficient approach for detecting errors in big sensor data on cloud
A time efficient approach for detecting errors in big sensor data on cloud
Large Scale On-Demand Image Processing For Disaster Relief
Analysis_of_Remote_Sensing_Quantitative_Inversion_in_Cloud_Computing.ppt
Semantics in Sensor Networks
Grid'5000: Running a Large Instrument for Parallel and Distributed Computing ...
Paper444012-4014
Application of Lotka-Volterra model to analyse Cloud behavior and optimise re...
Introduction to Big Data and Science Clouds (Chapter 1, SC 11 Tutorial)
AI at Scale for Materials and Chemistry
Using parallel hierarchical clustering to
Architectures for Data Commons (XLDB 15 Lightning Talk)
XGSN: An Open-source Semantic Sensing Middleware for the Web of Things
Materials Data Facility: Streamlined and automated data sharing, discovery, ...
GSN Global Sensor Networks for Environmental Data Management
X-GSN in OpenIoT SummerSchool
Modern Scientific Data Management Practices: The Atmospheric Radiation Measur...
Ad

Viewers also liked (6)

PPTX
Session 50 Maria Nichani
PPTX
Trafiklab Meetup 20150610
PPTX
Meetup 20160602
PDF
Trafiklab Meetup 20160211: Kundundersökning SLL
PDF
Veridict Trafiklab meetup 2016 12-06
PPTX
Trafiklab Meetup 20161206
Session 50 Maria Nichani
Trafiklab Meetup 20150610
Meetup 20160602
Trafiklab Meetup 20160211: Kundundersökning SLL
Veridict Trafiklab meetup 2016 12-06
Trafiklab Meetup 20161206
Ad

Similar to STDCS (20)

PDF
HISTSFC: Optimization for ND Massive Spatial Points Querying
PDF
HISTSFC: Optimization for ND Massive Spatial Points Querying
PPTX
High-Volume Data Collection and Real Time Analytics Using Redis
PPTX
design_doc
DOCX
V1_I2_2012_Paper5.docx
PPTX
SENSOR TASKING AND CONTROL in WSN .pptx
PDF
Real-Time Spatiotemporal Data Utilization For Future Mobility Services: Atsus...
PDF
Anchor Positioning using Sensor Transmission Range Based Clustering for Mobil...
PDF
Secure and privacy preserving data centric sensor networks with multi query o...
PDF
Paper@Soict2015: GPSInsights: towards a scalable framework for mining massive...
PPTX
Real time data management on wsn
PDF
Semantic Discovery and Integration of Urban Data Streams
PDF
Aggregation of data by using top k spatial query preferences
PDF
Improvement of limited Storage Placement in Wireless Sensor Network
PDF
Modeling and Querying Metadata in the Semantic Sensor Web: stRDF and stSPARQL
PDF
Service discovery using crdt
PPTX
Spatial Data in SQL Server
PDF
Moving objects media data computing(2019)
PPTX
Redisconf19: Real-time spatiotemporal data utilization for future mobility se...
PPTX
A Design of Distributed Storage System over HTTP for Collecting Sensor Data
HISTSFC: Optimization for ND Massive Spatial Points Querying
HISTSFC: Optimization for ND Massive Spatial Points Querying
High-Volume Data Collection and Real Time Analytics Using Redis
design_doc
V1_I2_2012_Paper5.docx
SENSOR TASKING AND CONTROL in WSN .pptx
Real-Time Spatiotemporal Data Utilization For Future Mobility Services: Atsus...
Anchor Positioning using Sensor Transmission Range Based Clustering for Mobil...
Secure and privacy preserving data centric sensor networks with multi query o...
Paper@Soict2015: GPSInsights: towards a scalable framework for mining massive...
Real time data management on wsn
Semantic Discovery and Integration of Urban Data Streams
Aggregation of data by using top k spatial query preferences
Improvement of limited Storage Placement in Wireless Sensor Network
Modeling and Querying Metadata in the Semantic Sensor Web: stRDF and stSPARQL
Service discovery using crdt
Spatial Data in SQL Server
Moving objects media data computing(2019)
Redisconf19: Real-time spatiotemporal data utilization for future mobility se...
A Design of Distributed Storage System over HTTP for Collecting Sensor Data

Recently uploaded (20)

PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Electronic commerce courselecture one. Pdf
PPTX
Spectroscopy.pptx food analysis technology
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
KodekX | Application Modernization Development
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
sap open course for s4hana steps from ECC to s4
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Programs and apps: productivity, graphics, security and other tools
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Dropbox Q2 2025 Financial Results & Investor Presentation
Encapsulation_ Review paper, used for researhc scholars
Electronic commerce courselecture one. Pdf
Spectroscopy.pptx food analysis technology
Network Security Unit 5.pdf for BCA BBA.
Mobile App Security Testing_ A Comprehensive Guide.pdf
KodekX | Application Modernization Development
Reach Out and Touch Someone: Haptics and Empathic Computing
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Advanced methodologies resolving dimensionality complications for autism neur...
Understanding_Digital_Forensics_Presentation.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Unlocking AI with Model Context Protocol (MCP)
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Chapter 3 Spatial Domain Image Processing.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
sap open course for s4hana steps from ECC to s4

STDCS

  • 1. STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration with Anandha Gopalan (University of Pittsburgh, Imperial College) and Jerry Zhao, Adel Youssef (Google, Inc.)
  • 2. Motivation: Real-Time Geo-Centric Sensor Network Applications Globally deployed sensor around the globe. Clusters of sensors forming networks. Mobile users roaming across the networks. Real-time geo-centric ad-hoc queries issued from within or nearby the queried area. The sensor network is responsible of answering these queries directly from the sensors rather than from base stations. Examples: Bronx Zoo cluster. Disaster management cluster.
  • 3. Motivation: Real-Time Geo-Centric Sensor Network Applications
  • 4. Data Storage Options in Sensor Networks Base Station Storage: Events are sent to base stations where queries are issued and evaluated. Best suited for continuous queries. In-Network Storage (INS): Events are stored in the sensor nodes. Best suited for ad-hoc queries. All previous INS schemes were Data-Centric Storage (DCS) schemes.
  • 5. In-Network Data-Centric Storage (DCS) Mainly to answer range queries. Quality of Data (QoD) of ad-hoc queries. Assign a value-range of readings for each sensor. Examples: Distributed Hash Tables (DHT) [Shenker et. al., HotNets’02] Geographic Hash Tables (GHT) [Ratnasamy et. al., WSNA’02] Distributed Index for Multi-dimensional data (DIM) [Li et. al., SenSys’03, Aly et. al., DMSN’05, MOBIQUITOUS’06] K-D Tree based Data-Centric Storage (KDDCS) [Aly et. al., CIKM’06]
  • 6. STDCS Overview Motivation: No previous INS schemes adopting geo-centric storage. Expected techniques may be: Local storage. Spatial storage Design Goal: Load-Balancing of storage load among sensors Differences from previous schemes: Temporally evolving spatial indexing scheme to balance query load among sensors. Dynamic query hotspot detection and decomposition.
  • 7. Roadmap Motivation: Real-Time Geo-Centric applications. Background: Data-Centric Storage (DCS). Problem Statement: Real-Time Geo-Centric Storage. Scheme Overview: STDCS. STDCS Components Local Virtual address assignment Spatio-Temporal data indexing. Point-to-point data delivery. Query processing. Adaptive hotspot decomposition. Experimental Results Conclusions
  • 8. STDCS Components: Local Virtual Address Assignment
  • 9. STDCS Components: Spatio-Temporal Data Indexing
  • 10. STDCS Components: Reading Delivery and Querying
  • 11. STDCS Components: Adaptive Hotspot Decomposition Motivation: Dynamic query hotspots as time progresses. Observation: Recurrent querying scenarios across the day, the week, etc. Technique: Continuously keeping track of hotspots using the Average Querying Frequency (AQF) metric. Dynamically chaning the switching time to decompose hotspots.
  • 12. Roadmap Motivation: Real-Time Geo-Centric applications. Background: Data-Centric Storage (DCS). Problem Statement: Real-Time Geo-Centric Storage. Scheme Overview: STDCS. STDCS Components Local Virtual address assignment Spatio-Temporal data indexing. Point-to-point data delivery. Query processing. Adaptive hotspot decomposition. Experimental Results Conclusions
  • 13. Simulation Description Compare: STDCS, local storage, spatial indexing. A cluster of stationary sensors (with random locations). Each sensor senses a reading each 10 min. Sensor reading = 1 packet. Sensor capacity = 20 readings (packets) Multiple mobile users. A query: random sensor, radius, and type. Two phases: initialization (3 hours of readings) & running (1 day of readings and queries). Metrics: throughput, energy level, node deaths.
  • 14. Experimental Results: STDCS vs. Query Hotspots
  • 15. Experimental Results: STDCS vs. Query Hotspots
  • 17. Experimental Results: Switching Time vs. Node Deaths
  • 18. Experimental Results: Adaptive Hotspot Decomposition
  • 19. Conclusions STDCS: A real-time geo-centric data storage scheme. A new concept of spatio-temporal data indexing. Ability to dynamically cope with dynamic loads and query hotspots.
  • 20. Acknowledgment This work has been partly supported by: Google, Inc. The “Secure CITI: A Secure Critical Information Technology Infrastructure for Disaster Management (S-CITI)” project funded through the ITR Medium Award ANI-0325353 from the National Science Foundation (NSF). For more information, please visit: http://www.cs.pitt.edu/s-citi/