SlideShare a Scribd company logo
A TIME EFFICIENT APPROACH FOR DETECTING ERRORS
IN BIG SENSOR DATA ON CLOUD
ABSTRACT
Big sensor data is prevalent in both industry and scientific research applications where
the data is generated with high volume and velocity it is difficult to process using on-hand
database management tools or traditional data processing applications.Cloud computing provides
a promising platform to support the addressing of this challenge as it provides a flexible stack of
massive computing, storage, and software services in a alable manner at low cost. Some
techniques have been developed in recent years for processing sensor data on cloud, such as
sensor-cloud. However, these techniques do not provide efficient support on fast detection and
locating of errors in big sensor data sets. For fast data error detection in big sensor data sets, in
this paper, we develop a novel data error detection approach which exploits the full computation
potential of cloud platform and the network feature of WSN. Firstly, a set of sensor data error
types are classified and defined. Based on that classification, the network feature of a clustered
WSN is introduced and analyzed to support fast error detection and location. Specifically, in our
proposed approach, the error detection is based on the scale-free network topology and most of
detection operations can be conducted in limited temporal or spatial data blocks instead of a
whole big data set. Hence the detection and location process can be ramatically accelerated.
Furthermore, the detection and location tasks can be distributed to cloud platform to fully exploit
the computation power and massive storage. Through the experiment on our cloud computing
platform of U-Cloud, it is demonstrated that our proposed approach can significantly reduce the
time for error detection and location in big data sets generated by large scale sensor network
systems with acceptable error detecting accuracy

More Related Content

PDF
A time efficient approach for detecting errors in big sensor data on cloud
PPTX
A time efficient approach for detecting errors in big sensor data on cloud
PPTX
prj exam
DOCX
A time efficient approach for detecting errors in big sensor data on cloud
PDF
Distributed Near Real-Time Processing of Sensor Network Data Flows for Smart ...
PDF
Paper444012-4014
PPT
PDF
IRJET- Secure Data Access on Distributed Database using Skyline Queries
A time efficient approach for detecting errors in big sensor data on cloud
A time efficient approach for detecting errors in big sensor data on cloud
prj exam
A time efficient approach for detecting errors in big sensor data on cloud
Distributed Near Real-Time Processing of Sensor Network Data Flows for Smart ...
Paper444012-4014
IRJET- Secure Data Access on Distributed Database using Skyline Queries

What's hot (20)

PDF
Introduction to Numetric (1)
PDF
What Are Science Clouds?
PPTX
Health & Status Monitoring (2010-v8)
PDF
A Survey on Neural Network Based Minimization of Data Center in Power Consump...
DOCX
Enabling Efficient and Geometric Range Query with Access Control over Encrypt...
PPT
Analysis_of_Remote_Sensing_Quantitative_Inversion_in_Cloud_Computing.ppt
PPTX
Open Science Data Cloud (IEEE Cloud 2011)
PDF
Centralized Data Verification Scheme for Encrypted Cloud Data Services
PDF
IDEAS 2013 Presentation
PPTX
Grid computing the grid
PPTX
Open Science Data Cloud - CCA 11
PPTX
Planet lab : cloud vs grid computing
PPTX
Usage Patterns to Provision for Scientific Experiments in Clouds
DOCX
Enabling Efficient and Geometric Range Query with Access Control over Encrypt...
PDF
The Matsu Project - Open Source Software for Processing Satellite Imagery Data
PPTX
Stanford/SLAC Cryo-EM Computing and Storage, Yee-Ting Li
PDF
Architectures for Data Commons (XLDB 15 Lightning Talk)
PPT
CLOUD BIOINFORMATICS Part1
PDF
About an Immune System Understanding for Cloud-native Applications - Biology ...
Introduction to Numetric (1)
What Are Science Clouds?
Health & Status Monitoring (2010-v8)
A Survey on Neural Network Based Minimization of Data Center in Power Consump...
Enabling Efficient and Geometric Range Query with Access Control over Encrypt...
Analysis_of_Remote_Sensing_Quantitative_Inversion_in_Cloud_Computing.ppt
Open Science Data Cloud (IEEE Cloud 2011)
Centralized Data Verification Scheme for Encrypted Cloud Data Services
IDEAS 2013 Presentation
Grid computing the grid
Open Science Data Cloud - CCA 11
Planet lab : cloud vs grid computing
Usage Patterns to Provision for Scientific Experiments in Clouds
Enabling Efficient and Geometric Range Query with Access Control over Encrypt...
The Matsu Project - Open Source Software for Processing Satellite Imagery Data
Stanford/SLAC Cryo-EM Computing and Storage, Yee-Ting Li
Architectures for Data Commons (XLDB 15 Lightning Talk)
CLOUD BIOINFORMATICS Part1
About an Immune System Understanding for Cloud-native Applications - Biology ...
Ad

Similar to A TIME EFFICIENT APPROACH FOR DETECTING ERRORS IN BIG SENSOR DATA ON CLOUD (20)

DOCX
A time efficient approach for detecting errors in big sensor data on cloud
DOCX
A time efficient approach for detecting errors in big sensor data on cloud
DOCX
A time efficient approach for detecting errors in big sensor data on cloud
PDF
Data Analysis In The Cloud
PDF
Parallel and distributed system projects for java and dot net
DOCX
Ieee transactions on 2018 network and service management
PDF
Time Orient Multi Attribute Sensor Selection Technique For Data Collection In...
PDF
Proximate node aware optimal and secure data aggregation in wireless sensor ...
PDF
An Approach to Data Extraction and Visualisation for Wireless Sensor Networks
 
PDF
Mobile computing projects list for java and dot net
PDF
sensors-20-01011-v2 (1).pdf
PDF
IRJET- A Novel Approach for Privacy Security in Cloud Storage Plan with Three...
PDF
V01 i010405
PDF
chapter 4.pdf
DOCX
chapter 4.docx
PDF
TWO LEVEL DATA FUSION MODEL FOR DATA MINIMIZATION AND EVENT DETECTION IN PERI...
PDF
A COST EFFECTIVE COMPRESSIVE DATA AGGREGATION TECHNIQUE FOR WIRELESS SENSOR N...
PDF
Volume 2-issue-6-2102-2107
PDF
Volume 2-issue-6-2102-2107
PDF
IEEE Networking 2016 Title and Abstract
A time efficient approach for detecting errors in big sensor data on cloud
A time efficient approach for detecting errors in big sensor data on cloud
A time efficient approach for detecting errors in big sensor data on cloud
Data Analysis In The Cloud
Parallel and distributed system projects for java and dot net
Ieee transactions on 2018 network and service management
Time Orient Multi Attribute Sensor Selection Technique For Data Collection In...
Proximate node aware optimal and secure data aggregation in wireless sensor ...
An Approach to Data Extraction and Visualisation for Wireless Sensor Networks
 
Mobile computing projects list for java and dot net
sensors-20-01011-v2 (1).pdf
IRJET- A Novel Approach for Privacy Security in Cloud Storage Plan with Three...
V01 i010405
chapter 4.pdf
chapter 4.docx
TWO LEVEL DATA FUSION MODEL FOR DATA MINIMIZATION AND EVENT DETECTION IN PERI...
A COST EFFECTIVE COMPRESSIVE DATA AGGREGATION TECHNIQUE FOR WIRELESS SENSOR N...
Volume 2-issue-6-2102-2107
Volume 2-issue-6-2102-2107
IEEE Networking 2016 Title and Abstract
Ad

More from I3E Technologies (20)

PPTX
Design of a low voltage low-dropout regulator
PPTX
An efficient constant multiplier architecture based on vertical horizontal bi...
PPTX
Aging aware reliable multiplier design with adaptive hold logic
PPTX
A high performance fir filter architecture for fixed and reconfigurable appli...
PPTX
A generalized algorithm and reconfigurable architecture for efficient and sca...
PPTX
A combined sdc sdf architecture for normal i o pipelined radix-2 fft
PPTX
Reverse converter design via parallel prefix adders novel components, method...
PPTX
Pre encoded multipliers based on non-redundant radix-4 signed-digit encoding
PPTX
Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...
PPTX
Variable form carrier-based pwm for boost-voltage motor driver with a charge-...
PPTX
Ultrasparse ac link converters
PPTX
Single inductor dual-output buck–boost power factor correction converter
PPTX
Ripple minimization through harmonic elimination in asymmetric interleaved mu...
PPTX
Resonance analysis and soft switching design of isolated boost converter with...
PPTX
Reliability evaluation of conventional and interleaved dc–dc boost converters
PPTX
Power factor corrected zeta converter based improved power quality switched m...
PPTX
Pfc cuk converter fed bldc motor drive
PPTX
Optimized operation of current fed dual active bridge dc dc converter for pv ...
PPTX
Online variable topology type photovoltaic grid-connected inverter
Design of a low voltage low-dropout regulator
An efficient constant multiplier architecture based on vertical horizontal bi...
Aging aware reliable multiplier design with adaptive hold logic
A high performance fir filter architecture for fixed and reconfigurable appli...
A generalized algorithm and reconfigurable architecture for efficient and sca...
A combined sdc sdf architecture for normal i o pipelined radix-2 fft
Reverse converter design via parallel prefix adders novel components, method...
Pre encoded multipliers based on non-redundant radix-4 signed-digit encoding
Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...
Variable form carrier-based pwm for boost-voltage motor driver with a charge-...
Ultrasparse ac link converters
Single inductor dual-output buck–boost power factor correction converter
Ripple minimization through harmonic elimination in asymmetric interleaved mu...
Resonance analysis and soft switching design of isolated boost converter with...
Reliability evaluation of conventional and interleaved dc–dc boost converters
Power factor corrected zeta converter based improved power quality switched m...
Pfc cuk converter fed bldc motor drive
Optimized operation of current fed dual active bridge dc dc converter for pv ...
Online variable topology type photovoltaic grid-connected inverter

Recently uploaded (20)

PPT
Mechanical Engineering MATERIALS Selection
PPT
Project quality management in manufacturing
PDF
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
DOCX
573137875-Attendance-Management-System-original
PPTX
Sustainable Sites - Green Building Construction
PDF
R24 SURVEYING LAB MANUAL for civil enggi
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PPTX
OOP with Java - Java Introduction (Basics)
PPTX
bas. eng. economics group 4 presentation 1.pptx
PPTX
web development for engineering and engineering
PDF
Unit I ESSENTIAL OF DIGITAL MARKETING.pdf
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PDF
PPT on Performance Review to get promotions
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
PDF
Digital Logic Computer Design lecture notes
PPT
Introduction, IoT Design Methodology, Case Study on IoT System for Weather Mo...
Mechanical Engineering MATERIALS Selection
Project quality management in manufacturing
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
573137875-Attendance-Management-System-original
Sustainable Sites - Green Building Construction
R24 SURVEYING LAB MANUAL for civil enggi
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
OOP with Java - Java Introduction (Basics)
bas. eng. economics group 4 presentation 1.pptx
web development for engineering and engineering
Unit I ESSENTIAL OF DIGITAL MARKETING.pdf
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
CYBER-CRIMES AND SECURITY A guide to understanding
PPT on Performance Review to get promotions
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
Digital Logic Computer Design lecture notes
Introduction, IoT Design Methodology, Case Study on IoT System for Weather Mo...

A TIME EFFICIENT APPROACH FOR DETECTING ERRORS IN BIG SENSOR DATA ON CLOUD

  • 1. A TIME EFFICIENT APPROACH FOR DETECTING ERRORS IN BIG SENSOR DATA ON CLOUD ABSTRACT Big sensor data is prevalent in both industry and scientific research applications where the data is generated with high volume and velocity it is difficult to process using on-hand database management tools or traditional data processing applications.Cloud computing provides a promising platform to support the addressing of this challenge as it provides a flexible stack of massive computing, storage, and software services in a alable manner at low cost. Some techniques have been developed in recent years for processing sensor data on cloud, such as sensor-cloud. However, these techniques do not provide efficient support on fast detection and locating of errors in big sensor data sets. For fast data error detection in big sensor data sets, in this paper, we develop a novel data error detection approach which exploits the full computation potential of cloud platform and the network feature of WSN. Firstly, a set of sensor data error types are classified and defined. Based on that classification, the network feature of a clustered WSN is introduced and analyzed to support fast error detection and location. Specifically, in our proposed approach, the error detection is based on the scale-free network topology and most of detection operations can be conducted in limited temporal or spatial data blocks instead of a whole big data set. Hence the detection and location process can be ramatically accelerated. Furthermore, the detection and location tasks can be distributed to cloud platform to fully exploit the computation power and massive storage. Through the experiment on our cloud computing platform of U-Cloud, it is demonstrated that our proposed approach can significantly reduce the time for error detection and location in big data sets generated by large scale sensor network systems with acceptable error detecting accuracy