PIMRC-2012, Sydney, Australia, 28 July, 2012
1 like1,912 views
The document discusses the use of GSN middleware for capturing and processing sensor data from mobile phones, highlighting the growing capabilities of mobile devices and their role in the Internet of Things (IoT). It proposes a data acquisition model for integrating mobile phones into the GSN framework, emphasizing performance advantages such as scalability and ease of extension. Future work includes enhancing the architecture and integrating context-capturing technologies to improve sensor data processing.
PIMRC-2012, Sydney, Australia, 28 July, 2012
- 1. Capturing Sensor Data From Mobile Phones Using GSN Middleware SEMANTIC DATA MANAGEMENT / INFORMATION ENGINEERING LAB Charith Perera (ANU-CSIRO), Arkady Zaslavsky (CSIRO), Peter Christen (ANU), Ali Salehi (CSIRO), Dimitrios Georgakopoulos (CSIRO) 09 September 2012
- 2. Agenda Background The Problem The Proposed Solution Performance Advantage Evaluation Future Work 2 |
- 4. Background • Mobile Phones getting more powerful • Processing Power (Ex: 1.4Ghz dual core processors) • Memory (more than 1GB RAM) • Storage (around 64 GB) • Number of mobile (5.6 billion mobile phones) • Built-in sensors (more than 12 in Android + camera + microphone) • Becomes cheaper and smaller 4 | • What does it mean… ? Already deployed, mobile (moving), sensors and sinks with decent amount of processing capability that are regularly charged by humans…
- 5. Background • Internet of Things • 20 billion things to be connected to internet by 2020 • Things = Sensors + actuators + processing/storage/communication • More data to be collected and processed 5 | 2020201520102003 By 2020 there will be 50 billion things During 2008, the number of things connected to the internet exceed the number of people on earth “…The Internet of Things allows people and things to be connected Anytime, Anyplace, with Anything and Anyone, ideally using Any path/network and Any Service1…” 1 P. Guillemin and P. Friess. Internet of things strategic research roadmap, Technical report, The Cluster of European Research Projects, 2009.
- 6. Background • The Role of Mobile Phones in the IoT Paradigm • Collect sensor data (from other sensors via Bluetooth) • Annotate sensor data (context annotation) • Generate sensor data (using built-in sensors) • Already deployed less deployment, maintenance cost 6 | • How to process collected data… ? Data processing engines/middleware solutions are required to fuse sensor data from multiple sensors or multiple devices that collects sensor data…
- 7. Data Stream Processing Engine 7 | Global Sensor Network (GSN) • GSN1 project started in 2005 at EPFL in the LSIR lab by Ali Salehi (now @ CSIRO IEL) and Prof. Karl Aberer. • A platform aimed at providing flexible middleware to address the challenges of sensor data acquisition, integration and distributed query processing • It is used widely in over ten EU/Swiss funded research projects • Foundation middleware for OpenIoT2/ SenseMA / Phenonet3 projects 1 sourceforge.net/apps/trac/gsn 2 openiot.eu: Open Source blueprint for large scale self-organizing cloud environments for IoT applications FP7-ICT-2011-7 3 phenonet.com : wireless sensors in agriculture
- 9. The Problem • Data processing engines such as GSN can be ported in to the mobile it self Do the processing in the mobile • Simplified version of GSN will be required. • Is it energy efficient…? 9 | • Is it feasible to process sensor data in the mobile… ? Processing and storage is still limited in mobile phones and significant amount of data processing will consume lot of energy that will discharge the battery very quickly • Why not uploading data into a GSN instance in the cloud Do the processing in Cloud HOW ?
- 11. The Solution Proposed 11 | Data Acquisition Model For GSN (DAM4GSN) Architecture Tablets Tablets Computers GSN Middleware Client Side Server Side Meta Data Packet Different Wrappers Proposed Wrapper (For low-level computational devices) Data Flow 1 2
- 12. Data Stream Processing Engine 12 | Global Sensor Network (GSN) Android Wrapper GSN Wrapper Life Cycle 1 2 3 4 4 3 • All the wrappers need to extend the Java class gsn.wrapper.AbstractWrapper • Every wrapper should implement four methods (numbered in 1-4): 1. initialise(), 2. finalise(), 3. getWrapperName(), 4.getOutputFormat() Wrappers == gateways, handlers, proxies, mediators…
- 14. Performance Advantage 14 | • Less installation or configuration of GSN: GSN assumes that sensors are connected to a server that is running GSN middleware through a sink. However, installing and configuring GSN in low-level computational devices such as mobile phones and tablets would be a overwhelming task and may not be feasible due to lack of resources. • Scalability: As we do not port (install) GSN into mobile devices, scalability is preserved at the server level, probably in the cloud. Therefore, Scalability do not depend on the resource availability on the device (i.e. mobile phone). • No continuous update for GSN middleware: Any form of update may only be required to be done in the client side (i.e. in mobile phones, tablets). No update is required in GSN server. • Easy to extend: Sensing capability of the mobile phones can be extended by attaching additional hardware components. It is not required to do any changes in wrappers in GSN server. • Support variety of low-level computational devices: Can be used by any mobile device or low end computing devices (e.g. mobile phones, tablets, laptops, etc.). The only capability that a mobile device need to have is sensor data collection, packet structure generation and network communication (i.e. Wi-Fi, 3G).
- 15. Evaluation 15 |
- 16. Evaluation 16 | Sensor Power (mA) Accelerometer 0.20 Gravity 0.20 Linear Acceleration 0.20 Proximity 0.75 Light 0.75 Magnetic Field 4.00 Rotation Vector 4.20 Orientation 4.20 • Experiments Setup: Samsung Galaxy S, Android platform 2.3 and PowerTutor1 app, Intel Core i7 CPU, 6GB ram, CSIRO IE Wi-Fi network • Network communication > CPU energy cost • Network communication parameters such as sampling rate2 should be carefully selected 1 ziyang.eecs.umich.edu/projects/powertutor 2 Google I/O 2012 http://www.youtube.com/watch?v=PwC1OlJo5VM (Total 58 mins. Efficiency: 16:43) Energy consumption in mJ per minute
- 17. Future Work 17 |
- 18. Application Scenario 18 | A farmer visits his field of crops and collects sensor data from variety of different sensors deployed. The mobile phone annotates collected raw sensor data with various context information such as location, time, etc. and sends them to GSN for storage, analysis, and interpretation. Mobile DeviceFarmer Crop Field 1 3 2 Collect Data Upload Data to the Cloud Annotate Sensor Data with context information GSN in Cloud
- 19. Future Work 19 | • Auto-generation and configuration of wrappers. Generating / Configure program code based on XML descriptions. • Combine context capturing, discovering and semantic technologies with processing of sensor data inside the wrapper itself. • Build the DAM4GSN architecture into GSN with the other improvements that will be proposed by OpenIoT and SenseMA projects Tablets Tablets ComputersClient Side Server Side Meta Data Packet Data Flow 1 2 GSN Middleware Different Wrappers Proposed Wrapper (For low-level computational devices)
- 20. Client Side Future Work 20 | • Auto-generation and configuration of wrappers. Generating / Configure program code based on XML descriptions. • Combine context capturing, discovering and semantic technologies with processing of sensor data inside the wrapper itself. • Build the DAM4GSN architecture into GSN with the other improvements that will be proposed by OpenIoT and SenseMA projects Tablets Tablets Computers Server Side Meta Data Packet (Description of Sensor Data Stream) Data Flow 1 GSN Middleware Different Wrappers Proposed Wrapper (For low-level computational devices) Semantic Reasoning and Annotation S1 S2 S3 S4 S5 S6 S7 S8 S9 Sn 2
- 21. CSIRO ICT Center Information Engineering Laboratory Charith Perera PhD Student t +61 2 6216 7135 e Charith.Perera@csiro.au w www.csiro.au/charith.perera SEMANTIC DATA MANAGEMENT / INFORMATION ENGINEERING LAB Thank You!
- 22. • Motion Sensors: Accelerometer (HS) (activities, moving speed, location ) Gravity (SS) OR (HS) Gyroscope (HS) (activities, moving speed, location ) linear accelerometer (SS) OR (HS) rotation vector (SS) OR (HS) • Position Sensors: Orientation (SS) geomagnetic field (HS) proximity (HS) (determine how close the face of a device is to an object) GPS (HS) (determine location, movements) • Environment Sensors: Light (HS) (climate to complement weather information), Pressure (HS) (ambient air pressure) Humidity (HS) (ambient relative humidity) Temperature (HS) (ambient air temperature) Appendix I: 22 | Possible usage of sensors built-in to the mobile phones Hardware sensors (HS) Software Sensors (SS)