SlideShare a Scribd company logo
Timeseries extraction, visualisation and
exploration
TasMAN, Sense-T, SensorCloud
CCI
Chris Sharman | Research Team Leader
17th March 2014
Introduction
• CCI= CSIRO Computational Informatics
• Sensor Networks / Gridded Model projects:
• Tasmanian Marine Analysis Network (TasMAN)
• SouthEsk Hydrological Sensor Network
• Sense-T (www.sense-t.org.au)
• Cross domain sensor networks:
• Coastal/Marine
• Hydrological
• Agriculture
• Aquaculture
Timeseries Servcies | Chris Sharman2 |
TasMAN Project
• Use case: Web-based sensor/model data exploration,
visualisation.
• Requirements
• Easy for Web Clients
• Low-latency, web-time
• Linked to WMS
• Data
• Sparse near real-time low-cost marine sensor nodes
• CSIRO SHOC model netCDF curvilinear output
– non-uniform grid
Timeseries Services | Chris Sharman3 |
TasMAN – Approach
• Sensor Network timeseries -> bespoke web service (see later)
• Model data -> patched ncWMS
• GetFeatureInfo request with JSON encoding (not standardised)
• Support for vector styles on rotated cell curvilinear grids
Timeseries Services | Chris Sharman4 |
{
longitude: 147.39339269881506,
latitude: -42.95279095077819,
featureInfo:
[
{
layerName: "setas_surf_nrt.temp",
iIndex: 101,
jIndex: 66,
elevation: -0.5,
gridCentreLon: 147.39511108398438,
gridCentreLat: -42.9555549621582,
featureInfo:
{2012-04-11T20:00:00.000Z: "15.368134",
2012-04-11T21:00:00.000Z: "15.308427",
2012-04-11T22:00:00.000Z: "15.210996",
2012-04-11T23:00:00.000Z: "15.168934",
2012-04-12T00:00:00.000Z: "15.173564",...
TasMAN – Web Client
• OpenLayers (WMS)
• Spatio-Temporal explorer
• Dataset browser (Simile
Timeline, ncWMS API)
• Time series chart
• Bespoke HTML/JS/Canvas
implementation
– Animated, interactive
– Multiple heterogeneous
timeseries
– Dynamic data loading
– GetFeatureInfo requests
Timeseries Services | Chris Sharman5 |
Sense-T and SensorCloud
• Infrastructure for Sense-T research projects
• Point-based timeseries
• Real-time ingestion network
• Sensor Messaging Gateway
• Annotation Service
• SensorCloud API
• THREDDS for Gridded data
Presentation title | Presenter name6 |
Data Exchange vs Web Visualisation, Exploration.
• SensorCloud API
• RESTful API
• StarFL meta-data model (OGC Discuss. Paper)
• Focus on simplicity and performance
• Low barrier to entry for developers
• Flexible Aggregation
• OGC SOS
• Designed for data exchange
• Strong governance
• Slow moving
• High Barrier to entry
Timeseries Services | Chris Sharman7 |
Presentation title | Presenter name8 |
CCI / Autonomous Systems
Chris Sharman
Research Team Leader
t +61 03 6232 5515
e chris.sharman@csiro.au
w www.csiro.au
CCI
Thank you – Questions?

More Related Content

PDF
FIWARE Global Summit - QuantumLeap: Time-series and Geographic Queries
PDF
Peering Forum: Personals Track
PDF
Scylla Summit 2022: Scalable and Sustainable Supply Chains with DLT and ScyllaDB
PDF
Coinage
PDF
Introducing MagnetoDB, a key-value storage sevice for OpenStack
PDF
Intro to Service Meshes & Progressive Delivery (WOUG)
PDF
[WSO2Con USA 2018] Microservices, Containers, and Beyond
PPT
New web service oriented ARC
FIWARE Global Summit - QuantumLeap: Time-series and Geographic Queries
Peering Forum: Personals Track
Scylla Summit 2022: Scalable and Sustainable Supply Chains with DLT and ScyllaDB
Coinage
Introducing MagnetoDB, a key-value storage sevice for OpenStack
Intro to Service Meshes & Progressive Delivery (WOUG)
[WSO2Con USA 2018] Microservices, Containers, and Beyond
New web service oriented ARC

Viewers also liked (20)

PPTX
Environment Canada's Data Management Service
PPTX
Event sourcing with the GetEventStore
PDF
Ugif 04 2011 france ug04042011-jroy_ts
PDF
Io t world_2016_iot_smart_gateways_moe
PDF
Scaling ingest pipelines with high performance computing principles - Rajiv K...
PPTX
Choosing the right platform for your Internet -of-Things solution
PDF
Why Smart Meters Need Informix TimeSeries
PPTX
Need for Time series Database
PDF
SignalFx: Making Cassandra Perform as a Time Series Database
PDF
Deep dive into event store using Apache Cassandra
PDF
Why Gateways are Important in Your IoT Architecture
PDF
Interactive analytics at scale with druid
PDF
Apache Cassandra for Timeseries- and Graph-Data
PDF
codecentric AG: CQRS and Event Sourcing Applications with Cassandra
PPTX
ML on Big Data: Real-Time Analysis on Time Series
PPTX
Using spark for timeseries graph analytics
PDF
Stream Computing & Analytics at Uber
PPTX
Understanding DPDK
PDF
The 7 Habits of Breakthrough Innovators
Environment Canada's Data Management Service
Event sourcing with the GetEventStore
Ugif 04 2011 france ug04042011-jroy_ts
Io t world_2016_iot_smart_gateways_moe
Scaling ingest pipelines with high performance computing principles - Rajiv K...
Choosing the right platform for your Internet -of-Things solution
Why Smart Meters Need Informix TimeSeries
Need for Time series Database
SignalFx: Making Cassandra Perform as a Time Series Database
Deep dive into event store using Apache Cassandra
Why Gateways are Important in Your IoT Architecture
Interactive analytics at scale with druid
Apache Cassandra for Timeseries- and Graph-Data
codecentric AG: CQRS and Event Sourcing Applications with Cassandra
ML on Big Data: Real-Time Analysis on Time Series
Using spark for timeseries graph analytics
Stream Computing & Analytics at Uber
Understanding DPDK
The 7 Habits of Breakthrough Innovators
Ad

Similar to Chris Sharman-SPEDDEXES 2014 (20)

PPT
Lambda Data Grid
PDF
Apache Cassandra in the Real World
PDF
The Nile Approach: Re-engineering Postgres for Millions of Tenants by Gwen Sh...
PPTX
Azure reference architectures
PDF
Webinar: SQL for Machine Data?
PPTX
[DSC Europe 23] Pramod Immaneni - Real-time analytics at IoT scale
PDF
Geospatial Sensor Networks and Partitioning Data
PDF
AWS Česko-Slovenský Webinár 03: Vývoj v AWS
PPTX
Closing the Loop - Information Management Tools for Auckland Motorways
PPTX
Kinney j aws
PDF
Closer Look at Cloud Centric Architectures
PPTX
Network Support for Cloud Applications - Felix Cuadrado
PPTX
Creating a Centralized Consumer Profile Management Service with WebSphere Dat...
PPTX
CLI, HTTP, GenAI and MCP telemetry/observability in Java
PPTX
IoT interoperability
PDF
Freedom of Movement for redisconf19
PPTX
Achieve business agility with Cloud APIs, Cloud-aware Apps, and Cloud DevOps ...
PPTX
Cloud Migration
PDF
Sukumar Nayak-Detailed-Cloud Risk Management and Audit
PDF
Working Experience_V5.0
Lambda Data Grid
Apache Cassandra in the Real World
The Nile Approach: Re-engineering Postgres for Millions of Tenants by Gwen Sh...
Azure reference architectures
Webinar: SQL for Machine Data?
[DSC Europe 23] Pramod Immaneni - Real-time analytics at IoT scale
Geospatial Sensor Networks and Partitioning Data
AWS Česko-Slovenský Webinár 03: Vývoj v AWS
Closing the Loop - Information Management Tools for Auckland Motorways
Kinney j aws
Closer Look at Cloud Centric Architectures
Network Support for Cloud Applications - Felix Cuadrado
Creating a Centralized Consumer Profile Management Service with WebSphere Dat...
CLI, HTTP, GenAI and MCP telemetry/observability in Java
IoT interoperability
Freedom of Movement for redisconf19
Achieve business agility with Cloud APIs, Cloud-aware Apps, and Cloud DevOps ...
Cloud Migration
Sukumar Nayak-Detailed-Cloud Risk Management and Audit
Working Experience_V5.0
Ad

More from aceas13tern (20)

PPTX
Risk assessment of Australian ecosystems. Dr Emma Burns. ACEAS Grand 2014
PPTX
Australian seagrass habitats: condition and threats, James Udy, ACEAS Grand 2014
PPTX
Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...
PPTX
Vast lands and variable data: patterns and processes of mammal decline. Chris...
PPTX
Unifying principles for modelling, Brad Evans, ACEAS Grand 2014
PPTX
SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...
PPTX
Ecosystem services and livelihood opportunities, Jeremy Russell-Smith, ACEAS ...
PPTX
Local to national, Dr Lee Belbin, ACEAS Grand 2014
PPTX
Interactive Games to Value and Manage Ecosystem Services. Prof. Bob Costanza....
PPTX
ACEAS rationale, organisation and status. A. Specht, ACEAS Grand 2014
PPTX
Extinction of Northern Quoll. Euan Ritchie ACEAS Grand 2014
PPTX
Avifaunal disarray Ralph MacNally ACEAS Grand 2014
PPTX
Andrew Treloar, overview of ACEAS Data Workflow, ACEAS Grand 2014
PPTX
Transformation of Australia’s vegetated landscapes. Richard Thackway ACEAS Gr...
PPTX
Drought-induced mortality. Pat Mitchell, ACEAS Grand 2014
PPTX
Australian seagrass habitats. Kathryn McMahon, ACEAS Grand 2014
PPTX
Animal telemetry, Ross Dwyer ACEAS Grand 2014
PPTX
Productivity and freshwater fish abundance. Jian Yen. ACEAS Grand 2014
PPTX
Indigenous bio cultural knowledge ACEAS Grand 2014 Locke and Clark
PPT
Adaptation pathways for aquatic plants. Patrick Driver ACEAS Grand 2014
Risk assessment of Australian ecosystems. Dr Emma Burns. ACEAS Grand 2014
Australian seagrass habitats: condition and threats, James Udy, ACEAS Grand 2014
Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...
Vast lands and variable data: patterns and processes of mammal decline. Chris...
Unifying principles for modelling, Brad Evans, ACEAS Grand 2014
SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...
Ecosystem services and livelihood opportunities, Jeremy Russell-Smith, ACEAS ...
Local to national, Dr Lee Belbin, ACEAS Grand 2014
Interactive Games to Value and Manage Ecosystem Services. Prof. Bob Costanza....
ACEAS rationale, organisation and status. A. Specht, ACEAS Grand 2014
Extinction of Northern Quoll. Euan Ritchie ACEAS Grand 2014
Avifaunal disarray Ralph MacNally ACEAS Grand 2014
Andrew Treloar, overview of ACEAS Data Workflow, ACEAS Grand 2014
Transformation of Australia’s vegetated landscapes. Richard Thackway ACEAS Gr...
Drought-induced mortality. Pat Mitchell, ACEAS Grand 2014
Australian seagrass habitats. Kathryn McMahon, ACEAS Grand 2014
Animal telemetry, Ross Dwyer ACEAS Grand 2014
Productivity and freshwater fish abundance. Jian Yen. ACEAS Grand 2014
Indigenous bio cultural knowledge ACEAS Grand 2014 Locke and Clark
Adaptation pathways for aquatic plants. Patrick Driver ACEAS Grand 2014

Recently uploaded (20)

PDF
VCE English Exam - Section C Student Revision Booklet
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PPTX
PPH.pptx obstetrics and gynecology in nursing
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PPTX
Week 4 Term 3 Study Techniques revisited.pptx
PDF
Business Ethics Teaching Materials for college
PDF
Anesthesia in Laparoscopic Surgery in India
PDF
Complications of Minimal Access Surgery at WLH
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPTX
Introduction to Child Health Nursing – Unit I | Child Health Nursing I | B.Sc...
PDF
TR - Agricultural Crops Production NC III.pdf
PPTX
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PPTX
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
VCE English Exam - Section C Student Revision Booklet
Microbial disease of the cardiovascular and lymphatic systems
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
STATICS OF THE RIGID BODIES Hibbelers.pdf
2.FourierTransform-ShortQuestionswithAnswers.pdf
PPH.pptx obstetrics and gynecology in nursing
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
O7-L3 Supply Chain Operations - ICLT Program
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
Week 4 Term 3 Study Techniques revisited.pptx
Business Ethics Teaching Materials for college
Anesthesia in Laparoscopic Surgery in India
Complications of Minimal Access Surgery at WLH
human mycosis Human fungal infections are called human mycosis..pptx
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
Introduction to Child Health Nursing – Unit I | Child Health Nursing I | B.Sc...
TR - Agricultural Crops Production NC III.pdf
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester

Chris Sharman-SPEDDEXES 2014

  • 1. Timeseries extraction, visualisation and exploration TasMAN, Sense-T, SensorCloud CCI Chris Sharman | Research Team Leader 17th March 2014
  • 2. Introduction • CCI= CSIRO Computational Informatics • Sensor Networks / Gridded Model projects: • Tasmanian Marine Analysis Network (TasMAN) • SouthEsk Hydrological Sensor Network • Sense-T (www.sense-t.org.au) • Cross domain sensor networks: • Coastal/Marine • Hydrological • Agriculture • Aquaculture Timeseries Servcies | Chris Sharman2 |
  • 3. TasMAN Project • Use case: Web-based sensor/model data exploration, visualisation. • Requirements • Easy for Web Clients • Low-latency, web-time • Linked to WMS • Data • Sparse near real-time low-cost marine sensor nodes • CSIRO SHOC model netCDF curvilinear output – non-uniform grid Timeseries Services | Chris Sharman3 |
  • 4. TasMAN – Approach • Sensor Network timeseries -> bespoke web service (see later) • Model data -> patched ncWMS • GetFeatureInfo request with JSON encoding (not standardised) • Support for vector styles on rotated cell curvilinear grids Timeseries Services | Chris Sharman4 | { longitude: 147.39339269881506, latitude: -42.95279095077819, featureInfo: [ { layerName: "setas_surf_nrt.temp", iIndex: 101, jIndex: 66, elevation: -0.5, gridCentreLon: 147.39511108398438, gridCentreLat: -42.9555549621582, featureInfo: {2012-04-11T20:00:00.000Z: "15.368134", 2012-04-11T21:00:00.000Z: "15.308427", 2012-04-11T22:00:00.000Z: "15.210996", 2012-04-11T23:00:00.000Z: "15.168934", 2012-04-12T00:00:00.000Z: "15.173564",...
  • 5. TasMAN – Web Client • OpenLayers (WMS) • Spatio-Temporal explorer • Dataset browser (Simile Timeline, ncWMS API) • Time series chart • Bespoke HTML/JS/Canvas implementation – Animated, interactive – Multiple heterogeneous timeseries – Dynamic data loading – GetFeatureInfo requests Timeseries Services | Chris Sharman5 |
  • 6. Sense-T and SensorCloud • Infrastructure for Sense-T research projects • Point-based timeseries • Real-time ingestion network • Sensor Messaging Gateway • Annotation Service • SensorCloud API • THREDDS for Gridded data Presentation title | Presenter name6 |
  • 7. Data Exchange vs Web Visualisation, Exploration. • SensorCloud API • RESTful API • StarFL meta-data model (OGC Discuss. Paper) • Focus on simplicity and performance • Low barrier to entry for developers • Flexible Aggregation • OGC SOS • Designed for data exchange • Strong governance • Slow moving • High Barrier to entry Timeseries Services | Chris Sharman7 |
  • 8. Presentation title | Presenter name8 |
  • 9. CCI / Autonomous Systems Chris Sharman Research Team Leader t +61 03 6232 5515 e chris.sharman@csiro.au w www.csiro.au CCI Thank you – Questions?