SlideShare a Scribd company logo
WattDepot: A software ecosystem for energy data collection, storage, analysis, and visualization Robert S. Brewer, Philip M. Johnson Collaborative Software Development Laboratory  Information and Computer Sciences Dept University of Hawaii at Manoa http://csdl.ics.hawaii.edu/
Motivation Research on changing energy use behaviors Need to collect & analyze energy data Requirements Collect data from many meters Sub-minute data collection Easy to simulate sensor data Internet-accessible repository Visualization variety & flexibility Open source Could not find an existing solution Developed WattDepot
Architecture Devices Meters WattDepot Sensors WattDepot Server WattDepot Clients HTTP HTTP
Sensors Software to collect data Interface to specific meters Store data in server via HTTP Designed for flexibility Encapsulates vendor-specific code Any platform or language Just needs to output XML over HTTP Current implementations TED 5000 home energy meter Veris power meters Modbus/TCP meters Sensors Server Clients
Servers Central data repository RESTful HTTP API Pluggable back-end database Data represented as XML or JSON Devices represented as Sources Server-side capabilities Aggregation of sources (virtual sources) Data interpolation Sensors Server Clients
Servers: Virtual Sources Virtual sources combine sub-sources Maps real-world entities to system Hierarchy can be multi-level But meter clocks may not be synchronized Saunders Hall Floor 2 North Saunders Hall Floor 2 South Saunders Hall Floor 2 Saunders Hall
Servers: Timestamp Problem Unsynchronized clocks cause problems Naïve data comparison difficult
Servers: Data Interpolation Data resampling at arbitrary times Linearly interpolate between data points Solves timestamp problem for virtual sources
Clients Data extraction & visualization Any platform or language Using REST or Google Visualization APIs Current implementations Real-time monitors Charts Geographic visualizations Android mobile application All independent of data input source Sensors Server Clients
Clients: Heatmap and Gauge
Clients: GeoMap
Related Systems Pachube Commercial hosted data storage YouTube for sensor data Limits on rate of data storage Arbitrary data means no energy “smarts” Google PowerMeter Smart meter data storage & visualization Data limited to 15 min intervals Focus on single-family homes
Our Application Dorm energy competition 30 floor-level meters Real-time data Extensive competition web app Customized goal-based visualizations Google Spreadsheet intermediary High performance “cloud cache” Build higher-level data abstractions Easy to prototype visualizations Simulated energy data critical Allows progress while meters are installed
Dorm Energy Visualizations
Future Directions Privacy Sources currently public or private Limited authentication support All current applications use public data Data aggregation Needed when comparing private data Sensors Additional meter support
System Availability Hosted on Google Code http://code.google.com/p/wattdepot/ Open source under New BSD license Discussion list http://groups.google.com/group/wattdepot-users
Q&A Ask away! Contact: rbrewer@lava.net, [email_address]

More Related Content

PPT
Introduction to WattDepot
PPTX
Cloud Options for Wearable Data Analysis
PPTX
How to extract valueable information from real time data feeds
PDF
Conferencia principal: Evolución y visión de Elastic Observability
PPTX
Lift & Shift to Azure
PPTX
Meniscus Advanced Energy Analytics Platform
PPTX
Overview of azure_iaas
PDF
Combining logs, metrics, and traces for unified observability
Introduction to WattDepot
Cloud Options for Wearable Data Analysis
How to extract valueable information from real time data feeds
Conferencia principal: Evolución y visión de Elastic Observability
Lift & Shift to Azure
Meniscus Advanced Energy Analytics Platform
Overview of azure_iaas
Combining logs, metrics, and traces for unified observability

What's hot (20)

PPT
Porting Spring PetClinic to GigaSpaces
PDF
Big Data Expo 2015 - Microsoft Transform you data into intelligent action
PDF
Building a centralized observability platform
PDF
CapMonPosterweb
PPTX
Spark Summit East Keynote by Anjul Bhambhri
PPT
Enfragy ems
PPTX
Best analytics tool
PDF
Amazon Neptune - visually more options
PPTX
Microsoft Azure alerts
PDF
Build Applications without Pipelines: Shortest path from complex data to live...
PPTX
Key-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
PDF
Observability and its application
PPTX
Real time analytics for streaming application v1.2
PDF
Overview spectra reconn
PDF
Transforming data into actionable insights
PDF
Combinación de logs, métricas y rastreos para observabilidad unificada
PDF
Data lake
PPTX
Timmons Group ArcGIS Explorer Emergency Operations Solution
PPTX
IncQuery-D: Distributed Incremental Graph Queries
Porting Spring PetClinic to GigaSpaces
Big Data Expo 2015 - Microsoft Transform you data into intelligent action
Building a centralized observability platform
CapMonPosterweb
Spark Summit East Keynote by Anjul Bhambhri
Enfragy ems
Best analytics tool
Amazon Neptune - visually more options
Microsoft Azure alerts
Build Applications without Pipelines: Shortest path from complex data to live...
Key-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Observability and its application
Real time analytics for streaming application v1.2
Overview spectra reconn
Transforming data into actionable insights
Combinación de logs, métricas y rastreos para observabilidad unificada
Data lake
Timmons Group ArcGIS Explorer Emergency Operations Solution
IncQuery-D: Distributed Incremental Graph Queries
Ad

Viewers also liked (8)

PPT
ICS 690 talk: Personal Environmental Trainer
PPTX
Population growth and Natural resources
PPT
Population 9 - Intro To Population And Resources
PDF
Population growth and Natural resources
PPTX
Population ppt
PPTX
Population growth
PPTX
Human Population Growth
PPTX
Population growth & its effect on environment
ICS 690 talk: Personal Environmental Trainer
Population growth and Natural resources
Population 9 - Intro To Population And Resources
Population growth and Natural resources
Population ppt
Population growth
Human Population Growth
Population growth & its effect on environment
Ad

Similar to WattDepot: A software ecosystem for energy data collection, storage, analysis, and visualization (20)

PPTX
WebAction In-Memory Computing Summit 2015
PPTX
Wikibon #IoT #HyperConvergence Presentation via @theCUBE
PPTX
Hyper-Convergence CrowdChat
PDF
Combining Logs, Metrics, and Traces for Unified Observability
PDF
Creating a Modern Data Architecture for Digital Transformation
PPTX
Building Realtime Web Applications With ASP.NET SignalR
PPTX
SQL Saturday Redmond The Power Platform
PPTX
Unlocking Operational Intelligence from the Data Lake
PDF
Big data on AWS
PDF
Big Data on AWS
PPTX
Future Grid Overview 2018
PDF
Azure IoT Suite
PPTX
Cortana Analytics Suite
PDF
Cortana Analytics Workshop: Building Next-Generation Smart Grids
PDF
Data Abstraction and Virtualization
PPTX
[DSC Europe 23] Pramod Immaneni - Real-time analytics at IoT scale
PPTX
Presentation on Cloud Mashups
PPTX
Microsoft SQL Server - StreamInsight Overview Presentation
PDF
Streaming Visualization
PPTX
Azure Overview Csco
WebAction In-Memory Computing Summit 2015
Wikibon #IoT #HyperConvergence Presentation via @theCUBE
Hyper-Convergence CrowdChat
Combining Logs, Metrics, and Traces for Unified Observability
Creating a Modern Data Architecture for Digital Transformation
Building Realtime Web Applications With ASP.NET SignalR
SQL Saturday Redmond The Power Platform
Unlocking Operational Intelligence from the Data Lake
Big data on AWS
Big Data on AWS
Future Grid Overview 2018
Azure IoT Suite
Cortana Analytics Suite
Cortana Analytics Workshop: Building Next-Generation Smart Grids
Data Abstraction and Virtualization
[DSC Europe 23] Pramod Immaneni - Real-time analytics at IoT scale
Presentation on Cloud Mashups
Microsoft SQL Server - StreamInsight Overview Presentation
Streaming Visualization
Azure Overview Csco

Recently uploaded (20)

PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
A Presentation on Artificial Intelligence
PPTX
Spectroscopy.pptx food analysis technology
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Machine learning based COVID-19 study performance prediction
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
A comparative analysis of optical character recognition models for extracting...
PPT
Teaching material agriculture food technology
PDF
cuic standard and advanced reporting.pdf
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Encapsulation theory and applications.pdf
PPTX
Machine Learning_overview_presentation.pptx
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Advanced methodologies resolving dimensionality complications for autism neur...
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Mobile App Security Testing_ A Comprehensive Guide.pdf
The AUB Centre for AI in Media Proposal.docx
A Presentation on Artificial Intelligence
Spectroscopy.pptx food analysis technology
Diabetes mellitus diagnosis method based random forest with bat algorithm
Network Security Unit 5.pdf for BCA BBA.
Machine learning based COVID-19 study performance prediction
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
The Rise and Fall of 3GPP – Time for a Sabbatical?
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
A comparative analysis of optical character recognition models for extracting...
Teaching material agriculture food technology
cuic standard and advanced reporting.pdf
Assigned Numbers - 2025 - Bluetooth® Document
Encapsulation theory and applications.pdf
Machine Learning_overview_presentation.pptx

WattDepot: A software ecosystem for energy data collection, storage, analysis, and visualization

  • 1. WattDepot: A software ecosystem for energy data collection, storage, analysis, and visualization Robert S. Brewer, Philip M. Johnson Collaborative Software Development Laboratory Information and Computer Sciences Dept University of Hawaii at Manoa http://csdl.ics.hawaii.edu/
  • 2. Motivation Research on changing energy use behaviors Need to collect & analyze energy data Requirements Collect data from many meters Sub-minute data collection Easy to simulate sensor data Internet-accessible repository Visualization variety & flexibility Open source Could not find an existing solution Developed WattDepot
  • 3. Architecture Devices Meters WattDepot Sensors WattDepot Server WattDepot Clients HTTP HTTP
  • 4. Sensors Software to collect data Interface to specific meters Store data in server via HTTP Designed for flexibility Encapsulates vendor-specific code Any platform or language Just needs to output XML over HTTP Current implementations TED 5000 home energy meter Veris power meters Modbus/TCP meters Sensors Server Clients
  • 5. Servers Central data repository RESTful HTTP API Pluggable back-end database Data represented as XML or JSON Devices represented as Sources Server-side capabilities Aggregation of sources (virtual sources) Data interpolation Sensors Server Clients
  • 6. Servers: Virtual Sources Virtual sources combine sub-sources Maps real-world entities to system Hierarchy can be multi-level But meter clocks may not be synchronized Saunders Hall Floor 2 North Saunders Hall Floor 2 South Saunders Hall Floor 2 Saunders Hall
  • 7. Servers: Timestamp Problem Unsynchronized clocks cause problems Naïve data comparison difficult
  • 8. Servers: Data Interpolation Data resampling at arbitrary times Linearly interpolate between data points Solves timestamp problem for virtual sources
  • 9. Clients Data extraction & visualization Any platform or language Using REST or Google Visualization APIs Current implementations Real-time monitors Charts Geographic visualizations Android mobile application All independent of data input source Sensors Server Clients
  • 12. Related Systems Pachube Commercial hosted data storage YouTube for sensor data Limits on rate of data storage Arbitrary data means no energy “smarts” Google PowerMeter Smart meter data storage & visualization Data limited to 15 min intervals Focus on single-family homes
  • 13. Our Application Dorm energy competition 30 floor-level meters Real-time data Extensive competition web app Customized goal-based visualizations Google Spreadsheet intermediary High performance “cloud cache” Build higher-level data abstractions Easy to prototype visualizations Simulated energy data critical Allows progress while meters are installed
  • 15. Future Directions Privacy Sources currently public or private Limited authentication support All current applications use public data Data aggregation Needed when comparing private data Sensors Additional meter support
  • 16. System Availability Hosted on Google Code http://code.google.com/p/wattdepot/ Open source under New BSD license Discussion list http://groups.google.com/group/wattdepot-users
  • 17. Q&A Ask away! Contact: rbrewer@lava.net, [email_address]