SlideShare a Scribd company logo
A convex optimization approach for automated
water and energy end use disaggregation
Dario Piga, Andrea Cominola, Matteo Giuliani, Andrea Castelletti, Andrea Emilio Rizzoli
The project
2
high resolution water
consumption data
interaction with customers
for socio-psychographic
data gathering
management strategies:
dynamic pricing
rewards
The project
3
SMART METERS
USER
MODEL
WDMS
customized
feedbacks
dynamic pricing
Toilet
Shower
Dishwasher
Washing machine
Garden
Swimming pool
GAMIFICATION | ONLINE BILL GAMIFICATION | ONLINE BILL
Water consumption disaggregation into end uses
Toilet
Shower
Dishwasher
Washing machine
Garden
Swimming pool
ONE MEASURE MANY END USES
Need for fully automated
disaggregation algorithms
overlapping, simultaneous
water end uses
human-dependent
vs
automatic fixtures
Personalized hints for reducing water/energy consumption
Information on potential saving in deferring to peak-off hours
Leak detection
Customized WDMS
3
Sparse optimization approach
Assumptions (appliance level)
Piece-wise constant consumption profiles
Finite number of operating modes
Knowledge of water consumption at each operating mode
𝑦"(𝑘) = 𝐵(
(")
… 𝐵*"
(")
𝜃(
(")
(𝑘)
⋮
𝜃*"
(")
(𝑘)
= 𝐵(")-
𝜃(")
(𝑘)
𝜃(")
(𝑘): unknown, sparse (only one component equal to 1)
4
Sparse optimization approach
Minimizing fitting error (least-squares)
min
1 2 3
4 𝑦 𝑘 − 4
𝐵(")-
𝜃(")
(𝑘)  
𝑦"(𝑘)
6
"7(
89
37(
Not unique solution (solution not reliable)
5
Sparse optimization approach
Adding regularization
min
1 2 3
4 𝑦 𝑘 − 4
𝐵(")-
𝜃(")
(𝑘)  
𝑦"(𝑘)
6
"7(
8
+ 𝛾( 4 4 𝜃(")
(𝑘) <
6
"7(
9
37(
9
37(
Ø l0-norm enforces sparsity in the vector 𝜃(")(𝑘)
Ø balances the tradeoff between fitting and sparsity𝛾(
non-convex optimization problem
𝑠. 𝑡. 𝜃 "
𝑘    ≥ 0, 𝜃(
"
𝑘 + …+ 𝜃*"
"
𝑘 = 1
6
Sparse optimization approach
Adding regularization (l1-norm)
min
1 2 3
4 𝑦 𝑘 − 4
𝐵(")-
𝜃(")
(𝑘)  
𝑦"(𝑘)
6
"7(
8
+ 𝛾( 4 4 𝜃(")
(𝑘) (
6
"7(
9
37(
9
37(
Ø replace l0-norm with l1-norm
Ø l1-norm still promotes sparsity
convex optimization problem
𝑠. 𝑡. 𝜃 "
𝑘    ≥ 0, 𝜃(
"
𝑘 + …+ 𝜃*"
"
𝑘 = 1
7
Sparse optimization approach
Adding regularization (l1-norm)
min
1 2 3
4 𝑦 𝑘 − 4
𝐵(")-
𝜃(")
(𝑘)  
𝑦"(𝑘)
6
"7(
8
+ 𝛾( 4 4 𝜔 "
(𝑘) ⊙ 𝜃(")
(𝑘) (
6
"7(
9
37(
9
37(
Ø replace l0-norm with l1-norm
Ø l1-norm still promotes sparsity
convex optimization problem
Ø fixed weights take into time-of-the-day probability𝜔 " (𝑘)
𝑠. 𝑡. 𝜃 "
𝑘    ≥ 0, 𝜃(
"
𝑘 + …+ 𝜃*"
"
𝑘 = 1
8
Sparse optimization approach
Enforce piece-wise constant consumption profiles
min
1 2 3
4 𝑦 𝑘 − 4
𝐵(")-
𝜃(")
(𝑘)  
𝑦"(𝑘)
6
"7(
8
+ 𝛾( 4 4 𝜔 "
(𝑘) ⊙ 𝜃(")
(𝑘) (
6
"7(
+ 𝛾8 4 4 𝑘"
𝜃(
(")
𝑘 − 𝜃(
(")
(𝑘 − 1)
⋮
𝜃*"
(")
𝑘 − 𝜃*"
(")
(𝑘 − 1)
F
6
"7(
9
378
9
37(
9
37(
Ø penalize time variation of the vector
Ø only the largest variation is penalized
convex optimization problem
𝜃(")(𝑘)
Ø fixed weights to more penalize rarely time varying appliances𝑘"
𝑠. 𝑡. 𝜃 "
𝑘    ≥ 0, 𝜃(
"
𝑘 + …+ 𝜃*"
"
𝑘 = 1
9
Tests on high-resolution electricity data
AMPds dataset: S. Makonin et al., AMPDs: a public dataset for load disaggregation and eco-feedback research, In Electrical Power and
Energy Conference, 2013.
10
Tests on water data
WEEP dataset: Heinrich, Water End Use and Efficiency Project, New Zealand, 2007
31%
37%
32%
SPARSE  OPTIMIZATION
34%
36%
30%
ACTUAL
Toilet
Tap
Shower
11
Conclusions and follow up
Ø New convex optimization based algorithm for end-use characterization
Ø Main assumption: piecewise constant consumption profiles (requires high-
resolution consumption readings)
Conclusions
Ø Development of final-refinements to deal with low-resolution data
Ø Development of tailored numerical solvers
Future works
12
consortium cluster
thank you
http://www.smarth2o-fp7.eu/
@smartH2Oproject
#SmartH2O
Andrea Cominola
andrea.cominola@polimi.it
Politecnico di Milano
Department of Electronics,
Information and Bioengineering

More Related Content

PDF
Optimization of parameters affecting the performance of passive solar distill...
PDF
Comparing the methods of Estimation of Three-Parameter Weibull distribution
PDF
Assignment in regression1
PDF
Australia with a Drying Climate - Sustainable urban water management. By what...
PPTX
Water projects, case studies and experiences
PDF
Smart metering, water pricing and social media to stimulate residential water...
PDF
Residential water users' modeling SOTA
PDF
The SmartH2O project and the role of social computing in promoting efficient ...
Optimization of parameters affecting the performance of passive solar distill...
Comparing the methods of Estimation of Three-Parameter Weibull distribution
Assignment in regression1
Australia with a Drying Climate - Sustainable urban water management. By what...
Water projects, case studies and experiences
Smart metering, water pricing and social media to stimulate residential water...
Residential water users' modeling SOTA
The SmartH2O project and the role of social computing in promoting efficient ...

Viewers also liked (16)

PPT
De la smart city la smart society
PDF
Visualizing & gamifying water & energy consumption for behavior change
PPTX
From Smart Water Meters to Demand and Customer Relationship Management
PPTX
The SmartH2O Technology
PDF
PROFILING RESIDENTIAL WATER USERS’ ROUTINES BY EIGENBEHAVIOR MODELLING
PDF
Ergebnisse aus dem SmartH2O Projekt: Kundensensibilisierung mit spielerischen...
PDF
Behaviour change and incentive modelling for water saving: first results fr...
PDF
Developing a stochastic simulation model for the generation of residential wa...
PDF
Gamification for water utilities
PDF
ICT solutions for highly-customized water demand management strategies
PDF
The SmartH2O project: a platform supporting residential water management thro...
PDF
Public awareness and feedback – Insights from the SmartH2O project
PDF
Data-driven behavioural modelling of residential water consumption to inform ...
PDF
Modelling and managing urban water demand through smart meters: Benefits and ...
PPTX
Persuasive games - concept, state of the art and issues on sustainability app...
PDF
Coadapting water supply and demand to changing climate in agricultural water ...
De la smart city la smart society
Visualizing & gamifying water & energy consumption for behavior change
From Smart Water Meters to Demand and Customer Relationship Management
The SmartH2O Technology
PROFILING RESIDENTIAL WATER USERS’ ROUTINES BY EIGENBEHAVIOR MODELLING
Ergebnisse aus dem SmartH2O Projekt: Kundensensibilisierung mit spielerischen...
Behaviour change and incentive modelling for water saving: first results fr...
Developing a stochastic simulation model for the generation of residential wa...
Gamification for water utilities
ICT solutions for highly-customized water demand management strategies
The SmartH2O project: a platform supporting residential water management thro...
Public awareness and feedback – Insights from the SmartH2O project
Data-driven behavioural modelling of residential water consumption to inform ...
Modelling and managing urban water demand through smart meters: Benefits and ...
Persuasive games - concept, state of the art and issues on sustainability app...
Coadapting water supply and demand to changing climate in agricultural water ...
Ad

Recently uploaded (20)

PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Empathic Computing: Creating Shared Understanding
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Machine learning based COVID-19 study performance prediction
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Encapsulation theory and applications.pdf
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
Unlocking AI with Model Context Protocol (MCP)
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
The Rise and Fall of 3GPP – Time for a Sabbatical?
Empathic Computing: Creating Shared Understanding
20250228 LYD VKU AI Blended-Learning.pptx
Review of recent advances in non-invasive hemoglobin estimation
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Diabetes mellitus diagnosis method based random forest with bat algorithm
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Machine learning based COVID-19 study performance prediction
Reach Out and Touch Someone: Haptics and Empathic Computing
Chapter 3 Spatial Domain Image Processing.pdf
Encapsulation theory and applications.pdf
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Advanced methodologies resolving dimensionality complications for autism neur...
NewMind AI Weekly Chronicles - August'25-Week II
Unlocking AI with Model Context Protocol (MCP)
Ad

A convex optimization approach for automated water and energy end use disaggregation

  • 1. A convex optimization approach for automated water and energy end use disaggregation Dario Piga, Andrea Cominola, Matteo Giuliani, Andrea Castelletti, Andrea Emilio Rizzoli
  • 2. The project 2 high resolution water consumption data interaction with customers for socio-psychographic data gathering management strategies: dynamic pricing rewards
  • 3. The project 3 SMART METERS USER MODEL WDMS customized feedbacks dynamic pricing Toilet Shower Dishwasher Washing machine Garden Swimming pool GAMIFICATION | ONLINE BILL GAMIFICATION | ONLINE BILL
  • 4. Water consumption disaggregation into end uses Toilet Shower Dishwasher Washing machine Garden Swimming pool ONE MEASURE MANY END USES Need for fully automated disaggregation algorithms overlapping, simultaneous water end uses human-dependent vs automatic fixtures Personalized hints for reducing water/energy consumption Information on potential saving in deferring to peak-off hours Leak detection Customized WDMS 3
  • 5. Sparse optimization approach Assumptions (appliance level) Piece-wise constant consumption profiles Finite number of operating modes Knowledge of water consumption at each operating mode 𝑦"(𝑘) = 𝐵( (") … 𝐵*" (") 𝜃( (") (𝑘) ⋮ 𝜃*" (") (𝑘) = 𝐵(")- 𝜃(") (𝑘) 𝜃(") (𝑘): unknown, sparse (only one component equal to 1) 4
  • 6. Sparse optimization approach Minimizing fitting error (least-squares) min 1 2 3 4 𝑦 𝑘 − 4 𝐵(")- 𝜃(") (𝑘)   𝑦"(𝑘) 6 "7( 89 37( Not unique solution (solution not reliable) 5
  • 7. Sparse optimization approach Adding regularization min 1 2 3 4 𝑦 𝑘 − 4 𝐵(")- 𝜃(") (𝑘)   𝑦"(𝑘) 6 "7( 8 + 𝛾( 4 4 𝜃(") (𝑘) < 6 "7( 9 37( 9 37( Ø l0-norm enforces sparsity in the vector 𝜃(")(𝑘) Ø balances the tradeoff between fitting and sparsity𝛾( non-convex optimization problem 𝑠. 𝑡. 𝜃 " 𝑘   ≥ 0, 𝜃( " 𝑘 + …+ 𝜃*" " 𝑘 = 1 6
  • 8. Sparse optimization approach Adding regularization (l1-norm) min 1 2 3 4 𝑦 𝑘 − 4 𝐵(")- 𝜃(") (𝑘)   𝑦"(𝑘) 6 "7( 8 + 𝛾( 4 4 𝜃(") (𝑘) ( 6 "7( 9 37( 9 37( Ø replace l0-norm with l1-norm Ø l1-norm still promotes sparsity convex optimization problem 𝑠. 𝑡. 𝜃 " 𝑘   ≥ 0, 𝜃( " 𝑘 + …+ 𝜃*" " 𝑘 = 1 7
  • 9. Sparse optimization approach Adding regularization (l1-norm) min 1 2 3 4 𝑦 𝑘 − 4 𝐵(")- 𝜃(") (𝑘)   𝑦"(𝑘) 6 "7( 8 + 𝛾( 4 4 𝜔 " (𝑘) ⊙ 𝜃(") (𝑘) ( 6 "7( 9 37( 9 37( Ø replace l0-norm with l1-norm Ø l1-norm still promotes sparsity convex optimization problem Ø fixed weights take into time-of-the-day probability𝜔 " (𝑘) 𝑠. 𝑡. 𝜃 " 𝑘   ≥ 0, 𝜃( " 𝑘 + …+ 𝜃*" " 𝑘 = 1 8
  • 10. Sparse optimization approach Enforce piece-wise constant consumption profiles min 1 2 3 4 𝑦 𝑘 − 4 𝐵(")- 𝜃(") (𝑘)   𝑦"(𝑘) 6 "7( 8 + 𝛾( 4 4 𝜔 " (𝑘) ⊙ 𝜃(") (𝑘) ( 6 "7( + 𝛾8 4 4 𝑘" 𝜃( (") 𝑘 − 𝜃( (") (𝑘 − 1) ⋮ 𝜃*" (") 𝑘 − 𝜃*" (") (𝑘 − 1) F 6 "7( 9 378 9 37( 9 37( Ø penalize time variation of the vector Ø only the largest variation is penalized convex optimization problem 𝜃(")(𝑘) Ø fixed weights to more penalize rarely time varying appliances𝑘" 𝑠. 𝑡. 𝜃 " 𝑘   ≥ 0, 𝜃( " 𝑘 + …+ 𝜃*" " 𝑘 = 1 9
  • 11. Tests on high-resolution electricity data AMPds dataset: S. Makonin et al., AMPDs: a public dataset for load disaggregation and eco-feedback research, In Electrical Power and Energy Conference, 2013. 10
  • 12. Tests on water data WEEP dataset: Heinrich, Water End Use and Efficiency Project, New Zealand, 2007 31% 37% 32% SPARSE  OPTIMIZATION 34% 36% 30% ACTUAL Toilet Tap Shower 11
  • 13. Conclusions and follow up Ø New convex optimization based algorithm for end-use characterization Ø Main assumption: piecewise constant consumption profiles (requires high- resolution consumption readings) Conclusions Ø Development of final-refinements to deal with low-resolution data Ø Development of tailored numerical solvers Future works 12