SlideShare a Scribd company logo
25th Annual Technical Conference - 2018
Author:
Asoka Korale, Ph.D., C.Eng., MIET
A Framework for Dynamic Pricing Electricity
Consumption Patterns via Time Series
Clustering of Consumer Demand
Introduction
• Innovative strategies to manage Consumer Demand
Smart Metering 
Consumer Expectations and Service Levels in an Environment of Complex Solutions
Expectation of High quality uninterrupted power supply
Complex power trading arrangement between consumers and utilities
Hybrid solutions including Solar and Battery Backup
 Complex and unique power consumption patterns
Challenges of meeting Dynamic Demand
Generation & Distribution dimensioned to meet Peak Demand
A typical Demand Pattern across Sectors
High infrastructure cost to meet peak demand
Imperatives for Managing Consumer Demand
Peak demand in a segment considerably higher than average
Different segments have different patterns
Managing Consumer Demand a key Strategy of the Utility
Lower operating costs Lower infrastructure costs
Lower / manage the risks of outages
Ensure better quality of supply
More predictable
Segmenting Household Power Consumption Patterns via Time Series Clustering
Model underlying Stochastic Process
 AR, MA, ARMA, ARMA ….
Model Based Clustering
https://www.safaribooksonline.com/library/view/r-data-analysis/9781786463500/ch36s03.html
Time series as being
generated by a random process
Hannan-Rissanen Algorithm to Estimate Parameters of ARMA(p,q)
qnqnnpnpnn bbYaYaY    ...... 1111
Initial parameter estimate as high order (m)
pure AR process

































)(
...
)1(
..
)0(...)1(
.........
)1(...r(0) 1
mr
r
rmr
mr
m

npnmnn YYY    ...11
Yule-Walker Equations to estimate AR parameters
mnmnnn YYY    ...11
Error term via pure high order AR process
Hannan-Rissanen Algorithm to Estimate parameters of ARMA(p,q)
Least squares to estimate ARMA parameters
mM 
mMMM TT 1
)( 

Populate matrix with lagged error terms estimated via pure AR process
nnn YY ˆ
which with some
modifications can
be put in the form
forming a least squares estimate for the ARMA parameters
qnqnpnpnn bbYaYaY    ......ˆ
1111where




































































qpn
pn
pn
n
q
p
qpnqpnqpn
qnnpnn
y
y
y
y
b
b
a
a
y
yy
...
...
...
...
1
...
......
1
1
1
21
1


]...[ 11 qp bbaa
Frequency Response from Pole Zero Map
)(
]...a[1
]...b[1
Y(z) 1
1
1
1
zE
zaz
zbz
p
p
q
q





B(z)
A(z)
n nY
Digital Signal Processing by Proakis and Manolakis
H = Y(z)/E(z) as product of complex roots
log(MSE(p+q))
AIC(p+q)
Model Order (p+q)
Akaike Information Criteria
Tradeoff between model complexity and prediction error
AIC = log(error variance or sum of squared prediction error) + 2*(p+q)
Minimum point of AIC curve gives optimum trade off
between model complexity and variance in error
Conditions of the Sample Survey
104 power consumption patterns
Each pattern an average over one month of weekdays
96 power measurements at 15 minute intervals in a day
Households in the Rajagiriya Area
Diverse sample of Households
Total System Power Consumption Pattern
Two peak periods
Peak a 66% increase over mean
of considerable length: 2.5 Hrs & 3 Hrs
Aggregate behavior less volatile
104 households at 15 minute intervals
ARMA Modeling of Power Consumption Patterns
Time series of complexity ARMA(1,2) Clustering ARMA(1,2) Parameters
Large majority in cluster Close correspondence between model parameters
Outlier Power Consumption Patterns of Complexity ARMA(3,4)
Params: a1 a2 a3 1 b1 b2 b3 b4 ]
[H1 #26: 0.8369 -0.7429 1.0646 1 0.8309 0.6752 0.5491 0.3363]
[H2 #60: 0.9325 -0.8261 0.9477 1 0.8137 0.6589 0.5539 0.3765]
Close match between
ARMA parameters sets
Outlier Power Consumption Patterns – ARMA(3,4) Frequency Response
close correspondence in response between two systems
Expected Temporal Behavior of Price Elasticity of Demand for Electricity
Electricity Demand a time varying function
Time of Day (Hrs)
KW
Greater inelasticity expected near peak demand
Away from peak
Nearer peak
P1
Price Elasticity of Demand should vary with time of day, segment, demographics, location …
Peak Demand Pattern & Price Elasticity of Demand
Determine change in Price needed to effect a change in Quantity Demanded
Identify Peak Demand and Energy consumption to moderate demand
Time of Day (Hrs)
KW
Demand Modification Strategy
Modified DemandPeak Consumption Pattern
Time of Day (Hrs)
KW
Demand increases on either side of peak with lower pricesPrice increases with demand
Amount consumed drops with increasing price Amount consumed increases with lower prices
KW
Conclusion
• Power patterns can be grouped by modeling as the result of an ARMA random process
• Such groups exhibit fairly close correspondence in both time and frequency behavior
• Strategies that take advantage of the group consumption pattern can be devised
• Dynamic pricing strategies can be implemented to moderate the peak and even the load
• Unique strategies can be devised catering to specific patterns (groups) of usage
• Outlier power patterns can be detected providing insights to anomalous consumption behavior
THANK YOU

More Related Content

PPT
Energy Savings Through Metering
PDF
arq3-3_power
PDF
Integrating probabilistic assessment of security of electricity supply into l...
PDF
Grid Features in the TIMES-based Japan Model
PDF
An integrated OPF dispatching model with wind power and demand response for d...
PPTX
Power plant economics
PDF
Analysis of the role of energy storages in Germany with TIMES PanEU – methodo...
PDF
Analysis of the relative roles of supply-side and demand-side measures in tac...
Energy Savings Through Metering
arq3-3_power
Integrating probabilistic assessment of security of electricity supply into l...
Grid Features in the TIMES-based Japan Model
An integrated OPF dispatching model with wind power and demand response for d...
Power plant economics
Analysis of the role of energy storages in Germany with TIMES PanEU – methodo...
Analysis of the relative roles of supply-side and demand-side measures in tac...

What's hot (20)

PDF
V2G: Measuring Electric Vehicle Drivers’ Willingness to Co-create Flexibility...
PDF
Jorim de Boks - PZEM
PDF
How costs affect deployment of low carbon technologies - analysis with JRC-EU...
PDF
Analysis of distribution grid tariffs in the Norwegian energy system
PDF
JRC-EU-TIMES updates and outlook
PDF
ETSAP-TIAM update and re-calibration
PDF
Predictive control for energy aware consolidation in cloud datacenters
PPTX
RE‐INVEST project: Exploiting sector synergies and countries interconnections...
PPT
Thesis Presentation
PDF
Selecting representative days
PPTX
Actual cost example
PDF
Integrating renewables and enabling flexibility of households and buildings
PPT
Session 6 project economics
PDF
Climate policy Engagement in Brazil: how delayed action might lead to CCS as ...
PPTX
Presentation
PPT
COSTMODEL_IDETC_2010_Jie
PPTX
Siad el quliti economic scheduling the construction of electric transmission
PDF
Energy Models and Scenarios - predicting Germany's electricity production sys...
PDF
EFEU / FLEXe Antila Heli in the future it is more important when you use elec...
V2G: Measuring Electric Vehicle Drivers’ Willingness to Co-create Flexibility...
Jorim de Boks - PZEM
How costs affect deployment of low carbon technologies - analysis with JRC-EU...
Analysis of distribution grid tariffs in the Norwegian energy system
JRC-EU-TIMES updates and outlook
ETSAP-TIAM update and re-calibration
Predictive control for energy aware consolidation in cloud datacenters
RE‐INVEST project: Exploiting sector synergies and countries interconnections...
Thesis Presentation
Selecting representative days
Actual cost example
Integrating renewables and enabling flexibility of households and buildings
Session 6 project economics
Climate policy Engagement in Brazil: how delayed action might lead to CCS as ...
Presentation
COSTMODEL_IDETC_2010_Jie
Siad el quliti economic scheduling the construction of electric transmission
Energy Models and Scenarios - predicting Germany's electricity production sys...
EFEU / FLEXe Antila Heli in the future it is more important when you use elec...
Ad

Similar to A framework for dynamic pricing electricity consumption patterns via time series clustering of consumer demand (20)

PDF
Breaking Down Analytical and Computational Barriers Across the Energy Industr...
PPT
Electricity Demand Side Management (DSM) and End-use Efficiency
PPT
Electricity Demand Side Management and End-use efficiency
PPTX
Demand side management
PDF
Advance Data Mining - Analysis and forecasting of power factor for optimum el...
PDF
IRJET- A Comparative Forecasting Analysis of ARIMA Model Vs Random Forest Alg...
PPTX
loss allocation methods in transactive energy market
PPTX
University of Victoria Talk - Metocean analysis and Machine Learning for Impr...
PPTX
The merits of integrating renewables with smarter grid carimet
PDF
Congestion Management Approaches in Deregulated Electricity Market: A Compreh...
PDF
Reliability Constrained Unit Commitment Considering the Effect of DG and DR P...
PDF
Aia tata power_26112010 r1
PPTX
Predicting Power Consumption for a Greener Tomorrow: Machine Learning Project...
PDF
Kalman Filter Algorithm for Mitigation of Power System Harmonics
PPTX
A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...
PDF
Power Management in Wireless Sensor Network
PDF
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
PDF
BDE SC3.3 Workshop - Wind Farm Monitoring and advanced analytics
PDF
Enhancing the Electric Grid Reliability through Data Analytics
PPTX
P2P energy trading and energy management system
Breaking Down Analytical and Computational Barriers Across the Energy Industr...
Electricity Demand Side Management (DSM) and End-use Efficiency
Electricity Demand Side Management and End-use efficiency
Demand side management
Advance Data Mining - Analysis and forecasting of power factor for optimum el...
IRJET- A Comparative Forecasting Analysis of ARIMA Model Vs Random Forest Alg...
loss allocation methods in transactive energy market
University of Victoria Talk - Metocean analysis and Machine Learning for Impr...
The merits of integrating renewables with smarter grid carimet
Congestion Management Approaches in Deregulated Electricity Market: A Compreh...
Reliability Constrained Unit Commitment Considering the Effect of DG and DR P...
Aia tata power_26112010 r1
Predicting Power Consumption for a Greener Tomorrow: Machine Learning Project...
Kalman Filter Algorithm for Mitigation of Power System Harmonics
A Hybrid Method of CART and Artificial Neural Network for Short Term Load For...
Power Management in Wireless Sensor Network
CoolDC'16: Seeing into a Public Cloud: Monitoring the Massachusetts Open Cloud
BDE SC3.3 Workshop - Wind Farm Monitoring and advanced analytics
Enhancing the Electric Grid Reliability through Data Analytics
P2P energy trading and energy management system
Ad

More from Asoka Korale (20)

DOCX
Improving predictability and performance by relating the number of events and...
PPTX
Improving predictability and performance by relating the number of events and...
PPTX
Novel price models in the capital market
PDF
Modeling prices for capital market surveillance
DOCX
Entity profling and collusion detection
PDF
Entity Profiling and Collusion Detection
PDF
Markov Decision Processes in Market Surveillance
PDF
A framework for dynamic pricing electricity consumption patterns via time ser...
DOC
Customer Lifetime Value Modeling
DOCX
Forecasting models for Customer Lifetime Value
DOC
Capacity and utilization enhancement
DOC
Cell load KPIs in support of event triggered Cellular Yield Maximization
DOCX
Vehicular Traffic Monitoring Scenarios
PPTX
Mixed Numeric and Categorical Attribute Clustering Algorithm
PPTX
Introduction to Bit Coin Model
PPTX
Estimating Gaussian Mixture Densities via an implemetation of the Expectaatio...
PPTX
Mapping Mobile Average Revenue per User to Personal Income level via Househol...
DOCX
Asoka_Korale_Event_based_CYM_IET_2013_submitted linkedin
PPTX
event tiggered cellular yield enhancement linkedin
DOCX
IET_Estimating_market_share_through_mobile_traffic_analysis linkedin
Improving predictability and performance by relating the number of events and...
Improving predictability and performance by relating the number of events and...
Novel price models in the capital market
Modeling prices for capital market surveillance
Entity profling and collusion detection
Entity Profiling and Collusion Detection
Markov Decision Processes in Market Surveillance
A framework for dynamic pricing electricity consumption patterns via time ser...
Customer Lifetime Value Modeling
Forecasting models for Customer Lifetime Value
Capacity and utilization enhancement
Cell load KPIs in support of event triggered Cellular Yield Maximization
Vehicular Traffic Monitoring Scenarios
Mixed Numeric and Categorical Attribute Clustering Algorithm
Introduction to Bit Coin Model
Estimating Gaussian Mixture Densities via an implemetation of the Expectaatio...
Mapping Mobile Average Revenue per User to Personal Income level via Househol...
Asoka_Korale_Event_based_CYM_IET_2013_submitted linkedin
event tiggered cellular yield enhancement linkedin
IET_Estimating_market_share_through_mobile_traffic_analysis linkedin

Recently uploaded (20)

PPTX
Geodesy 1.pptx...............................................
PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PDF
Well-logging-methods_new................
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PPTX
bas. eng. economics group 4 presentation 1.pptx
PPTX
Sustainable Sites - Green Building Construction
PPTX
UNIT 4 Total Quality Management .pptx
PDF
composite construction of structures.pdf
PPTX
Safety Seminar civil to be ensured for safe working.
PPTX
OOP with Java - Java Introduction (Basics)
DOCX
573137875-Attendance-Management-System-original
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PPTX
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
PDF
Unit I ESSENTIAL OF DIGITAL MARKETING.pdf
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
PPT
Project quality management in manufacturing
PDF
Operating System & Kernel Study Guide-1 - converted.pdf
PDF
737-MAX_SRG.pdf student reference guides
Geodesy 1.pptx...............................................
Embodied AI: Ushering in the Next Era of Intelligent Systems
Well-logging-methods_new................
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
bas. eng. economics group 4 presentation 1.pptx
Sustainable Sites - Green Building Construction
UNIT 4 Total Quality Management .pptx
composite construction of structures.pdf
Safety Seminar civil to be ensured for safe working.
OOP with Java - Java Introduction (Basics)
573137875-Attendance-Management-System-original
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
Unit I ESSENTIAL OF DIGITAL MARKETING.pdf
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
UNIT-1 - COAL BASED THERMAL POWER PLANTS
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
Project quality management in manufacturing
Operating System & Kernel Study Guide-1 - converted.pdf
737-MAX_SRG.pdf student reference guides

A framework for dynamic pricing electricity consumption patterns via time series clustering of consumer demand

  • 1. 25th Annual Technical Conference - 2018 Author: Asoka Korale, Ph.D., C.Eng., MIET A Framework for Dynamic Pricing Electricity Consumption Patterns via Time Series Clustering of Consumer Demand
  • 2. Introduction • Innovative strategies to manage Consumer Demand Smart Metering 
  • 3. Consumer Expectations and Service Levels in an Environment of Complex Solutions Expectation of High quality uninterrupted power supply Complex power trading arrangement between consumers and utilities Hybrid solutions including Solar and Battery Backup  Complex and unique power consumption patterns
  • 4. Challenges of meeting Dynamic Demand Generation & Distribution dimensioned to meet Peak Demand A typical Demand Pattern across Sectors High infrastructure cost to meet peak demand
  • 5. Imperatives for Managing Consumer Demand Peak demand in a segment considerably higher than average Different segments have different patterns Managing Consumer Demand a key Strategy of the Utility Lower operating costs Lower infrastructure costs Lower / manage the risks of outages Ensure better quality of supply More predictable
  • 6. Segmenting Household Power Consumption Patterns via Time Series Clustering Model underlying Stochastic Process  AR, MA, ARMA, ARMA …. Model Based Clustering https://www.safaribooksonline.com/library/view/r-data-analysis/9781786463500/ch36s03.html Time series as being generated by a random process
  • 7. Hannan-Rissanen Algorithm to Estimate Parameters of ARMA(p,q) qnqnnpnpnn bbYaYaY    ...... 1111 Initial parameter estimate as high order (m) pure AR process                                  )( ... )1( .. )0(...)1( ......... )1(...r(0) 1 mr r rmr mr m  npnmnn YYY    ...11 Yule-Walker Equations to estimate AR parameters mnmnnn YYY    ...11 Error term via pure high order AR process
  • 8. Hannan-Rissanen Algorithm to Estimate parameters of ARMA(p,q) Least squares to estimate ARMA parameters mM  mMMM TT 1 )(   Populate matrix with lagged error terms estimated via pure AR process nnn YY ˆ which with some modifications can be put in the form forming a least squares estimate for the ARMA parameters qnqnpnpnn bbYaYaY    ......ˆ 1111where                                                                     qpn pn pn n q p qpnqpnqpn qnnpnn y y y y b b a a y yy ... ... ... ... 1 ... ...... 1 1 1 21 1   ]...[ 11 qp bbaa
  • 9. Frequency Response from Pole Zero Map )( ]...a[1 ]...b[1 Y(z) 1 1 1 1 zE zaz zbz p p q q      B(z) A(z) n nY Digital Signal Processing by Proakis and Manolakis H = Y(z)/E(z) as product of complex roots
  • 10. log(MSE(p+q)) AIC(p+q) Model Order (p+q) Akaike Information Criteria Tradeoff between model complexity and prediction error AIC = log(error variance or sum of squared prediction error) + 2*(p+q) Minimum point of AIC curve gives optimum trade off between model complexity and variance in error
  • 11. Conditions of the Sample Survey 104 power consumption patterns Each pattern an average over one month of weekdays 96 power measurements at 15 minute intervals in a day Households in the Rajagiriya Area Diverse sample of Households
  • 12. Total System Power Consumption Pattern Two peak periods Peak a 66% increase over mean of considerable length: 2.5 Hrs & 3 Hrs Aggregate behavior less volatile 104 households at 15 minute intervals
  • 13. ARMA Modeling of Power Consumption Patterns Time series of complexity ARMA(1,2) Clustering ARMA(1,2) Parameters Large majority in cluster Close correspondence between model parameters
  • 14. Outlier Power Consumption Patterns of Complexity ARMA(3,4) Params: a1 a2 a3 1 b1 b2 b3 b4 ] [H1 #26: 0.8369 -0.7429 1.0646 1 0.8309 0.6752 0.5491 0.3363] [H2 #60: 0.9325 -0.8261 0.9477 1 0.8137 0.6589 0.5539 0.3765] Close match between ARMA parameters sets
  • 15. Outlier Power Consumption Patterns – ARMA(3,4) Frequency Response close correspondence in response between two systems
  • 16. Expected Temporal Behavior of Price Elasticity of Demand for Electricity Electricity Demand a time varying function Time of Day (Hrs) KW Greater inelasticity expected near peak demand Away from peak Nearer peak P1 Price Elasticity of Demand should vary with time of day, segment, demographics, location …
  • 17. Peak Demand Pattern & Price Elasticity of Demand Determine change in Price needed to effect a change in Quantity Demanded Identify Peak Demand and Energy consumption to moderate demand Time of Day (Hrs) KW
  • 18. Demand Modification Strategy Modified DemandPeak Consumption Pattern Time of Day (Hrs) KW Demand increases on either side of peak with lower pricesPrice increases with demand Amount consumed drops with increasing price Amount consumed increases with lower prices KW
  • 19. Conclusion • Power patterns can be grouped by modeling as the result of an ARMA random process • Such groups exhibit fairly close correspondence in both time and frequency behavior • Strategies that take advantage of the group consumption pattern can be devised • Dynamic pricing strategies can be implemented to moderate the peak and even the load • Unique strategies can be devised catering to specific patterns (groups) of usage • Outlier power patterns can be detected providing insights to anomalous consumption behavior