SlideShare a Scribd company logo
Efficiency Valuation:
Fine Tuning M&V for Business Transactions
Steve Kromer
Efficiency Valuation Organization
Copenhagen, Denmark
April 19th, 2006
2
The Speaker
• Steve Kromer, P.E.
– Twenty years experience in energy efficiency M&V
– Chair, Efficiency Valuation Organization (EVO)
• EVO: Efficiency Valuation Organization
– International non-profit organization
– Manages the IPMVP - Energy Savings Verification
– Developing the IEEFP - Finance Protocol
– Mission:
• To develop and promote the use of standardized efficiency
protocols
• To help users quantify the risks and benefits in efficiency
business transactions
3
Major Points
• Verifying energy efficiency investments in:
• Contract environments (ESCOs)
– Government (US Federal)
– Private
• Public programs (Utility)
• M&V “Protocols”
– IPMVP, FEMP, ASHRAE
– The 2006 California EM&V Protocols
• Identify, Quantify and Manage - Uncertainty
4
Edison’s Brightest Idea
5
Energy Impacts
Energy Efficiency -The Opportunity
• Energy Demand is a function of productivity
– Financial decisions within the firm drive energy purchases
– Optimizing energy utilization (not eliminating)
• Energy Demand contributes to environmental “costs”
– Society demands that these costs are priced
• Taxation – Public Goods Charge on electric bill
– Emissions markets - ETS, CDM, CCX
Markets drive value of efficiency
6
Energy Investment Decisions
Investment in Supply Side
Investment
Demand-SideSupply-Side
Generation
Transmission
Distribution
Efficiency
Demand Response
What Information is needed to support
Supply-Side
• Investment decisions ?
• Implementation ?
• Settlement ?
What Information is needed to support
Supply-Side
• Investment decisions ?
• Implementation ?
• Settlement ?
7
Efficiency Investment Decisions
Information Needs
Investment
Demand-SideSupply-Side
What Information is needed to support
Demand-Side
• Investment decisions ?
• Implementation ?
• Settlement ?
What Information is needed to support
Demand-Side
• Investment decisions ?
• Implementation ?
• Settlement ?
•T -8 Lighting
•New Chiller
•VAV Install
•Controls
•High Efficiency Motors
Generation
Transmission
Distribution
Efficiency
Demand Response
8
Balancing Investment
in Supply and Demand
Investment
•T -8 Lighting
•New Chiller
•Boilers
•Plant Improvements
•Controls
•High Efficiency Motors
Demand-SideSupply-Side
Generation
Transmission
Distribution
Efficiency
Demand Response
9
EXAMPLE: California
2006-2008 Energy Efficiency Programs
Demand-Side
InvestmentInvestment
$2.0 Billion$2.0 Billion
Supply-Side
Generation
Transmission
Distribution
Efficiency
Demand Response
•T -8 Lighting
•New Chiller
•Boilers
•Plant Improvements
•High Efficiency Motors
New EM&V Protocols
Based on:
IPMVP
10
IPMVP
International Performance Measurement and
Verification Protocol
• Volume I - Energy Savings Concepts and Tools
– Defines basic M&V terminology (4 “Options”)
– General procedures to achieve reliable and cost-effective
determination of savings
– Applicable to energy or water efficiency projects in buildings and
industrial plants
• Volume II - Indoor Environmental Quality
• Volume III - New Construction and Renewables
11
M&V Options
Options A and B are
retrofit-isolation
methods
Options C and D are
whole-facility
methods
The difference is
where the boundary
lines are drawn
12
M&V Constraints
• EVERY SITUATION IS DIFFERENT
– Every facility is “wired” differently
– Difficult to create standard M&V plans
• M&V plan costs must be reasonable
– Costs must provide benefits
• Cost of M&V should reflect uncertainty in
project
– Lower uncertainty = less M&V
• M&V should reduce uncertainty
– Benefit is the reduced uncertainty
13
M&V Requires TWO Meters
250,000
500,000
750,000
1,000,000
kWh
Baseline Period Performance Period
WWHH meter
Watt-hour MeterWatt-hour Meter
What Would Have Happened MeterWhat Would Have Happened Meter
14
Watt-hour (Wh) Meters &
What Would Have Happened (WWHH) Meters
What Would Have Happened Meter = Model
Components - Algorithms (Models), Inputs, Metered data
Example 1 - Change Point Models…
Example 2 - Simple Lighting Spreadsheet
Watt-hour Meter
Components - Wheels, Dials, Wires, CTs
15
M&V Decisions
Balancing Benefit and Cost
Cost of
Information
Benefit of
Information?
What Information is needed to support
• Investment decisions ?
• Implementation ?
• Settlement ?
What Information is needed to support
• Investment decisions ?
• Implementation ?
• Settlement ?
Benefit/Cost = 1Benefit/Cost = 1
•Meters
•Analysis
How do we quantify the value of
reduced uncertainty?
•Reduced
Uncertainty
16
Settlement Quality
• We’ve heard about “Investment Grade” Audits
• Now we need “Settlement Quality” M&V
• Can you bank the output of your M&V?
• Is the M&V sufficient for credits, certificates?
17
M&V Contexts
• Government Contracts (ESPC)
– Federal Energy Savings Performance Contracts
• Private Contracts within a firm
– Enron Energy Services
– Energy Asset Management - Project Valuation
• Public Programs (Utility Programs)
– Texas, BC Hydro, New England, Northwest
– California EM&V
18
FEMP Super ESPC
• M&V must follow FEMP M&V Protocol
– Based on IPMVP
– Some instruction on basing M&V on uncertainty
• Hundreds of projects in federal sector
• Measurement plans for each project
• Uncertainty variables identified
• Total uncertainty calculated
• Value of Information = Comfort of Agency
decisions makers
19
Private Firm M&V
• M&V required to justify internal capital
allocations (optimize energy systems)
• Portfolio Approach
– All projects evaluated for uncertainty and risk
– Highest risks get most attention
• Value of M&V - Calculated by risk-adjusted
discount rate (Rigorous!!)
• Requires taking a position on risk/reward
20
California EM&V Protocols
EM&V - Evaluation, Measurement & Verification
• $2 Billion EE Investment by Utilities
• $120 Million budget for EM&V (3 yrs)
–Allocation of EM&V based on uncertainty
–Uncertainty assessed for each program
–Portfolio model assess total uncertainty
–Uses Monte Carlo simulation tool
• http://www.cpuc.ca.gov/static/energy/electric/energy+efficiency/rulemaking/eeevaluation.htm
21
Public Programs:
California EM&V
• Public Goods Charges (tax on ratepayers)
• Political emphasis on “enhancing reliability”
• Approach taken -
– Identify (calculate) “baseline” uncertainty
– Portfolio-wide “risk” assessment
• Allocation of MASSIVE M&V funding based on
risk ($120,000,000 US)
• Relative allocation, not absolute (not rigorous)
• Value based on expected uncertainty reduction
22
“Monte Carlo” Tools
• Common tools using Monte Carlo techniques
• SAS - most common statistical software package
(All big evaluation firms and utilities have SAS)
• SPSS - Statistical Package for Social Sciences
• @Risk (Palisade)
– commerical software
– runs as Excel “add-in”
• Crystal Ball (Decisioneering)
– commercial software
– runs as Excel “add-in”
23
Energy Efficiency Investments
Physical and Financial Risks
+ =
Physical Assumptions Forecast =Range of possible outcomes
24
“Results” - the Forecast
and Sensitivity
25
Applicable at Many levels
• Apply at Portfolio Level (Top down)
– Allocation of EM&V resources
• Apply to Programs
– Planning
• Apply to Project M&V (Bottom up)
– Identifying the variables to measure
• Next step - optimal allocation of resources
– Based of cost of reduced uncertainty
26
Lighting Example
Using Crystal Ball
• Simple “Model”
• Full load hour biggest uncertainty
• Watts of baseline next biggest
• Pre and Post Metering increase precison
27
Applying Risk Analysis to
Programs
Using Crystal Ball
• Accepted “Model”
• Measurable Precision
• Quantified Risk
28
Applying Risk Analysis to
Portfolios
29
Monte Carlo tools
• Compatible with IPMVP
• Simple to apply to any spreadsheet model
• “Best case” “Worst case” “Most likely”
estimates are already in your head.
• Allows systematic management of “estimates”
30
Conclusions
• IPMVP Options successfully applied in
government / private / utility programs
• Identifying, Quantifying and Managing
uncertainty is critical to the business transaction
• The Art of M&V is evolving
• Tools to help quantify uncertainty and optimize
allocation of M&V resources are available
31
Thank You
Join us today:
www.efficiencyvaluation.org
Download IPMVP Volumes:
www.ipmvp.org
Contact me:
Steve Kromer, Chair, EVO Board of Directors:
stevek@efficiencyvaluation.org

More Related Content

PPTX
GTC_Energy Services_Mexico City
PDF
Preliminary Modeling & Life Cycle Costing: Underpinnings of Integrated Design.
PDF
[Infographic] 2013 U.S. Utility Grid Automation Survey (Part 2)
PDF
PDF
Brasilia int school_solar_energy_putting_in_place_the_solar_potential_v1
PPTX
How to Align With The Right EMS Provider
PDF
Accelerating the Benefits of Food and Bev Sustainability Programs
PPTX
Jordi Macià, EURECAT Technology Centre of Catalonia, Barcelona, Spain
GTC_Energy Services_Mexico City
Preliminary Modeling & Life Cycle Costing: Underpinnings of Integrated Design.
[Infographic] 2013 U.S. Utility Grid Automation Survey (Part 2)
Brasilia int school_solar_energy_putting_in_place_the_solar_potential_v1
How to Align With The Right EMS Provider
Accelerating the Benefits of Food and Bev Sustainability Programs
Jordi Macià, EURECAT Technology Centre of Catalonia, Barcelona, Spain

What's hot (19)

PPT
Measurement & Verification
PPT
Paul Hamilton, Schneider Electric: Lean and Clean: Equipping Modern Manufactu...
PPTX
NZC - Olgyay Scaling
PDF
What is a Green Building
PPT
Optimizing machine, line, and process efficiency in manufacturing operations
PPT
AESP_Spring
PDF
Energy Management Impact on Distributed Control Systems (DCS) in Industrial E...
PPTX
Patrik Kolar, Head of Department B (LIFE and Horizon 2020 Energy, Environment...
PPTX
Solar energy ongoing project by Magda Cayón
PPT
Quality and Building Energy Management
PPTX
Building EQ
PDF
The Future of Mining
PPTX
IES Faculty - Closing the Performance Gap
PPTX
C&I Direct Program Presenation
PDF
Taking Stock – 40 years of Industrial Energy Audits
PDF
Sidpec_Egypt
PPTX
American Institute of Architects Committee on the Envrinment
PPTX
Module 3 - Incorporating non-financial data into organisational decision making
PPTX
How green standards are changing data center design and operations
Measurement & Verification
Paul Hamilton, Schneider Electric: Lean and Clean: Equipping Modern Manufactu...
NZC - Olgyay Scaling
What is a Green Building
Optimizing machine, line, and process efficiency in manufacturing operations
AESP_Spring
Energy Management Impact on Distributed Control Systems (DCS) in Industrial E...
Patrik Kolar, Head of Department B (LIFE and Horizon 2020 Energy, Environment...
Solar energy ongoing project by Magda Cayón
Quality and Building Energy Management
Building EQ
The Future of Mining
IES Faculty - Closing the Performance Gap
C&I Direct Program Presenation
Taking Stock – 40 years of Industrial Energy Audits
Sidpec_Egypt
American Institute of Architects Committee on the Envrinment
Module 3 - Incorporating non-financial data into organisational decision making
How green standards are changing data center design and operations
Ad

Similar to Efficiency Valuation: Fine Tuning M&V for Business Transactions (20)

PPTX
Measurement & Verification
PPTX
The ABCs of M&V (measurement & verification of energy savings)
PDF
Time to step up performance-based energy efficiency measurement and verificat...
PDF
Evaluation, Measurement & Verification (EM&V) – Overview of Best Practices fo...
PDF
M&V for Building Performance
PPTX
SESEC Training Module 10: Measurement and Verification
PDF
Simplified Measurement & Verification for Energy, Water & CO2-Savings
PPTX
Catalyst 2016: Cost Avoidance 1: M&V Fundamentals.
PDF
Project Controls Expo, 13th Nov 2013 - "EVM for the Rest of Us" By Javier Slo...
PPTX
Scaling-Up EE Programs: The Measurement Challenge
PPTX
Measuring and Verifying Energy Cost Savings in EnergyCAP
PDF
The Art & Science of Valuation
PDF
Understanding Valuation for Equity Compensation and Avoiding the Perils of 409A
PDF
The Art & Science of Valuation - CleanTech North
PDF
An introduction to an effective earned value management system (EVMS) webinar...
PDF
Back to basics - Earned Value Management for beginners webinar
PDF
Earning Value from Earned Value Management
PDF
What's it Worth? Valuing a Business for Sale
PPT
Basics of valuation 03 12 10 by natarajan
PPT
Basics of valuation 03 12 10 by natarajan
Measurement & Verification
The ABCs of M&V (measurement & verification of energy savings)
Time to step up performance-based energy efficiency measurement and verificat...
Evaluation, Measurement & Verification (EM&V) – Overview of Best Practices fo...
M&V for Building Performance
SESEC Training Module 10: Measurement and Verification
Simplified Measurement & Verification for Energy, Water & CO2-Savings
Catalyst 2016: Cost Avoidance 1: M&V Fundamentals.
Project Controls Expo, 13th Nov 2013 - "EVM for the Rest of Us" By Javier Slo...
Scaling-Up EE Programs: The Measurement Challenge
Measuring and Verifying Energy Cost Savings in EnergyCAP
The Art & Science of Valuation
Understanding Valuation for Equity Compensation and Avoiding the Perils of 409A
The Art & Science of Valuation - CleanTech North
An introduction to an effective earned value management system (EVMS) webinar...
Back to basics - Earned Value Management for beginners webinar
Earning Value from Earned Value Management
What's it Worth? Valuing a Business for Sale
Basics of valuation 03 12 10 by natarajan
Basics of valuation 03 12 10 by natarajan
Ad

More from IEA DSM Implementing Agreement (IA) (20)

PDF
Converting Demand Side Operation in to an Accurate Tool for the Transmission ...
PDF
Customer Organizations
PDF
Market Mechanisms for White Certificates
PDF
Consumer's Services Companies
PDF
Utilities Industry & the Capital Market - Under Pressure - Utilities Global S...
PDF
Practical experiences with internal and external energy performance contracti...
PDF
From theory based policy evaluation to smart policy design: lessons learned f...
PDF
Registration and validation in Denmark – the principles and the chosen solutions
PDF
The New Structure for PSO Activities in Denmark – Goals and Overall Set-up
PDF
Measuring and verifying energy savings within the Energy Fund Model in Norway
PDF
The Italian white certificates market and the measurement and verification of...
PDF
Energy Efficiency Obligations - the UK Practical Experience on Validating & E...
PDF
EU Directive on Energy End-Use and Services
PDF
Automatic meter management – A customer's perspective
PDF
Options for a White Certificates scheme in the Netherlands
PDF
Energy services in practice – Saving energy and directly earn money
PDF
Monitoring information for EU reporting
PDF
Australian Energy Efficiency and Demand Side Management Activities
PDF
USA Activities on DSM (Demand Response & Energy Efficiency)
PDF
The Current Status and Prospect of Distributed Generation in Korea
Converting Demand Side Operation in to an Accurate Tool for the Transmission ...
Customer Organizations
Market Mechanisms for White Certificates
Consumer's Services Companies
Utilities Industry & the Capital Market - Under Pressure - Utilities Global S...
Practical experiences with internal and external energy performance contracti...
From theory based policy evaluation to smart policy design: lessons learned f...
Registration and validation in Denmark – the principles and the chosen solutions
The New Structure for PSO Activities in Denmark – Goals and Overall Set-up
Measuring and verifying energy savings within the Energy Fund Model in Norway
The Italian white certificates market and the measurement and verification of...
Energy Efficiency Obligations - the UK Practical Experience on Validating & E...
EU Directive on Energy End-Use and Services
Automatic meter management – A customer's perspective
Options for a White Certificates scheme in the Netherlands
Energy services in practice – Saving energy and directly earn money
Monitoring information for EU reporting
Australian Energy Efficiency and Demand Side Management Activities
USA Activities on DSM (Demand Response & Energy Efficiency)
The Current Status and Prospect of Distributed Generation in Korea

Recently uploaded (20)

PPTX
An Unlikely Response 08 10 2025.pptx
DOCX
ENGLISH PROJECT FOR BINOD BIHARI MAHTO KOYLANCHAL UNIVERSITY
PPTX
_ISO_Presentation_ISO 9001 and 45001.pptx
PPTX
Sustainable Forest Management ..SFM.pptx
PPTX
water for all cao bang - a charity project
PDF
MODULE 3 BASIC SECURITY DUTIES AND ROLES.pdf
PPTX
NORMAN_RESEARCH_PRESENTATION.in education
PPTX
Lesson-7-Gas. -Exchange_074636.pptx
PPTX
Hydrogel Based delivery Cancer Treatment
PPTX
FINAL TEST 3C_OCTAVIA RAMADHANI SANTOSO-1.pptx
PPTX
PurpoaiveCommunication for students 02.pptx
PPTX
chapter8-180915055454bycuufucdghrwtrt.pptx
PDF
COLEAD A2F approach and Theory of Change
PPTX
Tour Presentation Educational Activity.pptx
PPTX
Tablets And Capsule Preformulation Of Paracetamol
PPT
First Aid Training Presentation Slides.ppt
PPTX
ANICK 6 BIRTHDAY....................................................
PPTX
lesson6-211001025531lesson plan ppt.pptx
PDF
IKS PPT.....................................
PDF
PM Narendra Modi's speech from Red Fort on 79th Independence Day.pdf
An Unlikely Response 08 10 2025.pptx
ENGLISH PROJECT FOR BINOD BIHARI MAHTO KOYLANCHAL UNIVERSITY
_ISO_Presentation_ISO 9001 and 45001.pptx
Sustainable Forest Management ..SFM.pptx
water for all cao bang - a charity project
MODULE 3 BASIC SECURITY DUTIES AND ROLES.pdf
NORMAN_RESEARCH_PRESENTATION.in education
Lesson-7-Gas. -Exchange_074636.pptx
Hydrogel Based delivery Cancer Treatment
FINAL TEST 3C_OCTAVIA RAMADHANI SANTOSO-1.pptx
PurpoaiveCommunication for students 02.pptx
chapter8-180915055454bycuufucdghrwtrt.pptx
COLEAD A2F approach and Theory of Change
Tour Presentation Educational Activity.pptx
Tablets And Capsule Preformulation Of Paracetamol
First Aid Training Presentation Slides.ppt
ANICK 6 BIRTHDAY....................................................
lesson6-211001025531lesson plan ppt.pptx
IKS PPT.....................................
PM Narendra Modi's speech from Red Fort on 79th Independence Day.pdf

Efficiency Valuation: Fine Tuning M&V for Business Transactions

  • 1. Efficiency Valuation: Fine Tuning M&V for Business Transactions Steve Kromer Efficiency Valuation Organization Copenhagen, Denmark April 19th, 2006
  • 2. 2 The Speaker • Steve Kromer, P.E. – Twenty years experience in energy efficiency M&V – Chair, Efficiency Valuation Organization (EVO) • EVO: Efficiency Valuation Organization – International non-profit organization – Manages the IPMVP - Energy Savings Verification – Developing the IEEFP - Finance Protocol – Mission: • To develop and promote the use of standardized efficiency protocols • To help users quantify the risks and benefits in efficiency business transactions
  • 3. 3 Major Points • Verifying energy efficiency investments in: • Contract environments (ESCOs) – Government (US Federal) – Private • Public programs (Utility) • M&V “Protocols” – IPMVP, FEMP, ASHRAE – The 2006 California EM&V Protocols • Identify, Quantify and Manage - Uncertainty
  • 5. 5 Energy Impacts Energy Efficiency -The Opportunity • Energy Demand is a function of productivity – Financial decisions within the firm drive energy purchases – Optimizing energy utilization (not eliminating) • Energy Demand contributes to environmental “costs” – Society demands that these costs are priced • Taxation – Public Goods Charge on electric bill – Emissions markets - ETS, CDM, CCX Markets drive value of efficiency
  • 6. 6 Energy Investment Decisions Investment in Supply Side Investment Demand-SideSupply-Side Generation Transmission Distribution Efficiency Demand Response What Information is needed to support Supply-Side • Investment decisions ? • Implementation ? • Settlement ? What Information is needed to support Supply-Side • Investment decisions ? • Implementation ? • Settlement ?
  • 7. 7 Efficiency Investment Decisions Information Needs Investment Demand-SideSupply-Side What Information is needed to support Demand-Side • Investment decisions ? • Implementation ? • Settlement ? What Information is needed to support Demand-Side • Investment decisions ? • Implementation ? • Settlement ? •T -8 Lighting •New Chiller •VAV Install •Controls •High Efficiency Motors Generation Transmission Distribution Efficiency Demand Response
  • 8. 8 Balancing Investment in Supply and Demand Investment •T -8 Lighting •New Chiller •Boilers •Plant Improvements •Controls •High Efficiency Motors Demand-SideSupply-Side Generation Transmission Distribution Efficiency Demand Response
  • 9. 9 EXAMPLE: California 2006-2008 Energy Efficiency Programs Demand-Side InvestmentInvestment $2.0 Billion$2.0 Billion Supply-Side Generation Transmission Distribution Efficiency Demand Response •T -8 Lighting •New Chiller •Boilers •Plant Improvements •High Efficiency Motors New EM&V Protocols Based on: IPMVP
  • 10. 10 IPMVP International Performance Measurement and Verification Protocol • Volume I - Energy Savings Concepts and Tools – Defines basic M&V terminology (4 “Options”) – General procedures to achieve reliable and cost-effective determination of savings – Applicable to energy or water efficiency projects in buildings and industrial plants • Volume II - Indoor Environmental Quality • Volume III - New Construction and Renewables
  • 11. 11 M&V Options Options A and B are retrofit-isolation methods Options C and D are whole-facility methods The difference is where the boundary lines are drawn
  • 12. 12 M&V Constraints • EVERY SITUATION IS DIFFERENT – Every facility is “wired” differently – Difficult to create standard M&V plans • M&V plan costs must be reasonable – Costs must provide benefits • Cost of M&V should reflect uncertainty in project – Lower uncertainty = less M&V • M&V should reduce uncertainty – Benefit is the reduced uncertainty
  • 13. 13 M&V Requires TWO Meters 250,000 500,000 750,000 1,000,000 kWh Baseline Period Performance Period WWHH meter Watt-hour MeterWatt-hour Meter What Would Have Happened MeterWhat Would Have Happened Meter
  • 14. 14 Watt-hour (Wh) Meters & What Would Have Happened (WWHH) Meters What Would Have Happened Meter = Model Components - Algorithms (Models), Inputs, Metered data Example 1 - Change Point Models… Example 2 - Simple Lighting Spreadsheet Watt-hour Meter Components - Wheels, Dials, Wires, CTs
  • 15. 15 M&V Decisions Balancing Benefit and Cost Cost of Information Benefit of Information? What Information is needed to support • Investment decisions ? • Implementation ? • Settlement ? What Information is needed to support • Investment decisions ? • Implementation ? • Settlement ? Benefit/Cost = 1Benefit/Cost = 1 •Meters •Analysis How do we quantify the value of reduced uncertainty? •Reduced Uncertainty
  • 16. 16 Settlement Quality • We’ve heard about “Investment Grade” Audits • Now we need “Settlement Quality” M&V • Can you bank the output of your M&V? • Is the M&V sufficient for credits, certificates?
  • 17. 17 M&V Contexts • Government Contracts (ESPC) – Federal Energy Savings Performance Contracts • Private Contracts within a firm – Enron Energy Services – Energy Asset Management - Project Valuation • Public Programs (Utility Programs) – Texas, BC Hydro, New England, Northwest – California EM&V
  • 18. 18 FEMP Super ESPC • M&V must follow FEMP M&V Protocol – Based on IPMVP – Some instruction on basing M&V on uncertainty • Hundreds of projects in federal sector • Measurement plans for each project • Uncertainty variables identified • Total uncertainty calculated • Value of Information = Comfort of Agency decisions makers
  • 19. 19 Private Firm M&V • M&V required to justify internal capital allocations (optimize energy systems) • Portfolio Approach – All projects evaluated for uncertainty and risk – Highest risks get most attention • Value of M&V - Calculated by risk-adjusted discount rate (Rigorous!!) • Requires taking a position on risk/reward
  • 20. 20 California EM&V Protocols EM&V - Evaluation, Measurement & Verification • $2 Billion EE Investment by Utilities • $120 Million budget for EM&V (3 yrs) –Allocation of EM&V based on uncertainty –Uncertainty assessed for each program –Portfolio model assess total uncertainty –Uses Monte Carlo simulation tool • http://www.cpuc.ca.gov/static/energy/electric/energy+efficiency/rulemaking/eeevaluation.htm
  • 21. 21 Public Programs: California EM&V • Public Goods Charges (tax on ratepayers) • Political emphasis on “enhancing reliability” • Approach taken - – Identify (calculate) “baseline” uncertainty – Portfolio-wide “risk” assessment • Allocation of MASSIVE M&V funding based on risk ($120,000,000 US) • Relative allocation, not absolute (not rigorous) • Value based on expected uncertainty reduction
  • 22. 22 “Monte Carlo” Tools • Common tools using Monte Carlo techniques • SAS - most common statistical software package (All big evaluation firms and utilities have SAS) • SPSS - Statistical Package for Social Sciences • @Risk (Palisade) – commerical software – runs as Excel “add-in” • Crystal Ball (Decisioneering) – commercial software – runs as Excel “add-in”
  • 23. 23 Energy Efficiency Investments Physical and Financial Risks + = Physical Assumptions Forecast =Range of possible outcomes
  • 24. 24 “Results” - the Forecast and Sensitivity
  • 25. 25 Applicable at Many levels • Apply at Portfolio Level (Top down) – Allocation of EM&V resources • Apply to Programs – Planning • Apply to Project M&V (Bottom up) – Identifying the variables to measure • Next step - optimal allocation of resources – Based of cost of reduced uncertainty
  • 26. 26 Lighting Example Using Crystal Ball • Simple “Model” • Full load hour biggest uncertainty • Watts of baseline next biggest • Pre and Post Metering increase precison
  • 27. 27 Applying Risk Analysis to Programs Using Crystal Ball • Accepted “Model” • Measurable Precision • Quantified Risk
  • 28. 28 Applying Risk Analysis to Portfolios
  • 29. 29 Monte Carlo tools • Compatible with IPMVP • Simple to apply to any spreadsheet model • “Best case” “Worst case” “Most likely” estimates are already in your head. • Allows systematic management of “estimates”
  • 30. 30 Conclusions • IPMVP Options successfully applied in government / private / utility programs • Identifying, Quantifying and Managing uncertainty is critical to the business transaction • The Art of M&V is evolving • Tools to help quantify uncertainty and optimize allocation of M&V resources are available
  • 31. 31 Thank You Join us today: www.efficiencyvaluation.org Download IPMVP Volumes: www.ipmvp.org Contact me: Steve Kromer, Chair, EVO Board of Directors: stevek@efficiencyvaluation.org