SlideShare a Scribd company logo
Using Data Analytics to Bridge the
Gap between M&V 1.0 and 2.0
Paul Dobrowsky
ERS
WHY DO WE NEED MORE M&V?
A Framework for Comparing M&V
1. What happened? – Precision
2. Why did it happen? – Insights
3. Can we apply the insights? – Timeliness
4. And ideally...it’s cost effective – Cost
Precision Insights Timeliness Cost
Presentation Roadmap
Current Methods
• Traditional M&V (IPMVP A/B)
• M&V 2.0 (AMI)
A New Way Forward?
• EDGE M&V
• Example - Con Edison EDGE M&V
• How does it stack up?
Some Quick Caveats….
• All methods are examined under the lens of
the commercial and industrial (C&I) sector
• Different bar heights represent a qualitative,
not quantitative, appraisal of the relative
strengths in each category
Traditional M&V
• Precision: Directly coupled with cost through site visits
• Insights: Granular data collection…on a small sample of sites
• Timeliness: Begins after program life cycle
• Cost: Site visit focus is costly
Precision Insights Timeliness Cost
M&V 2.0
• Analysis of AMI billing data
• No on-site presence
• Results can approach real-time
Precision Insights Timeliness Cost
?
M&V 2.0 - Precision
Precision Insights Timeliness Cost
?
• “Big Data” analytics – can analyze a larger
number of sites
• Issues finding clean/representative data –
significant data processing
M&V 2.0 - Insights
Precision Insights Timeliness Cost
?
• Reliance on large aggregate analysis and full
building data can make it difficult to parse
outcomes
M&V 2.0 - Timeliness
Precision Insights Timeliness Cost
?
• Data is readily available through utility
platform, analysis results can begin
percolating once projects are installed
M&V 2.0 - Cost
Precision Insights Timeliness Cost
?
• Large amount of data processing/cleaning
• Costs decoupled from number of projects in
analysis group
Can We Bridge the Gap?
• Traditional is reliable, but insights come too late.
• Insights tied to small number of projects.
• Cost scales directly with desired precision.
Precision Insights Timeliness Cost
?
Can We Bridge the Gap?
• M&V 2.0 theoretically scales well and brings answers on
performance more quickly.
• Lacks the depth and granularity for individual measure-level
insight.
• Jury still out on precision.
Precision Insights Timeliness Cost
?
Precision Insights Timeliness Cost
Can We Bridge the Gap?
Neither approach fits every need!
?
EDGE M&V
• Energy-focused
• Deep
• Granular
• Evaluation M&V
EDGE M&V
• Tracking Data: Coordination with Implementation
• Predictive Features: Flexible (past M&V, AMI…)
EDGE M&V
• Automated processing of tracking data
• Engineer oversight
EDGE M&V
• Initial Validation: Past M&V Data
• Ongoing validation: Additional Post-Install M&V
EDGE M&V
• Results as real-time as Tracking availability
• Work with PA to make model work for them
EDGE M&V Implementation
• BQDM target: More than 52 MW of demand reduction
at peak hours
• Primarily through SBDI lighting projects
• Over 4,000 businesses effected so far
• Regulator requires quarterly reporting on achieved
reductions
EDGE M&V Implementation
• Completed in 2015
• Over 400 loggers
characterizing SBDI
lighting behavior
• Structured by space
type and business
demographics
• Added additional
structure to tracking
data to allow for
data transformation
• Improved to weekly
reporting of
installations
• Unique opportunity
to utilize an EDGE
approach!
EDGE M&V Implementation
• Delivered five-day turnaround on impact of over
1,500 businesses in 2016
• Leveraging findings to plan future implementation
Initial Validation 5% Absolute Precision
Final Validation Results coming in March!
EDGE M&V
• Measure-level modeling
• Flexible data sources
• Continuous impact reporting through
integration with tracking data
Precision Insights Timeliness Cost
EDGE M&V - Precision
• Utilize past M&V data to construct model
• Measure-level modeling on predictive factors
provides precision similar to Traditional M&V
Precision Insights Timeliness Cost
EDGE M&V - Insights
• Granular analysis of measure-level we can
learn how impacts are trending
Precision Insights Timeliness Cost
EDGE M&V - Timeliness
• Impact projections are available as
implementation tracking data updates
• Requires cooperation/coordination with
implementation contractor
Precision Insights Timeliness Cost
EDGE M&V - Cost
• Limited additional site work
• Costs are decoupled from precision, allows
focus to shift to realizing value of insights
Precision Insights Timeliness Cost
Methods Overview
EDGE M&V
M&V 2.0
Traditional M&V
?
Final Takeaways
• Current M&V methods don’t allow us to
unlock value – M&V is a cost center
• EDGE M&V merges speed and cost
effectiveness with measure-level focus
• Decouple cost from Precision and the focus
shifts to Insights
Questions?
Paul Dobrowsky
Engineer – Data Analytics
pdobrowsky@ers-inc.com

More Related Content

PDF
GISinc Cost Map for Water Utilities ArcGIS | Opelika Case Study
PPTX
Direct Channel Demand Planning (Fortune 100 Technology Company)
PPTX
Sales & Operations Planning (Fortune 100 Technology Company)
PDF
2014 PV Performance Modeling Workshop: SolarAnywhere: WebWeb-Accessible Irrad...
PPTX
Demand Planning for NPIs (Fortune 100 Technology Company)
PDF
The Future of Visualization
PDF
Making the Case for NoSQL
PPTX
Chris Irwin - Business Development Director, Tridium
GISinc Cost Map for Water Utilities ArcGIS | Opelika Case Study
Direct Channel Demand Planning (Fortune 100 Technology Company)
Sales & Operations Planning (Fortune 100 Technology Company)
2014 PV Performance Modeling Workshop: SolarAnywhere: WebWeb-Accessible Irrad...
Demand Planning for NPIs (Fortune 100 Technology Company)
The Future of Visualization
Making the Case for NoSQL
Chris Irwin - Business Development Director, Tridium

What's hot (12)

PPTX
IES BIM Faculty - BIM4Analysis Update
PDF
Wi fi tracker-jan26_larry
PPTX
BIFM Event: Intelligent Big Data in Building Facilities & Services
PPTX
520 project ppt
PDF
Equota Pitch Deck EN 2015
PPTX
520 project
PPTX
Keeping a Common Address Database “Common” Using FME
PDF
IBM Internet of Things Keynote @ m2m World Congress - April 2015
PPTX
How TAG brings value to Surety Agents
 
PPTX
Fall 2013 release webinar
PDF
Xpediter 9.4 – Value Today, Essential Tomorrow Webcast
PDF
LeanIX New API Tokens
IES BIM Faculty - BIM4Analysis Update
Wi fi tracker-jan26_larry
BIFM Event: Intelligent Big Data in Building Facilities & Services
520 project ppt
Equota Pitch Deck EN 2015
520 project
Keeping a Common Address Database “Common” Using FME
IBM Internet of Things Keynote @ m2m World Congress - April 2015
How TAG brings value to Surety Agents
 
Fall 2013 release webinar
Xpediter 9.4 – Value Today, Essential Tomorrow Webcast
LeanIX New API Tokens
Ad

Similar to Using Data Analytics to Bridge the Gap between M&V 1.0 and 2.0 (20)

PDF
The Practical Application of 5D BIM to controls
PDF
Enhancing project management and control by levering visualization and 4D sch...
PDF
Android Based Water Meter Reader for Water Comoanies
PDF
Estimation of a micro services based estimation application bhawna thakur -...
PPTX
3D Models for Construction Estimating
PPTX
Delivering Projects Better with BIM
PDF
eSmart Systems, Digitalizing the future
PDF
AVEVA World Conference NA - Patrick Reilly, Vista Projects
PPTX
Proposal for PSEB
PDF
Edinburgh Revit User Group - BIM Level 2 to LOD Presentation
PPTX
Overcoming the 5 Most Common PCM Challenges
PPTX
How the economist with cloud BI and Looker have improved data-driven decision...
PDF
M.S.ENG. Lean/Six-Sigma Project Technical Documentation
PDF
Neo4j + Process Tempo present Plan Your Cloud Migration with Confidence
PDF
Implementing Advanced Analytics Platform
PPTX
Tata steel ideation contest
PPTX
Tata steel ideation
PDF
Tata steel ideation contest
PDF
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
PPTX
#ATAGTR2021 Presentation : "Performance Evaluation Strategy of multi-access e...
The Practical Application of 5D BIM to controls
Enhancing project management and control by levering visualization and 4D sch...
Android Based Water Meter Reader for Water Comoanies
Estimation of a micro services based estimation application bhawna thakur -...
3D Models for Construction Estimating
Delivering Projects Better with BIM
eSmart Systems, Digitalizing the future
AVEVA World Conference NA - Patrick Reilly, Vista Projects
Proposal for PSEB
Edinburgh Revit User Group - BIM Level 2 to LOD Presentation
Overcoming the 5 Most Common PCM Challenges
How the economist with cloud BI and Looker have improved data-driven decision...
M.S.ENG. Lean/Six-Sigma Project Technical Documentation
Neo4j + Process Tempo present Plan Your Cloud Migration with Confidence
Implementing Advanced Analytics Platform
Tata steel ideation contest
Tata steel ideation
Tata steel ideation contest
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
#ATAGTR2021 Presentation : "Performance Evaluation Strategy of multi-access e...
Ad

More from Zondits (20)

PDF
Fitting Energy Efficiency Into Commercial Tenant Fits Outs
PDF
Tenant Focus: Winning Efficiency Projects in the Commercial Space
PPTX
Charging Up End Users for Energy Storage: Who to Target?
PPTX
Pay For Performance Incentives Using Performance-Based Rebates
PDF
Packaged CHP Programs and Non-Wires Solutions
PPTX
What's Hot? Combined Heat and Power (CHP)
PPTX
Commercial Building Codes: Finding the Path to Improved Compliance
PPTX
Facility Scale Battery Storage
PDF
ERS at PSEG LI October 2015
PPTX
Maintaining and Growing Efficiency Efforts in the Changing C&I Landscape
PPTX
Are we there yet
PDF
Integrating processimpactevals
PDF
Facility scaleenergystorage
PPTX
Optimization of industrial refrigeration plants
PPTX
The benefits of advanced thermostats
PPTX
Subsidizing the installation of demand enabling technologies
PPTX
Integrating fuel cell systems in critical industrial processes
PPTX
Innovative compressed air case studies
PPTX
Industrial approaches addressing new energy code
PPTX
Identifying high value chp candidates
Fitting Energy Efficiency Into Commercial Tenant Fits Outs
Tenant Focus: Winning Efficiency Projects in the Commercial Space
Charging Up End Users for Energy Storage: Who to Target?
Pay For Performance Incentives Using Performance-Based Rebates
Packaged CHP Programs and Non-Wires Solutions
What's Hot? Combined Heat and Power (CHP)
Commercial Building Codes: Finding the Path to Improved Compliance
Facility Scale Battery Storage
ERS at PSEG LI October 2015
Maintaining and Growing Efficiency Efforts in the Changing C&I Landscape
Are we there yet
Integrating processimpactevals
Facility scaleenergystorage
Optimization of industrial refrigeration plants
The benefits of advanced thermostats
Subsidizing the installation of demand enabling technologies
Integrating fuel cell systems in critical industrial processes
Innovative compressed air case studies
Industrial approaches addressing new energy code
Identifying high value chp candidates

Recently uploaded (20)

PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PPTX
Geodesy 1.pptx...............................................
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PPTX
bas. eng. economics group 4 presentation 1.pptx
PPTX
Welding lecture in detail for understanding
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PPTX
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
DOCX
573137875-Attendance-Management-System-original
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PDF
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
PPTX
OOP with Java - Java Introduction (Basics)
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PPTX
web development for engineering and engineering
PPTX
Lecture Notes Electrical Wiring System Components
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
Geodesy 1.pptx...............................................
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
bas. eng. economics group 4 presentation 1.pptx
Welding lecture in detail for understanding
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
573137875-Attendance-Management-System-original
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
OOP with Java - Java Introduction (Basics)
CYBER-CRIMES AND SECURITY A guide to understanding
web development for engineering and engineering
Lecture Notes Electrical Wiring System Components
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx

Using Data Analytics to Bridge the Gap between M&V 1.0 and 2.0

  • 1. Using Data Analytics to Bridge the Gap between M&V 1.0 and 2.0 Paul Dobrowsky ERS
  • 2. WHY DO WE NEED MORE M&V?
  • 3. A Framework for Comparing M&V 1. What happened? – Precision 2. Why did it happen? – Insights 3. Can we apply the insights? – Timeliness 4. And ideally...it’s cost effective – Cost Precision Insights Timeliness Cost
  • 4. Presentation Roadmap Current Methods • Traditional M&V (IPMVP A/B) • M&V 2.0 (AMI) A New Way Forward? • EDGE M&V • Example - Con Edison EDGE M&V • How does it stack up?
  • 5. Some Quick Caveats…. • All methods are examined under the lens of the commercial and industrial (C&I) sector • Different bar heights represent a qualitative, not quantitative, appraisal of the relative strengths in each category
  • 6. Traditional M&V • Precision: Directly coupled with cost through site visits • Insights: Granular data collection…on a small sample of sites • Timeliness: Begins after program life cycle • Cost: Site visit focus is costly Precision Insights Timeliness Cost
  • 7. M&V 2.0 • Analysis of AMI billing data • No on-site presence • Results can approach real-time Precision Insights Timeliness Cost ?
  • 8. M&V 2.0 - Precision Precision Insights Timeliness Cost ? • “Big Data” analytics – can analyze a larger number of sites • Issues finding clean/representative data – significant data processing
  • 9. M&V 2.0 - Insights Precision Insights Timeliness Cost ? • Reliance on large aggregate analysis and full building data can make it difficult to parse outcomes
  • 10. M&V 2.0 - Timeliness Precision Insights Timeliness Cost ? • Data is readily available through utility platform, analysis results can begin percolating once projects are installed
  • 11. M&V 2.0 - Cost Precision Insights Timeliness Cost ? • Large amount of data processing/cleaning • Costs decoupled from number of projects in analysis group
  • 12. Can We Bridge the Gap? • Traditional is reliable, but insights come too late. • Insights tied to small number of projects. • Cost scales directly with desired precision. Precision Insights Timeliness Cost ?
  • 13. Can We Bridge the Gap? • M&V 2.0 theoretically scales well and brings answers on performance more quickly. • Lacks the depth and granularity for individual measure-level insight. • Jury still out on precision. Precision Insights Timeliness Cost ?
  • 14. Precision Insights Timeliness Cost Can We Bridge the Gap? Neither approach fits every need! ?
  • 15. EDGE M&V • Energy-focused • Deep • Granular • Evaluation M&V
  • 16. EDGE M&V • Tracking Data: Coordination with Implementation • Predictive Features: Flexible (past M&V, AMI…)
  • 17. EDGE M&V • Automated processing of tracking data • Engineer oversight
  • 18. EDGE M&V • Initial Validation: Past M&V Data • Ongoing validation: Additional Post-Install M&V
  • 19. EDGE M&V • Results as real-time as Tracking availability • Work with PA to make model work for them
  • 20. EDGE M&V Implementation • BQDM target: More than 52 MW of demand reduction at peak hours • Primarily through SBDI lighting projects • Over 4,000 businesses effected so far • Regulator requires quarterly reporting on achieved reductions
  • 21. EDGE M&V Implementation • Completed in 2015 • Over 400 loggers characterizing SBDI lighting behavior • Structured by space type and business demographics • Added additional structure to tracking data to allow for data transformation • Improved to weekly reporting of installations • Unique opportunity to utilize an EDGE approach!
  • 22. EDGE M&V Implementation • Delivered five-day turnaround on impact of over 1,500 businesses in 2016 • Leveraging findings to plan future implementation Initial Validation 5% Absolute Precision Final Validation Results coming in March!
  • 23. EDGE M&V • Measure-level modeling • Flexible data sources • Continuous impact reporting through integration with tracking data Precision Insights Timeliness Cost
  • 24. EDGE M&V - Precision • Utilize past M&V data to construct model • Measure-level modeling on predictive factors provides precision similar to Traditional M&V Precision Insights Timeliness Cost
  • 25. EDGE M&V - Insights • Granular analysis of measure-level we can learn how impacts are trending Precision Insights Timeliness Cost
  • 26. EDGE M&V - Timeliness • Impact projections are available as implementation tracking data updates • Requires cooperation/coordination with implementation contractor Precision Insights Timeliness Cost
  • 27. EDGE M&V - Cost • Limited additional site work • Costs are decoupled from precision, allows focus to shift to realizing value of insights Precision Insights Timeliness Cost
  • 28. Methods Overview EDGE M&V M&V 2.0 Traditional M&V ?
  • 29. Final Takeaways • Current M&V methods don’t allow us to unlock value – M&V is a cost center • EDGE M&V merges speed and cost effectiveness with measure-level focus • Decouple cost from Precision and the focus shifts to Insights
  • 30. Questions? Paul Dobrowsky Engineer – Data Analytics pdobrowsky@ers-inc.com

Editor's Notes

  • #20: But this is more than a theoretical framework…..
  • #21: Needed quarterly results, to meet tthat challenge we created and EDGE MV solution. Utilizing load study of SBDI and MF pop that included > 3000 loggers completed at the beginning of BQDM that formed the backbone of this model
  • #22: Needed quarterly results, to meet tthat challenge we created and EDGE MV solution. Utilizing load study of SBDI and MF pop that included > 3000 loggers completed at the beginning of BQDM that formed the backbone of this model
  • #29: Bar charts with strengths weakness table? Just S/W table? I would like to show the all side by side once