SlideShare a Scribd company logo
energy efficient resource 
management in virtualised 
datacenters 
Fabien Hermenier
USA 3 % 
of the 2005 budget 
(Environmental Protection Agency, 2007) 
1.5% 
in 2010 ?
1Consume less 
2003
the brown constant 
● 
● 
● 
● 
● ● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
● 
180 
175 W 
170 
160 
150 
140 
130 
120 
110 
0 1 2 3 4 
VM # 
Consumption (Watt) 
Node consumption statistics (Cluster edel, 128GB HDD) 
110 W
2003elnozahy et al. : 
“let’s turn off useless stuff” 
Packing concentrate WWW 
requests
2006 Hansen et al. : 
“look! look it’s moving” 
live migration 
N1 VM1 N2
consume less, 
the theory 
1) model power consumption 
2) pack VMs 
3) turn-off unused nodes 
4) minimize(W) 
5) profit
consume less, 
the practice 
hw. heterogeneity 
env. capabilities 
performance vs. energy 
workload volatility 
data center size 
, ,
BtrPlace proposal 
core reconfiguration 
algorithm 
users scripts 
+ = 
specialized reconfiguration 
algorithm
spread(VM[2..3]); 
preserve({VM1},’ucpu’, 3); 
offline(@N4); 
The reconfiguration plan 
0’00 
to 
0’02: 
relocate(VM2,N2) 
0’00 
to 
0’04: 
relocate(VM6,N2) 
0’02 
to 
0’05: 
relocate(VM4,N1) 
0’04 
to 
0’08: 
shutdown(N4) 
0’05 
to 
0’06: 
allocate(VM1,‘cpu’,3) 
BtrPlace
the core reconfiguration 
algorithm is modeled wrt. the 
impact of actions on resources
Premadevariables, 
spread({VM1,VM2}): 
allDifferent(dhost 
1 , dhost 
2 ) ^ 
dhost 
1 = chost 
2 ! dst 
1 # ced 
2 ^ 
dhost 
2 = chost 
1 ! dst 
2 # ced 
1 
constraints
Constraint Programming 
! 
! 
! 
to the rescue
2010 2013 
Energy aware ICT optimization policies 
(+ btrPlace)
multi-core CPUs, 
DDR3 memory, 
spinning HD, 
PUE / CUE, 
boot/shutdown time 
workload particularities 
VM template 
migration duration 
migration payback time 
hw. particularities 
a fine-grain power model
energy-related variables are linked to 
core ones
energy-oriented constraints 
MaxServerPower 
DelayBtwMigrations 
DelayBtwServerSwitch 
PayBackTime 
SpareCPUs 
minEnergyCons 
minGasEmissions 
cap consumption 
reduce ping-pong effects 
migration as an investment 
control the consolidation aggressiveness 
optimisation criteria
Time (minutes) P4G P4G + spare P4G + spare + vcpu P4G + spare + vcpu + delay 
500 1000 1500 2000 2500 
1 
2 
3 
4 
5 
6 
7 
Servers 
dominates scalability 
the core problem
coarse to fine 
grain optimisation 
-16% 
-47% 
- 27% 
-7%
Consuming less 
dealing with 
THE BROWN CONSTANT
Consuming less 
dealing with 
UNAPPROPRIATE 
HARDWARE
energy proportional servers, 
hw. community did not 
chill 
free cooling, 
fanless processors
? workload agnostic 
need to revamp software approaches 
migration 
a balancing problem
Consume be2tter 
2012
DC4Cities 
2013 2016 
let existing and new data centres become energy adaptive
align workload to renewable 
energies availability
forecasts 
1) 24h power 
budget 
2) alt. working 
modes 
energy adaptive 
applications 
3) selected mode 
DC4Cities gray box approach
Energy adaptive 
Batch scheduling 
How many parallel jobs, 
which ones to defer 
Trade replicas 
against latency 
Allocate resources 
against SLAs 
Energy adaptive 
WWW 
Energy adaptive 
IaaS 
Energy adaptive 
… …
ConclusionS
consume less, consume better, non-renewable 
power sources, DVFS, live-migration, 
deferrable workload, so many facets, non-deferrable 
workload, elasticity, VM packing, 
VOVO, VM balancing, white-box approach, 
black-box approach, solutions need to follow 
new capabilities and usage, priority over SLA, 
priority over savings, renewable power sources, 
fine grain power model, coarse grain power 
model, steady workload, bursty workload
1.1 - 1.5 % 
in 2010 
USA 
(Environmental Protection Agency, 2013)
.org
energy efficient resource management in virtualised datacenters

More Related Content

PPTX
cloud schedualing
PPT
Scheduling in cloud
PDF
Autonomous control in Big Data platforms: and experience with Cassandra
PDF
DT2 Eventstore ss_v001.1
PPTX
Map Reduce in the Clouds (http://salsahpc.indiana.edu/mapreduceroles4azure/)
PDF
Aws meetup (sep 2015) exprimir cada centavo
PPTX
SIMULATION AND PERFORMANCE ANALYSIS OF A LARGE SCALED INTERNET APPLICATION ...
PDF
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTES
cloud schedualing
Scheduling in cloud
Autonomous control in Big Data platforms: and experience with Cassandra
DT2 Eventstore ss_v001.1
Map Reduce in the Clouds (http://salsahpc.indiana.edu/mapreduceroles4azure/)
Aws meetup (sep 2015) exprimir cada centavo
SIMULATION AND PERFORMANCE ANALYSIS OF A LARGE SCALED INTERNET APPLICATION ...
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTES

What's hot (15)

PDF
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)
PPTX
C-Cube: Elastic Continuous Clustering in the Cloud
PPTX
Job sequence scheduling for cloud computing
PPT
REVIEW PAPER on Scheduling in Cloud Computing
PDF
TASK SCHEDULING USING AMALGAMATION OF MET HEURISTICS SWARM OPTIMIZATION ALGOR...
DOCX
distributed, concurrent, and independent access to encrypted cloud databases
DOC
Probabilistic consolidation of virtual machines in self organizing cloud data...
DOC
Distributed, concurrent, and independent access to encrypted cloud databases
DOCX
On the speedup of recovery in large scale erasure-coded storage systems
PDF
CSCC-X2007
PDF
PPTX
Cluster computing
PDF
Resource management in the cloud
PDF
Apache Spark
ODP
Dark silicon
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)
C-Cube: Elastic Continuous Clustering in the Cloud
Job sequence scheduling for cloud computing
REVIEW PAPER on Scheduling in Cloud Computing
TASK SCHEDULING USING AMALGAMATION OF MET HEURISTICS SWARM OPTIMIZATION ALGOR...
distributed, concurrent, and independent access to encrypted cloud databases
Probabilistic consolidation of virtual machines in self organizing cloud data...
Distributed, concurrent, and independent access to encrypted cloud databases
On the speedup of recovery in large scale erasure-coded storage systems
CSCC-X2007
Cluster computing
Resource management in the cloud
Apache Spark
Dark silicon
Ad

Viewers also liked (20)

PPTX
Question 4
PDF
Bin repacking scheduling in virtualized datacenters
PPTX
Digital Marketing For Small Businesses
PPTX
Final Piece
PPTX
The 2015 Budget by Branston Adams
PPTX
Media coursework
PPTX
20 Best Photographs
PDF
رزومه شرکت
PPTX
Online Portfolio
PPT
Testing
PPTX
For Better And Worse - Mobile Communications In The Workplace
PPTX
Horror Conventions
PPTX
Introduction to Google Plus
PPTX
Media Conventions
PPTX
40 Best Photographs
PPTX
Question 6
PDF
MotioMera
PPTX
DOC
Prakash CV
PDF
How much does management matter?, Nicholas Bloom
Question 4
Bin repacking scheduling in virtualized datacenters
Digital Marketing For Small Businesses
Final Piece
The 2015 Budget by Branston Adams
Media coursework
20 Best Photographs
رزومه شرکت
Online Portfolio
Testing
For Better And Worse - Mobile Communications In The Workplace
Horror Conventions
Introduction to Google Plus
Media Conventions
40 Best Photographs
Question 6
MotioMera
Prakash CV
How much does management matter?, Nicholas Bloom
Ad

Similar to energy efficient resource management in virtualised datacenters (20)

PDF
CNR @ VMUG.IT 20150304
PPTX
A Study on Task Scheduling in Could Data Centers for Energy Efficacy
DOC
Distributed, concurrent, and independent access to encrypted cloud databases
PDF
A stochastic approach to analysis of energy aware dvs-enabled cloud datacenters
PDF
MRI Energy-Efficient Cloud Computing
PPTX
Presentation on Bigdata (Energy Efficient Failure Recovery in Hadoop)
PDF
REAL-TIME ADAPTIVE ENERGY-SCHEDULING ALGORITHM FOR VIRTUALIZED CLOUD COMPUTING
PDF
REAL-TIME ADAPTIVE ENERGY-SCHEDULING ALGORITHM FOR VIRTUALIZED CLOUD COMPUTING
PDF
REAL-TIME ADAPTIVE ENERGY-SCHEDULING ALGORITHM FOR VIRTUALIZED CLOUD COMPUTING
PDF
REAL-TIME ADAPTIVE ENERGY-SCHEDULING ALGORITHM FOR VIRTUALIZED CLOUD COMPUTING
PDF
IRJET- Power Scheduling Algorithm based Power Optimization of Mpsocs
PDF
A MULTI-OBJECTIVE PERSPECTIVE FOR OPERATOR SCHEDULING USING FINEGRAINED DVS A...
PDF
ENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMS
PPT
Distributed, concurrent, and independent access to encrypted cloud databases
PDF
Summer Intern Report
PDF
Welcome to International Journal of Engineering Research and Development (IJERD)
PPTX
Green scheduling
PPT
Distributedconcurrentandindependentaccesstoencryptedclouddatabases 1410150430...
PDF
A survey on dynamic energy management at virtualization level in cloud data c...
PDF
A SURVEY ON DYNAMIC ENERGY MANAGEMENT AT VIRTUALIZATION LEVEL IN CLOUD DATA C...
CNR @ VMUG.IT 20150304
A Study on Task Scheduling in Could Data Centers for Energy Efficacy
Distributed, concurrent, and independent access to encrypted cloud databases
A stochastic approach to analysis of energy aware dvs-enabled cloud datacenters
MRI Energy-Efficient Cloud Computing
Presentation on Bigdata (Energy Efficient Failure Recovery in Hadoop)
REAL-TIME ADAPTIVE ENERGY-SCHEDULING ALGORITHM FOR VIRTUALIZED CLOUD COMPUTING
REAL-TIME ADAPTIVE ENERGY-SCHEDULING ALGORITHM FOR VIRTUALIZED CLOUD COMPUTING
REAL-TIME ADAPTIVE ENERGY-SCHEDULING ALGORITHM FOR VIRTUALIZED CLOUD COMPUTING
REAL-TIME ADAPTIVE ENERGY-SCHEDULING ALGORITHM FOR VIRTUALIZED CLOUD COMPUTING
IRJET- Power Scheduling Algorithm based Power Optimization of Mpsocs
A MULTI-OBJECTIVE PERSPECTIVE FOR OPERATOR SCHEDULING USING FINEGRAINED DVS A...
ENERGY-AWARE DISK STORAGE MANAGEMENT: ONLINE APPROACH WITH APPLICATION IN DBMS
Distributed, concurrent, and independent access to encrypted cloud databases
Summer Intern Report
Welcome to International Journal of Engineering Research and Development (IJERD)
Green scheduling
Distributedconcurrentandindependentaccesstoencryptedclouddatabases 1410150430...
A survey on dynamic energy management at virtualization level in cloud data c...
A SURVEY ON DYNAMIC ENERGY MANAGEMENT AT VIRTUALIZATION LEVEL IN CLOUD DATA C...

Recently uploaded (20)

PDF
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
PPTX
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
PPTX
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
PPTX
The KM-GBF monitoring framework – status & key messages.pptx
PPTX
INTRODUCTION TO EVS | Concept of sustainability
PDF
Sciences of Europe No 170 (2025)
PDF
Biophysics 2.pdffffffffffffffffffffffffff
PPTX
2. Earth - The Living Planet earth and life
PDF
. Radiology Case Scenariosssssssssssssss
PDF
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
PDF
Placing the Near-Earth Object Impact Probability in Context
PDF
The scientific heritage No 166 (166) (2025)
PDF
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
PPTX
Microbiology with diagram medical studies .pptx
PPTX
Classification Systems_TAXONOMY_SCIENCE8.pptx
PDF
Phytochemical Investigation of Miliusa longipes.pdf
PPTX
ECG_Course_Presentation د.محمد صقران ppt
PPTX
2Systematics of Living Organisms t-.pptx
PPTX
2. Earth - The Living Planet Module 2ELS
PDF
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
The KM-GBF monitoring framework – status & key messages.pptx
INTRODUCTION TO EVS | Concept of sustainability
Sciences of Europe No 170 (2025)
Biophysics 2.pdffffffffffffffffffffffffff
2. Earth - The Living Planet earth and life
. Radiology Case Scenariosssssssssssssss
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
Placing the Near-Earth Object Impact Probability in Context
The scientific heritage No 166 (166) (2025)
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
Microbiology with diagram medical studies .pptx
Classification Systems_TAXONOMY_SCIENCE8.pptx
Phytochemical Investigation of Miliusa longipes.pdf
ECG_Course_Presentation د.محمد صقران ppt
2Systematics of Living Organisms t-.pptx
2. Earth - The Living Planet Module 2ELS
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud

energy efficient resource management in virtualised datacenters

  • 1. energy efficient resource management in virtualised datacenters Fabien Hermenier
  • 2. USA 3 % of the 2005 budget (Environmental Protection Agency, 2007) 1.5% in 2010 ?
  • 4. the brown constant ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 180 175 W 170 160 150 140 130 120 110 0 1 2 3 4 VM # Consumption (Watt) Node consumption statistics (Cluster edel, 128GB HDD) 110 W
  • 5. 2003elnozahy et al. : “let’s turn off useless stuff” Packing concentrate WWW requests
  • 6. 2006 Hansen et al. : “look! look it’s moving” live migration N1 VM1 N2
  • 7. consume less, the theory 1) model power consumption 2) pack VMs 3) turn-off unused nodes 4) minimize(W) 5) profit
  • 8. consume less, the practice hw. heterogeneity env. capabilities performance vs. energy workload volatility data center size , ,
  • 9. BtrPlace proposal core reconfiguration algorithm users scripts + = specialized reconfiguration algorithm
  • 10. spread(VM[2..3]); preserve({VM1},’ucpu’, 3); offline(@N4); The reconfiguration plan 0’00 to 0’02: relocate(VM2,N2) 0’00 to 0’04: relocate(VM6,N2) 0’02 to 0’05: relocate(VM4,N1) 0’04 to 0’08: shutdown(N4) 0’05 to 0’06: allocate(VM1,‘cpu’,3) BtrPlace
  • 11. the core reconfiguration algorithm is modeled wrt. the impact of actions on resources
  • 12. Premadevariables, spread({VM1,VM2}): allDifferent(dhost 1 , dhost 2 ) ^ dhost 1 = chost 2 ! dst 1 # ced 2 ^ dhost 2 = chost 1 ! dst 2 # ced 1 constraints
  • 13. Constraint Programming ! ! ! to the rescue
  • 14. 2010 2013 Energy aware ICT optimization policies (+ btrPlace)
  • 15. multi-core CPUs, DDR3 memory, spinning HD, PUE / CUE, boot/shutdown time workload particularities VM template migration duration migration payback time hw. particularities a fine-grain power model
  • 16. energy-related variables are linked to core ones
  • 17. energy-oriented constraints MaxServerPower DelayBtwMigrations DelayBtwServerSwitch PayBackTime SpareCPUs minEnergyCons minGasEmissions cap consumption reduce ping-pong effects migration as an investment control the consolidation aggressiveness optimisation criteria
  • 18. Time (minutes) P4G P4G + spare P4G + spare + vcpu P4G + spare + vcpu + delay 500 1000 1500 2000 2500 1 2 3 4 5 6 7 Servers dominates scalability the core problem
  • 19. coarse to fine grain optimisation -16% -47% - 27% -7%
  • 20. Consuming less dealing with THE BROWN CONSTANT
  • 21. Consuming less dealing with UNAPPROPRIATE HARDWARE
  • 22. energy proportional servers, hw. community did not chill free cooling, fanless processors
  • 23. ? workload agnostic need to revamp software approaches migration a balancing problem
  • 25. DC4Cities 2013 2016 let existing and new data centres become energy adaptive
  • 26. align workload to renewable energies availability
  • 27. forecasts 1) 24h power budget 2) alt. working modes energy adaptive applications 3) selected mode DC4Cities gray box approach
  • 28. Energy adaptive Batch scheduling How many parallel jobs, which ones to defer Trade replicas against latency Allocate resources against SLAs Energy adaptive WWW Energy adaptive IaaS Energy adaptive … …
  • 30. consume less, consume better, non-renewable power sources, DVFS, live-migration, deferrable workload, so many facets, non-deferrable workload, elasticity, VM packing, VOVO, VM balancing, white-box approach, black-box approach, solutions need to follow new capabilities and usage, priority over SLA, priority over savings, renewable power sources, fine grain power model, coarse grain power model, steady workload, bursty workload
  • 31. 1.1 - 1.5 % in 2010 USA (Environmental Protection Agency, 2013)
  • 32. .org