SlideShare a Scribd company logo
Robust Cloud Resource Provisioning
for Cloud Computing Environments
presented by

Sivadon Chaisiri1, Bu-Sung Lee1,2, and Dusit Niyato1
1
  School of Computer Engineering, Nanyang Technological University, Singapore
2
  HP Labs Singapore

presented in
IEEE International Conference on Service-Oriented Computing and Applications
   (SOCA’10) Perth, Australia, December 14, 2010
Outline
●
    Overview of Cloud Computing
    ●
        Provisioning plans
●
    Challenge of Resource Provisioning
●
    Robust Cloud Resource Provisioning
    ●
        Modeling the RCRP
    ●
        Formulating the RCRP
●
    Numerical Studies
●
    Conclusion



                                  2
Overview of Cloud Computing
                                                                     Hardware
Software                                                           infrastructure
                     Pool of resources
                                                                                    Cloud Computing
                                                                                    •   Large distributed system
                           Physical compute resources                               •   Large pool of resources
Storage                                                            Network
                                                                                    •   Multiple providers
                                                                                         • Amazon EC2
      Cloud         Cloud            Cloud               Cloud         Cloud             • GoGrid
     provider      provider         provider            provider      provider
                                                                                         • Rackspace
            Cloud Computing                                                         •   Virtualization (e.g., IaaS)
                                                                                    •   Internet access
                                                                                    •   Pay-per-use basis
                                                                                    •   Provisioning plans
  Cloud
 consumer
                 Cloud
                consumer
                                   Cloud
                                  consumer
                                                         Cloud
                                                        consumer
                                                                         Cloud
                                                                       consumer
                                                                                         • On-demand
                                                                                         • Reservation




                                                                                                  3
Provisioning Plans
●
        On-demand plan offered by Amazon EC2




●
        Reservation plan offered by Amazon EC2




●
        Reservation can reduce the total provisioning cost
    ●
        On-demand (Small Instance): 0.085x365x24 = $744.60 for 1yr contract
    ●
        Reservation: 227.50+(0.03x365x24) = $490.30 for 1yr contract or
        34.15% cheaper but 49.04% cheaper for 3yr contract

                                                    4
Challenge of Resource Provision
   ●
        Goal: How many VMs do we need to provision in advance to
        minimize the total cost under uncertainty?
   ●
        Challenge:
         ●
                Multivariate uncertainty e.g., price, demand, availability, etc.
         ●
                Unavoidable under- and overprovisioning costs
         ●
                Multiple providers + service-level-agreements (SLAs)
                               Decision                 Realization


                              Reserve N VMs        Utilize N VMs (no more cost)




                                   Actual demand is N VMs

                                      (a) Best provisioning

  Decision             Realization                                    Decision              Realization


                                                                                                          No need
                                                                  Reserve N VMs       Utilize N/2 VMs
Reserve N VMs                       Provision 2N VMs                                                    on-demand
                   Utilize N VMs      on-demand                                                         provisioning
                                   (on demand cost)                                           (oversubscribed cost)
    Actual demand is 3N VMs                                            Actual demand is N/2 VMs
  (b) Underprovisioning problem                                       (c) Overprovisioning problem


                                                                                            5
Robust Cloud Resource Provisioning
●
        RCRP algorithm is proposed
    ●
        Minimize the expected resource provisioning cost
    ●
        Reduce on-demand & oversubscribed costs
    ●
        Consider multivariate uncertainty
    ●
        Meet the decision maker’s risk preference: most decision
        makers are risk averse
●
    Two types of robustness
    ●
        Solution robustness: solution is almost optimal
    ●
        Model robustness: penalty is almost avoided




                                                6
Modeling the RCRP
●
    System model of cloud computing




                                      7
Modeling the RCRP (cont...)
●
    Multiple IaaS-based cloud providers
●
    Provisioning plans: reservation & on-demand
●
    Each cloud provider offers different plans, prices, and
    service-level-agreement (SLA)
●
    VM class = group of VMs executing the same job
●
    Each VM class requires different resources
●
    Demand = the number of VMs of specific VM class
    required to execute the cloud consumer's job




                                          8
Modeling the RCRP (cont...)




●
    Provisioning phases: reservation, expending, on-demand
●
    Two provisioning stages (namely first and second)
●
    Uncertain parameter is described by probability distribution
●
    Realization = observed uncertain parameter
●
    Recourse action = the action corresponding to certain
    realization
●
    (Optimal) Solution consists of
     ●
         The number of reserved VMs provisioned for each VM class
     ●
         A collection of recourse actions

                                                9
Formulating the RCRP
• Complete RCRP model




                         10
Formulating the RCRP (cont…)
• Multi-criteria optimization



• Total resource provisioning cost:


• Solution robustness: cost of deviation with weight    :



• Model robustness: penalty function cost with weight       :




                                        11
Formulating the RCRP (cont...)

                Solution robustness        Model robustness

●
    Adjustment of weights to meet the risk preference
• Weighting to adjust the solution robustness
• Guideline for adjusting the model robustness
  ●
    Weighting        and      to adjust the model robustness:
      ●
              : overprovisioning weights
      ●
              : underprovisioning weights
  ●
    Simplifying over- and underprovisioning weights
      ●
        Let
      ●
        where
                                          12
Numerical Studies:                         Parameter Setting

• Two VM classes (I1 and I2) require difference resources
• Max resource capacity offered by cloud providers (J1 to J4):
    ●   J1 (private cloud) offers limited resources but zero on-demand cost
    ●   J2 to J4 (public clouds) offer abundant resources

• Pricing defined by each cloud provider:




• Three types of uncertain parameters are considered
     – Types: user's demand, resource price, resource availability
     – Each type is described by different probability distribution
•   RCRP and other models are implemented and solved by GAMS/CPLEX

                                                        13
Numerical Studies: Results




                      14
Numerical Studies: Results (cont...)
●
    Comparison between RCRP and others




●
    Summary of the comparison:
    ●
        NoRes yields the highest total cost
    ●
        MaxRes has zero on-demand but highest oversubscribed
    ●
        EVU gains the lowest oversubscribed but high on-demand
    ●
        OVMP achieves the minimum total cost
    ●
        RCRP is more flexibly controlled and it can achieve the
        total cost close to OVMP


                                              15
Conclusion
●
    Due to uncertainty, inefficiency of resource
    provisioning can lead to very expensive costs
●
    RCRP is proposed to minimize the total provisioning
    cost, while uncertainty is considered
●
    RCRP can achieve both solution- and model-
    robustness
●
    RCRP can meet decision makers' risk preferences
●
    RCRP can be applied in the real practice
●
    Future work: sampling techniques and real practice
    will be performed



                                        16
THANK YOU




            17
Formulating the RCRP (cont…)
• Stochastic programming (SP) model




• This SP could only satisfy low-risk decisions
• SP cannot be adjusted to meet the risk preference
                                      18
Numerical Studies: Results (cont...)
 How to choose the appropriate solution?
  1) Apply goal programming based on a predefined goal such as
       ●
           Expected reservation cost <= $1,200
       ●
           Expected on-demand cost <= $1,000
       ●
           Stand deviation of RO must be less than SP
  2) Vary the weights and solve the RCRP until the goal is met




                                     Selected solution:      = 1 and   =1




                                                        19

More Related Content

PDF
Optimization of Resource Provisioning Cost in Cloud Computing
PDF
InterCloud - Cloud based DRP
PPTX
Manage rising disk prices with storage virtualization webinar
PDF
MyCassandra: A Cloud Storage Supporting both Read Heavy and Write Heavy Workl...
PDF
MyCassandra (Full English Version)
PDF
Lug best practice_hpc_workflow
PDF
産総研におけるプライベートクラウドへの取り組み
PDF
Como a computação em nuvem e tecnologias de brokering podem auxiliar os prove...
Optimization of Resource Provisioning Cost in Cloud Computing
InterCloud - Cloud based DRP
Manage rising disk prices with storage virtualization webinar
MyCassandra: A Cloud Storage Supporting both Read Heavy and Write Heavy Workl...
MyCassandra (Full English Version)
Lug best practice_hpc_workflow
産総研におけるプライベートクラウドへの取り組み
Como a computação em nuvem e tecnologias de brokering podem auxiliar os prove...

What's hot (20)

PPTX
Bangalore cloudstack user group
DOCX
Notes
PPT
Ram chinta hug-20120922-v1
KEY
TriHUG - Beyond Batch
PDF
Google Compute and MapR
PPT
Island: Local Storage Volume for Cinder
PDF
Cloumon enterprise
PPT
Session 49 - Semantic metadata management practical
PDF
Session9part2 Servers Detailed
PPTX
Hadoop on Virtual Machines
PPTX
Stacking up with OpenStack: building for High Availability
PPTX
Servers fail, who cares?
PPTX
Windows Azure and the cloud: What it’s all about
PDF
RunE2E Case Study: SAP BusinessObjects in the AWS Cloud
PDF
Open repository 2011_duracloud-final
PPTX
30a accessing your cluster
PDF
Nevmug Martins Point Health Care J Anuary 2009
PPT
PPTX
#lspe: Dynamic Scaling
PDF
Open solaris customer presentation
Bangalore cloudstack user group
Notes
Ram chinta hug-20120922-v1
TriHUG - Beyond Batch
Google Compute and MapR
Island: Local Storage Volume for Cinder
Cloumon enterprise
Session 49 - Semantic metadata management practical
Session9part2 Servers Detailed
Hadoop on Virtual Machines
Stacking up with OpenStack: building for High Availability
Servers fail, who cares?
Windows Azure and the cloud: What it’s all about
RunE2E Case Study: SAP BusinessObjects in the AWS Cloud
Open repository 2011_duracloud-final
30a accessing your cluster
Nevmug Martins Point Health Care J Anuary 2009
#lspe: Dynamic Scaling
Open solaris customer presentation
Ad

Similar to Robust Cloud Resource Provisioning for Cloud Computing Environments (20)

PPTX
QLogic Adapters & Virtualized Environments
PPTX
Cloud stack overview
PPTX
Architecting a Private Cloud - Cloud Expo
PDF
6 Roadmap Cloudstack Developer Day
PPTX
Private Clouds - Business Agility Seminar
PPTX
Mhta.private.cloud.final.16.9
PPTX
Cloud Computing : Security and Forensics
PPT
Unit 4
PPT
Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Enviro...
PDF
Patterns for Cloud Computing
PDF
3 Networking CloudStack Developer Day
PDF
Hyper-V 3.0 Overview
PDF
Tudor Damian - Hyper-V 3.0 overview
PDF
Windows Azure Platfom By Soumow Atitallah
PPTX
Prairie DevCon-What's New in Hyper-V in Windows Server "8" Beta - Part 2
PPTX
Cloud platform technical sales presentation
PDF
Cost Minimization for Provisioning Virtual Servers in Amazon EC2
PPTX
Introduction: Build infrastucture-as-a-service Clouds with Apache CloudStack
PDF
Deep dive: Citrix CloudPlatform for Infrastructure as a Service
QLogic Adapters & Virtualized Environments
Cloud stack overview
Architecting a Private Cloud - Cloud Expo
6 Roadmap Cloudstack Developer Day
Private Clouds - Business Agility Seminar
Mhta.private.cloud.final.16.9
Cloud Computing : Security and Forensics
Unit 4
Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Enviro...
Patterns for Cloud Computing
3 Networking CloudStack Developer Day
Hyper-V 3.0 Overview
Tudor Damian - Hyper-V 3.0 overview
Windows Azure Platfom By Soumow Atitallah
Prairie DevCon-What's New in Hyper-V in Windows Server "8" Beta - Part 2
Cloud platform technical sales presentation
Cost Minimization for Provisioning Virtual Servers in Amazon EC2
Introduction: Build infrastucture-as-a-service Clouds with Apache CloudStack
Deep dive: Citrix CloudPlatform for Infrastructure as a Service
Ad

Recently uploaded (20)

PDF
Insiders guide to clinical Medicine.pdf
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
RMMM.pdf make it easy to upload and study
PDF
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPTX
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PDF
Anesthesia in Laparoscopic Surgery in India
PPTX
PPH.pptx obstetrics and gynecology in nursing
PPTX
Pharma ospi slides which help in ospi learning
PDF
VCE English Exam - Section C Student Revision Booklet
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
Insiders guide to clinical Medicine.pdf
O7-L3 Supply Chain Operations - ICLT Program
RMMM.pdf make it easy to upload and study
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
STATICS OF THE RIGID BODIES Hibbelers.pdf
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
Anesthesia in Laparoscopic Surgery in India
PPH.pptx obstetrics and gynecology in nursing
Pharma ospi slides which help in ospi learning
VCE English Exam - Section C Student Revision Booklet
Final Presentation General Medicine 03-08-2024.pptx
Microbial disease of the cardiovascular and lymphatic systems
O5-L3 Freight Transport Ops (International) V1.pdf
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Abdominal Access Techniques with Prof. Dr. R K Mishra
Module 4: Burden of Disease Tutorial Slides S2 2025
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx

Robust Cloud Resource Provisioning for Cloud Computing Environments

  • 1. Robust Cloud Resource Provisioning for Cloud Computing Environments presented by Sivadon Chaisiri1, Bu-Sung Lee1,2, and Dusit Niyato1 1 School of Computer Engineering, Nanyang Technological University, Singapore 2 HP Labs Singapore presented in IEEE International Conference on Service-Oriented Computing and Applications (SOCA’10) Perth, Australia, December 14, 2010
  • 2. Outline ● Overview of Cloud Computing ● Provisioning plans ● Challenge of Resource Provisioning ● Robust Cloud Resource Provisioning ● Modeling the RCRP ● Formulating the RCRP ● Numerical Studies ● Conclusion 2
  • 3. Overview of Cloud Computing Hardware Software infrastructure Pool of resources Cloud Computing • Large distributed system Physical compute resources • Large pool of resources Storage Network • Multiple providers • Amazon EC2 Cloud Cloud Cloud Cloud Cloud • GoGrid provider provider provider provider provider • Rackspace Cloud Computing • Virtualization (e.g., IaaS) • Internet access • Pay-per-use basis • Provisioning plans Cloud consumer Cloud consumer Cloud consumer Cloud consumer Cloud consumer • On-demand • Reservation 3
  • 4. Provisioning Plans ● On-demand plan offered by Amazon EC2 ● Reservation plan offered by Amazon EC2 ● Reservation can reduce the total provisioning cost ● On-demand (Small Instance): 0.085x365x24 = $744.60 for 1yr contract ● Reservation: 227.50+(0.03x365x24) = $490.30 for 1yr contract or 34.15% cheaper but 49.04% cheaper for 3yr contract 4
  • 5. Challenge of Resource Provision ● Goal: How many VMs do we need to provision in advance to minimize the total cost under uncertainty? ● Challenge: ● Multivariate uncertainty e.g., price, demand, availability, etc. ● Unavoidable under- and overprovisioning costs ● Multiple providers + service-level-agreements (SLAs) Decision Realization Reserve N VMs Utilize N VMs (no more cost) Actual demand is N VMs (a) Best provisioning Decision Realization Decision Realization No need Reserve N VMs Utilize N/2 VMs Reserve N VMs Provision 2N VMs on-demand Utilize N VMs on-demand provisioning (on demand cost) (oversubscribed cost) Actual demand is 3N VMs Actual demand is N/2 VMs (b) Underprovisioning problem (c) Overprovisioning problem 5
  • 6. Robust Cloud Resource Provisioning ● RCRP algorithm is proposed ● Minimize the expected resource provisioning cost ● Reduce on-demand & oversubscribed costs ● Consider multivariate uncertainty ● Meet the decision maker’s risk preference: most decision makers are risk averse ● Two types of robustness ● Solution robustness: solution is almost optimal ● Model robustness: penalty is almost avoided 6
  • 7. Modeling the RCRP ● System model of cloud computing 7
  • 8. Modeling the RCRP (cont...) ● Multiple IaaS-based cloud providers ● Provisioning plans: reservation & on-demand ● Each cloud provider offers different plans, prices, and service-level-agreement (SLA) ● VM class = group of VMs executing the same job ● Each VM class requires different resources ● Demand = the number of VMs of specific VM class required to execute the cloud consumer's job 8
  • 9. Modeling the RCRP (cont...) ● Provisioning phases: reservation, expending, on-demand ● Two provisioning stages (namely first and second) ● Uncertain parameter is described by probability distribution ● Realization = observed uncertain parameter ● Recourse action = the action corresponding to certain realization ● (Optimal) Solution consists of ● The number of reserved VMs provisioned for each VM class ● A collection of recourse actions 9
  • 10. Formulating the RCRP • Complete RCRP model 10
  • 11. Formulating the RCRP (cont…) • Multi-criteria optimization • Total resource provisioning cost: • Solution robustness: cost of deviation with weight : • Model robustness: penalty function cost with weight : 11
  • 12. Formulating the RCRP (cont...) Solution robustness Model robustness ● Adjustment of weights to meet the risk preference • Weighting to adjust the solution robustness • Guideline for adjusting the model robustness ● Weighting and to adjust the model robustness: ● : overprovisioning weights ● : underprovisioning weights ● Simplifying over- and underprovisioning weights ● Let ● where 12
  • 13. Numerical Studies: Parameter Setting • Two VM classes (I1 and I2) require difference resources • Max resource capacity offered by cloud providers (J1 to J4): ● J1 (private cloud) offers limited resources but zero on-demand cost ● J2 to J4 (public clouds) offer abundant resources • Pricing defined by each cloud provider: • Three types of uncertain parameters are considered – Types: user's demand, resource price, resource availability – Each type is described by different probability distribution • RCRP and other models are implemented and solved by GAMS/CPLEX 13
  • 15. Numerical Studies: Results (cont...) ● Comparison between RCRP and others ● Summary of the comparison: ● NoRes yields the highest total cost ● MaxRes has zero on-demand but highest oversubscribed ● EVU gains the lowest oversubscribed but high on-demand ● OVMP achieves the minimum total cost ● RCRP is more flexibly controlled and it can achieve the total cost close to OVMP 15
  • 16. Conclusion ● Due to uncertainty, inefficiency of resource provisioning can lead to very expensive costs ● RCRP is proposed to minimize the total provisioning cost, while uncertainty is considered ● RCRP can achieve both solution- and model- robustness ● RCRP can meet decision makers' risk preferences ● RCRP can be applied in the real practice ● Future work: sampling techniques and real practice will be performed 16
  • 17. THANK YOU 17
  • 18. Formulating the RCRP (cont…) • Stochastic programming (SP) model • This SP could only satisfy low-risk decisions • SP cannot be adjusted to meet the risk preference 18
  • 19. Numerical Studies: Results (cont...) How to choose the appropriate solution? 1) Apply goal programming based on a predefined goal such as ● Expected reservation cost <= $1,200 ● Expected on-demand cost <= $1,000 ● Stand deviation of RO must be less than SP 2) Vary the weights and solve the RCRP until the goal is met Selected solution: = 1 and =1 19