Protecting from transient failures in cloud microsoft azure deployments
Download as PPT, PDF0 likes52 views
This document presents a talk on protecting from transient failures in Microsoft Azure cloud deployments. It discusses using the AURA tool to deploy applications to the Azure cloud and detect and recover from transient failures. The talk outlines Azure services including virtual machines, storage, networking, databases, analytics, machine learning and more. It then discusses using AURA's deployment graph and executors to monitor deployments. The talk presents strategies for retrying failed deployments, including various backoff approaches, and selecting exponential backoff to optimize recovery from transient failures.
![Cloud Azure Storage and WEB Apps
Web server starts before the database server is successfully configure in right way.
Each Executor will run the necessary deployment scripts .
To monitor the deployment status through a real-time monitoring UI. [2]
Specifically, To view each script’s logs, a real-time view of the Deployment Graph, the
status of the respective script execution.
Dhaka University of Engineering and Technology, Gazipur](https://image.slidesharecdn.com/protectingfromtransientfailuresincloudmicrosoftazuredeployments-190915013925/85/Protecting-from-transient-failures-in-cloud-microsoft-azure-deployments-13-320.jpg)
![Cloud Azure Mobile, Containers and Database
Green edges represent completed scripts.
Blue edges represent running scripts.
Red edges represent failed executions .
Gray edges represent pending scripts.
Web Server stores the deployment script.
DB Server helps data manipulation activities of the Application. [2]
Dhaka University of Engineering and Technology, Gazipur
Figure 7. Cloud deployment graph with 1 Web Server and 1 Database Server
DBServer1
DBServer2
WEBServer1
DBServer3
WEBServer2
APPServer3
3
APPServer2
APPServer1 APPServer4
WEBServer3
WEBServer4](https://image.slidesharecdn.com/protectingfromtransientfailuresincloudmicrosoftazuredeployments-190915013925/85/Protecting-from-transient-failures-in-cloud-microsoft-azure-deployments-14-320.jpg)
![References
[1] WWW.portal.web.azure.com, I have studied the Microsoft Web Portal and
tried to understand .
[2] www.aura.com from GitHub , I have studied from here and make sure that
Hadoop and wordpress deployment to detect the transient fault Tolerance .
[3] www.ams.web.com from here , I have studied that how can I deploy the new
Application in Amazon Cloud Computing .
Dhaka University of Engineering and Technology, Gazipur](https://image.slidesharecdn.com/protectingfromtransientfailuresincloudmicrosoftazuredeployments-190915013925/85/Protecting-from-transient-failures-in-cloud-microsoft-azure-deployments-23-320.jpg)
Protecting from transient failures in cloud microsoft azure deployments
- 1. Protecting from Transient Failures in Cloud Microsoft Azure Deployments Supervised By: Dr. Mohammad Abdur Rouf (Professor) Head of Department of Computer Science & Engineering Dhaka University of Engineering and Technology, Gazipur Ph.D. (KAIST) , M.Sc. Engg. (BUET), © B.Sc. Engg. (KU) Dhaka University of Engineering and Technology, Gazipur Presented by Md. Mostafijur Rahman M.Sc. Engg. Student ID #: 132431 (p) Department of Computer Science and Engineering
- 2. Outline of the talk • Introduction • Related Work • Cloud Azure Dashboard Structure • Microsoft Azure Cloud Services 100+ • Virtual Machines & Storage Accounts • Compute Networking Storage , Web Mobile, Containers, Databases, Analytics AI + Machine ,Learning Internet of Things, Integration Security, Identity Developer Tools, Management Tools , Software as a Service (SaaS) and Blockchain . • Cloud Compute Microsoft Azure • Cloud Azure Virtual Networking • Cloud Azure Storage and WEB Apps • Cloud Azure Mobile, Containers and Database • Cloud Azure Database and Analytics • Cloud Azure INTERNET OF THINGS • Cloud Azure AI + Machine Learning • Cloud Azure Integration • Cloud Azure Identity and Security • Cloud Azure DEVOPS, Migration • Microsoft Azure Cloud Message Routing • Conclusions and Future Work • References Useful Links Dhaka University of Engineering and Technology, Gazipur
- 3. Introduction • Microsoft Azure formerly known as Windows Azure is Microsoft's public cloud computing platform. Users can pick and choose from these services to develop ander scale new applications or run existing applications in the public cloud. In your browser, open the Azure portal. Click Create a resource > Compute > Cloud Service. In the DNS name input box, enter a URL prefix for the cloud service. ... Specify a new Resource group for the service. ... Choose the region where you want to deploy the application. ... Click Create. • To overcome this failure, Direct Acyclic Graph that traverse the graph breath first manner and find the deployment specific script error using AURA Tool. • To monitor the graphical user Interface and try minimum fail script node re-executed. • To wait for threshold time and retry fetching the resource before calling it quits. • A fixed amount of retries within threshold time, To make consider it a permanent failure. Dhaka University of Engineering and Technology, Gazipur
- 4. Related Work AURA application deployment with error-recovery enhancements Dhaka University of Engineering and Technology, Gazipur
- 5. Related Work AURA application deployment with error-recovery enhancements Dhaka University of Engineering and Technology, Gazipur
- 6. Related Work AURA for a Hadoop and Wordpress deployment: Dhaka University of Engineering and Technology, Gazipur
- 7. Cloud Azure Dashboard Structure Dhaka University of Engineering and Technology, Gazipur Figure 1. AURA Architecture Sc Application WEB UI Queue REST API Cloud Connector Scheduler AURA Master Application Module (1) Module (2) Module (3) AURA ExecutorAURA ExecutorAURA Executor Cloud Provider
- 8. Microsoft Azure Cloud Services 100+ Dhaka University of Engineering and Technology, Gazipur Application WEB UI Queue REST API Cloud Connector Scheduler AURA Master Application Module (1) Module (2) Module (3) AURA ExecutorAURA ExecutorAURA Executor
- 9. Virtual Machines & Storage Accounts Dhaka University of Engineering and Technology, Gazipur We can create Multiple Virtual Machine.
- 10. Compute Networking Storage , Web Mobile, Containers, Databases, Analytics AI + Machine ,Learning Internet of Things, Integration Security, Identity Developer Tools, Management Tools , Software as a Service (SaaS) and Blockchain . Dhaka University of Engineering and Technology, Gazipur 3
- 11. Cloud Compute Microsoft Azure Dhaka University of Engineering and Technology, Gazipur Call Service Success ? YesNO Call Successful Next Action Figure : Cloud Compute Microsoft Azure Transient Failure ? Yes Retry ? Delay Threshold Time YesCall failed NO Permanent call fail 20<
- 12. Cloud Azure Virtual Networking Dhaka University of Engineering and Technology, Gazipur Start Two Parameter Graph T Failed Node n failed ← {n} healthy← ∅ While failed ≠ ∅ Have t ∈ depends (T, v) ? Have failed (t) ? failed ← failed ∪ {t} healthy ← healthy ∪ {t} NO Yes Yes Yes v = POP(failed) NO Return Healthy End While Again
- 13. Cloud Azure Storage and WEB Apps Web server starts before the database server is successfully configure in right way. Each Executor will run the necessary deployment scripts . To monitor the deployment status through a real-time monitoring UI. [2] Specifically, To view each script’s logs, a real-time view of the Deployment Graph, the status of the respective script execution. Dhaka University of Engineering and Technology, Gazipur
- 14. Cloud Azure Mobile, Containers and Database Green edges represent completed scripts. Blue edges represent running scripts. Red edges represent failed executions . Gray edges represent pending scripts. Web Server stores the deployment script. DB Server helps data manipulation activities of the Application. [2] Dhaka University of Engineering and Technology, Gazipur Figure 7. Cloud deployment graph with 1 Web Server and 1 Database Server DBServer1 DBServer2 WEBServer1 DBServer3 WEBServer2 APPServer3 3 APPServer2 APPServer1 APPServer4 WEBServer3 WEBServer4
- 15. Cloud Azure Database and Analytics Dhaka University of Engineering and Technology, Gazipur To recovery from failure module deployment script using Retry Policy, to use of No Bakeoff, Constant Bakeoff, Linear Bakeoff, Fibonacci Bakeoff, Quadratic Bakeoff, Exponential Bakeoff and Polynomial Bakeoff etc. # Retries Constant Backoff Time Linear Backoff Time Fibonacci Backoff Time Quadratic Backoff Time Exponential Backoff Time Polynomial Backoff Time 1 1s 0s 0s 0s 1s 0s 3 3s 3s 2s 5s 7s 9s 5 5s 10s 7s 30s 31s 100s 10 10s 45s 88s 285s 1023s 2025s 20 20s 190s 10945s 2470s 1048575s 36100s Table 1: Retries Backoff Approaches
- 16. Cloud Azure INTERNET OF THINGS In our work, To use the AURA deployment tool to detect transient failure and re- execute the fail module script. The ability of AURA tool is minimum number of fail script re-execute or Retry strategy. The retry policy delay depends on number of retries. From the Retry strategies, To choose the exponential backoff and recover from the transient failure in effective and optimal way . I have tested several backoff strategies to use c programing . I have found many results and compare among them . I have selected the exponential backoff to protect the transient failure in effective and optimal way. AURA (Error Recovery ) tool has been developed by using the python programing language. I want to implement the message passing error node re- execute or retry strategies using ASP.NET programing and database SQL Server 2012 and snapshot implementation after certain time. Dhaka University of Engineering and Technology, Gazipur
- 17. Cloud Azure AI + Machine Learning Dhaka University of Engineering and Technology, Gazipur
- 18. Cloud Azure Integration Dhaka University of Engineering and Technology, Gazipur
- 19. Cloud Azure Identity and Security Dhaka University of Engineering and Technology, Gazipur
- 20. Cloud Azure DEVOPS, Migration Dhaka University of Engineering and Technology, Gazipur
- 21. Microsoft Azure Cloud Dashboard Dhaka University of Engineering and Technology, Gazipur
- 22. Microsoft Azure Cloud Message Routing Dhaka University of Engineering and Technology, Gazipur
- 23. References [1] WWW.portal.web.azure.com, I have studied the Microsoft Web Portal and tried to understand . [2] www.aura.com from GitHub , I have studied from here and make sure that Hadoop and wordpress deployment to detect the transient fault Tolerance . [3] www.ams.web.com from here , I have studied that how can I deploy the new Application in Amazon Cloud Computing . Dhaka University of Engineering and Technology, Gazipur
- 24. Section Questions and Answers Thanks Dhaka University of Engineering and Technology, Gazipur