Cloud native resiliency patterns from the ground up
1 like186 views
The document discusses resilience and techniques for building resilient systems. It describes normal and faulty behavior in systems and how controls like circuit breakers, retries, and fallbacks can be used for feedback, recovery, and detection to mitigate issues. It provides examples of implementing circuit breakers with Istio and load shedding, rate limiting, and concurrency control. It also discusses interplay between autoscaling and load shedding and using fallbacks with Skupper. Code samples are available on GitHub.
Cloud native resiliency patterns from the ground up
- 2. Hello! I am Ana @ammbra1508 Java Champion, Certified Architect Developer Advocate @ RedHat Moved from to “Control” enthusiast
- 3. What is resilience? @ammbra1508 Normal Behaviour Faulty Behaviour Unexpected event occurs Unexpected condition occurs Degraded Mode Behaviour Feedback control mitigates malfunction Recovery control restores expected behaviour Detection control recognizes malfunction
- 4. What is resilience? @ammbra1508 Normal Behaviour Faulty Behaviour Unexpected event occurs Unexpected condition occurs Degraded Mode Behaviour Feedback control mitigates malfunction Recovery control restores expected behaviour Detection control recognizes malfunction
- 6. In other words… @ammbra1508 Recovery Control @CircuitBreaker, @Fallback Feedback Control @CircuitBreaker, @Retry, @Fallback Detection Control @CircuitBreaker, @Timeout, @Retry
- 8. My recipe @ammbra1508 Deployment activity v1 Deployment activity v2 Service activity Istio Kubernetes
- 9. Circuit breaker with Istio @ammbra1508
- 10. @ammbra1508 Load shedding drops some proportion of load by dropping traffic as the server approaches overload conditions. source: Site Reliability Engineering book
- 12. Concurrency control based on request priority @ammbra1508
- 14. Interplay autoscaling and load shedding @ammbra1508 Autoscaling condition Workload increases Load shedding starts and reduces resource stress Increased traffic continues Load shedding stops Yes No Trigger autoscaling
- 16. @ammbra1508 Code made available at https://github.com/ammbra/resilience