Lessons Learnt from Guanyu
Download as PPTX, PDF0 likes83 views
The document discusses lessons learned from the Guanyu project, focusing on AWS architecture and the use of ECS for distributing workloads and autoscaling. It highlights challenges with resource availability, especially in the context of utilizing spot instances and managing scaling policies. Key takeaways include the importance of balancing cost, performance, and availability while leveraging uniform workloads for efficiency.
Lessons Learnt from Guanyu
- 1. Lessons learnt from Guanyu -- ECS, Autoscaling, and Architecture Cliff Chao-kuan Lu 呂昭寬 AWSUGTW <clifflu@gmail.com> Image by NASA JPL via Space Images
- 2. Agenda • Cliff • Guanyu • Future
- 3. Cliff Chao-kuan Lu 呂昭寬 • Sr. Architect @ 104 Corp., #1 Job Bank in Taiwan • Organizer to AWS User Group Taiwan • AWS Community Hero • Certified ALL-5 + Big Data
- 4. Guanyu • Home-made security service on top of Sophos AV and AWS ECS • 6-9M scans per month at $100-200 • Developed June-August 2016
- 8. Architecture, In Short • Node.js web project + Sophos-AV in 1 image •Monolithic
- 9. Container Footprint • At rest • CPU: Minimal • Memory: ~30mb • Scanning • CPU: ~50% (single core) • Memory: ~300mb • Default: 4 parallel scans • Cache Hit • CPU: Minimal • Memory: ~30mb
- 11. Auto Scaling, NOT Ideal ?
- 12. Dilemma - Resource Availability • Starting EC2 instances takes time • Buffer with %Unreserved • Upper bound to %Reserved
- 13. Taking Spot Instance into Play • Takes longer to instantiate • Not always available • Lower price • Targets 50% reserved • Dual ASG (Spot + On- Demand)
- 14. Dilemma - Allocation / Utilization
- 15. Gotcha: Overshoot • Longer boot-up time means more buffer required • Metrics reflects PAST status • Grew to 17 when we needed 4 • Tuning complex scaling policies is an Art
- 16. Yeah, Art
- 17. Planned Scan Engines • Malware • Sophos AV • BinaryAlert https://www.binaryalert.io/ • Inappropriate Images • AWS Rekognition • OpenNSFW https://github.com/yahoo/open_nsfw
- 19. Advantages • Uniform workloads is easier to manage • Synchronous -> Asynchronous • Allows higher %Reserved • Do more, cost less
- 20. Better Late than Never
- 21. Take Home Message • Spot instance offers great performance per dollar • Mind the platform gap • Never too late to refactor • Keep an eye on Auto Scaling • Balance availability, cost, and performance
- 22. QUESTIONS
- 23. Thank You SEE YOU NEXT YEAR!