Top 5 Considerations for Operating a Kubernetes Environment at Scale
0 likes317 views
The document discusses key considerations for operating a Kubernetes environment at scale, emphasizing the importance of proper resource calculation, service distribution, and monitoring tools. It highlights Keitaro's experience in managing Kubernetes deployments and Signalfx’s monitoring solutions tailored for dynamic, cloud-native environments. Additionally, the document outlines the challenges and essential strategies necessary for successful Kubernetes implementation and scaling.
Top 5 Considerations for Operating a Kubernetes Environment at Scale
- 1. MM/DD/YY PREPARED FOR: PLACE LOGO HERE TOP 5 CONSIDERATIONS FOR OPERATING A KUBERNETES ENVIRONMENT AT SCALE Marko Bocevski, Co-Founder & CTO at Keitaro Patrick Lin, VP Products at SignalFx @signalfx | www.signalfx.com
- 2. INTRODUCTIONS Marko Bocevski • Co-Founder & CTO at Keitaro Patrick Lin • VP Products at SignalFx
- 3. AGENDA • Challenges in Today’s Cloud-Native Environments • Keitaro’s Experience in Managing Kubernetes at Scale • Deep Dive into SignalFx’s New Kubernetes Monitoring • What’s Next for Keitaro • Q&A
- 4. @signalfx | www.signalfx.com4 CLOUD ERA HAS DRIVEN A NEW TECHNOLOGY PLATFORM Software Delivered “As A Service” Microservices of enterprises expect to monitor microservices by the end of 2018 Containers of new workloads in containers by 2019 Function as a Service Event-driven, short-lived architectures with no runtime access using Lambda functions in production of software will be delivered with a subscription model by 2020 >80% Gartner: Market Trends: Prepare Now to Smooth the Inevitable Transition to a Subscription-Based Business Model >76% 12.3% Gartner: How Microservices Have a Macroeffect on APM Gartner 2017 Strategic Roadmap for Compute Infrastructure Requiring more operational oversight from Development and enabling more frequent updates Decentralized application architectures, requiring strong collaboration across teams 50% Elastic architectures provisioned directly by engineering teams 2017 Key Takeaways from The State of Modern Apps Report
- 5. @signalfx | www.signalfx.com5 DEV • Plan • Create • Verify • Package • Release • Configure • Monitor • Support OPS OPSDEV • Plan • Create • Verify • Package • Release • Configure • Monitor • Support Throw it over the fence OLD Monolith NEW Microservices AND A FUNDAMENTAL ORGANIZATION SHIFT You write it. You run it.
- 6. @signalfx | www.signalfx.com6 LEADING TO NEW OPERATING MODELS DEV OPSOLD 10x Teams Monolith PLAN | CREATE | VERIFY NEW PACKAGE | RELEASE | CONFIGURE MONITOR | SUPPORT Microservices 100x Releases 1000x Dependencies 100x Components
- 7. TREND SOLUTION CRITERIA TECH REQUIREMENTS 1. Scale-out open source platforms, microservices architectures Monitoring service-wide aggregate metrics vs. host-specific metrics Streaming aggregation of composite metrics 2. Containers and functions / serverless Instant discovery with real-time monitoring Streaming high-resolution metrics 3. Developer choice, decentralized operations (loss of centralized control) Shared context across distributed teams and instant visibility into any changes in environment Centralized, self-service, real-time operational intelligence solution 4. High-velocity release cycles Predictive analytics and proactive alerting to identify emerging trends Real-time streaming analytics, alerts, anomaly detection, outlier detection 5. Troubleshooting across distributed teams Advanced real-time correlation and dimensional analysis Interactive, high-cardinality queries and alerts CLOUD-NATIVE MONITORING REQUIREMENTS
- 8. AGENDA • Challenges in Today’s Cloud-Native Environments • Keitaro’s Experience in Managing Kubernetes at Scale • Deep Dive into SignalFx’s New Kubernetes Monitoring • What’s Next for Keitaro • Q&A
- 9. OVERVIEW OF • Founded in 2011, based in Sweden • Provides Linux and open-source software consultancy with a strong focus in bleeding edge technologies and managed services • Key focus on providing docker and kubernetes based services • Customers across telecom, financial services, education, tech, media, and government 5 Locations 36 Employees 100+ Finished or Ongoing Projects 18 KUBERNETES deployments
- 10. TODAY’S BUSINESS OBJECTIVES • Increasing customer expectations for always-on apps • Reimaging a highly collaborative Dev and Ops organizations • Leveraging cutting-edge technologies • Modernizing application deployments and availability
- 11. CUSTOMER USE CASE VIDERUMS MOVE TO KUBERNETES Viderum (http://www.viderum.com) is a SaaS provider of open data management platforms 1. Implemented a SaaS solution that can scale to support thousands of customers using “traditional” software - CKAN (http://www.ckan.org) 2. Setup based on a custom deployment of kubernetes including deis/workflow, traefik, crunchy postgres, Ceph, Minio etc. 3. Implemented scaling and application/service clustering by utilizing data from kubernetes and docker metrics 4. Simplified workflow and encapsulated a lot of the cluster complexity to the developers. 5. Optimized resources and enabled delivery of more than 100 data portals per node 6. Zero downtime for deployment and easy rollback. 7. Enabled deployment of new portals within seconds
- 12. SCALING KUBERNETES Scaling is pretty easy, fast and without downtime 1. Scaling pods when you need more resources for any service a. In mere seconds b. Autoscaling 2. Scaling nodes when you need to grow performance of whole cluster. a. Seamless horizontal scaling b. Built-in advanced mechanisms for load distribution
- 13. TOP CONSIDERATIONS IN DEPLOYING KUBERNETES Kubernetes is a complex framework and it is up to you to use it cleverly 1. Calculate at start all resources needed (cpu, memory, storage). 2. Plan good distribution of services across cluster like databases, caching, workload and similar. 3. Implement good monitoring and metrics tools. 4. Understand your cluster and utilize the vast amount of metrics flowing through it 5. Kubernetes provides basis but is not enough, combine it with other tools that will help in your use-case.
- 14. AGENDA • Challenges in Today’s Cloud-Native Environments • Keitaro’s Experience in Managing Kubernetes at Scale • Deep Dive into SignalFx’s New Kubernetes Monitoring • What’s Next for Keitaro • Q&A
- 15. INTRODUCING KUBERNETES MONITORING DYNAMIC DETECTORS Deliver On-Time Alerts That Adapt To Fast-Moving Data SIGNALFX SMART AGENT Eliminate the Need to Manually Configure for Each New Container, App, or Service OUT-OF-THE-BOX VISUALIZATIONS Immediately Visualize Your Data and Explore ’Up and Down’ The Stack The most comprehensive, real-time view into health and performance for orchestrated container environments
- 16. MM/DD/YY PREPARED FOR: PLACE LOGO HERE SIGNALFX DEMO
- 17. SIGNALFX SMART AGENT • Based on SignalFx collectd agent • Enhanced with service discovery and auto-configuration when working in conjunction with Kubernetes • Deploy with out-of-the-box rules, then customize for your specific use case Eliminate the Need to Manually Configure for Each New Container, App, or Service
- 18. OUT-OF-THE-BOX KUBERNETES VISUALIZATIONS • Top-to-bottom view to correlate issues from app down to infrastructure - Architecture view - Pods and nodes dashboards - Built-in container content • Links to related Navigator views to explore 'up and down' the stack • Monitoring for etcd as well Immediately Visualize Your Data and Explore ’Up and Down’ The Stack
- 19. DYNAMIC DETECTORS • On-time alerting optimized for high-churn environments to minimize discovery delay • Built-in alert conditions great for finding patterns and trends across dynamic environments Deliver On-Time Alerts That Adapt To Fast-Moving Data
- 20. AGENDA • Challenges in Today’s Cloud-Native Environments • Keitaro’s Experience in Managing Kubernetes at Scale • Deep Dive into SignalFx’s New Kubernetes Monitoring • What’s Next for Keitaro • Q&A
- 21. KEY BENEFITS WITH SIGNALFX (TO DATE) • Highly configurable views and alerts across nodes, containers, services and applications • Lots of integrations out of the box especially Kubernetes integration • Pagerduty and Slack integration works flawlessy • Real-time metrics collection • Easy to use dashboards to get quick insights into key metrics and KPIs
- 22. WHAT’S NEXT FOR KEITARO • Explore integrating SignalFx into customer applications • Implement Kubernetes scaling triggers based on data from SignalFx • Set up data views for customers • Fine tune alerting and detection specifically for highly-available services
- 23. AGENDA • Challenges in Today’s Cloud-Native Environments • Keitaro’s Experience in Managing Kubernetes at Scale • Deep Dive into SignalFx’s New Kubernetes Monitoring • What’s Next for Keitaro • Q&A
- 24. GET STARTED TODAY • Read more about Kubernetes Monitoring from SignalFx - docs.signalfx.com/en/latest/integrations/kubernetes-quickstart.html • Start a free trial with SignalFx - info.signalfx.com/trial.html
- 25. MM/DD/YY PREPARED FOR: PLACE LOGO HERE Q&A
- 26. MM/DD/YY PREPARED FOR: PLACE LOGO HERE TOP 5 CONSIDERATIONS FOR OPERATING A KUBERNETES ENVIRONMENT AT SCALE Marko Bocevski, Co-Founder & CTO at Keitaro Patrick Lin, VP Product & Partnerships at SignalFx @signalfx | www.signalfx.com