MongoDB .local London 2019: New Product Announcements: MongoDB Atlas Autoscaling and MongoDB Atlas Open Service Broker
Download as PPTX, PDF1 like168 views
The document discusses the MongoDB Atlas autoscaling feature, which automatically manages compute and storage capacity to balance performance and cost based on predicted workload patterns. It outlines the process of predicting future utilization, scaling operations, and performance monitoring. Additionally, it introduces the Atlas Open Service Broker for managing MongoDB clusters within Kubernetes environments.
MongoDB .local London 2019: New Product Announcements: MongoDB Atlas Autoscaling and MongoDB Atlas Open Service Broker
- 1. @ #MDBlocal Guillaume Meister Principal Solutions Architect, EMEA gmeister_fr Atlas Autoscaling
- 2. #MDBLocal GUILLAUME MEISTER Principal Solutions Architect, EMEA based in Paris MongoDB Office
- 3. #MDBLocal Flexibility - Y Reliability - Y Performance - Y Cost - ?
- 4. #MDBLocal Managing Capacity is the Key to Cost Optimization Reality Aspirations
- 5. #MDBLocal Ever played Whack-A-Mole? meet François the Database Administrateur !
- 6. Introducing Atlas Autoscaling Automatically manage capacity to intelligently balance between performance and cost
- 7. #MDBLocal How does it work? ComputeStorage Predict future workload patterns Automatically adjusts storage and compute to fit the workload
- 8. #MDBLocal What do spikes look like ? (Simulated Results)
- 9. #MDBLocal How does it work? Storage For any given compute, provision the right disk space Automatically increases disk space to keep up with writes Compute Adjusts the CPU and Memory provisioned to keep up with workload If workload increases, scale up to perform If workload decreases, scale down to save
- 10. #MDBLocal How do we do it? Monitor Performance & Learn ● Actually easier? ● How do we know we are doing well? ● How do we know we are not? ● How can we learn and improve the system Predict Future Workload ● Not easy :) ● Up ○ Too fast wastes $ ○ Too slow degrades performance ● Down ○ Too fast degrades performance ○ Too slow wastes $ Adjust Capacity Safely ● Not easy :) ● Scaling is expensive ● How do we reduce impact to app? feedback
- 11. #MDBLocal Step 1: Predicting Future Workload using Expert Learning Up Scaling Normalized CPU Util > 75% OR Memory Util > 75% For at-least 1 hour Checked every 5 minutes Down Scaling Normalized CPU Util <50% AND Memory Util <50% For at-least 72 hour Checked every 5 minutes
- 12. #MDBLocal 2. Perform Scaling Operations User Atlas Metrics Atlas predicts future utilization Executes autoscalin g decisions Check user specified conditions Automated hardware provisionin g Atlas automatically changes cluster’s computation capacity with no downtime Utilization metrics are captured in real time User Alerts to users
- 13. #MDBLocal Step 3: Monitor Performance & Learn Telemetry tracking how well we are predicting Telemetry tracking how the workload pattern changes Testing new algorithms with historic data to improve performance Ability to tune algorithm per cluster, if needed
- 16. #MDBLocal When to use autoscaling? If utilization is variable throughout the day or week & you want to save $ If you want to not worry about scaling your cluster as you grow over time If you have very high utilization & you are afraid of oversaturating your cluster But don't forget to use ATLAS Performance Advisor to optimize your queries !
- 17. #MDBLocal Real life behavior High CPU utilization indicates that the Atlas cluster tier is insufficient to meet the workload requirements After auto-scaling, CPU utilization drops indicating the Atlas cluster is sufficiently sized
- 18. #MDBLocal Now François can relax ! is luv MongoDB autoscaling !
- 19. Q&A
- 21. #MDBlocal Atlas Open Service Broker Deploying managed MongoDB clusters from within Kubernetes LONDON Ben Elgar
- 22. Who am I? ● Software engineer on Private Cloud Kubernetes team ● MongoDB Enterprise Operator ● Lead development on the Atlas Open Service Broker
- 23. Why should you listen? ● Manage your MongoDB clusters inside of Kubernetes ● Consistency ● Easily replicable ● No custom scripts
- 24. What is a service broker? ● An application that implements the Open Service Broker API ● Provision third-party resources from within a platform
- 25. What is the Atlas service broker? ● Application you run inside of Kubernetes ● Exposes a standard API ● Manage Atlas clusters and users with Kubernetes resources
- 26. Kubernetes ServiceInstance Resource Service Catalog Atlas Service Broker --- apiVersion: servicecatalog.k8s.io/v1beta1 kind: ServiceInstance metadata: name: atlas-cluster-instance spec: serviceClassExternalName: mongodb-atlas-aws servicePlanExternalName: M10 parameters: cluster: providerSettings: regionName: "EU_CENTRAL_1" Atlas
- 27. Live Demo Wish me luck.
- 28. Nota Bene ● Only clusters and users—everything else must be managed in Atlas ● Resources in Kubernetes will not reflect changes made outside
- 29. Open Source ● Free as in speech and free as in beer ● Apache Licensed https://github.com/mongodb/mongodb-atlas-service-broker
- 30. CHEERS!
- 31. #MDBlocal MongoDB Atlas New Features: Open Service Broker Ben Elgar https://www.surveymonkey.com/r/8KSJRK5