Private cloud as a code
0 likes95 views
This document summarizes a private cloud infrastructure at CESNET in Brno, Czech Republic. It discusses the migration to an automated OpenStack deployment using Foreman for provisioning and configuration. Statistics show the infrastructure growing from 53897 VMs in 2020 to 131242 VMs in 2021. Bottlenecks discussed include dependencies on infrastructure, hardware limitations, networking issues, and challenges with development and operations. The conclusion discusses promoting the cloud for HPC workloads and best practices.
Private cloud as a code
- 1. Private cloud as a code
- 2. Introduction ● Andrei Kirushchanka ● Cloud infrastructure tech lead ● CESNET, Brno, Czech Republic
- 3. ● Introduction ● Exposition ○ Use-cases ○ Private vs Public ○ History and migration to OpenStack Table of Contents 3 ● Automated deployment ○ 2 years ago ○ Now ● Infrastructure and statistics ● Bottlenecks and issues ● Insights and conclusion ○ Partners/sponsors
- 5. Project aims to improve cancer drug development success rates through the enablement of collaborative PDX(Patient derived tumour xenografts) research. https://www.europdx.eu/ Melanoma model
- 6. ELIXIR coordinates and develops life science resources across Europe so that researchers can more easily find, analyse and share data, exchange expertise, and implement best practices. This makes it possible for them to gain greater insights into how living organisms work. 6 https://elixir-europe.org
- 7. Earth observation data hub and platform http://www.nextgeoss.eu/
- 8. The goal of VESPA (Virtual European Solar and Planetary Access) is to build a Virtual Observatory (VO) for Solar System Sciences, by adapting standard VO techniques and developing new tools and standards to handle the specificities of Planetary Science data. http://europlanet-vespa.eu/ VESPA
- 9. Effective Management of Pests and Harmful Alien Species: Integrated Solutions http://www.emphasisproject.eu/
- 10. Predicting weather and climate and its impacts on the environment http://www.drihm.eu/
- 11. 11 ?
- 13. Automated deployment 01 Two years ago and now
- 15. 15 HW provisioning 2 years ago Controller Compute nodes Foreman
- 16. 16 Configuration 2 years ago Controller Compute nodes master
- 17. 17 OpenStack deployment 2 years ago
- 18. 18 OpenStack deployment 2 years ago + =
- 19. 19 OpenStack deployment 2 years ago Controller
- 20. 20 Automated deployment 2 years ago Controller Compute nodes Foreman
- 21. OpenStack components 2 years ago 21 keystone placement OpenStack version: Rocky Nova EC2 Glance EC2 img. builder heat Cloud Formation Cinder EBS Ceph_rgw (oject) S3 Horizon Manage ment console neutron ovn
- 27. OpenStack components Now 27 keystone placement OpenStack version: Train Nova EC2 Glance EC2 img. builder heat Cloud Formation Cinder EBS Ceph_rgw (oject) S3 Horizon Manage ment console neutron ovn Monasca Octavia ELB Magnum (stage) EKS Barbican KMS
- 31. 31 Statistics Users Projects Hypervisors April 2020 395 345 164 April 2021 763 650 227
- 32. 32 Statistics VMs VMs/day April 2020 53897 148 April 2021 131242 360
- 33. GPU cards NVIDIA 2080 NVIDIA 1080 NVIDIA T4 62 CEPH Storage amount Block storage + Object storage 1.5 PB Statistics GPU and storage 3 3
- 35. Bottlenecks and issues 3 5 ● Code dependency on the infrastructure ● Hardware ● Networking ● Dev & Operations
- 36. Bottlenecks and issues 3 6 ● Code dependency on the infrastructure
- 39. Bottlenecks and issues 3 9 ● Dev & Operations
- 41. Insights and Conclusion 4 1 ● HPC CLoud ● Promote cloud usage best practices
- 42. Colin Powel 42