EOSC-hub Cloud Container Compute for EOSC-hub
- 1. eosc-hub.eu @EOSC_eu EOSC-hub receives funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 777536. Run Docker containers in a lightweight virtualised environment EGI Cloud Container Compute
- 2. 2 Motivation and driving consideration about the service Service architecture and interfaces: overview - How the user can access the service E.g.: REST, GUI, CLIs, etc. - Service options and attributes Acceptable Usage Policy (AUP) Access policy and business model Use cases Documentation/tutorial/information 11/27/2018 Content
- 3. 3 Containers provide OS-level virtualization for running applications on same kernel as host with less overhead, faster startup and smaller sizes than VMs. Containers are well suited for microservices-based applications which are composed of several independent services running in a coordinated manner. Cloud Container Compute gives you the ability to deploy and scale Docker containers on-demand using Kubernetes technology. The service provides with easy provision of Kubernetes clusters on EGI Cloud Compute resources that can be scaled and upgraded without the overhead of installing, managing and operating the nodes. Cloud Container Compute offers users offers guaranteed computational resources in a secure and isolated environment with industry-standard Kubernetes container orchestration platform that: - Manages the nodes where to run the containers - Automates the deployment, management, scaling, networking, and availability of container-based applications running on that cluster. 11/27/2018 Motivation
- 4. Cloud Management Framework IaaS API 411/27/2018 Service architecture and interfaces EGI Cloud Container Compute IaaS Federated Access Tools 1. Provision cluster VMs 3. Use native Kubernetes tooling with EGI Check-in authentication 2. Deploy Kubernetes cluster on provisioned VMs EGI Cloud Compute Service
- 5. 5 API/CLI access: - Uses native Kubernetes API with OpenID Connect authentication https://kubernetes.io/docs/reference/access-authn- authz/authentication/#authentication-strategies 11/27/2018 Service access
- 6. 6 Service Options: - General purpose instance: base performance instance type with up to 8 cores and up to 4 GB RAM per core - Compute-intensive instance: optimised instance for cpu-bound tasks. Up to 64 cores (non-overcommitted) and possible low- latency network - High-memory instance: optimised instances for tasks with big memory requirements. Up 120GB RAM per core. Service attributes: - Associated storage to each VM (GB) - Access type: opportunistic (non guaranteed resources) or reserved - Start of service (date) and duration (days) 11/27/2018 Service options and attributes
- 7. 7 EGI AuP: - https://documents.egi.eu/public/ShowDocument?docid=2 623 Further VO-level AuPs may also apply 11/27/2018 Acceptable Usage Policy
- 8. 8 Access policies: - Policy-based - Wide-access - Market-drive Payment model: - Sponsored (free for a certain quota) - Wide-access - Market-driven 11/27/2018 Access policies and Funding models
- 9. 9 EGI Container Compute documentation page: - https://wiki.egi.eu/wiki/Federated_Cloud_Containers Kubernetes documentation: - https://kubernetes.io/docs/ 11/27/2018 Documentation
- 10. 10 EGI Notebooks is a newly developed service that provides Jupyter environment to researchers for interactive data analysis. 11/27/2018 Use cases – EGI Notebooks Spawns users’ Jupyter notebooks Ingress: routes requests to k8s services NFS-backed Persistent Volumes EGI Notebooks uses Cloud Container Compute to create a Kubernetes cluster to deploy and run the service.