Multi-Clusters Made Easy with Liqo: Getting Rid of Your Clusters Keeping Them All | Alex Palesandro
Download as PPTX, PDF0 likes494 views
Liqo simplifies the management of multiple Kubernetes clusters by enabling resource sharing and seamless orchestration across dynamic multi-cluster topologies. It allows for virtual nodes that operate as if they were physical nodes in a control plane, supporting various cloud environments. The document outlines Liqo's capabilities, including discovery, peering, and network interconnection to enhance scalability and connectivity for applications across clusters.
Multi-Clusters Made Easy with Liqo: Getting Rid of Your Clusters Keeping Them All | Alex Palesandro
- 1. Multi-Clusters Made Easy with Liqo: Getting Rid of Your Clusters by Keeping Them All Alex Palesandro, Politecnico di Torino
- 2. Why so many Kubernetes clusters? 02 Many organizations relies on multiple infrastructure providers (e.g. Public Clouds) Vendor Lock-ins 03 Law prescriptions and/or performance issues may require cluster in diverse geographical locations Geographical Constraints 01 Multiple departments spawn clusters within the same organization Organizational Constraints 04 Kubernetes clusters cannot grow endlessly; scalability limitations arise around a few thousand nodes Scalability Issues
- 3. Multi-cluster Challenges How to orchestrate applications across multiple clusters? How can we interconnect multiple clusters? Pod Connectivity Service Discovery Pod Offloading Object Replication
- 4. 4 Liqo Liqo enables workload management on dynamic and seamless Kubernetes multi- cluster topologies, taking care of: • Resource Sharing • Orchestration • Scheduling • Networking • (Storage) • Support for K8s, K3s, EKS, AKS, GKE and OpenShift and most popular CNIs.
- 5. A partial Taxonomy Fleet Service Mesh Kubefed ArgoCD Cilium Submariner GitOps FluxCD CNI-provided CNI-Agnostic Networking Skupper Multi-Cluster Control Plane Integrated
- 6. 6 “Home” cluster “Foreign” cluster B “Foreign” cluster A Liqo: The multi-cluster with Virtual Nodes • “A “Virtual node” virtualizes the remote cluster. • “Virtual nodes” are equivalent to physical nodes w.r.t. the Kubernetes Control plane • Can be controlled by the vanilla Kubernetes scheduler and controller-manager • Compatible with the Kubernetes APIs and primitives. (Virtual) Node 3 (Virtual) Node 2 Node 1 Node 2 Node 1 Node 2 Node 1
- 7. 7 7 Hybrid Cloud Use-Cases Establishing a new peering New virtual cluster created app app app app app app app app Cloud migration app app app app app app Establishing a new peering New virtual cluster created Cloud bursting Public Cloud Private Cloud Public Cloud Private Cloud
- 8. Advanced Use-Cases Cluster Cluster Tenant SaaS Provider Tenant Customer Cluster Tenant Customer Tenant Tenant Cluster Customer Tenant
- 9. Cluster 3 Cluster 2 Cluster 1 Single Pane of Glass Organization-wide Supercluster (Virtual Cluster) … Virtual Node Virtual Node Virtual Node France Japan Project X on nodes = Europe … Platform Team Project X Team Policies 1 $/h 0.5 $/h 3 $/h Germany App APP 2 Project Y Team App 1 App 1 App 1 Hundreds of clusters (ex. Edge, Cloud)
- 10. The Liqo Workflow 01 Discovery Discovers available clusters 02 Peering Establish an administrative interconnection between the clusters and negotiate the parameters. 03 Network Interconnection Establish a network interconnection between the clusters. 05 04 Resource Management Creates the virtual node and make the external resources available Use Offload your pods
- 11. 12 Network Fabric • Cross-cluster network fabric, with uniform network connectivity • Pod-to-pod, pod-to-service, etc., independently from the location of source and destination. • Liqo provides: • Special-purpose network overlay to a Liqo Gateway (possibly replicated) in each cluster • Gateways directly (and securely) connected • Network params (e.g., local/remote IP addresses for pods and services) are dynamically negotiated • Transparent (double) NAT is established if needed • Does not depend on the underlying CNI Node Big node Node Node Node Node K8s CNI network Liqo GW+NAT Liqo GW+NAT Router LoadB K8s CNI network Router LoadB Internet From P1 to S1 From P1 to P2 From P1* to P2* From P1* to P2* 01 Discovery 02 Peering 03 Network Interconnection 04 Resource Management 05 Use
- 13. Liqo Status and Road Map 0.1 Oct 2020 0.2 Mar 2021 0.3 Sep 2021 Jan 2020 CNCF Blog Post May 2021 KubeCon EU ScaleX May 2021 June 2021 Google Kubernetes Podcast KCD Italy Nov 2021 Nov 2021 Jan 2022 100 400 Polito – TOP-IX Joint Deployment Polito Exams on Liqo 0.4 Dec 2021
- 14. 18 Next Steps (v0.4) • Persistent Storage Support • Support StatefulSet and PVC across clusters via a Virtual StorageClass • Direct Connectivity between Clusters
- 15. 19 Thanks! • More information available on our website: • www.liqo.io • Check out the code at: • https://github.com/liqotech/liqo • Follow us on: • Twitter: @liqo_io • Shoot us a message at: • info@liqo.io Questions?