Own your ClickHouse data with Altinity.Cloud Anywhere-2023-01-17.pdf
0 likes246 views
The document discusses Altinity.Cloud Anywhere, a service that allows users to run ClickHouse databases on their own Kubernetes clusters. It provides automation of ClickHouse operations and management through the Altinity Connector. Users can prepare their own Kubernetes environment, connect it to Altinity.Cloud, and then launch and manage ClickHouse clusters on their infrastructure. Advanced topics covered include how the service works internally and how to get support from Altinity.
Own your ClickHouse data with Altinity.Cloud Anywhere-2023-01-17.pdf
- 1. © 2023 Altinity, Inc. Own your ClickHouse data with Altinity.Cloud® Anywhere Robert Hodges and Alexander Zaitsev 1 Version 2023-01 - © 2023 Altinity, Inc.
- 2. © 2023 Altinity, Inc. Let’s make some introductions ClickHouse support and services including Altinity.Cloud® Authors of Altinity Kubernetes Operator for ClickHouse and other open source projects Us Database geeks with decades of experience in DBMS and applications You App developers looking to build real-time analytics to solve business problems* 2 * You also like Kubernetes ;)
- 3. © 2023 Altinity, Inc. © 2023 Altinity, Inc. What’s Altinity.Cloud Anywhere? 3
- 4. © 2023 Altinity, Inc. Understands SQL Runs on bare metal to cloud Shared nothing architecture Stores data in columns Parallel and vectorized execution Scales to many petabytes Is Open source (Apache 2.0) ClickHouse is a real-time analytic database It’s the core engine for low-latency analytics ClickHouse Event Streams ELT Object Storage Interactive Graphics Dashboards APIs 4
- 5. © 2023 Altinity, Inc. 5 Altinity.Cloud is a zero-maintenance SaaS for ClickHouse Complete automation of operations with baked in DBA support Run in any AWS/GCP region or your own Kubernetes clusters Supports all versions and features of ClickHouse (also experimental ones!) Cost and performance optimized for real-time analytics
- 6. © 2023 Altinity, Inc. 6 Pure SaaS is convenient, but many users need more choices to meet business requirements Run in your own VPCs for security compliance Keep analytics close to on-prem data sources Use 100% open source to avoid vendor lock-in Use your own infrastructure to control costs
- 7. © 2023 Altinity, Inc. 7 DEMO TIME!
- 8. © 2023 Altinity, Inc. Altinity.Cloud Manager (“ACM”) Altinity.Cloud runs ClickHouse in Kubernetes “environments” Google GKE CH CH CH CH Tenant A Environment CH CH CH CH Tenant B Environment Altinity VPC Altinity Kubernetes
- 9. © 2023 Altinity, Inc. Altinity.Cloud Manager (“ACM”) Altinity.Cloud Anywhere can run in your Kubernetes 9 Google GKE CH CH CH CH Tenant A Environment CH CH CH CH Anywhere Environment CH CH CH CH Tenant B Environment User Kubernetes Altinity VPC Altinity Kubernetes User VPC Altinity Connector
- 10. © 2023 Altinity, Inc. Getting up and running with Altinity.Cloud Anywhere 10 1 Prepare Kubernetes 2 Connect to Altinity.Cloud 3 Start your clusters!
- 11. © 2023 Altinity, Inc. © 2023 Altinity, Inc. Preparing your Kubernetes 11
- 12. © 2023 Altinity, Inc. Choosing a Kubernetes distribution Currently certified distributions 12 Pending certifications * * Used for demo/test only
- 13. © 2023 Altinity, Inc. Your Kubernetes setup needs to get a few things right 13 Master Node Worker Node Worker Node Pod Pod Pod Pod ClickHouse Pod ClickHouse Pod Provision a cluster Add/remove nodes as needed (auto-scaling) Manage cloud block storage for data
- 14. © 2023 Altinity, Inc. Setup to provision EKS Cluster using eksctl 1. Bring up jump VM in AWS 2. Install AWS CLI 3. Install eksctl 4. Install kubectl (1.24 or greater) 5. Install aws-iam-authenticator 6. Add AWS IAM permissions to VM to create EKS clusters 14 Setup Provision Autoscaling Add CSI Test
- 15. © 2023 Altinity, Inc. Provision Kubernetes cluster on EKS eksctl create cluster -f - << EOF --- apiVersion: eksctl.io/v1alpha5 kind: ClusterConfig metadata: name: ${CLUSTER_NAME} region: ${AWS_DEFAULT_REGION} version: "1.23" tags: karpenter.sh/discovery: ${CLUSTER_NAME} managedNodeGroups: - instanceType: m5.large amiFamily: AmazonLinux2 name: ${CLUSTER_NAME}-ng desiredCapacity: 2 minSize: 1 maxSize: 10 iam: withOIDC: true EOF 15 Setup Provision Autoscaling Add CSI Test
- 16. © 2023 Altinity, Inc. Add CSI driver to managed storage (Kubernetes 1.23+) eksctl create iamserviceaccount --name ebs-csi-controller-sa --namespace kube-system --cluster ubuntu-altinity-cloud-anywhere-demo --attach-policy-arn arn:aws:iam::aws:policy/service-role/AmazonEBSCSIDriverPolicy --approve --role-only --role-name AmazonEKS_EBS_CSI_DriverRole eksctl create addon --name aws-ebs-csi-driver --cluster ${CLUSTER_NAME} --service-account-role-arn arn:aws:iam::${AWS_ACCOUNT_ID}:role/AmazonEKS_EBS_CSI_DriverRole --force 16 Setup Provision Autoscaling Add CSI Test
- 17. © 2023 Altinity, Inc. Add matching storage class(es) for CSI driver kubectl apply -f - <<EOF kind: StorageClass apiVersion: storage.k8s.io/v1 metadata: name: gp2 annotations: storageclass.kubernetes.io/is-default-class: "true" provisioner: ebs.csi.aws.com parameters: fsType: ext4 type: gp2 reclaimPolicy: Delete volumeBindingMode: WaitForFirstConsumer allowVolumeExpansion: true EOF 17 Setup Provision Autoscaling Add CSI Test
- 18. © 2023 Altinity, Inc. Add Karpenter to allocate/deallocate VMs automatically 1. Install Helm 2. Install Karpenter using getting started with eksctl instructions a. Create Karpenter infra and IAM roles b. Create IAM identity mapping so new VMs can join cluster c. Create IAM role for KarpenterController so it can launch VMs d. Install Karpenter Helm Chart e. Create a Karpenter provisioner to manage VMs 18 Setup Provision Autoscaling Add CSI Test
- 19. © 2023 Altinity, Inc. Here’s what a Karpenter provisioner looks like cat <<EOF | kubectl apply -f - apiVersion: karpenter.sh/v1alpha5 kind: Provisioner metadata: name: default spec: limits: resources: cpu: 1000 providerRef: name: default ttlSecondsAfterEmpty: 30 --- apiVersion: karpenter.k8s.aws/v1alpha1 kind: AWSNodeTemplate metadata: name: default spec: subnetSelector: karpenter.sh/discovery: ${CLUSTER_NAME} securityGroupSelector: karpenter.sh/discovery: ${CLUSTER_NAME} EOF 19 Setup Provision Autoscaling Add CSI Test
- 20. © 2023 Altinity, Inc. Try it out! Make sure your Kubernetes cluster can provision nodes and allocate storage! Try installing a simple application like nginx and prove that 1. Karpenter can allocate a VM for it. 2. Storage allocation on block storage works. Common problems: ● You missed IAM privileges somewhere ● CSI driver and matching storageclass missing/invalid ● Karpenter provisioner not correctly defined 20 Setup Provision Autoscaling Add CSI Test
- 21. © 2023 Altinity, Inc. Seems complicated! Isn’t there a better way? Yes!! Starting in Q1 2023, Altinity.Cloud will offer full provisioning of EKS from soup-to-nuts. All you need to supply is an IAM role and a VPC. 21
- 22. © 2023 Altinity, Inc. © 2023 Altinity, Inc. Connecting to Altinity.Cloud 22
- 23. © 2023 Altinity, Inc. Get an Altinity.Cloud account (if you don’t have one) 23 https://altinity.com/altinity-cloud-anywhere
- 24. © 2023 Altinity, Inc. Sign into Altinity.Cloud and find your environment 24 https://acm.altinity.cloud
- 25. © 2023 Altinity, Inc. Install Altinity Connector and set up connection # Download altinitycloud-connect. curl -sSL https://github.com/altinity/altinitycloud-connect/releases/download/v0.9.3/al tinitycloud-connect-0.9.3-linux-amd64 -o altinitycloud-connect && chmod a+x altinitycloud-connect && sudo mv altinitycloud-connect /usr/local/bin/ # Login to Altinity.Cloud. altinitycloud-connect login --token=<registration token> # Pipe setup commands to deploy connector to your Kubernetes cluster. altinitycloud-connect kubernetes | kubectl apply -f - 25
- 26. © 2023 Altinity, Inc. Fill out resource configuration 26 Node pool AZs and machine types Block storage types Services that will use the node pool
- 27. © 2023 Altinity, Inc. Review and Press FINISH to initiate setup 27
- 28. © 2023 Altinity, Inc. Altinity.Cloud Anywhere environment dashboard 28 Current nodes Allocated RAM and storage Environment statistics
- 29. © 2023 Altinity, Inc. © 2023 Altinity, Inc. Working with Clusters in Anywhere 29
- 30. © 2023 Altinity, Inc. Cluster view is the same as Altinity.Cloud 30 Create a new cluster An active cluster
- 31. © 2023 Altinity, Inc. So is the cluster dashboard 31
- 32. © 2023 Altinity, Inc. Rescaling is limited by your resources 32 Vertical scaling Horizontal scaling
- 33. © 2023 Altinity, Inc. Add new node types from the Environment Dashboard 33
- 34. © 2023 Altinity, Inc. Configure backups in Environment->Edit->Backups 34 Enable backups Backup schedule S3 bucket details
- 35. © 2023 Altinity, Inc. You can backup and restore Kubernetes data 35
- 36. © 2023 Altinity, Inc. What else is there? ● Setting up private connectivity from Kubernetes to other VPCs ○ ClickHouse.Cloud supports VPC Endpoints ● Running other applications alongside managed ClickHouse ● Disaster recovery 36 Contact support for help on any of these!
- 37. © 2023 Altinity, Inc. © 2023 Altinity, Inc. Advanced Topics 37
- 38. © 2023 Altinity, Inc. Altinity.Cloud Manager (“ACM”) How does Altinity.Cloud Anywhere work internally? 38 Altinity Operator Secure outbound HTTPS Apps Object Storage AWS NLB Altinity Connector System services ClickHouse + ZooKeeper Edge Proxy Cloud Block Storage Altinity VPC Your VPC
- 39. © 2023 Altinity, Inc. What’s going on under the covers in a ClickHouse cluster? 39 Altinity Operator Cluster Endpoint Node Endpoint Node Endpoint ClickHouse Node (=VM) Volume Claims Volume Claims Availability Zone ClickHouse Node (=VM) Volume Claims Volume Claims Availability Zone Block Storage Connection to Cluster DNS
- 40. © 2023 Altinity, Inc. Restricting access to data is a standard feature 40
- 41. © 2023 Altinity, Inc. © 2023 Altinity, Inc. How Altinity.Cloud Anywhere support works 41
- 42. © 2023 Altinity, Inc. Altinity.Cloud has enterprise support for all environments ● Schema design ● Performance optimization ● Troubleshooting ● Upgrades ● Capacity planning ● Integrations (Kafka, BI, librarise.) ● And random questions Ways to access support ● Slack - shared slack channel ● Zendesk - email to support at altinity dot com 42 We also answer questions about Kubernetes!
- 43. © 2023 Altinity, Inc. How to get the most out of Altinity.Cloud support ● Log production issues in Zendesk, not Slack ○ Makes it easier to track progress ● Contact us in advance prior to: ○ ClickHouse version upgrades ○ Scale-out operations that may require us to raise AWS or GCP quotas ● Don’t wait for problems. We can help you with migration, design and capacity planning and many other topics ○ Just ask if you have questions! ○ We also can do regular check-in calls to help you make progress 43
- 44. © 2023 Altinity, Inc. Wrap-up 44 Start a free two-week trial today! https://altinity.com/altinity-cloud-anywhere/ ● Altinity.Cloud Anywhere gives you convenience of cloud with the control of installed software ● Pricing is based on compute only. We don’t charge for data ● Run ClickHouse anywhere that Kubernetes runs ● Don’t want to bother with Kubernetes? We can install that, too!
- 45. © 2023 Altinity, Inc. Thank you! Questions? Website: https://altinity.com Email: info@altinity.com Slack: altinitydbworkspace.slack.com 45 Altinity.Cloud Altinity Support Altinity Stable Builds Free 2 week trials