SlideShare a Scribd company logo
Application
Modernization
Tip of the week series
Where does my money go? - Breaking down GKE
cluster cost using GKE Usage Metering
Sreenivas Makam
Why do we need GKE Usage Metering?
● Break down the GKE cluster cost by individual
users and applications using the cluster
● Map GKE resources requested vs actual
consumption
● Tune GKE cluster configurations to optimize
cost
What is GKE Usage metering?
● Visibility into GKE cluster cost
○ Break down the overall GKE cluster cost into namespaces, labels or a combination of both
○ Cost split into CPU, memory, network, GPU, TPU for the above resources
○ In multi-tenant scenarios, each team can be cross-charged using this capability.
○ Optimize cluster resource allocation thereby reducing overall cost
● Feature enabled as part of creating a cluster or editing an existing cluster
● This feature needs billing and metering data export to bigquery
● Cost correlation is done by matching billing report and usage metering data for the corresponding
kubernetes resources
● Sample datastudio templates are provided to view the GKE metering data from datastudio dashboard
GKE usage metering - Sample dashboards
Usage Metering workflow
Create bigquery
dataset and table for
billing data export to
BQ
Create bigquery
dataset and table for
GKE metering export
Create GKE cluster
and enable GKE usage
metering.
Generate query to
correlate billing data
and metering data.
Setup query to run
periodically
Use existing data
studio template to
create dashboard from
the correlated BQ table
Useful dashboards
Usage breakdown
- Gives cost breakdown by namespace
- Visibility into unallocated resources
Cost trends by namespace
- Visibility into cluster, namespace, resource(cpu, memory, network) and SKU(CPU/memory types)
- Understand if the application is cpu, memory or network intensive
Cost trends by labels
- Visibility into individual label cost
- Helps in multi-tenant cost distribution
Consumption trends
- Compares requested vs actually used resources(CPU, memory, network).
- Helps in optimizing resource allocation
Conclusion
With GKE usage metering, we can get deep visibility
into usage patterns in our cluster which in turn can
help optimize the spend
References
GKE Usage metering
That’s a wrap.

More Related Content

PPTX
Infrastructure-as-Code (IaC) Using Terraform (Intermediate Edition)
PPTX
Introduction to Kubernetes
PDF
【旧版】Oracle Exadata Cloud Service:サービス概要のご紹介 [2021年7月版]
PDF
Advanced Load Balancer/Traffic Manager and App Gateway for Microsoft Azure
PPTX
Azure Fundamentals || AZ-900
PPTX
Postgres Playground で pgbench を走らせよう!(第35回PostgreSQLアンカンファレンス@オンライン 発表資料)
PDF
The Best Storage Solution For CloudStack: LINSTOR
PPTX
5 g nr numerology
Infrastructure-as-Code (IaC) Using Terraform (Intermediate Edition)
Introduction to Kubernetes
【旧版】Oracle Exadata Cloud Service:サービス概要のご紹介 [2021年7月版]
Advanced Load Balancer/Traffic Manager and App Gateway for Microsoft Azure
Azure Fundamentals || AZ-900
Postgres Playground で pgbench を走らせよう!(第35回PostgreSQLアンカンファレンス@オンライン 発表資料)
The Best Storage Solution For CloudStack: LINSTOR
5 g nr numerology

What's hot (20)

PDF
DDS in Action -- Part I
PDF
Unrevealed Story Behind Viettel Network Cloud Hotpot | Đặng Văn Đại, Hà Mạnh ...
PDF
MQTT Protocol: IOT Technology
PDF
Deep dive into Kubernetes Networking
PDF
Kubernetes design principles, patterns and ecosystem
PDF
Kubernetes Concepts And Architecture Powerpoint Presentation Slides
PPTX
SAP Extractorのソースエンドポイントとしての利用
PPTX
8 - Configuring a VPRN Nokia Router.pptx
PPTX
Presentation on private 5G.pptx
PDF
Azure DRaaS v0.7
PDF
Easy, Secure, and Fast: Using NATS.io for Streams and Services
PPT
NVIDIA OpenGL 4.6 in 2017
PDF
Google Cloud Networking Deep Dive
PPTX
ONOS: Open Network Operating System. An Open-Source Distributed SDN Operating...
PPTX
FICO Open Shift presentation
PDF
Part 10: 5G Use cases - 5G for Absolute Beginners
PDF
GKE Tip Series how do i choose between gke standard, autopilot and cloud run
PPTX
Infrastructure as Code
PDF
MongoDB Cheat Sheet – Quick Reference
PDF
GSM Protocol Stack and Frame Formating
DDS in Action -- Part I
Unrevealed Story Behind Viettel Network Cloud Hotpot | Đặng Văn Đại, Hà Mạnh ...
MQTT Protocol: IOT Technology
Deep dive into Kubernetes Networking
Kubernetes design principles, patterns and ecosystem
Kubernetes Concepts And Architecture Powerpoint Presentation Slides
SAP Extractorのソースエンドポイントとしての利用
8 - Configuring a VPRN Nokia Router.pptx
Presentation on private 5G.pptx
Azure DRaaS v0.7
Easy, Secure, and Fast: Using NATS.io for Streams and Services
NVIDIA OpenGL 4.6 in 2017
Google Cloud Networking Deep Dive
ONOS: Open Network Operating System. An Open-Source Distributed SDN Operating...
FICO Open Shift presentation
Part 10: 5G Use cases - 5G for Absolute Beginners
GKE Tip Series how do i choose between gke standard, autopilot and cloud run
Infrastructure as Code
MongoDB Cheat Sheet – Quick Reference
GSM Protocol Stack and Frame Formating
Ad

Similar to GKE Tip Series - Usage Metering (14)

PDF
Google Kubernetes Engine (GKE) deep dive
PDF
Building cost-effective mobile product & marketing app analytics based on GCP...
PDF
Analyzing petabytes of smartmeter data using Cloud Bigtable, Cloud Dataflow, ...
PPTX
[Webinar] Getting to Insights Faster: A Framework for Agile Big Data
PDF
Deep into Prometheus
PDF
Dip into prometheus
PDF
Energy usage insights_with_hadoop_and_h_base
PDF
SunGard - Defining Sustainability Metrics (KpIs)
PDF
Optimizing SaaS Growth with Effective Product Metering
PDF
Steps to Modernize Your Data Ecosystem with Mindtree Blog
PDF
6 Steps to Modernize Data Ecosystem with Mindtree
PDF
Six Steps to Modernize Your Data Ecosystem - Mindtree
PDF
Steps to Modernize Your Data Ecosystem | Mindtree
PPTX
From Zero to Cloud using Spring with Cloud-Native Data Technologies - John Blum
Google Kubernetes Engine (GKE) deep dive
Building cost-effective mobile product & marketing app analytics based on GCP...
Analyzing petabytes of smartmeter data using Cloud Bigtable, Cloud Dataflow, ...
[Webinar] Getting to Insights Faster: A Framework for Agile Big Data
Deep into Prometheus
Dip into prometheus
Energy usage insights_with_hadoop_and_h_base
SunGard - Defining Sustainability Metrics (KpIs)
Optimizing SaaS Growth with Effective Product Metering
Steps to Modernize Your Data Ecosystem with Mindtree Blog
6 Steps to Modernize Data Ecosystem with Mindtree
Six Steps to Modernize Your Data Ecosystem - Mindtree
Steps to Modernize Your Data Ecosystem | Mindtree
From Zero to Cloud using Spring with Cloud-Native Data Technologies - John Blum
Ad

More from Sreenivas Makam (18)

PDF
My kubernetes toolkit
PDF
Top 3 reasons why you should run your Enterprise workloads on GKE
PDF
How Kubernetes helps Devops
PPTX
Docker Networking Tip - Load balancing options
PPTX
Docker Networking Tip - Macvlan driver
PPTX
Docker Networking Overview
PPTX
Docker Networking - Common Issues and Troubleshooting Techniques
PPTX
Compare Docker deployment options in the public cloud
PPTX
Docker Mentorweek beginner workshop notes
PPTX
Devops in Networking
PPTX
Docker Security Overview
PPTX
Docker 1.11 Presentation
PPTX
Service Discovery using etcd, Consul and Kubernetes
PPTX
CoreOS Overview and Current Status
PPTX
Container Monitoring with Sysdig
PPTX
CI, CD with Docker, Jenkins and Tutum
PPTX
Docker 1.9 Feature Overview
PPTX
Docker Networking - Current Status and goals of Experimental Networking
My kubernetes toolkit
Top 3 reasons why you should run your Enterprise workloads on GKE
How Kubernetes helps Devops
Docker Networking Tip - Load balancing options
Docker Networking Tip - Macvlan driver
Docker Networking Overview
Docker Networking - Common Issues and Troubleshooting Techniques
Compare Docker deployment options in the public cloud
Docker Mentorweek beginner workshop notes
Devops in Networking
Docker Security Overview
Docker 1.11 Presentation
Service Discovery using etcd, Consul and Kubernetes
CoreOS Overview and Current Status
Container Monitoring with Sysdig
CI, CD with Docker, Jenkins and Tutum
Docker 1.9 Feature Overview
Docker Networking - Current Status and goals of Experimental Networking

Recently uploaded (20)

PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
cuic standard and advanced reporting.pdf
PDF
Spectral efficient network and resource selection model in 5G networks
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Modernizing your data center with Dell and AMD
PDF
Empathic Computing: Creating Shared Understanding
PPTX
MYSQL Presentation for SQL database connectivity
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
KodekX | Application Modernization Development
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
Encapsulation theory and applications.pdf
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Machine learning based COVID-19 study performance prediction
PPTX
A Presentation on Artificial Intelligence
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
Cloud computing and distributed systems.
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
cuic standard and advanced reporting.pdf
Spectral efficient network and resource selection model in 5G networks
The AUB Centre for AI in Media Proposal.docx
Modernizing your data center with Dell and AMD
Empathic Computing: Creating Shared Understanding
MYSQL Presentation for SQL database connectivity
NewMind AI Weekly Chronicles - August'25 Week I
KodekX | Application Modernization Development
“AI and Expert System Decision Support & Business Intelligence Systems”
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Encapsulation theory and applications.pdf
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Machine learning based COVID-19 study performance prediction
A Presentation on Artificial Intelligence
Encapsulation_ Review paper, used for researhc scholars
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
Cloud computing and distributed systems.

GKE Tip Series - Usage Metering

  • 1. Application Modernization Tip of the week series Where does my money go? - Breaking down GKE cluster cost using GKE Usage Metering Sreenivas Makam
  • 2. Why do we need GKE Usage Metering? ● Break down the GKE cluster cost by individual users and applications using the cluster ● Map GKE resources requested vs actual consumption ● Tune GKE cluster configurations to optimize cost
  • 3. What is GKE Usage metering? ● Visibility into GKE cluster cost ○ Break down the overall GKE cluster cost into namespaces, labels or a combination of both ○ Cost split into CPU, memory, network, GPU, TPU for the above resources ○ In multi-tenant scenarios, each team can be cross-charged using this capability. ○ Optimize cluster resource allocation thereby reducing overall cost ● Feature enabled as part of creating a cluster or editing an existing cluster ● This feature needs billing and metering data export to bigquery ● Cost correlation is done by matching billing report and usage metering data for the corresponding kubernetes resources ● Sample datastudio templates are provided to view the GKE metering data from datastudio dashboard
  • 4. GKE usage metering - Sample dashboards
  • 5. Usage Metering workflow Create bigquery dataset and table for billing data export to BQ Create bigquery dataset and table for GKE metering export Create GKE cluster and enable GKE usage metering. Generate query to correlate billing data and metering data. Setup query to run periodically Use existing data studio template to create dashboard from the correlated BQ table
  • 6. Useful dashboards Usage breakdown - Gives cost breakdown by namespace - Visibility into unallocated resources Cost trends by namespace - Visibility into cluster, namespace, resource(cpu, memory, network) and SKU(CPU/memory types) - Understand if the application is cpu, memory or network intensive Cost trends by labels - Visibility into individual label cost - Helps in multi-tenant cost distribution Consumption trends - Compares requested vs actually used resources(CPU, memory, network). - Helps in optimizing resource allocation
  • 7. Conclusion With GKE usage metering, we can get deep visibility into usage patterns in our cluster which in turn can help optimize the spend