SlideShare a Scribd company logo
How to Build a Scalable, Distributed,
Multi-Cloud API Architecture on
Kubernetes
September 02, 2020
1
Hello!
Shehani Rathnayake
Pubudu Gunatilaka
Software Engineer, WSO2
pubudug@wso2.com
shehanir@wso2.com
Technical Lead, WSO2
● Centralized API Management
● Cloud Native API Management
● Why Kubernetes?
● Deployment Modes
● API Operator for Kubernetes
● Private Jet Mode for Kubernetes
● Demo
● Q&A
What’s covered...
3
Centralized API Management
4
Centralized API Management
5
Cloud Native API Management
6
Deploying in Kubernetes
7
Why Kubernetes?
● Auto scale API Gateways/ backend services
⦿ CPU/Memory
⦿ Custom metrics such as requests per minute
● Auto healing for the applications
● Easy to manage and deploy applications
● Zero down time rolling updates
● Canary deployments
● End to end fully automation capability
8
An Overview of an API Gateway
9
How to handle...
● Different resource usages
● Different Security enforcements
● Dynamic routing
● API mediation and transformation
● API Shaping
● Response Caching
● Private vs Public APIs
● API Gateway per department/unit
10
The Solution
11
WSO2 Microgateway
12
WSO2 Microgateway
● Lightweight version of API gateway designed for MSA
● Designed to scale
⦿ ~1s startup time
⦿ Self-validating tokens
⦿ Localized rate limiting
⦿ Offline analytics
⦿ Immutable and Stateless
● Support for lifecycle management across environments
● Low Resource Environments
⦿ 40 MB of distribution size and docker base images.
⦿ < 250 MB of memory.
⦿ < 1 core CPU.
13
Cloud Native API Architecture
14
Cloud Native API Architecture
15
Multi Cloud API Architecture
16
VMs
VMs
Data Plane
17
Deployment Modes
18
● Scale separately
● Dedicated API microgateway for
the API
Private Jet Mode
19
● Scale microservice with the API
microgateway
● Dedicated API microgateway for
the API
Sidecar Mode
20
Shared Mode
● Multiple APIs deployed in the API
microgateway
21
API Operator for Kubernetes
22
● Makes API a first class citizen in Kubernetes
eco system
● Easier to deploy
● Imposese
⦿ Security
⦿ Throttling
⦿ Mediation
⦿ Monitoring
For your microservices
● Build in deployment patterns
● Fully automated experience for cloud native
API management
● Single source of truth
API Operator for Kubernetes
23
API CRD API Controller
API Operator
K8s API Server
Docker Registry
apictl add api -n products-api
--from-file=products_swagger.yaml
API Operator Overview
24
Private Jet Mode for APIs on Kubernetes
25
Private Jet Mode for APIs on Kubernetes
● WSO2 API Manager/Kubernetes integration
● Dedicated API microgateway for the API
● Single control plane to govern the data plane
● Expose via Ingress Gateway on Kubernetes
● Prerequisites
⦿ Kubernetes cluster with API Operator
⦿ WSO2 API Manager running in Kubernetes / VMs
26
The Workflow
27
Demo
28
Question Time!
29
wso2.com
Thanks!
30

More Related Content

PDF
Rate Limiting GQLs Using Depth and Complexity Analysis
PDF
Creating a Scalable and Decentralized API Management Architecture with WSO2 A...
PDF
API Management for GraphQL
PDF
[APIdays Paris 2019] From Microservices to APIs: The API operator in Kubernetes
PDF
[WSO2 Summit APAC 2020} Creating Smart Endpoints Using Integration Microservices
PDF
Continuous Integration and Continuous Deployment (CI/CD) with WSO2 Enterprise...
PDF
Explore the Latest on WSO2 Identity Server 5.11
PDF
[APIdays Paris 2019] API Management in Service Mesh Using Istio and WSO2 API ...
Rate Limiting GQLs Using Depth and Complexity Analysis
Creating a Scalable and Decentralized API Management Architecture with WSO2 A...
API Management for GraphQL
[APIdays Paris 2019] From Microservices to APIs: The API operator in Kubernetes
[WSO2 Summit APAC 2020} Creating Smart Endpoints Using Integration Microservices
Continuous Integration and Continuous Deployment (CI/CD) with WSO2 Enterprise...
Explore the Latest on WSO2 Identity Server 5.11
[APIdays Paris 2019] API Management in Service Mesh Using Istio and WSO2 API ...

What's hot (20)

PDF
Cloud Native API Management : Microservices to APIs in Kubernetes
PDF
[WSO2 Summit Americas 2020] Creating Smart Endpoints Using Integration Micros...
PDF
Building and Deploying Complex Streaming Data Processing Pipelines with WSO2 ...
PDF
[Webinar] WSO2 Enterprise Integrator 7.1.0 Release
PDF
WSO2 User Group Bangalore Meetup
PDF
[WSO2 API Manager Community Call] Expose Services as Managed APIs
PDF
Microservices Communication Patterns with gRPC
PDF
[Workshop] API Management in Microservices Architecture
PDF
Productising your Microservices as API Products
PDF
Digital Asset Governance for the Enterprise
PDF
Deploying WSO2 API Manager in Production-Grade Kubernetes
PDF
Adaptive Scaling of Microgateways on Kubernetes
PDF
Exposing Lambda Functions as Managed APIs
PDF
Exposing GraphQLs as Managed APIs
PDF
[WSO2 API Day Toronto 2019] Cloud-native Integration for the Enterprise
PDF
[Workshop] API-driven Integration
PDF
[WSO2 Summit Americas 2020] Automating an Integrated API Supply Chain Using a...
PDF
[WSO2 Integration Summit San Francisco 2019] Cloud-native Integration for the...
PDF
Digital Transformation for Karnataka Bank Through API-led Integration
PDF
API Management for GraphQL
Cloud Native API Management : Microservices to APIs in Kubernetes
[WSO2 Summit Americas 2020] Creating Smart Endpoints Using Integration Micros...
Building and Deploying Complex Streaming Data Processing Pipelines with WSO2 ...
[Webinar] WSO2 Enterprise Integrator 7.1.0 Release
WSO2 User Group Bangalore Meetup
[WSO2 API Manager Community Call] Expose Services as Managed APIs
Microservices Communication Patterns with gRPC
[Workshop] API Management in Microservices Architecture
Productising your Microservices as API Products
Digital Asset Governance for the Enterprise
Deploying WSO2 API Manager in Production-Grade Kubernetes
Adaptive Scaling of Microgateways on Kubernetes
Exposing Lambda Functions as Managed APIs
Exposing GraphQLs as Managed APIs
[WSO2 API Day Toronto 2019] Cloud-native Integration for the Enterprise
[Workshop] API-driven Integration
[WSO2 Summit Americas 2020] Automating an Integrated API Supply Chain Using a...
[WSO2 Integration Summit San Francisco 2019] Cloud-native Integration for the...
Digital Transformation for Karnataka Bank Through API-led Integration
API Management for GraphQL
Ad

Similar to How to Build a Scalable, Distributed, Multi-Cloud API Architecture on Kubernetes (20)

PPTX
apidays LIVE Australia 2020 - Productising your Microservices as API Products...
PDF
WSO2 API microgateway introduction
PDF
Cloud Native APIs: The API Operator for Kubernetes
PDF
WSO2 API Microgateway for Easier Development and Greater Scalability
PDF
The Best of Both Worlds: Introducing WSO2 API Manager 4.0.0
PPTX
Ultimate Guide to Microservice Architecture on Kubernetes
PPTX
London-MuleSoft-Meetup-April-19-2023
PDF
Pivotal Cloud Foundry 2.1: Making Transformation Real Webinar
PDF
Highlights of WSO2 API Manager 4.0.0
PPT
Kubernetes for Cloud-Native Environments
PPTX
Powering your Apps via Google Cloud Platform
PDF
Apidays Paris 2023 - Kubernetes Gateways, Pubudu Gunatilaka, WSO2
PPTX
London MuleSoft Meetup
PDF
API Management within a Microservice Architecture
PPTX
API Management Within a Microservices Architecture
PDF
The Kubernetes Gateway API and its role in Cloud Native API Management
PDF
Scale into Multi-Cloud with Containers
PDF
[Lakmal] Automate Microservice to API
PDF
Introduction to Kubernetes with demo
PDF
Securing Your Apps & APIs in the Cloud
apidays LIVE Australia 2020 - Productising your Microservices as API Products...
WSO2 API microgateway introduction
Cloud Native APIs: The API Operator for Kubernetes
WSO2 API Microgateway for Easier Development and Greater Scalability
The Best of Both Worlds: Introducing WSO2 API Manager 4.0.0
Ultimate Guide to Microservice Architecture on Kubernetes
London-MuleSoft-Meetup-April-19-2023
Pivotal Cloud Foundry 2.1: Making Transformation Real Webinar
Highlights of WSO2 API Manager 4.0.0
Kubernetes for Cloud-Native Environments
Powering your Apps via Google Cloud Platform
Apidays Paris 2023 - Kubernetes Gateways, Pubudu Gunatilaka, WSO2
London MuleSoft Meetup
API Management within a Microservice Architecture
API Management Within a Microservices Architecture
The Kubernetes Gateway API and its role in Cloud Native API Management
Scale into Multi-Cloud with Containers
[Lakmal] Automate Microservice to API
Introduction to Kubernetes with demo
Securing Your Apps & APIs in the Cloud
Ad

More from WSO2 (20)

PDF
Demystifying CMS-0057-F - Compliance Made Seamless with WSO2
PDF
Quantum Threats Are Closer Than You Think – Act Now to Stay Secure
PDF
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
PDF
Application Modernization with Choreo - The AI-Native Internal Developer Plat...
PDF
Build Smarter, Deliver Faster with Choreo - An AI Native Internal Developer P...
PDF
Platformless Modernization with Choreo.pdf
PDF
Application Modernization with Choreo for the BFSI Sector
PDF
Choreo - The AI-Native Internal Developer Platform as a Service: Overview
PDF
[Roundtable] Choreo - The AI-Native Internal Developer Platform as a Service
PPTX
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
PPTX
WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...
PPTX
WSO2Con 2025 - Building Secure Customer Experience Apps
PPTX
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
PPTX
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
PPTX
WSO2Con 2025 - Unified Management of Ingress and Egress Across Multiple API G...
PPTX
WSO2Con 2025 - How an Internal Developer Platform Lets Developers Focus on Code
PPTX
WSO2Con 2025 - Architecting Cloud-Native Applications
PDF
Mastering Intelligent Digital Experiences with Platformless Modernization
PDF
Accelerate Enterprise Software Engineering with Platformless
PDF
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
Demystifying CMS-0057-F - Compliance Made Seamless with WSO2
Quantum Threats Are Closer Than You Think – Act Now to Stay Secure
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
Application Modernization with Choreo - The AI-Native Internal Developer Plat...
Build Smarter, Deliver Faster with Choreo - An AI Native Internal Developer P...
Platformless Modernization with Choreo.pdf
Application Modernization with Choreo for the BFSI Sector
Choreo - The AI-Native Internal Developer Platform as a Service: Overview
[Roundtable] Choreo - The AI-Native Internal Developer Platform as a Service
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...
WSO2Con 2025 - Building Secure Customer Experience Apps
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
WSO2Con 2025 - Unified Management of Ingress and Egress Across Multiple API G...
WSO2Con 2025 - How an Internal Developer Platform Lets Developers Focus on Code
WSO2Con 2025 - Architecting Cloud-Native Applications
Mastering Intelligent Digital Experiences with Platformless Modernization
Accelerate Enterprise Software Engineering with Platformless
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

Recently uploaded (20)

DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Modernizing your data center with Dell and AMD
PDF
cuic standard and advanced reporting.pdf
PDF
Encapsulation theory and applications.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
NewMind AI Monthly Chronicles - July 2025
The AUB Centre for AI in Media Proposal.docx
Modernizing your data center with Dell and AMD
cuic standard and advanced reporting.pdf
Encapsulation theory and applications.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
The Rise and Fall of 3GPP – Time for a Sabbatical?
Encapsulation_ Review paper, used for researhc scholars
Building Integrated photovoltaic BIPV_UPV.pdf
NewMind AI Weekly Chronicles - August'25 Week I
Chapter 3 Spatial Domain Image Processing.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
“AI and Expert System Decision Support & Business Intelligence Systems”
Per capita expenditure prediction using model stacking based on satellite ima...
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Reach Out and Touch Someone: Haptics and Empathic Computing
Review of recent advances in non-invasive hemoglobin estimation
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Network Security Unit 5.pdf for BCA BBA.
NewMind AI Monthly Chronicles - July 2025

How to Build a Scalable, Distributed, Multi-Cloud API Architecture on Kubernetes