SlideShare a Scribd company logo
Creating a Scalable and Decentralized
API Management Architecture with
WSO2 API Manager
Pubudu Gunatilaka
Technical Lead, WSO2
Dinusha Dissanayake
Senior Software Engineer, WSO2
Agenda
● Typical API Management Story
● Decentralized API Management Architecture
● Building the Solution
● API Operator for Kubernetes
● Deployment modes for APIs
● Live Demo
● Q n A
Typical API Management Story
“
TRAFFIC MANAGER
API PUBLISHER
DEVELOPER PORTAL KEY MANAGER
API GATEWAY
API
PROVIDERS
API CONSUMERS
API CONSUMERS
Publish
API
Push to
Store
Publish
throttling
policies
Update gateway
Access token
generation request
Key
Validatio
n
API
Invocation
SERVICE IMPL
Subscribe
to API
API CONSUMERS
API GATEWAYAPI GATEWAYAPI GATEWAY
LOAD BALANCER
Modern businesses are consumer driven
Photo by Joshua Earle on Unsplash
Breaking down the Monolith Application
Breaking down the Monolith Application: Delivering services
as APIs
Microservice Architecture Key Aspects
● Testing, deploying and running individual components separately
● Agility, flexibility and speed to market
● Adopt microservice development for fast innovation
● Agile software development life cycles for smaller teams
● Freedom to use heterogenous technologies, early feedback cycles
● Decentralized governance
Usage of APIs in API Gateway
API GATEWAY
Food
API
Store API
SMS
API
Payment
API
Some key concerns...
● Different resource usages
● Different Security enforcements
● Dynamic routing
● API mediation and transformation
● API Shaping
● Response Caching
● Private vs Public APIs
● API Gateway per department/unit API GATEWAY
Food
API
Store API
SMS
API
Payment
API
Decentralized API Management
Architecture
“
Addressing the concerns...
Store API
API GATEWAY
Payment
API
API GATEWAY
Food
API
SMS
API
API GATEWAY
● Lightweight version of API gateway designed for MSA
● Designed to scale
○ ~1s startup time
○ Self-validating tokens
○ Localized rate limiting
○ Offline analytics
○ Immutable and Stateless
● Support for lifecycle management across environments
● Low Resource Environments
○ 40 MB of distribution size and docker base images.
○ < 250 MB of memory.
○ < 1 core CPU.
WSO2 API Microgateway
Creating a Scalable and Decentralized API Management Architecture with WSO2 API Manager
Why Decentralized API Management Architecture?
● Modern application development practices mandate a more decentralized
approach
● Improve productivity and agility by giving teams more autonomy to
self-serve
● Microservice philosophy also favours decentralization in all aspects of
software design
● At a high level, it is about giving the business greater agility when bringing
new ideas to market
Building the Solution
“
Solution Stages
● API Design Phase:
○ API Creator
■ WSO2 API Manager, Github
● API Approval Phase:
○ API Product Manager
■ WSO2 API Manager, Github
● API Deployment Phase:
○ Fully automated
■ Jenkins, Kubernetes with API Operator, apictl
API Design Phase
● API Creator
designs the
API
API Design Phase
● Use apictl(Command Line tool) to export the API from the API Publisher.
○ You can also download the Swagger definition from the API
Publisher.
● Commit the API artifacts to the personal Github Repo.
apictl export-api -n Online-Store -v 1.0.0 -r admin -e development
git commit -a -m “Adding OnlineStoreAPI”
git push origin store-apis
● Make a pull request for API Product Manager’s approval
API Design Phase
● Github branch structure
Github Branch Name food-apis sms-api location-api
API Name(s) food-delivery-api sms-api location-api
pizza-api
restaurant-api
API Microgateway 1 API Microgateway 2 API Microgateway 3
API Approval Phase
● Review and merge the pull request by the API Product Manager
● Login into the API Publisher and publish the API
API Operator for Kubernetes
● Makes API a first class citizen in Kubernetes eco
system
● Easier to deploy
● Imposese
○ Security
○ Throttling
○ Mediation
○ Monitoring
For your microservices
● Build in deployment patterns
● Fully automated experience for cloud native API
management
● Single source of truth
API Operator Overview
API CRD API Controller
API Operator
K8s API Server
Docker Registry
apictl add api -n products-api
--from-file=products_swagger.yaml
API Deployment Phase
● Github release in the respective branch (eg: food-apis-v1.0.0)
● Jenkins job triggers for the release of food-apis-v1.0.0
● Using apictl (command line tool), add an API in Kubernetes using the API
Operator for Kubernetes
● Deploys an API microgateway in Kubernetes
● Ingress resource will be created
Ingress Traffic Routing
...
spec:
rules:
- host: mgw.ingress.wso2.com
http:
paths:
- path: /review/v1.0
backend:
serviceName: review-api
servicePort: 9095
- path: /inventory/v1.0
backend:
serviceName: inventory-api
servicePort: 9095
...
CI/CD Workflow
Deployment Modes for APIs
“
Deployment modes for APIs...
● Private Jet Mode
❏ Scale separately
❏ Dedicated API microgateway for
the API
Pod
API Microgateway
Container
/API1
Pod
Microservice
Container
Pod
Microservice
Container
Deployment modes for APIs...
● Sidecar Mode
❏ Scale microservice with the API
microgateway
❏ Dedicated API microgateway for
the API
Pod
API
Microgateway
Container
/API1
Microservice
Container
Deployment modes for APIs...
● Shared Mode
❏ Multiple APIs deployed in the
API microgateway
Pod
API Microgateway
Container
/API1
/API2
/API3
Pod
Microserv
ice
Container
Pod
Microserv
ice
Container
Pod
Microserv
ice
Container
Demo
Q & A
● Demo Artifacts
https://github.com/pubudu538/api-operator-demo
● Download and try out:
https://wso2.com/api-management/
● Slack Channel:
https://apim-slack.wso2.com
● GitHub:
https://github.com/wso2/product-apim/issues
Webinars to follow
● Apr 30
gRPC Support With API Microgateway 3.1
● May 5
Deploying GraphQL Services as Managed APIs
● May 12
Overview of API Microgateway 3.1
THANK YOU
wso2.com

More Related Content

PDF
FIDO UAF Specifications: Overview & Tutorial
PPTX
IBM API Connect Deployment `Good Practices - IBM Think 2018
PPTX
Kubernetes Security
PPTX
OAuth 2
PDF
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShift
PDF
Kubernetes Architecture and Introduction
PDF
AWS Summit Seoul 2023 | AWS Graviton과 함께하는 계획문제 최적화 애플리케이션 개발
PPTX
Introduction to Amazon Web Services (AWS)
FIDO UAF Specifications: Overview & Tutorial
IBM API Connect Deployment `Good Practices - IBM Think 2018
Kubernetes Security
OAuth 2
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShift
Kubernetes Architecture and Introduction
AWS Summit Seoul 2023 | AWS Graviton과 함께하는 계획문제 최적화 애플리케이션 개발
Introduction to Amazon Web Services (AWS)

What's hot (20)

PPTX
API Security Fundamentals
PDF
Clean architecture with ddd layering in php
PDF
How to migrate an application in IBM APIc, and preserve its client credential
PDF
Amazon EventBridge
PDF
API Management Solution Powerpoint Presentation Slides
PDF
Kubernetes architecture
PDF
SpringBoot 3 Observability
PPTX
Cisco Web and Email Security Overview
PDF
The resurgence of event driven architecture
PDF
Introduction to Kubernetes Workshop
PPTX
Docker Hub: Past, Present and Future by Ken Cochrane & BC Wong
PDF
IoT security zigbee -- Null Meet bangalore
PDF
FIDO2 Specifications Overview
PPT
XSS - Attacks & Defense
PDF
Kubernetes Secrets Management on Production with Demo
PPTX
Authorization and Authentication using IdentityServer4
PDF
AWS DirectConnect 구성 가이드 (김용우) - 파트너 웨비나 시리즈
PPTX
API Security Lifecycle
PDF
API Gateway How-To: The Many Ways to Apply the Gateway Pattern
PDF
AWS와 부하테스트의 절묘한 만남 :: 김무현 솔루션즈 아키텍트 :: Gaming on AWS 2016
API Security Fundamentals
Clean architecture with ddd layering in php
How to migrate an application in IBM APIc, and preserve its client credential
Amazon EventBridge
API Management Solution Powerpoint Presentation Slides
Kubernetes architecture
SpringBoot 3 Observability
Cisco Web and Email Security Overview
The resurgence of event driven architecture
Introduction to Kubernetes Workshop
Docker Hub: Past, Present and Future by Ken Cochrane & BC Wong
IoT security zigbee -- Null Meet bangalore
FIDO2 Specifications Overview
XSS - Attacks & Defense
Kubernetes Secrets Management on Production with Demo
Authorization and Authentication using IdentityServer4
AWS DirectConnect 구성 가이드 (김용우) - 파트너 웨비나 시리즈
API Security Lifecycle
API Gateway How-To: The Many Ways to Apply the Gateway Pattern
AWS와 부하테스트의 절묘한 만남 :: 김무현 솔루션즈 아키텍트 :: Gaming on AWS 2016
Ad

Similar to Creating a Scalable and Decentralized API Management Architecture with WSO2 API Manager (20)

PDF
[Workshop] API Management in Microservices Architecture
PPTX
apidays LIVE Australia 2020 - Productising your Microservices as API Products...
PDF
Productising your Microservices as API Products
PDF
The Best of Both Worlds: Introducing WSO2 API Manager 4.0.0
PDF
Cloud Native API Management : Microservices to APIs in Kubernetes
PPTX
London-MuleSoft-Meetup-April-19-2023
PPTX
London MuleSoft Meetup
PDF
Cloud Native APIs: The API Operator for Kubernetes
PDF
Getting Started with the WSO2 manager
PDF
WSO2 User Group Bangalore Meetup
PDF
How to Build a Scalable, Distributed, Multi-Cloud API Architecture on Kubernetes
PDF
Highlights of WSO2 API Manager 4.0.0
PPTX
Accélérez vos déploiements applicatifs avec NGINX Controller
PDF
[apidays LIVE HONK KONG] - OAS to Managed API in Seconds
PDF
Automate NGINX with DevOps Tools
PDF
API Management within a Microservice Architecture
PPTX
API Management Within a Microservices Architecture
PDF
Delivering New Digital Experiences Fast - Introducing Choreo
PDF
Reducing DevOps Burden with Git-based CI/CD Pipelines for APIs
PDF
Getting Started with the WSO2 API Manager
[Workshop] API Management in Microservices Architecture
apidays LIVE Australia 2020 - Productising your Microservices as API Products...
Productising your Microservices as API Products
The Best of Both Worlds: Introducing WSO2 API Manager 4.0.0
Cloud Native API Management : Microservices to APIs in Kubernetes
London-MuleSoft-Meetup-April-19-2023
London MuleSoft Meetup
Cloud Native APIs: The API Operator for Kubernetes
Getting Started with the WSO2 manager
WSO2 User Group Bangalore Meetup
How to Build a Scalable, Distributed, Multi-Cloud API Architecture on Kubernetes
Highlights of WSO2 API Manager 4.0.0
Accélérez vos déploiements applicatifs avec NGINX Controller
[apidays LIVE HONK KONG] - OAS to Managed API in Seconds
Automate NGINX with DevOps Tools
API Management within a Microservice Architecture
API Management Within a Microservices Architecture
Delivering New Digital Experiences Fast - Introducing Choreo
Reducing DevOps Burden with Git-based CI/CD Pipelines for APIs
Getting Started with the WSO2 API Manager
Ad

More from WSO2 (20)

PDF
Demystifying CMS-0057-F - Compliance Made Seamless with WSO2
PDF
Quantum Threats Are Closer Than You Think – Act Now to Stay Secure
PDF
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
PDF
Application Modernization with Choreo - The AI-Native Internal Developer Plat...
PDF
Build Smarter, Deliver Faster with Choreo - An AI Native Internal Developer P...
PDF
Platformless Modernization with Choreo.pdf
PDF
Application Modernization with Choreo for the BFSI Sector
PDF
Choreo - The AI-Native Internal Developer Platform as a Service: Overview
PDF
[Roundtable] Choreo - The AI-Native Internal Developer Platform as a Service
PPTX
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
PPTX
WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...
PPTX
WSO2Con 2025 - Building Secure Customer Experience Apps
PPTX
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
PPTX
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
PPTX
WSO2Con 2025 - Unified Management of Ingress and Egress Across Multiple API G...
PPTX
WSO2Con 2025 - How an Internal Developer Platform Lets Developers Focus on Code
PPTX
WSO2Con 2025 - Architecting Cloud-Native Applications
PDF
Mastering Intelligent Digital Experiences with Platformless Modernization
PDF
Accelerate Enterprise Software Engineering with Platformless
PDF
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
Demystifying CMS-0057-F - Compliance Made Seamless with WSO2
Quantum Threats Are Closer Than You Think – Act Now to Stay Secure
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
Application Modernization with Choreo - The AI-Native Internal Developer Plat...
Build Smarter, Deliver Faster with Choreo - An AI Native Internal Developer P...
Platformless Modernization with Choreo.pdf
Application Modernization with Choreo for the BFSI Sector
Choreo - The AI-Native Internal Developer Platform as a Service: Overview
[Roundtable] Choreo - The AI-Native Internal Developer Platform as a Service
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...
WSO2Con 2025 - Building Secure Customer Experience Apps
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
WSO2Con 2025 - Unified Management of Ingress and Egress Across Multiple API G...
WSO2Con 2025 - How an Internal Developer Platform Lets Developers Focus on Code
WSO2Con 2025 - Architecting Cloud-Native Applications
Mastering Intelligent Digital Experiences with Platformless Modernization
Accelerate Enterprise Software Engineering with Platformless
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

Recently uploaded (20)

PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
sap open course for s4hana steps from ECC to s4
PPTX
Spectroscopy.pptx food analysis technology
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
MYSQL Presentation for SQL database connectivity
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPT
Teaching material agriculture food technology
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Approach and Philosophy of On baking technology
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Machine learning based COVID-19 study performance prediction
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Network Security Unit 5.pdf for BCA BBA.
Building Integrated photovoltaic BIPV_UPV.pdf
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Mobile App Security Testing_ A Comprehensive Guide.pdf
sap open course for s4hana steps from ECC to s4
Spectroscopy.pptx food analysis technology
Spectral efficient network and resource selection model in 5G networks
MYSQL Presentation for SQL database connectivity
The Rise and Fall of 3GPP – Time for a Sabbatical?
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
Teaching material agriculture food technology
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Approach and Philosophy of On baking technology
Unlocking AI with Model Context Protocol (MCP)
Machine learning based COVID-19 study performance prediction
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Network Security Unit 5.pdf for BCA BBA.

Creating a Scalable and Decentralized API Management Architecture with WSO2 API Manager

  • 1. Creating a Scalable and Decentralized API Management Architecture with WSO2 API Manager Pubudu Gunatilaka Technical Lead, WSO2 Dinusha Dissanayake Senior Software Engineer, WSO2
  • 2. Agenda ● Typical API Management Story ● Decentralized API Management Architecture ● Building the Solution ● API Operator for Kubernetes ● Deployment modes for APIs ● Live Demo ● Q n A
  • 4. TRAFFIC MANAGER API PUBLISHER DEVELOPER PORTAL KEY MANAGER API GATEWAY API PROVIDERS API CONSUMERS API CONSUMERS Publish API Push to Store Publish throttling policies Update gateway Access token generation request Key Validatio n API Invocation SERVICE IMPL Subscribe to API
  • 5. API CONSUMERS API GATEWAYAPI GATEWAYAPI GATEWAY LOAD BALANCER
  • 6. Modern businesses are consumer driven Photo by Joshua Earle on Unsplash
  • 7. Breaking down the Monolith Application
  • 8. Breaking down the Monolith Application: Delivering services as APIs
  • 9. Microservice Architecture Key Aspects ● Testing, deploying and running individual components separately ● Agility, flexibility and speed to market ● Adopt microservice development for fast innovation ● Agile software development life cycles for smaller teams ● Freedom to use heterogenous technologies, early feedback cycles ● Decentralized governance
  • 10. Usage of APIs in API Gateway API GATEWAY Food API Store API SMS API Payment API
  • 11. Some key concerns... ● Different resource usages ● Different Security enforcements ● Dynamic routing ● API mediation and transformation ● API Shaping ● Response Caching ● Private vs Public APIs ● API Gateway per department/unit API GATEWAY Food API Store API SMS API Payment API
  • 13. Addressing the concerns... Store API API GATEWAY Payment API API GATEWAY Food API SMS API API GATEWAY
  • 14. ● Lightweight version of API gateway designed for MSA ● Designed to scale ○ ~1s startup time ○ Self-validating tokens ○ Localized rate limiting ○ Offline analytics ○ Immutable and Stateless ● Support for lifecycle management across environments ● Low Resource Environments ○ 40 MB of distribution size and docker base images. ○ < 250 MB of memory. ○ < 1 core CPU. WSO2 API Microgateway
  • 16. Why Decentralized API Management Architecture? ● Modern application development practices mandate a more decentralized approach ● Improve productivity and agility by giving teams more autonomy to self-serve ● Microservice philosophy also favours decentralization in all aspects of software design ● At a high level, it is about giving the business greater agility when bringing new ideas to market
  • 18. Solution Stages ● API Design Phase: ○ API Creator ■ WSO2 API Manager, Github ● API Approval Phase: ○ API Product Manager ■ WSO2 API Manager, Github ● API Deployment Phase: ○ Fully automated ■ Jenkins, Kubernetes with API Operator, apictl
  • 19. API Design Phase ● API Creator designs the API
  • 20. API Design Phase ● Use apictl(Command Line tool) to export the API from the API Publisher. ○ You can also download the Swagger definition from the API Publisher. ● Commit the API artifacts to the personal Github Repo. apictl export-api -n Online-Store -v 1.0.0 -r admin -e development git commit -a -m “Adding OnlineStoreAPI” git push origin store-apis ● Make a pull request for API Product Manager’s approval
  • 21. API Design Phase ● Github branch structure Github Branch Name food-apis sms-api location-api API Name(s) food-delivery-api sms-api location-api pizza-api restaurant-api API Microgateway 1 API Microgateway 2 API Microgateway 3
  • 22. API Approval Phase ● Review and merge the pull request by the API Product Manager ● Login into the API Publisher and publish the API
  • 23. API Operator for Kubernetes ● Makes API a first class citizen in Kubernetes eco system ● Easier to deploy ● Imposese ○ Security ○ Throttling ○ Mediation ○ Monitoring For your microservices ● Build in deployment patterns ● Fully automated experience for cloud native API management ● Single source of truth
  • 24. API Operator Overview API CRD API Controller API Operator K8s API Server Docker Registry apictl add api -n products-api --from-file=products_swagger.yaml
  • 25. API Deployment Phase ● Github release in the respective branch (eg: food-apis-v1.0.0) ● Jenkins job triggers for the release of food-apis-v1.0.0 ● Using apictl (command line tool), add an API in Kubernetes using the API Operator for Kubernetes ● Deploys an API microgateway in Kubernetes ● Ingress resource will be created
  • 26. Ingress Traffic Routing ... spec: rules: - host: mgw.ingress.wso2.com http: paths: - path: /review/v1.0 backend: serviceName: review-api servicePort: 9095 - path: /inventory/v1.0 backend: serviceName: inventory-api servicePort: 9095 ...
  • 29. Deployment modes for APIs... ● Private Jet Mode ❏ Scale separately ❏ Dedicated API microgateway for the API Pod API Microgateway Container /API1 Pod Microservice Container Pod Microservice Container
  • 30. Deployment modes for APIs... ● Sidecar Mode ❏ Scale microservice with the API microgateway ❏ Dedicated API microgateway for the API Pod API Microgateway Container /API1 Microservice Container
  • 31. Deployment modes for APIs... ● Shared Mode ❏ Multiple APIs deployed in the API microgateway Pod API Microgateway Container /API1 /API2 /API3 Pod Microserv ice Container Pod Microserv ice Container Pod Microserv ice Container
  • 32. Demo
  • 33. Q & A
  • 34. ● Demo Artifacts https://github.com/pubudu538/api-operator-demo ● Download and try out: https://wso2.com/api-management/ ● Slack Channel: https://apim-slack.wso2.com ● GitHub: https://github.com/wso2/product-apim/issues
  • 35. Webinars to follow ● Apr 30 gRPC Support With API Microgateway 3.1 ● May 5 Deploying GraphQL Services as Managed APIs ● May 12 Overview of API Microgateway 3.1