SlideShare a Scribd company logo
Extending Service Mesh with API
Management
Nirmal Fernando
Senior Lead Solutions Engineer
Agenda:
• Evolution of Applications
• Why microservice architecture?
• Challenges with microservices?
• Why Service Mesh?
• Why API Management?
• WSO2 API Manager with Istio / Demo
Evolution of Applications
Disaggregated architectures drive 50 billion endpoints to grow >1 trillion
CONSUMER DEMAND
SUPPLIERS DISAGGREGATE ARCHITECTURE TO MEET DEMAND
1
10
102
103
105
109
MONOLITHIC
BUSINESS APP
ENTERPRISE
APPS
DEPARTME
NTAL APPS
SAAS APPS
PUBLIC /
PRIVATE APIS
1970s
|
MAINFRAME
1980s
|
IT
AWAKENING
1990s
|
INTERNET
2000s
|
MOBILE
2010s
|
IoT/AI
2020+
|
DIGITAL NATIVE
SERVERLESS &
MICROSERVICES
What is Microservices Architecture?
● Architectural and organizational approach to software
development
● Designed to speed-up deployment cycles, foster
innovation and ownership, improve maintainability and
scalability
● Composed of small independent services, each of which
is built around a single business capability
● Services are owned by small self-contained teams
Why Microservices Architecture?
● Agility - small independent teams are empowered to work independently
and quickly, thus shortening the cycle times
● Innovation - teams can act autonomously and choose appropriate
technologies, frameworks and low cost of failure
● Quality - dividing into small well-defined modules improves reusability,
composability and maintainability of code
● Scalability - fine-grained decoupling of microservices allows you to
horizontally scale each service independently from each other
● Availability - easier to implement failure isolation, thus improve the overall
availability of your application
Challenges with Microservices
• Network resiliency (retry, failover, circuit breaker)
• Architectural complexity (complexity in interactions)
– service discovery
– service authentication
• Operational complexity
– Analytics, tracing, monitoring (Observability)
– How to deploy a new version of a service (roll out new
version - Canary deployment)
Challenges with Microservices
How to address these challenges?
Service Mesh
A service mesh is a dedicated infrastructure layer that
controls service-to-service communication over a network.
It provides a method in which separate parts of an
application can communicate with each other.
source:techtarget.com
Istio is an open source service mesh implementation which
provides behavioral insights and operational control over
the service mesh as a whole, offering a complete solution
to satisfy the diverse requirements of microservice
applications.
Istio
Istio Component Overview
• Pilot is responsible for configuring the data plane, defining basic
proxy behaviour, providing service discovery for the Envoy
sidecars, traffic management capabilities for intelligent routing, and
resiliency.
• Mixer can respond to various queries from the data plane such as
authorization, access control or quota checks, and collects
telemetry data from the Envoy proxy and other services.
• Citadel enables strong service-to-service and end-user
authentication with built-in identity and credential management.
Allows you to build zero-trust environments.
Istio Component Overview
Istio Architecture (source — https://istio.io/docs/concepts/what-is-istio/)
Demo
Type Service Mesh API Management
Routing L3/L4 HTTP, GRPC, GraphQL
Security Service identity and mTLS User/App Authentication and
Authorization(OAuth / JWT)
Analytics Service operational analytics Business and developer focus analytics
Rate Limiting RPC level rate limiting Business related rate limiting
Personas and Portal DevOps portals Publisher, Developer, CXO portal
• When users need to expose microservices services to
outside in a secured and a controlled manner.
• When fine grained security should be enforced on APIs
exposed.
• When stats need to be collected on API usage for
monetization and billing.
• When it is required to offer a marketplace for APIs for
easy discovery and adoption.
When is API Management required in a Service Mesh
Istio + WSO2 API Manager
Istio Architecture (source — https://istio.io/docs/concepts/what-is-istio/)
WSO2 Mixer Adaptor
Separately Hosted WSO2 API Manager
Service Mesh and API Management
Artifacts to Istio
Demo
https://github.com/nirmal070125/istio-ballerina-service-rollout
What just happened?
JWT Validation Process
JWT Token Validation Process
OAuth 2.0 Validation Process
Analytics Process
API Analytics
THANK YOU
wso2.com
WSO2 - Istio adapter
https://github.com/wso2/istio-apim/tree/1.0
WSO2 - Istio Web Page
https://wso2.com/api-management/microservices/istio/

More Related Content

PDF
[WSO2 API Day Chicago 2019] Cloud-native Integration for the Enterprise
PDF
[WSO2 API Day Dallas 2019] API-Driven World
PDF
[WSO2 API Day Dallas 2019] Extending Service Mesh with API Management
PDF
[WSO2 API Day Dallas 2019] Cloud-native Integration for the Enterprise
PDF
[WSO2 API Day Toronto 2019] Extending Service Mesh with API Management
PDF
[WSO2 Summit Sydney 2019] Ballerina - Cloud Native Programming Language
PDF
apidays LIVE London 2021 - Presenting the Kubernetes Browser by Daria Muehlet...
PDF
Cloud Native Application Integration With APIs
[WSO2 API Day Chicago 2019] Cloud-native Integration for the Enterprise
[WSO2 API Day Dallas 2019] API-Driven World
[WSO2 API Day Dallas 2019] Extending Service Mesh with API Management
[WSO2 API Day Dallas 2019] Cloud-native Integration for the Enterprise
[WSO2 API Day Toronto 2019] Extending Service Mesh with API Management
[WSO2 Summit Sydney 2019] Ballerina - Cloud Native Programming Language
apidays LIVE London 2021 - Presenting the Kubernetes Browser by Daria Muehlet...
Cloud Native Application Integration With APIs

What's hot (20)

PDF
[WSO2 Integration Summit San Francisco 2019] Protecting API Infrastructures —...
PDF
Transforming Retail Banking: Competitive Advantage through Microservices
PPTX
WEB API Gateway
PDF
[WSO2 Integration Summit London 2019] Identity and Access Management in an AP...
PDF
APIdays Paris 2019 - Adopting Service Mesh by Marco Palladino , Kong
PDF
Architecting SaaS
PPTX
Cloud Native Application Development-build fast, low TCO, scalable & agile so...
PDF
apidays LIVE Paris - Bring the API culture to DevOps teams by Christophe Bour...
PDF
apidays LIVE Australia 2021 - Quantum Duality of “API as a business and a tec...
PDF
Building Sustainable Ecosystems: The Economics of Collaboration
PPTX
APIdays Helsinki 2019 - „Open Banking in a Box” and why it does not exist, Kr...
PDF
INTERFACE, by apidays - A cloud-native approach for open banking in action b...
PDF
[Kong summit 2019] Egress Gateway Pattern - Zhuojie Zhou
PDF
apidays LIVE Paris 2021 - Building a hybrid integration platform to ease digi...
PPTX
Security architecture best practices for saas applications
PPTX
APIs: The Gateway to Digital Transformation
PPTX
Developing a Service-oriented Architecture (SOA)- based Product Management Pl...
PDF
APIs from the Edge to the Mesh
PDF
apidays LIVE New York 2021 - Building Contextualized API Specifications by Bo...
PPTX
apidays LIVE New York 2021 - API Automation For DevOps at Scale by Rod Cope, ...
[WSO2 Integration Summit San Francisco 2019] Protecting API Infrastructures —...
Transforming Retail Banking: Competitive Advantage through Microservices
WEB API Gateway
[WSO2 Integration Summit London 2019] Identity and Access Management in an AP...
APIdays Paris 2019 - Adopting Service Mesh by Marco Palladino , Kong
Architecting SaaS
Cloud Native Application Development-build fast, low TCO, scalable & agile so...
apidays LIVE Paris - Bring the API culture to DevOps teams by Christophe Bour...
apidays LIVE Australia 2021 - Quantum Duality of “API as a business and a tec...
Building Sustainable Ecosystems: The Economics of Collaboration
APIdays Helsinki 2019 - „Open Banking in a Box” and why it does not exist, Kr...
INTERFACE, by apidays - A cloud-native approach for open banking in action b...
[Kong summit 2019] Egress Gateway Pattern - Zhuojie Zhou
apidays LIVE Paris 2021 - Building a hybrid integration platform to ease digi...
Security architecture best practices for saas applications
APIs: The Gateway to Digital Transformation
Developing a Service-oriented Architecture (SOA)- based Product Management Pl...
APIs from the Edge to the Mesh
apidays LIVE New York 2021 - Building Contextualized API Specifications by Bo...
apidays LIVE New York 2021 - API Automation For DevOps at Scale by Rod Cope, ...
Ad

Similar to [WSO2 API Day Chicago 2019] Extending Service Mesh with API Management (20)

PDF
[APIdays Singapore 2019] API Management in a Istio Service Mesh with WSO2 API...
PDF
[APIdays Paris 2019] API Management in Service Mesh Using Istio and WSO2 API ...
PDF
APIdays Paris 2019 - Cloud native API Management for Microservices on a Servi...
PPTX
APIdays Helsinki 2019 - Impact of Microservices Architecture on API Managemen...
PDF
Api Management with Service Mesh
PDF
Istio and Kubernetes Relationship
PDF
Why Microservice
PDF
The Role of Data Virtualization in an API Economy
PDF
[APIdays Melbourne 2019] Delivering the Modern API: Know What it Takes
PDF
Overcoming Ongoing Digital Transformational Challenges with a Microservices A...
PDF
API Management Microservices beyond HIP
PDF
Microservices = Death of the Enterprise Service Bus (ESB)?
PDF
12월 16일 Meetup [Deep Dive] Microservice 트래픽 관리를 위한 Istio 알아보기 | 강인호 컨설턴트, 오라클
PDF
The elegant way of implementing microservices with istio
PDF
Enterprise Integration in Cloud Native Microservices Architectures
PDF
API’s and Micro Services 0.5
PDF
Agile integration: Decomposing the monolith
PPTX
Comparative Analysis of Software Architectures.pptx
PPTX
Istio a service mesh
PDF
AppSphere 15 - Containers and Microservices Create New Performance Challenges
[APIdays Singapore 2019] API Management in a Istio Service Mesh with WSO2 API...
[APIdays Paris 2019] API Management in Service Mesh Using Istio and WSO2 API ...
APIdays Paris 2019 - Cloud native API Management for Microservices on a Servi...
APIdays Helsinki 2019 - Impact of Microservices Architecture on API Managemen...
Api Management with Service Mesh
Istio and Kubernetes Relationship
Why Microservice
The Role of Data Virtualization in an API Economy
[APIdays Melbourne 2019] Delivering the Modern API: Know What it Takes
Overcoming Ongoing Digital Transformational Challenges with a Microservices A...
API Management Microservices beyond HIP
Microservices = Death of the Enterprise Service Bus (ESB)?
12월 16일 Meetup [Deep Dive] Microservice 트래픽 관리를 위한 Istio 알아보기 | 강인호 컨설턴트, 오라클
The elegant way of implementing microservices with istio
Enterprise Integration in Cloud Native Microservices Architectures
API’s and Micro Services 0.5
Agile integration: Decomposing the monolith
Comparative Analysis of Software Architectures.pptx
Istio a service mesh
AppSphere 15 - Containers and Microservices Create New Performance Challenges
Ad

More from WSO2 (20)

PDF
Demystifying CMS-0057-F - Compliance Made Seamless with WSO2
PDF
Quantum Threats Are Closer Than You Think – Act Now to Stay Secure
PDF
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
PDF
Application Modernization with Choreo - The AI-Native Internal Developer Plat...
PDF
Build Smarter, Deliver Faster with Choreo - An AI Native Internal Developer P...
PDF
Platformless Modernization with Choreo.pdf
PDF
Application Modernization with Choreo for the BFSI Sector
PDF
Choreo - The AI-Native Internal Developer Platform as a Service: Overview
PDF
[Roundtable] Choreo - The AI-Native Internal Developer Platform as a Service
PPTX
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
PPTX
WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...
PPTX
WSO2Con 2025 - Building Secure Customer Experience Apps
PPTX
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
PPTX
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
PPTX
WSO2Con 2025 - Unified Management of Ingress and Egress Across Multiple API G...
PPTX
WSO2Con 2025 - How an Internal Developer Platform Lets Developers Focus on Code
PPTX
WSO2Con 2025 - Architecting Cloud-Native Applications
PDF
Mastering Intelligent Digital Experiences with Platformless Modernization
PDF
Accelerate Enterprise Software Engineering with Platformless
PDF
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
Demystifying CMS-0057-F - Compliance Made Seamless with WSO2
Quantum Threats Are Closer Than You Think – Act Now to Stay Secure
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
Application Modernization with Choreo - The AI-Native Internal Developer Plat...
Build Smarter, Deliver Faster with Choreo - An AI Native Internal Developer P...
Platformless Modernization with Choreo.pdf
Application Modernization with Choreo for the BFSI Sector
Choreo - The AI-Native Internal Developer Platform as a Service: Overview
[Roundtable] Choreo - The AI-Native Internal Developer Platform as a Service
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...
WSO2Con 2025 - Building Secure Customer Experience Apps
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
WSO2Con 2025 - Unified Management of Ingress and Egress Across Multiple API G...
WSO2Con 2025 - How an Internal Developer Platform Lets Developers Focus on Code
WSO2Con 2025 - Architecting Cloud-Native Applications
Mastering Intelligent Digital Experiences with Platformless Modernization
Accelerate Enterprise Software Engineering with Platformless
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

Recently uploaded (20)

PDF
cuic standard and advanced reporting.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
MYSQL Presentation for SQL database connectivity
PPTX
Cloud computing and distributed systems.
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
Big Data Technologies - Introduction.pptx
PPT
Teaching material agriculture food technology
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPTX
Spectroscopy.pptx food analysis technology
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
KodekX | Application Modernization Development
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
cuic standard and advanced reporting.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
MYSQL Presentation for SQL database connectivity
Cloud computing and distributed systems.
Diabetes mellitus diagnosis method based random forest with bat algorithm
Big Data Technologies - Introduction.pptx
Teaching material agriculture food technology
MIND Revenue Release Quarter 2 2025 Press Release
Chapter 3 Spatial Domain Image Processing.pdf
Mobile App Security Testing_ A Comprehensive Guide.pdf
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Understanding_Digital_Forensics_Presentation.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Spectroscopy.pptx food analysis technology
Advanced methodologies resolving dimensionality complications for autism neur...
Reach Out and Touch Someone: Haptics and Empathic Computing
KodekX | Application Modernization Development
The Rise and Fall of 3GPP – Time for a Sabbatical?
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...

[WSO2 API Day Chicago 2019] Extending Service Mesh with API Management

  • 1. Extending Service Mesh with API Management Nirmal Fernando Senior Lead Solutions Engineer
  • 2. Agenda: • Evolution of Applications • Why microservice architecture? • Challenges with microservices? • Why Service Mesh? • Why API Management? • WSO2 API Manager with Istio / Demo
  • 3. Evolution of Applications Disaggregated architectures drive 50 billion endpoints to grow >1 trillion CONSUMER DEMAND SUPPLIERS DISAGGREGATE ARCHITECTURE TO MEET DEMAND 1 10 102 103 105 109 MONOLITHIC BUSINESS APP ENTERPRISE APPS DEPARTME NTAL APPS SAAS APPS PUBLIC / PRIVATE APIS 1970s | MAINFRAME 1980s | IT AWAKENING 1990s | INTERNET 2000s | MOBILE 2010s | IoT/AI 2020+ | DIGITAL NATIVE SERVERLESS & MICROSERVICES
  • 4. What is Microservices Architecture? ● Architectural and organizational approach to software development ● Designed to speed-up deployment cycles, foster innovation and ownership, improve maintainability and scalability ● Composed of small independent services, each of which is built around a single business capability ● Services are owned by small self-contained teams
  • 5. Why Microservices Architecture? ● Agility - small independent teams are empowered to work independently and quickly, thus shortening the cycle times ● Innovation - teams can act autonomously and choose appropriate technologies, frameworks and low cost of failure ● Quality - dividing into small well-defined modules improves reusability, composability and maintainability of code ● Scalability - fine-grained decoupling of microservices allows you to horizontally scale each service independently from each other ● Availability - easier to implement failure isolation, thus improve the overall availability of your application
  • 7. • Network resiliency (retry, failover, circuit breaker) • Architectural complexity (complexity in interactions) – service discovery – service authentication • Operational complexity – Analytics, tracing, monitoring (Observability) – How to deploy a new version of a service (roll out new version - Canary deployment) Challenges with Microservices
  • 8. How to address these challenges?
  • 9. Service Mesh A service mesh is a dedicated infrastructure layer that controls service-to-service communication over a network. It provides a method in which separate parts of an application can communicate with each other. source:techtarget.com
  • 10. Istio is an open source service mesh implementation which provides behavioral insights and operational control over the service mesh as a whole, offering a complete solution to satisfy the diverse requirements of microservice applications. Istio
  • 11. Istio Component Overview • Pilot is responsible for configuring the data plane, defining basic proxy behaviour, providing service discovery for the Envoy sidecars, traffic management capabilities for intelligent routing, and resiliency. • Mixer can respond to various queries from the data plane such as authorization, access control or quota checks, and collects telemetry data from the Envoy proxy and other services. • Citadel enables strong service-to-service and end-user authentication with built-in identity and credential management. Allows you to build zero-trust environments.
  • 12. Istio Component Overview Istio Architecture (source — https://istio.io/docs/concepts/what-is-istio/)
  • 13. Demo
  • 14. Type Service Mesh API Management Routing L3/L4 HTTP, GRPC, GraphQL Security Service identity and mTLS User/App Authentication and Authorization(OAuth / JWT) Analytics Service operational analytics Business and developer focus analytics Rate Limiting RPC level rate limiting Business related rate limiting Personas and Portal DevOps portals Publisher, Developer, CXO portal
  • 15. • When users need to expose microservices services to outside in a secured and a controlled manner. • When fine grained security should be enforced on APIs exposed. • When stats need to be collected on API usage for monetization and billing. • When it is required to offer a marketplace for APIs for easy discovery and adoption. When is API Management required in a Service Mesh
  • 16. Istio + WSO2 API Manager Istio Architecture (source — https://istio.io/docs/concepts/what-is-istio/) WSO2 Mixer Adaptor Separately Hosted WSO2 API Manager
  • 17. Service Mesh and API Management
  • 27. WSO2 - Istio adapter https://github.com/wso2/istio-apim/tree/1.0 WSO2 - Istio Web Page https://wso2.com/api-management/microservices/istio/