SlideShare a Scribd company logo
Service Meshes
The Ultimate Guide
infoq.com/articles/service-mesh-ultimate-guide
Do you need service meshes in your tech stack?
Outline
Key takeaways
Timeline
Use Cases
Antipatterns
FAQ
More
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
A service mesh manages all service-to-
service communication within a
distributed (potentially microservice-
based) software system. It accomplishes
this typically via the use of “sidecar”
proxies that are deployed alongside each
service through which all traffic is
transparently routed.
KEY TAKE AWAY NO 1
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Proxies used within a service mesh are
typically “application layer” aware
(operating at Layer 7 in the OSI
networking stack). This means that
traffic routing decisions and the labeling
of metrics can draw upon data in HTTP
headers or other application layer
protocol metadata.
KEY TAKE AWAY NO 2
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
A service mesh provides dynamic service
discovery and traffic management,
including traffic shadowing (duplicating)
for testing, and traffic splitting for canary
releasing, incremental rollout, and A/B
type experimentation.
KEY TAKE AWAY NO 3
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
A service mesh also supports the
implementation and enforcement of cross
cutting requirements, such as security
(providing service identity and TLS) and
reliability (rate limiting, circuit-breaking).
KEY TAKE AWAY NO 4
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
As a service mesh is on the critical path
for every request being handled within
the system, it can also provide additional
“observability,” such as distributed
tracing of a request, frequency of HTTP
error codes, global and service-to-service
latency.
KEY TAKE AWAY NO 5
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
There are clear benefits provided
by the use of a service mesh, but
the tradeoffs of added complexity
and the requirement of additional
runtime resources should be
analyzed.
KEY TAKE AWAY NO 6
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Service mesh technology is rapidly
becoming part of the (cloud native)
application platform “plumbing.” The
interesting innovation within this space is
happening in relation to the higher-level
abstractions and the human-focused
control planes.
KEY TAKE AWAY NO 7
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Popular service meshes include: Linkerd,
Istio, Consul, Kuma, and Maesh.
Supporting technologies within this space
include: Layer 7-aware proxies, such as
Envoy, HAProxy, and NGINX; and service
mesh orchestration, visualization, and
understandability tooling, such as
SuperGloo, Kiali, and Dive.
KEY TAKE AWAY NO 8
I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D EI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Timeline
SERVICE MESHES ON INFOQ
2011
Twitter began
work on the Scala-
powered Finagle
2013
Airbnb
released
SmartStack
2014
Netflix
released an
entire suite of
JVM-based
utilities
including
Prana
05/ 2017
the releases of
Istio
07/ 2018
Linkerd 2.0
11/2018
Consul Connect
and SuperGloo
05/2019
service mesh
interface
(SMI)
09/2019
Maesh and
Kuma
infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
SERVICE MESHES- USE CASES
Z I M C O R E H U B S | D E S I G N T H I N K I N G
DYNAMIC
SERVICE
DISCOVERY
AND ROUTING
SERVICE-TO-
SERVICE
COMMUNICATION
RELIABILITY
OBSERVABILITY OF
TRAFFIC
COMMUNICATION
SECURITY
infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
SERVICE MESHES- ANTIPATTERNS
Z I M C O R E H U B S | D E S I G N T H I N K I N G
TOO MANY
TRAFFIC
MANAGEMENT
LAYERS
SERVICE MESH
SILVER BULLET
ENTERPRISE
SERVICE BUS
(ESB) 2.0
BIG BANG
DEPLOYMENT
infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
Q: WHAT IS A SERVICE MESH?
A: A service mesh is a technology that manages
all service-to-service, “east-west,” traffic within a
distributed (potentially microservice-based)
software system.
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
FAQ
Q: HOW DOES A SERVICE MESH DIFFER FROM
AN API GATEWAY?
A: A service mesh manages all service-to-
service, “east-west,” traffic within a distributed
(potentially microservice-based) software
system.
FAQ
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
Q: IF I AM DEPLOYING MICROSERVICES, DO I
NEED A SERVICE MESH?
A: Not necessarily. A service mesh provides one
way of implementing service discovery. Other
solutions include language-specific libraries
(such as Ribbon and Eureka, or Finagle)
FAQ
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
Q: DO I NEED A SERVICE MESH TO IMPLEMENT
SERVICE DISCOVERY WITH MICROSERVICES?
A: No. A service mesh provides one way of
implementing service discovery. Other solutions
include language-specific libraries (such as
Ribbon and Eureka, or Finagle)
FAQ
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
SOME RESOURCES
SERVICE MESH
PODCAST
Idit Levine Discussing
Gloo, Service Mesh
Interface, and Web
Assembly Hub
Oliver Gould on the
Three Pillars of Service
Mesh, SMI, and Making
Technology Bets
SERVICE MESH
INFLUENCERS
Kasun Indrasiri
Bilgin Ibryam
Kelsey Hightower
SERVICE MESH
TUTORIALS
Layer 5 Meshery
Solo’s SuperGloo
KataCoda Istio tutorial
SERVICE MESH
EMAG
Service Mesh: Past,
Present, and Future
https://www.infoq.co
m/minibooks/service-
mesh/
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
Share your knowledge
WRITE FOR INFOQ
DANIEL BRYANT
InfoQ News Manager
CHARLES HUMBLE
Editor in Chief
Send us an email at
editors@infoq.com
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
FACEBOOK/INFOQ @INFOQ YOUTUBE/INFOQ
CONNECT WITH US
INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE

More Related Content

PDF
The Complete Guide to Service Mesh
PPTX
Service mesh
PDF
Bringing it all together - Denver JUG
PPTX
apidays LIVE JAKARTA - Take control of your microservices with App Mesh by Ak...
PPTX
Micro xchg 2018 - What is a Service Mesh?
PPTX
microXchg 2018: "What is a Service Mesh? Do I Need One When Developing 'Cloud...
PDF
apidays LIVE Paris - Avoid Building a Microservices Death Star by Przemek Kulik
PDF
Comparison of Current Service Mesh Architectures
The Complete Guide to Service Mesh
Service mesh
Bringing it all together - Denver JUG
apidays LIVE JAKARTA - Take control of your microservices with App Mesh by Ak...
Micro xchg 2018 - What is a Service Mesh?
microXchg 2018: "What is a Service Mesh? Do I Need One When Developing 'Cloud...
apidays LIVE Paris - Avoid Building a Microservices Death Star by Przemek Kulik
Comparison of Current Service Mesh Architectures

Similar to Service Meshes- The Ultimate Guide (20)

PDF
Dublin Microservice "Introduction to Service Meshes"
PDF
Bringing it all together
PPTX
O'Reilly 2017: "Introduction to Service Meshes"
PPTX
Api service mesh and microservice tooling
PPTX
Navigating the service mesh landscape with Istio, Consul Connect, and Linkerd
PPTX
CloudNativeLondon 2017: "What is a Service Mesh, and Do I Need One when Devel...
PPTX
API World: The service-mesh landscape
PDF
Intro to Service Meshes & Progressive Delivery (WOUG)
PPTX
Do You Need A Service Mesh?
PPTX
Cloud Native & Service Mesh
PDF
All About Microservices and OpenSource Microservice Frameworks
PDF
API Gateway or Service Mesh - Complementary or excluding concepts
PPTX
PHX DevOps Days: Service Mesh Landscape
PDF
[APIdays Singapore 2019] API Management in a Istio Service Mesh with WSO2 API...
PDF
API Gateway or Service mesh - Complementary or excluding concepts
PDF
Service Mesh Advanced Use Cases
PPTX
Making Microservices Smarter with Istio, Envoy and Pivotal Ingress Router
PPTX
Service mesh from linkerd to conduit (cloud native taiwan meetup)
PPTX
Service-mesh options with Linkerd, Consul, Istio and AWS AppMesh
PDF
Service Mesh Advanced Use Cases
Dublin Microservice "Introduction to Service Meshes"
Bringing it all together
O'Reilly 2017: "Introduction to Service Meshes"
Api service mesh and microservice tooling
Navigating the service mesh landscape with Istio, Consul Connect, and Linkerd
CloudNativeLondon 2017: "What is a Service Mesh, and Do I Need One when Devel...
API World: The service-mesh landscape
Intro to Service Meshes & Progressive Delivery (WOUG)
Do You Need A Service Mesh?
Cloud Native & Service Mesh
All About Microservices and OpenSource Microservice Frameworks
API Gateway or Service Mesh - Complementary or excluding concepts
PHX DevOps Days: Service Mesh Landscape
[APIdays Singapore 2019] API Management in a Istio Service Mesh with WSO2 API...
API Gateway or Service mesh - Complementary or excluding concepts
Service Mesh Advanced Use Cases
Making Microservices Smarter with Istio, Envoy and Pivotal Ingress Router
Service mesh from linkerd to conduit (cloud native taiwan meetup)
Service-mesh options with Linkerd, Consul, Istio and AWS AppMesh
Service Mesh Advanced Use Cases
Ad

More from C4Media (20)

PDF
Streaming a Million Likes/Second: Real-Time Interactions on Live Video
PDF
Next Generation Client APIs in Envoy Mobile
PDF
Software Teams and Teamwork Trends Report Q1 2020
PDF
Understand the Trade-offs Using Compilers for Java Applications
PDF
Kafka Needs No Keeper
PDF
High Performing Teams Act Like Owners
PDF
Does Java Need Inline Types? What Project Valhalla Can Bring to Java
PDF
Shifting Left with Cloud Native CI/CD
PDF
CI/CD for Machine Learning
PDF
Fault Tolerance at Speed
PDF
Architectures That Scale Deep - Regaining Control in Deep Systems
PDF
ML in the Browser: Interactive Experiences with Tensorflow.js
PDF
Build Your Own WebAssembly Compiler
PDF
User & Device Identity for Microservices @ Netflix Scale
PDF
Scaling Patterns for Netflix's Edge
PDF
Make Your Electron App Feel at Home Everywhere
PDF
The Talk You've Been Await-ing For
PDF
Future of Data Engineering
PDF
Automated Testing for Terraform, Docker, Packer, Kubernetes, and More
PDF
Navigating Complexity: High-performance Delivery and Discovery Teams
Streaming a Million Likes/Second: Real-Time Interactions on Live Video
Next Generation Client APIs in Envoy Mobile
Software Teams and Teamwork Trends Report Q1 2020
Understand the Trade-offs Using Compilers for Java Applications
Kafka Needs No Keeper
High Performing Teams Act Like Owners
Does Java Need Inline Types? What Project Valhalla Can Bring to Java
Shifting Left with Cloud Native CI/CD
CI/CD for Machine Learning
Fault Tolerance at Speed
Architectures That Scale Deep - Regaining Control in Deep Systems
ML in the Browser: Interactive Experiences with Tensorflow.js
Build Your Own WebAssembly Compiler
User & Device Identity for Microservices @ Netflix Scale
Scaling Patterns for Netflix's Edge
Make Your Electron App Feel at Home Everywhere
The Talk You've Been Await-ing For
Future of Data Engineering
Automated Testing for Terraform, Docker, Packer, Kubernetes, and More
Navigating Complexity: High-performance Delivery and Discovery Teams
Ad

Recently uploaded (20)

PDF
KodekX | Application Modernization Development
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Machine learning based COVID-19 study performance prediction
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
Big Data Technologies - Introduction.pptx
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Electronic commerce courselecture one. Pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
KodekX | Application Modernization Development
Understanding_Digital_Forensics_Presentation.pptx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
20250228 LYD VKU AI Blended-Learning.pptx
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Machine learning based COVID-19 study performance prediction
Review of recent advances in non-invasive hemoglobin estimation
Big Data Technologies - Introduction.pptx
CIFDAQ's Market Insight: SEC Turns Pro Crypto
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Encapsulation_ Review paper, used for researhc scholars
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Per capita expenditure prediction using model stacking based on satellite ima...
Electronic commerce courselecture one. Pdf
Building Integrated photovoltaic BIPV_UPV.pdf
“AI and Expert System Decision Support & Business Intelligence Systems”
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...

Service Meshes- The Ultimate Guide

  • 1. Service Meshes The Ultimate Guide infoq.com/articles/service-mesh-ultimate-guide Do you need service meshes in your tech stack?
  • 2. Outline Key takeaways Timeline Use Cases Antipatterns FAQ More I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 3. A service mesh manages all service-to- service communication within a distributed (potentially microservice- based) software system. It accomplishes this typically via the use of “sidecar” proxies that are deployed alongside each service through which all traffic is transparently routed. KEY TAKE AWAY NO 1 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 4. Proxies used within a service mesh are typically “application layer” aware (operating at Layer 7 in the OSI networking stack). This means that traffic routing decisions and the labeling of metrics can draw upon data in HTTP headers or other application layer protocol metadata. KEY TAKE AWAY NO 2 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 5. A service mesh provides dynamic service discovery and traffic management, including traffic shadowing (duplicating) for testing, and traffic splitting for canary releasing, incremental rollout, and A/B type experimentation. KEY TAKE AWAY NO 3 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 6. A service mesh also supports the implementation and enforcement of cross cutting requirements, such as security (providing service identity and TLS) and reliability (rate limiting, circuit-breaking). KEY TAKE AWAY NO 4 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 7. As a service mesh is on the critical path for every request being handled within the system, it can also provide additional “observability,” such as distributed tracing of a request, frequency of HTTP error codes, global and service-to-service latency. KEY TAKE AWAY NO 5 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 8. There are clear benefits provided by the use of a service mesh, but the tradeoffs of added complexity and the requirement of additional runtime resources should be analyzed. KEY TAKE AWAY NO 6 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 9. Service mesh technology is rapidly becoming part of the (cloud native) application platform “plumbing.” The interesting innovation within this space is happening in relation to the higher-level abstractions and the human-focused control planes. KEY TAKE AWAY NO 7 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 10. Popular service meshes include: Linkerd, Istio, Consul, Kuma, and Maesh. Supporting technologies within this space include: Layer 7-aware proxies, such as Envoy, HAProxy, and NGINX; and service mesh orchestration, visualization, and understandability tooling, such as SuperGloo, Kiali, and Dive. KEY TAKE AWAY NO 8 I N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D EI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 11. Timeline SERVICE MESHES ON INFOQ 2011 Twitter began work on the Scala- powered Finagle 2013 Airbnb released SmartStack 2014 Netflix released an entire suite of JVM-based utilities including Prana 05/ 2017 the releases of Istio 07/ 2018 Linkerd 2.0 11/2018 Consul Connect and SuperGloo 05/2019 service mesh interface (SMI) 09/2019 Maesh and Kuma infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 12. SERVICE MESHES- USE CASES Z I M C O R E H U B S | D E S I G N T H I N K I N G DYNAMIC SERVICE DISCOVERY AND ROUTING SERVICE-TO- SERVICE COMMUNICATION RELIABILITY OBSERVABILITY OF TRAFFIC COMMUNICATION SECURITY infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 13. SERVICE MESHES- ANTIPATTERNS Z I M C O R E H U B S | D E S I G N T H I N K I N G TOO MANY TRAFFIC MANAGEMENT LAYERS SERVICE MESH SILVER BULLET ENTERPRISE SERVICE BUS (ESB) 2.0 BIG BANG DEPLOYMENT infoq.com/articles/service-mesh-ultimate-guideI N F O Q . C O M / A R T I C L E S / S E R V I C E - M E S H - U L T I M A T E - G U I D E
  • 14. Q: WHAT IS A SERVICE MESH? A: A service mesh is a technology that manages all service-to-service, “east-west,” traffic within a distributed (potentially microservice-based) software system. INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE FAQ
  • 15. Q: HOW DOES A SERVICE MESH DIFFER FROM AN API GATEWAY? A: A service mesh manages all service-to- service, “east-west,” traffic within a distributed (potentially microservice-based) software system. FAQ INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 16. Q: IF I AM DEPLOYING MICROSERVICES, DO I NEED A SERVICE MESH? A: Not necessarily. A service mesh provides one way of implementing service discovery. Other solutions include language-specific libraries (such as Ribbon and Eureka, or Finagle) FAQ INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 17. Q: DO I NEED A SERVICE MESH TO IMPLEMENT SERVICE DISCOVERY WITH MICROSERVICES? A: No. A service mesh provides one way of implementing service discovery. Other solutions include language-specific libraries (such as Ribbon and Eureka, or Finagle) FAQ INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 18. SOME RESOURCES SERVICE MESH PODCAST Idit Levine Discussing Gloo, Service Mesh Interface, and Web Assembly Hub Oliver Gould on the Three Pillars of Service Mesh, SMI, and Making Technology Bets SERVICE MESH INFLUENCERS Kasun Indrasiri Bilgin Ibryam Kelsey Hightower SERVICE MESH TUTORIALS Layer 5 Meshery Solo’s SuperGloo KataCoda Istio tutorial SERVICE MESH EMAG Service Mesh: Past, Present, and Future https://www.infoq.co m/minibooks/service- mesh/ INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 19. Share your knowledge WRITE FOR INFOQ DANIEL BRYANT InfoQ News Manager CHARLES HUMBLE Editor in Chief Send us an email at editors@infoq.com INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE
  • 20. FACEBOOK/INFOQ @INFOQ YOUTUBE/INFOQ CONNECT WITH US INFOQ.COM/ARTICLES/SERVICE-MESH-ULTIMATE-GUIDE