SlideShare a Scribd company logo
1Confidential
Building Event-Driven Microservices
with Stateful Streams
Kai Waehner
Technology Evangelist
kontakt@kai-waehner.de
LinkedIn
@KaiWaehner
www.confluent.io
www.kai-waehner.de
Apache Kafka, Kafka Streams, KSQL, and more…
(Kudos to my colleagues Ben and Jay)
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Microservices
Orders
Service
Basket
Service
Payment
Service
Fulfillment
Service
Stock
Service
Autonomy
Orders
Service
Independently Deployable
Orders
Service
Basket
Service
Payment
Service
Fulfillment
Service
Stock
Service
Allows us to scale
Scale in people terms
Scale in infrastructure terms
Service
Service
Service
Service A instance 1
Service A instance 2
Service B instance 1
Service B instance 2
Cluster
(many machines)
Scalable Streaming Microservices
How do we get there?
• Loose Coupling
• Data Enabled
• Event Driven
• Streaming Platform
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
à It is NOT a Queue! J
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
• All messaging systems are storage systems
• Slow consumers
• Reprocessing
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
KSQL – A Streaming SQL Engine for Apache Kafka
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Apache Kafka + Kafka Connect + Kafka Streams
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL
Apache Kafka: The Rise of a Streaming Platform
The Log ConnectorsConnectors
Producer Consumer
Streaming Engine
54
Highly Scalable Microservices with Apache Kafka +
Mesos
Kai Waehner
Technology Evangelist
kontakt@kai-waehner.de
@KaiWaehner
www.confluent.io
www.kai-waehner.de
LinkedIn
Questions? Feedback?
Please contact me!
Download Apache Kafka
& Confluent Platform
confluent.io/download

More Related Content

PPTX
Supply Chain Optimization with Apache Kafka
PDF
DataOps on Streaming Data: From Kafka to InfluxDB via Kubernetes Native Flows...
PDF
Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
PDF
Apache Kafka as Event Streaming Platform for Microservice Architectures
PDF
Kai Waehner [Confluent] | Real-Time Streaming Analytics with 100,000 Cars Usi...
PDF
App modernization on AWS with Apache Kafka and Confluent Cloud
PDF
Connected Vehicles and V2X with Apache Kafka
PDF
Kafka Streams vs. KSQL for Stream Processing on top of Apache Kafka
Supply Chain Optimization with Apache Kafka
DataOps on Streaming Data: From Kafka to InfluxDB via Kubernetes Native Flows...
Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Apache Kafka as Event Streaming Platform for Microservice Architectures
Kai Waehner [Confluent] | Real-Time Streaming Analytics with 100,000 Cars Usi...
App modernization on AWS with Apache Kafka and Confluent Cloud
Connected Vehicles and V2X with Apache Kafka
Kafka Streams vs. KSQL for Stream Processing on top of Apache Kafka

What's hot (20)

PDF
Top use cases for 2022 with Data in Motion and Apache Kafka
PDF
Building event-driven Microservices with Kafka Ecosystem
PDF
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
PDF
Apache Kafka Landscape for Automotive and Manufacturing
PPTX
IIoT with Kafka and Machine Learning for Supply Chain Optimization In Real Ti...
PDF
Apache Kafka and Blockchain - Comparison and a Kafka-native Implementation
PDF
Real-Life Use Cases & Architectures for Event Streaming with Apache Kafka
PDF
Kafka for Real-Time Replication between Edge and Hybrid Cloud
PDF
Event Driven Architecture with Quarkus,Kafka, Kubernetes
PDF
Apache Kafka for Smart Grid, Utilities and Energy Production
PDF
Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....
PDF
Architecture patterns for distributed, hybrid, edge and global Apache Kafka d...
PDF
Apache Kafka in the Insurance Industry
PDF
Building Event-Driven Applications with Apache Kafka & Confluent Platform
PDF
Apache Kafka in Financial Services - Use Cases and Architectures
PDF
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)
PDF
Leveraging Data in Motion | Jun Rao, Co-Founder, Confluent | Kafka Summit APA...
PDF
IBM Cloud Pak for Integration with Confluent Platform powered by Apache Kafka
PDF
Apache Kafka Open Source Ecosystem for Machine Learning at Extreme Scale (Apa...
PDF
Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures
Top use cases for 2022 with Data in Motion and Apache Kafka
Building event-driven Microservices with Kafka Ecosystem
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
Apache Kafka Landscape for Automotive and Manufacturing
IIoT with Kafka and Machine Learning for Supply Chain Optimization In Real Ti...
Apache Kafka and Blockchain - Comparison and a Kafka-native Implementation
Real-Life Use Cases & Architectures for Event Streaming with Apache Kafka
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Event Driven Architecture with Quarkus,Kafka, Kubernetes
Apache Kafka for Smart Grid, Utilities and Energy Production
Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....
Architecture patterns for distributed, hybrid, edge and global Apache Kafka d...
Apache Kafka in the Insurance Industry
Building Event-Driven Applications with Apache Kafka & Confluent Platform
Apache Kafka in Financial Services - Use Cases and Architectures
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)
Leveraging Data in Motion | Jun Rao, Co-Founder, Confluent | Kafka Summit APA...
IBM Cloud Pak for Integration with Confluent Platform powered by Apache Kafka
Apache Kafka Open Source Ecosystem for Machine Learning at Extreme Scale (Apa...
Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures
Ad

Similar to Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL (20)

PDF
Apache Kafka as Event-Driven Open Source Streaming Platform (Prague Meetup)
PDF
JHipster conf 2019 - Kafka Ecosystem
PDF
Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...
PDF
Service Mesh with Apache Kafka, Kubernetes, Envoy, Istio and Linkerd
PDF
Santander Stream Processing with Apache Flink
PDF
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
PDF
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...
PDF
Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...
PDF
MongoDB World 2019: Streaming ETL on the Shoulders of Giants
PDF
Introduction to Apache Kafka and Confluent... and why they matter
PDF
Apache Kafka in the Airline, Aviation and Travel Industry
PPTX
Streaming Data Ingest and Processing with Apache Kafka
PPTX
Oracle Code Keynote with Thomas Kurian
PDF
Leveraging Microservice Architectures & Event-Driven Systems for Global APIs
PDF
Apache Kafka + Apache Mesos + Kafka Streams - Highly Scalable Streaming Micro...
PPTX
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...
PDF
Serverless Messaging with Microsoft Azure by Steef-Jan Wiggers
PDF
Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...
PDF
Building a Secure, Tamper-Proof & Scalable Blockchain on Top of Apache Kafka ...
PDF
Introduction to Apache Kafka and Confluent... and why they matter!
Apache Kafka as Event-Driven Open Source Streaming Platform (Prague Meetup)
JHipster conf 2019 - Kafka Ecosystem
Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...
Service Mesh with Apache Kafka, Kubernetes, Envoy, Istio and Linkerd
Santander Stream Processing with Apache Flink
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...
Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...
MongoDB World 2019: Streaming ETL on the Shoulders of Giants
Introduction to Apache Kafka and Confluent... and why they matter
Apache Kafka in the Airline, Aviation and Travel Industry
Streaming Data Ingest and Processing with Apache Kafka
Oracle Code Keynote with Thomas Kurian
Leveraging Microservice Architectures & Event-Driven Systems for Global APIs
Apache Kafka + Apache Mesos + Kafka Streams - Highly Scalable Streaming Micro...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...
Serverless Messaging with Microsoft Azure by Steef-Jan Wiggers
Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...
Building a Secure, Tamper-Proof & Scalable Blockchain on Top of Apache Kafka ...
Introduction to Apache Kafka and Confluent... and why they matter!
Ad

More from Kai Wähner (20)

PDF
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
PDF
When NOT to use Apache Kafka?
PDF
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
PDF
The Heart of the Data Mesh Beats in Real-Time with Apache Kafka
PDF
Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware
PDF
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
PDF
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
PDF
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
PDF
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
PDF
Apache Kafka in the Healthcare Industry
PDF
Apache Kafka in the Healthcare Industry
PDF
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
PDF
Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0
PDF
Kappa vs Lambda Architectures and Technology Comparison
PPTX
The Top 5 Apache Kafka Use Cases and Architectures in 2022
PDF
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
PDF
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
PDF
Apache Kafka in the Transportation and Logistics
PDF
Apache Kafka for Cybersecurity and SIEM / SOAR Modernization
PDF
Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies?
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
When NOT to use Apache Kafka?
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
The Heart of the Data Mesh Beats in Real-Time with Apache Kafka
Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare Industry
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0
Kappa vs Lambda Architectures and Technology Comparison
The Top 5 Apache Kafka Use Cases and Architectures in 2022
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Apache Kafka in the Transportation and Logistics
Apache Kafka for Cybersecurity and SIEM / SOAR Modernization
Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies?

Recently uploaded (20)

PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
A Presentation on Artificial Intelligence
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Modernizing your data center with Dell and AMD
PDF
NewMind AI Monthly Chronicles - July 2025
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
KodekX | Application Modernization Development
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
Mobile App Security Testing_ A Comprehensive Guide.pdf
A Presentation on Artificial Intelligence
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Modernizing your data center with Dell and AMD
NewMind AI Monthly Chronicles - July 2025
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Diabetes mellitus diagnosis method based random forest with bat algorithm
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
KodekX | Application Modernization Development
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Digital-Transformation-Roadmap-for-Companies.pptx
Per capita expenditure prediction using model stacking based on satellite ima...
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
Network Security Unit 5.pdf for BCA BBA.
Spectral efficient network and resource selection model in 5G networks
Understanding_Digital_Forensics_Presentation.pptx
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Dropbox Q2 2025 Financial Results & Investor Presentation

Event-Driven Microservices with Apache Kafka, Kafka Streams and KSQL