SlideShare a Scribd company logo
Event Stream
Processing
with Kafka
 Tim Lossen • @tlossen • Wooga
Kafka?
Event-Stream Processing with Kafka
1883 — 1924
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
high-throughput
persistent
publish-subscribe
messaging
high-throughput
persistent
publish-subscribe
messaging
producer
broker
consumer
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
high-throughput
persistent
publish-subscribe
messaging
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
high-throughput
persistent
publish-subscribe
messaging
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
high-throughput
persistent
publish-subscribe
messaging
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Case Study:
 Tracking
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
requests per second
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
installs per minute
Event-Stream Processing with Kafka
Kafkaesque
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
github.com/wooga/kafka-rb
github.com/wooga/kafka-erlang
github.com/wooga/kafkaesque
Questions?
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka

More Related Content

PDF
Dashboard Mania
PDF
A Streaming Platform Architecture Based on Apache Kafka
PDF
Mini-Training: Netflix Simian Army
PDF
Five Fabulous Sinks for Your Kafka Data. #3 will surprise you! (Rachel Pedres...
PDF
Aws + kubernetes = ❤︎
PDF
0-60: Tesla's Streaming Data Platform ( Jesse Yates, Tesla) Kafka Summit SF 2019
PPTX
Sas 2015 event_driven
PPT
Docker in the Cloud
Dashboard Mania
A Streaming Platform Architecture Based on Apache Kafka
Mini-Training: Netflix Simian Army
Five Fabulous Sinks for Your Kafka Data. #3 will surprise you! (Rachel Pedres...
Aws + kubernetes = ❤︎
0-60: Tesla's Streaming Data Platform ( Jesse Yates, Tesla) Kafka Summit SF 2019
Sas 2015 event_driven
Docker in the Cloud

What's hot (20)

PPTX
Mario Cartia - SMACK is the new LAMP! - Codemotion Milan 2017
PDF
Apache Kafkaとグラフデータベースによる成長するネットワークグラフを分析・可視化する基盤
PPTX
No Docker? No Problem: Automating installation and config with Ansible
PPT
DevOpsCon Cloud Workshop
PDF
Kubernetes on AWS gone wild
PDF
Apache Kafka 0.11 の Exactly Once Semantics
PDF
Immutable Infrastructure: Rise of the Machine Images
PDF
Real time stock processing with apache nifi, apache flink and apache kafka
PDF
Don’t Be Scared: Multi-Tenant Cluster Support at Scale (Kelly Attaway, Pandor...
PPTX
RedisConf17 - Pain-free Pipelining
PDF
Livy: A REST Web Service For Apache Spark
PPTX
Continuous Deployment to the Cloud using Spinnaker
PDF
Kafka Summit NYC 2017 - The Source of Truth: Why the New York Times Stores Ev...
PDF
Spinnaker Chadev
PDF
2015-04-15 | Apache Kafka (Vienna Scala User Group)
PPTX
Canary Releases on Kubernetes w/ Spinnaker, Istio, and Prometheus
PDF
Fact-Based Monitoring - PuppetConf 2014
PDF
E2E Data Pipeline - Apache Spark/Airflow/Livy
PPTX
APPLICATIONS AND CONTAINERS AT SCALE: OpenShift + Kubernetes + Docker
PPTX
Mutating Admission Webhook creation
Mario Cartia - SMACK is the new LAMP! - Codemotion Milan 2017
Apache Kafkaとグラフデータベースによる成長するネットワークグラフを分析・可視化する基盤
No Docker? No Problem: Automating installation and config with Ansible
DevOpsCon Cloud Workshop
Kubernetes on AWS gone wild
Apache Kafka 0.11 の Exactly Once Semantics
Immutable Infrastructure: Rise of the Machine Images
Real time stock processing with apache nifi, apache flink and apache kafka
Don’t Be Scared: Multi-Tenant Cluster Support at Scale (Kelly Attaway, Pandor...
RedisConf17 - Pain-free Pipelining
Livy: A REST Web Service For Apache Spark
Continuous Deployment to the Cloud using Spinnaker
Kafka Summit NYC 2017 - The Source of Truth: Why the New York Times Stores Ev...
Spinnaker Chadev
2015-04-15 | Apache Kafka (Vienna Scala User Group)
Canary Releases on Kubernetes w/ Spinnaker, Istio, and Prometheus
Fact-Based Monitoring - PuppetConf 2014
E2E Data Pipeline - Apache Spark/Airflow/Livy
APPLICATIONS AND CONTAINERS AT SCALE: OpenShift + Kubernetes + Docker
Mutating Admission Webhook creation
Ad

More from Tim Lossen (20)

PDF
Apocalypse Later
PDF
Embracing Failure
PDF
Embracing Failure
PDF
Enemy of the State?
PDF
Beyond Devops
PDF
All Your Core Are Belong To Us
PDF
Podularity FTW!
PDF
Cubic Foot Gardening
PDF
Into the Void
PDF
Treasure Island -- Concurrency in JRuby
PDF
Dashboard Mania
PDF
JRuby vs. Rubinius
PDF
Redis to the Rescue?
PDF
Redis to the Rescue?
PDF
The Smallest Cluster in the World
PDF
Announcing Euruko 2011
PDF
Memory: The New Disk
PDF
Key-Value-Stores -- The Key to Scaling?
PDF
Cassandra vs. Redis
PDF
An Introduction to Membase
Apocalypse Later
Embracing Failure
Embracing Failure
Enemy of the State?
Beyond Devops
All Your Core Are Belong To Us
Podularity FTW!
Cubic Foot Gardening
Into the Void
Treasure Island -- Concurrency in JRuby
Dashboard Mania
JRuby vs. Rubinius
Redis to the Rescue?
Redis to the Rescue?
The Smallest Cluster in the World
Announcing Euruko 2011
Memory: The New Disk
Key-Value-Stores -- The Key to Scaling?
Cassandra vs. Redis
An Introduction to Membase
Ad

Recently uploaded (20)

PDF
Machine learning based COVID-19 study performance prediction
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
MYSQL Presentation for SQL database connectivity
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PPTX
Big Data Technologies - Introduction.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPTX
Spectroscopy.pptx food analysis technology
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Encapsulation theory and applications.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Empathic Computing: Creating Shared Understanding
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Machine learning based COVID-19 study performance prediction
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
MYSQL Presentation for SQL database connectivity
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Big Data Technologies - Introduction.pptx
Network Security Unit 5.pdf for BCA BBA.
Mobile App Security Testing_ A Comprehensive Guide.pdf
The Rise and Fall of 3GPP – Time for a Sabbatical?
NewMind AI Weekly Chronicles - August'25 Week I
Spectroscopy.pptx food analysis technology
The AUB Centre for AI in Media Proposal.docx
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Encapsulation theory and applications.pdf
20250228 LYD VKU AI Blended-Learning.pptx
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Empathic Computing: Creating Shared Understanding
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows