SlideShare a Scribd company logo
@diego_pacheco
Principal Software
Stream
Patterns
Events
Sources
The need for a TW system
Events
Less
State
Lambda
Architecture
Stream Patterns
Stream Patterns
kafka + spark + cassandra
kafka + spark + cassandra
Client side Join
Analytics
Large Scale ML
Notifications /
Alerts
kafka
Pick a Stream Engine
Client Side Joins
Stream Aggregation
Tech
Evolution
Data
Pipeline
@diego_pacheco
Principal Software Architect
Stream
Patterns
Thank You !
Obrigado !

More Related Content

PDF
Akka Streams
PPTX
Alpakka - Connecting Kafka and ElasticSearch to Akka Streams
PPTX
Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...
PPTX
Flink Forward Berlin 2018: Timo Walther - "Flink SQL in Action"
PDF
Scaling stream data pipelines with Pravega and Apache Flink
PPTX
Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...
PDF
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
PDF
Flink Forward Berlin 2018: Ravi Suhag & Sumanth Nakshatrithaya - "Managing Fl...
Akka Streams
Alpakka - Connecting Kafka and ElasticSearch to Akka Streams
Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...
Flink Forward Berlin 2018: Timo Walther - "Flink SQL in Action"
Scaling stream data pipelines with Pravega and Apache Flink
Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward Berlin 2018: Ravi Suhag & Sumanth Nakshatrithaya - "Managing Fl...

What's hot (20)

PDF
Flink Forward San Francisco 2018: Andrew Torson - "Extending Flink metrics: R...
PDF
Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...
PDF
Stream Processing using Apache Flink in Zalando's World of Microservices - Re...
PDF
Alpakka:Intergating Akka-Streams with different technology
PDF
Flink Forward Berlin 2018: Viktor Klang - Keynote "The convergence of stream ...
PDF
Tuning Flink For Robustness And Performance
PPTX
Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...
PDF
Apache flink
PPTX
Kafka Practices @ Uber - Seattle Apache Kafka meetup
PDF
Flink Forward Berlin 2018: Raj Subramani - "A streaming Quantitative Analytic...
PPTX
Spline: Data Lineage For Spark Structured Streaming
PDF
Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...
PPTX
Taking a look under the hood of Apache Flink's relational APIs.
PPTX
Dataflow vs spark streaming
PPTX
Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...
PDF
Building your first aplication using Apache Apex
PDF
Athens BigData Meetup - Sept 17
PPTX
Stream Analytics with SQL on Apache Flink
PDF
Flink Forward Berlin 2018: Krzysztof Zarzycki & Alexey Brodovshuk - "Assistin...
PDF
Getting into the flow building applications with reactive streams
Flink Forward San Francisco 2018: Andrew Torson - "Extending Flink metrics: R...
Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...
Stream Processing using Apache Flink in Zalando's World of Microservices - Re...
Alpakka:Intergating Akka-Streams with different technology
Flink Forward Berlin 2018: Viktor Klang - Keynote "The convergence of stream ...
Tuning Flink For Robustness And Performance
Flink Forward Berlin 2018: Oleksandr Nitavskyi - "Data lossless event time st...
Apache flink
Kafka Practices @ Uber - Seattle Apache Kafka meetup
Flink Forward Berlin 2018: Raj Subramani - "A streaming Quantitative Analytic...
Spline: Data Lineage For Spark Structured Streaming
Flink Forward Berlin 2018: Stephan Ewen - Keynote: "Unlocking the next wave o...
Taking a look under the hood of Apache Flink's relational APIs.
Dataflow vs spark streaming
Flink Forward Berlin 2018: Aljoscha Krettek & Till Rohrmann - Keynote: "A Yea...
Building your first aplication using Apache Apex
Athens BigData Meetup - Sept 17
Stream Analytics with SQL on Apache Flink
Flink Forward Berlin 2018: Krzysztof Zarzycki & Alexey Brodovshuk - "Assistin...
Getting into the flow building applications with reactive streams
Ad

More from Diego Pacheco (20)

PDF
Naming Things Book : Simple Book Review!
PDF
Continuous Discovery Habits Book Review.pdf
PDF
Thoughts about Shape Up
PDF
Holacracy
PDF
AWS IAM
PDF
PDF
Encryption Deep Dive
PDF
Sec 101
PDF
Reflections on SCM
PDF
Management: Doing the non-obvious! III
PDF
Design is not Subjective
PDF
Architecture & Engineering : Doing the non-obvious!
PDF
Management doing the non-obvious II
PDF
Testing in production
PDF
Nine lies about work
PDF
Management: doing the nonobvious!
PDF
AI and the Future
PDF
Dealing with dependencies
PDF
Dealing with dependencies in tests
PDF
Kanban 2020
Naming Things Book : Simple Book Review!
Continuous Discovery Habits Book Review.pdf
Thoughts about Shape Up
Holacracy
AWS IAM
Encryption Deep Dive
Sec 101
Reflections on SCM
Management: Doing the non-obvious! III
Design is not Subjective
Architecture & Engineering : Doing the non-obvious!
Management doing the non-obvious II
Testing in production
Nine lies about work
Management: doing the nonobvious!
AI and the Future
Dealing with dependencies
Dealing with dependencies in tests
Kanban 2020
Ad

Recently uploaded (20)

PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPTX
Cloud computing and distributed systems.
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Electronic commerce courselecture one. Pdf
PDF
Chapter 3 Spatial Domain Image Processing.pdf
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
sap open course for s4hana steps from ECC to s4
PPTX
Big Data Technologies - Introduction.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Per capita expenditure prediction using model stacking based on satellite ima...
Cloud computing and distributed systems.
20250228 LYD VKU AI Blended-Learning.pptx
Encapsulation_ Review paper, used for researhc scholars
Mobile App Security Testing_ A Comprehensive Guide.pdf
Electronic commerce courselecture one. Pdf
Chapter 3 Spatial Domain Image Processing.pdf
The AUB Centre for AI in Media Proposal.docx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Agricultural_Statistics_at_a_Glance_2022_0.pdf
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
MIND Revenue Release Quarter 2 2025 Press Release
Spectral efficient network and resource selection model in 5G networks
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
sap open course for s4hana steps from ECC to s4
Big Data Technologies - Introduction.pptx
Network Security Unit 5.pdf for BCA BBA.
Advanced methodologies resolving dimensionality complications for autism neur...
Diabetes mellitus diagnosis method based random forest with bat algorithm

Stream Patterns