SlideShare a Scribd company logo
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
How does Spark work?
task
task
task
task
task
task
task
task
task
Real-time data streams with Apache Kafka and Spark
HDInsight and
Azure Databricks
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark
aka.ms/apache-kafka
aka.ms/apache-spark
aka.ms/kafka-spark-azure
 Create HDInsight Kafka cluster using ARM: aka.ms/hdi-kafka-arm
 Create Kafka topics in HDInsight: aka.ms/hdi-kafka-topic
 Lena on Twitter: twitter.com/lenadroid
 Lena on Github: github.com/lenadroid
Real-time data streams with Apache Kafka and Spark
Real-time data streams with Apache Kafka and Spark

More Related Content

PPT
Hw09 Building Data Intensive Apps A Closer Look At Trending Topics.Org
PDF
Sparking up Data Engineering: Spark Summit East talk by Rohan Sharma
PDF
Serverless log analytics with Amazon Kinesis
PDF
Event driven workloads on Kubernetes with KEDA
PPTX
Microsoft Azure IaaS and Terraform
PPTX
PPTX
Operational challenges behind Serverless architectures
PPTX
Summit openshift-on-openstack
Hw09 Building Data Intensive Apps A Closer Look At Trending Topics.Org
Sparking up Data Engineering: Spark Summit East talk by Rohan Sharma
Serverless log analytics with Amazon Kinesis
Event driven workloads on Kubernetes with KEDA
Microsoft Azure IaaS and Terraform
Operational challenges behind Serverless architectures
Summit openshift-on-openstack

What's hot (20)

PDF
Atlantisで実現するTerraformのGitOps
PDF
NetflixOSS: The Netflix Way
PDF
Mining public datasets using opensource tools: Zeppelin, Spark and Juju
PPT
Apache Solr search for Drupal. Ievgen Kartakov.
PPTX
Building a raspberry pi cluster
PDF
A quick introduction to AWS Lambda
PDF
Big data for dot net Devs with Spark
PDF
PDF
An Overview of Spinnaker
PDF
Kubernetes on AWS gone wild
PDF
Azure containers fundamentals
PPTX
Amazon EMR Facebook Presto Meetup
PPTX
SF Big Analytics: Machine Learning with Presto by Christopher Berner
PDF
Cloud Native Unleashed
PDF
DevOps Days Tel Aviv - Serverless Architecture
PDF
If you doing file uploads with rails you're gonna have a bad time
PPTX
How to collect Google Analytics events to your own data warehouse and do it o...
PDF
Making Spinnaker Go @ Stitch Fix
PDF
Spinnaker - Bay Area AWS Meetup - 20160726
PDF
All the Ops: DataOps with GitOps for Streaming data on Kafka and Kubernetes
Atlantisで実現するTerraformのGitOps
NetflixOSS: The Netflix Way
Mining public datasets using opensource tools: Zeppelin, Spark and Juju
Apache Solr search for Drupal. Ievgen Kartakov.
Building a raspberry pi cluster
A quick introduction to AWS Lambda
Big data for dot net Devs with Spark
An Overview of Spinnaker
Kubernetes on AWS gone wild
Azure containers fundamentals
Amazon EMR Facebook Presto Meetup
SF Big Analytics: Machine Learning with Presto by Christopher Berner
Cloud Native Unleashed
DevOps Days Tel Aviv - Serverless Architecture
If you doing file uploads with rails you're gonna have a bad time
How to collect Google Analytics events to your own data warehouse and do it o...
Making Spinnaker Go @ Stitch Fix
Spinnaker - Bay Area AWS Meetup - 20160726
All the Ops: DataOps with GitOps for Streaming data on Kafka and Kubernetes
Ad

More from Microsoft Tech Community (20)

PPTX
100 ways to use Yammer
PPTX
10 Yammer Group Suggestions
PPTX
Removing Security Roadblocks to IoT Deployment Success
PPTX
Building mobile apps with Visual Studio and Xamarin
PPTX
Best practices with Microsoft Graph: Making your applications more performant...
PPTX
Interactive emails in Outlook with Adaptive Cards
PPTX
Unlocking security insights with Microsoft Graph API
PPTX
Break through the serverless barriers with Durable Functions
PPTX
Multiplayer Server Scaling with Azure Container Instances
PPTX
Explore Azure Cosmos DB
PPTX
Media Streaming Apps with Azure and Xamarin
PPTX
DevOps for Data Science
PPTX
Real-World Solutions with PowerApps: Tips & tricks to manage your app complexity
PPTX
Azure Functions and Microsoft Graph
PPTX
Ingestion in data pipelines with Managed Kafka Clusters in Azure HDInsight
PPTX
Getting Started with Visual Studio Tools for AI
PPTX
Using AML Python SDK
PPTX
Mobile Workforce Location Tracking with Bing Maps
PPTX
Cognitive Services Labs in action Anomaly detection
PPTX
Speech Devices SDK
100 ways to use Yammer
10 Yammer Group Suggestions
Removing Security Roadblocks to IoT Deployment Success
Building mobile apps with Visual Studio and Xamarin
Best practices with Microsoft Graph: Making your applications more performant...
Interactive emails in Outlook with Adaptive Cards
Unlocking security insights with Microsoft Graph API
Break through the serverless barriers with Durable Functions
Multiplayer Server Scaling with Azure Container Instances
Explore Azure Cosmos DB
Media Streaming Apps with Azure and Xamarin
DevOps for Data Science
Real-World Solutions with PowerApps: Tips & tricks to manage your app complexity
Azure Functions and Microsoft Graph
Ingestion in data pipelines with Managed Kafka Clusters in Azure HDInsight
Getting Started with Visual Studio Tools for AI
Using AML Python SDK
Mobile Workforce Location Tracking with Bing Maps
Cognitive Services Labs in action Anomaly detection
Speech Devices SDK
Ad

Recently uploaded (20)

PPTX
A Presentation on Artificial Intelligence
PDF
1 - Historical Antecedents, Social Consideration.pdf
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
WOOl fibre morphology and structure.pdf for textiles
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Encapsulation theory and applications.pdf
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Mushroom cultivation and it's methods.pdf
A Presentation on Artificial Intelligence
1 - Historical Antecedents, Social Consideration.pdf
Group 1 Presentation -Planning and Decision Making .pptx
A comparative study of natural language inference in Swahili using monolingua...
Enhancing emotion recognition model for a student engagement use case through...
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
gpt5_lecture_notes_comprehensive_20250812015547.pdf
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
WOOl fibre morphology and structure.pdf for textiles
A novel scalable deep ensemble learning framework for big data classification...
Building Integrated photovoltaic BIPV_UPV.pdf
SOPHOS-XG Firewall Administrator PPT.pptx
Agricultural_Statistics_at_a_Glance_2022_0.pdf
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Encapsulation theory and applications.pdf
Assigned Numbers - 2025 - Bluetooth® Document
Mushroom cultivation and it's methods.pdf

Real-time data streams with Apache Kafka and Spark

Editor's Notes