SlideShare a Scribd company logo
Kafka Pluggable Authorizer for
Enterprise Security
Anna Kepler
Data Engineer
Kafka Pluggable Authorization for Enterprise Security (Anna Kepler, Viasat) Kafka Summit NYC 2019
Kafka Pluggable Authorization for Enterprise Security (Anna Kepler, Viasat) Kafka Summit NYC 2019
Data Security at Scale is Hard
Databus Streaming Platform
Shifting Objective Over Time
Data Democratization
Fast Customer Onboarding
Self-Service
High Volume Stream Processing
2014
4 teams
60 streams
Shifting Objective Over Time
Data Security
Data Governance
Accountability2019
50+ teams
1,000+ streams
Default Kafka® Authorization
authorizer.class.name = kafka.security.auth.SimpleAclAuthorizer
allow.everyone.if.no.acl.found=true
super.users=User:Bob;User:Alice
bin/kafka-acls
--add --allow-principal User:Bob 
--producer --topic test-topic
Databus Kafka Authorization
authorizer.class.name = com.viasat.databus.DatabusKafkaAuthorizer
role.manager.url = https://roles.visat.io
permissions.expiration.sec = 60
Role Manager Service
Endpoints
/tenancies
/resources
/subjects
/capabilities
Role Manager cli
COMMANDS:
version Get version information
token Get a JWT for authentication
tenancy Interact with tenancies
resource Interact with resources
capability Interact with capabilities
subject Interact with subjects
help, h Shows a list of commands
role capability list –r stream:my-stream
Working with Role Manager
{
"id": "tenancy:team-awesome",
"groups": [
{
"stripe": ”team-awesome",
"group": ”team-awesome-admins",
"capabilities":
[ "read", "write", "describe", "modify", "delete" ]
}
]
}
Working with Role Manager
{
"id": "tenancy:team-awesome",
"groups": [
{
"stripe": "team-awesome",
"group": "team-awesome-readers",
"capabilities": [ ”read", "describe" ]
}
]
}
Granular Permissions
{
"fromSubjectId": "Bob”,
"toResourceId": "stream:shared-stream",
"action": "read"
}
# With the cli
role capability create capability.json
Why do it
Integration into Central Authentication System
Delegation of controls to team admins
REST API used by various components in the platform
In-depth monitoring
Thank you
Anna Kepler
Data Engineer, Viasat
https://www.linkedin.com/in/akepler
https://github.com/Viasat
https://careers.viasat.com/

More Related Content

PDF
Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...
PDF
Introducing Kafka's Streams API
PDF
[Demo session] 관리형 Kafka 서비스 - Oracle Event Hub Service
PDF
Apache Kafka in Adobe Ad Cloud's Analytics Platform
PDF
Kafka Security 101 and Real-World Tips
PDF
Writing Blazing Fast, and Production-Ready Kafka Streams apps in less than 30...
PDF
Securing Kafka
PDF
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
Flexible Authentication Strategies with SASL/OAUTHBEARER (Michael Kaminski, T...
Introducing Kafka's Streams API
[Demo session] 관리형 Kafka 서비스 - Oracle Event Hub Service
Apache Kafka in Adobe Ad Cloud's Analytics Platform
Kafka Security 101 and Real-World Tips
Writing Blazing Fast, and Production-Ready Kafka Streams apps in less than 30...
Securing Kafka
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...

What's hot (20)

PDF
Stream Me Up, Scotty: Transitioning to the Cloud Using a Streaming Data Platform
PDF
Stream Processing with Apache Kafka and .NET
PDF
Confluent Operations Training for Apache Kafka
PDF
How Yelp Leapt to Microservices with More than a Message Queue
PDF
Hello, kafka! (an introduction to apache kafka)
PDF
Understanding Apache Kafka® Latency at Scale
PPTX
Apache Kafka at LinkedIn - How LinkedIn Customizes Kafka to Work at the Trill...
PDF
Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...
PPTX
Protecting your data at rest with Apache Kafka by Confluent and Vormetric
PDF
Making Kafka Cloud Native | Jay Kreps, Co-Founder & CEO, Confluent
PDF
Event Sourcing, Stream Processing and Serverless (Benjamin Stopford, Confluen...
PDF
Running Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications
PDF
Building Microservices with Apache Kafka
PDF
Introducing Confluent Cloud: Apache Kafka as a Service
PDF
Common issues with Apache Kafka® Producer
PDF
Intro to AsyncAPI
PDF
Everything you ever needed to know about Kafka on Kubernetes but were afraid ...
PDF
8 Lessons Learned from Using Kafka in 1000 Scala microservices - Scale by the...
PDF
Event Driven Architectures with Apache Kafka on Heroku
PDF
A Tour of Apache Kafka
Stream Me Up, Scotty: Transitioning to the Cloud Using a Streaming Data Platform
Stream Processing with Apache Kafka and .NET
Confluent Operations Training for Apache Kafka
How Yelp Leapt to Microservices with More than a Message Queue
Hello, kafka! (an introduction to apache kafka)
Understanding Apache Kafka® Latency at Scale
Apache Kafka at LinkedIn - How LinkedIn Customizes Kafka to Work at the Trill...
Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...
Protecting your data at rest with Apache Kafka by Confluent and Vormetric
Making Kafka Cloud Native | Jay Kreps, Co-Founder & CEO, Confluent
Event Sourcing, Stream Processing and Serverless (Benjamin Stopford, Confluen...
Running Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications
Building Microservices with Apache Kafka
Introducing Confluent Cloud: Apache Kafka as a Service
Common issues with Apache Kafka® Producer
Intro to AsyncAPI
Everything you ever needed to know about Kafka on Kubernetes but were afraid ...
8 Lessons Learned from Using Kafka in 1000 Scala microservices - Scale by the...
Event Driven Architectures with Apache Kafka on Heroku
A Tour of Apache Kafka
Ad

Similar to Kafka Pluggable Authorization for Enterprise Security (Anna Kepler, Viasat) Kafka Summit NYC 2019 (20)

PDF
Apache Kafka® Security Overview
PDF
Apache Kafka - Scalable Message-Processing and more !
PPTX
PDF
Kafka 2018 - Securing Kafka the Right Way
PPTX
Monitoring and Resiliency Testing our Apache Kafka Clusters at Goldman Sachs ...
PDF
Hadoop security
PDF
Actual CCDAK Questions with Practice Tests and braindumps
PPTX
Spark on Azure HDInsight - spark meetup seattle
PPTX
Apache Kafka Security
PPTX
Ai tour 2019 Mejores Practicas en Entornos de Produccion Big Data Open Source...
PPTX
Visualizing Kafka Security
PDF
Reinventing Kafka in the Data Streaming Era - Jun Rao
PDF
Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...
PDF
C19013010 the tutorial to build shared ai services session 2
PDF
Kafka clients and emitters
PDF
Citizen Streaming Engineer - A How To
PDF
Hadoop & Security - Past, Present, Future
PDF
Kubernetes connectivity to Cloud Native Kafka | Evan Shortiss and Hugo Guerre...
PPTX
How to Lock Down Apache Kafka and Keep Your Streams Safe
PDF
Team Collaboration in Kafka Clusters With Maria Berinde-Tampanariu | Current ...
Apache Kafka® Security Overview
Apache Kafka - Scalable Message-Processing and more !
Kafka 2018 - Securing Kafka the Right Way
Monitoring and Resiliency Testing our Apache Kafka Clusters at Goldman Sachs ...
Hadoop security
Actual CCDAK Questions with Practice Tests and braindumps
Spark on Azure HDInsight - spark meetup seattle
Apache Kafka Security
Ai tour 2019 Mejores Practicas en Entornos de Produccion Big Data Open Source...
Visualizing Kafka Security
Reinventing Kafka in the Data Streaming Era - Jun Rao
Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...
C19013010 the tutorial to build shared ai services session 2
Kafka clients and emitters
Citizen Streaming Engineer - A How To
Hadoop & Security - Past, Present, Future
Kubernetes connectivity to Cloud Native Kafka | Evan Shortiss and Hugo Guerre...
How to Lock Down Apache Kafka and Keep Your Streams Safe
Team Collaboration in Kafka Clusters With Maria Berinde-Tampanariu | Current ...
Ad

More from confluent (20)

PDF
Stream Processing Handson Workshop - Flink SQL Hands-on Workshop (Korean)
PPTX
Webinar Think Right - Shift Left - 19-03-2025.pptx
PDF
Migration, backup and restore made easy using Kannika
PDF
Five Things You Need to Know About Data Streaming in 2025
PDF
Data in Motion Tour Seoul 2024 - Keynote
PDF
Data in Motion Tour Seoul 2024 - Roadmap Demo
PDF
From Stream to Screen: Real-Time Data Streaming to Web Frontends with Conflue...
PDF
Confluent per il settore FSI: Accelerare l'Innovazione con il Data Streaming...
PDF
Data in Motion Tour 2024 Riyadh, Saudi Arabia
PDF
Build a Real-Time Decision Support Application for Financial Market Traders w...
PDF
Strumenti e Strategie di Stream Governance con Confluent Platform
PDF
Compose Gen-AI Apps With Real-Time Data - In Minutes, Not Weeks
PDF
Building Real-Time Gen AI Applications with SingleStore and Confluent
PDF
Unlocking value with event-driven architecture by Confluent
PDF
Il Data Streaming per un’AI real-time di nuova generazione
PDF
Unleashing the Future: Building a Scalable and Up-to-Date GenAI Chatbot with ...
PDF
Break data silos with real-time connectivity using Confluent Cloud Connectors
PDF
Building API data products on top of your real-time data infrastructure
PDF
Speed Wins: From Kafka to APIs in Minutes
PDF
Evolving Data Governance for the Real-time Streaming and AI Era
Stream Processing Handson Workshop - Flink SQL Hands-on Workshop (Korean)
Webinar Think Right - Shift Left - 19-03-2025.pptx
Migration, backup and restore made easy using Kannika
Five Things You Need to Know About Data Streaming in 2025
Data in Motion Tour Seoul 2024 - Keynote
Data in Motion Tour Seoul 2024 - Roadmap Demo
From Stream to Screen: Real-Time Data Streaming to Web Frontends with Conflue...
Confluent per il settore FSI: Accelerare l'Innovazione con il Data Streaming...
Data in Motion Tour 2024 Riyadh, Saudi Arabia
Build a Real-Time Decision Support Application for Financial Market Traders w...
Strumenti e Strategie di Stream Governance con Confluent Platform
Compose Gen-AI Apps With Real-Time Data - In Minutes, Not Weeks
Building Real-Time Gen AI Applications with SingleStore and Confluent
Unlocking value with event-driven architecture by Confluent
Il Data Streaming per un’AI real-time di nuova generazione
Unleashing the Future: Building a Scalable and Up-to-Date GenAI Chatbot with ...
Break data silos with real-time connectivity using Confluent Cloud Connectors
Building API data products on top of your real-time data infrastructure
Speed Wins: From Kafka to APIs in Minutes
Evolving Data Governance for the Real-time Streaming and AI Era

Recently uploaded (20)

PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Encapsulation theory and applications.pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Electronic commerce courselecture one. Pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Review of recent advances in non-invasive hemoglobin estimation
Reach Out and Touch Someone: Haptics and Empathic Computing
Network Security Unit 5.pdf for BCA BBA.
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Digital-Transformation-Roadmap-for-Companies.pptx
Encapsulation theory and applications.pdf
Unlocking AI with Model Context Protocol (MCP)
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Electronic commerce courselecture one. Pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
“AI and Expert System Decision Support & Business Intelligence Systems”
Per capita expenditure prediction using model stacking based on satellite ima...
The AUB Centre for AI in Media Proposal.docx
Chapter 3 Spatial Domain Image Processing.pdf
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Encapsulation_ Review paper, used for researhc scholars
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx

Kafka Pluggable Authorization for Enterprise Security (Anna Kepler, Viasat) Kafka Summit NYC 2019