How we migrated 760 Kafka nodes without downtime

View organization page for Salesforce

6,252,262 followers

Our Marketing Cloud Bigdata Platform team recently migrated over 760 Kafka and 60+ Zookeeper nodes across 12 clusters — all while sustaining 1M messages per second and 15TB of daily data. Dive into the details to learn how they achieved this seamless, zero-downtime migration: https://sforce.co/3H6nYrL

  • Inside Marketing Cloud's Kafka
Cluster Upgrade: Migrating 760+
Nodes With 1,000,000 Messages/Second

Dheeraj Bansal
PMTS Software Engineering,
Salesforce

Dheeraj's photo in a circle, Agent Einstein in a square shape, and Agent Astro in a diamond shape, surrounding a computer with people standing on it and around it with books.

Impressive work! Massive kudos to the team for pulling off such a complex upgrade seamlessly. 👏

Impressive achievement by the Marketing Cloud Bigdata Platform team! Migrating such a massive Kafka infrastructure without downtime while handling millions of messages per second is truly remarkable.

Massive respect for this kind of orchestration. That’s data resilience at its finest 🎯

That’s an impressive migration at scale 🚀

See more comments

To view or add a comment, sign in

Explore content categories