DevNation Live: Kafka and Debezium
0 likes3,001 views
The document discusses change data capture (CDC) in microservices using Debezium, enabling event streaming of data and schema changes across databases. It outlines various CDC use cases such as data replication, caching, and enabling real-time updates, along with the architecture and integration of Debezium with Apache Kafka. The content emphasizes Debezium's extensibility and community support, targeting a range of databases and encouraging contributions to its open-source platform.
DevNation Live: Kafka and Debezium
- 14. Pattern: Microservice DataPattern: Microservice Data SynchronizationSynchronization Microservice ArchitecturesMicroservice Architectures Propagate data between different services without coupling Each service keeps optimised views locally #Debezium @gunnarmorling Order Item Stock App Local DB Local DB Local DB App App Item ChangesStock Changes
- 15. Source DB (with "Events" table) Kafka Connect Apache Kafka DBZ Order Events Credit Worthiness Check Events Pattern: OutboxPattern: Outbox Avoiding Dual WritesAvoiding Dual Writes #Debezium @gunnarmorling ID Category Type Payload 123 Order OrderCreated { "id" : 123, ... } 456 Order OrderDetailCanceled { "id" : 456, ... } Order Service Shipment Service Customer Service ID Category Type Payload 123 Order OrderCreated { "id" : 123, ... } 456 Order OrderDetail- Canceled { "id" : 456, ... } 789 ... ... ...
- 17. DemoDemo