RabbitMQ and AMQP Model
- 1. 1
- 2. 2 Agenda • What is & Why RabbitMQ • RabbitMQ & AMQP • Demo • Application Architectures • Q&A
- 3. 3 Show RabbitMQ management console
- 4. What & Why 4 • Open source, lightweight message broker • Flexible configurations to control message delivering behavior • Third-party plugin support • Integrated Security • Platform neutral AMQP implementation with many programming language support as client Publish C
- 5. RabbitMQ & AMQP 5 • RabbitMQ implements the AMQP protocol • We have to speak AMQP to work with RabbitMQ • Like OOP, AMQP has classes and methods - AMQP commands • Knowing AMQP will be a definite help when working client libraries • AMQP commands marshal into frames App Client Image Ref: https://www.brianstorti.com/speaking-rabbit-amqps-frame-structure/
- 8. AMQP model 8 Ref: https://www.rabbitmq.com/tutorials/amqp-concepts.html#amqp-model
- 9. Connection vs Channel 9 • Keep one Connection to RabbitMQ • Create Channel to transmit information • A single AMQP connection can have multiple channels Client
- 10. Declaring an Exchange 10 • Exchange is responsible for message routing • Routing algorithm will be based on the exchange type • Exchanges are created using the Exchange.Declare command, Once the command has been sent and RabbitMQ has created the exchange, an Exchange.DeclareOk method frame is sent in response, if error Channel.Close • PHP - $channel->exchange_declare() • JAVA - channel.exchangeDeclare() • JavaScript - ch.assertExchange()
- 11. Declaring a Queue 11 • Queues used to store actual data • Created using Queue.Declare command, returning Queue.DeclareOK. if there are any errors close the channel. • Params: queueName, durable, exclusive, autoDelete • Java - channel.queueDeclare() • C# - channel.QueueDeclare() • PHP - $channel->queue_declare()
- 12. Bind a Queue 12 • Bind using Queue.Bind command and return Queue.BindOk • Bind a Queue to an Exchange • Params: queueName, exchange,routingKey • Java - channel.queueBind() • Python - channel.queue_bind
- 13. AMQP Model in nutshell 13 • Exchange.Declare • Queue.Declare • Queue.Bind
- 14. Exchange types 14 • Direct exchange - Delivers messages to queues based on the message routing key. Default exchange is direct exchange with no name (Empty string) • Fanout exchange - Routes messages to all the queues that are bound to it and the routing key is ignored. • Topic exchange - Route messages to one or many queues based on pattern matching between a message routing key and binding • Headers exchange - Uses message headers and ignore routing keys
- 15. Reading a Queue & Acknowledgement 15 • Use Basic.Consume command, this is a push modal • Basic.Ack used to confirm or can use auto acknowledgement when Binding • When no_ack set to true, RabbitMQ will send messages continuously until the consumer sends a Basic.Cancel command or the consumer is disconnected. • If the no_ack flag is set to false, a consumer must acknowledge each message that it receives by sending a Basic.Ack Client Consume Ack
- 16. Let’s start the demo 16 • Get start with RabbitMQ • Run RabbitMQ as a docker instance • Use default exchange to publish & consume • Demo - face detection application • RabbitMQ in AWS EC2 – Remote • Image uploader in AWS • Image processor in local machine docker run -d --hostname my-rabbit --name some-rabbit -p 5672:5672 -p 8282:15672 rabbitmq:3-management
- 18. Demo.. 18 Web App FaceDetection p-Img-request p-Img-response FD-R-Q Key: FD-R-Q C Key: detect-faces FaceDetection DesktopApp (OpenCV) I-W-PID Key: detect-faces C Exchanges Queues CQueueConsumber
- 19. Architectural choices 19 • Tightly coupled application • Decouple DB updates Application DB Application DB
- 20. Architectural choices.. 20 • Add new features Application C1 DB C2 Another System
- 21. Architectural choices.. 21 • Replication Application DB C DB C
- 23. Architectural choices 23 • Loosely coupled components • Realtime and Reactive capabilities • Improve scalability of applications • Easy and seamless adding of new features • Replication of data, events or even full application
- 24. Q & A 24 • Thank you!!
Editor's Notes
- #2: I am Rajitha from Gapstars and I am working for Conxillium RabbitMQ to sync data between our application Desktop other in Mutitenant Cloud native application Seamless user experience between two applications
- #3: 1st What is and & Why RabbitMQ 2nd RabbitMQ & AMQP AMQP Protocol How to speak AMQ Protocol AMQP Model Exchange Queues Binding Also Connection Channel After 2nd section, I can answer questions if you have Demo – Coding and Face detection application in Cloud –AWS and Face detection in Local machine
- #4: Running as a Docker instance This is Web Console RabbiMQs default post is 5672
- #5: Open Source Mozilla Public License Light weight (40 MB) memory to operate Easy to get start and deploy Flexible configuration Message Routing algorithm Persist messages, Queue Failour handling Plugin to support multiprotocols (AMQP, STOMP Text base, JMS) SSL support for Connection, Authentication Actually RabbitMQ is impl of AMQP – Advance message queueing protocol Like HTTP language independent That is why RabbitMQ and AMQP is going together
- #8: This is the internal protocol level communication 5 Frame types (Prptocol Header, Method Frame, Content Header Frame, Body Frame, Heart Beat Frame) The GOOD thing is…. We do not have to warry about these internal structures Client Libs do this for us We have to know AMQP Model.. That’s all
- #9: Exchange -> that routes messages to queues, Different type of exchanges.. (Like post office, post exchange, Some sorted through address, some through POST BOX Number.. ) Queue—A data structure on disk or in memory FIFO queue Binding—Bind exchange with a queue
- #16: Now you know Exchange Queue Binding And how to consume a message Lets move on to the demo
- #18: Image Processor on local with OpenCV And it is connected to RabbitMQ App user will upload and img for process App will send it to RabbitMQ to process.. Who ever connetec to RabbitMQ will process it and send data back
- #19: 1. two exchanges will be declared when application starting up 2.Create a queue for the Worker 3. Bind the Queue with “request” exchange with “detect-faces” key 4. Start to consume that queue 5. Web App 6. After user upload an Image 7. Create a queue with “face-detection-response-queue” 8. Bind it with “response” Exchange with routing key as QueueName it self 9. Then it will get ready to consume its own created queue 10. Also send the message to “request” Exchange with routing key “detect-faces” and set the reply to as it is own queue
- #25: Exchange -> that routes messages to queues, Different type of exchanges.. (Like post office, post exchange, Some sorted through address, some through POST BOX Number.. ) Queue—A data structure on disk or in memory FIFO queue Binding—Bind exchange with a queue
- #26: Exchange -> that routes messages to queues, Different type of exchanges.. (Like post office, post exchange, Some sorted through address, some through POST BOX Number.. ) Queue—A data structure on disk or in memory FIFO queue Binding—Bind exchange with a queue