Taste Rabbitmq
24 likes7,593 views
This document discusses message queues and RabbitMQ. It begins with basic definitions of message queues, producers, and consumers. It then discusses why message queues and RabbitMQ are used, including for decoupling systems, higher performance, and acting as an inter-process communication mechanism. The document then walks through an example log system and how it could be improved by integrating RabbitMQ and message queues. It discusses splitting log types into separate queues, using exchanges to route messages, and performance tuning. It concludes by covering clustering RabbitMQ nodes for scaling and high availability.
![clustering to scale
create cluster:
rabbit2$ rabbitmqctl stop_app
Stopping node rabbit@rabbit2 ...done.
rabbit2$ rabbitmqctl reset
Resetting node rabbit@rabbit2 ...done.
rabbit2$ rabbitmqctl cluster rabbit@rabbit1
Clustering node rabbit@rabbit2 with [rabbit@rabbit1] ...done.
rabbit2$ rabbitmqctl start_app
Starting node rabbit@rabbit2 ...done.](https://image.slidesharecdn.com/rabbitmqv2-110428110008-phpapp01/85/Taste-Rabbitmq-34-320.jpg)
![clustering to scale
Check it out:
rabbit1$ rabbitmqctl status
Status of node rabbit@rabbit1 ...
[...,
{nodes,[{disc,[rabbit@rabbit1]},{ram,[rabbit@rabbit2]}]},
{running_nodes,[rabbit@rabbit2,rabbit@rabbit1]}]
...done.](https://image.slidesharecdn.com/rabbitmqv2-110428110008-phpapp01/85/Taste-Rabbitmq-35-320.jpg)
Taste Rabbitmq
- 1. Taste jeff@techparty.org
- 2. What‘s a MQ
- 3. What‘s a MQ queue
- 4. What‘s a MQ message queue
- 5. What‘s a MQ message Producer queue
- 6. What‘s a MQ Consumer message Producer queue
- 8. Why rabbitMQ? Based on Erlang Reliable Highly available Scalable portable Implemented AMQP Standard and More 100% OpenSource
- 9. I have a log system
- 10. register Login logout Log System DataBase
- 11. register Login log = getLog(request) if log.type == ‘login’: logout # balabala ....... if log.type == ‘register’: # balabala ....... log.save() Log System DataBase
- 12. register Login log = getLog(request) if log.type == ‘login’: logout # balabala ....... if log.type == ‘register’: # balabala ....... log.save() Log System I need ... 1. better performance 2. cleaner code DataBase 3. easier to test 4. ....
- 13. Step1. work with Queue
- 14. Step1. work with Queue ....... log = getLog(request) channel.publish(None,‘log-queue’,None,log)
- 15. Step1. work with Queue ....... log = getLog(request) channel.publish(None,‘log-queue’,None,log) def onLog(log): if log.type == ‘login’: # balabala if log.type == ‘logout’: # balabala log.save()
- 16. Step1. work with Queue ....... log = getLog(request) channel.publish(None,‘log-queue’,None,log) def onLog(log): if log.type == ‘login’: # balabala if log.type == ‘logout’: # balabala log.save()
- 17. Step1. work with Queue ....... log = getLog(request) channel.publish(None,‘log-queue’,None,log) def onLog(log): if log.type == ‘login’: yep. performance better now # balabala but. that if log.type == ‘logout’: codes still smell bad~~ # balabala log.save()
- 18. step2. Split Queues login logout
- 19. step2. Split Queues ....... log = getLog(request) channel.publish(None,log.type,None,log) login logout
- 20. step2. Split Queues ....... def onLog(loginlog): log = getLog(request) # balabala channel.publish(None,log.type,None,log) loginlog.save() login logout
- 21. step2. Split Queues ....... def onLog(loginlog): log = getLog(request) # balabala channel.publish(None,log.type,None,log) loginlog.save() login logout def onLog(logoutlog): # balabala logoutlog.save()
- 22. step2. Split Queues ....... def onLog(loginlog): log = getLog(request) # balabala channel.publish(None,log.type,None,log) loginlog.save() login logout def onLog(logoutlog): # balabala What’s that guy? logoutlog.save()
- 23. Say hi to Exchange
- 24. Direct Exchange
- 25. Fanout Exchange
- 26. Topic Exchange
- 27. step3. Share message c# x login c1 P x c2 logout
- 28. step3. Share message ....... log = getLog(request) channel.exchange_declare(log.type,‘fanout’) channel.publish(log.type,’’,None,log) c# x login c1 P x c2 logout
- 29. step3. Share message ....... log = getLog(request) def onLog(loginlog): channel.exchange_declare(log.type,‘fanout’) # balabala channel.publish(log.type,’’,None,log) loginlog.save() c# x login c1 P x c2 logout
- 30. step3. Share message ....... log = getLog(request) def onLog(loginlog): channel.exchange_declare(log.type,‘fanout’) # balabala channel.publish(log.type,’’,None,log) loginlog.save() c# x login c1 P x c2 logout def onLog(logoutlog): # balabala logoutlog.save()
- 31. Performance test non-persist-mode 100000 msg en-queue de-queue 10,000/s 7,500/s 5,000/s 2,500/s 0/s 128 512 1024 3072 10240
- 32. Performance tune Parameters for multiple consumer toning: QOS consumer count autoAck?
- 33. clustering to scale Start rabbit nodes: rabbit1$ rabbitmq-server rabbit2$ rabbitmq-server
- 34. clustering to scale create cluster: rabbit2$ rabbitmqctl stop_app Stopping node rabbit@rabbit2 ...done. rabbit2$ rabbitmqctl reset Resetting node rabbit@rabbit2 ...done. rabbit2$ rabbitmqctl cluster rabbit@rabbit1 Clustering node rabbit@rabbit2 with [rabbit@rabbit1] ...done. rabbit2$ rabbitmqctl start_app Starting node rabbit@rabbit2 ...done.
- 35. clustering to scale Check it out: rabbit1$ rabbitmqctl status Status of node rabbit@rabbit1 ... [..., {nodes,[{disc,[rabbit@rabbit1]},{ram,[rabbit@rabbit2]}]}, {running_nodes,[rabbit@rabbit2,rabbit@rabbit1]}] ...done.
- 36. Highly Available
- 37. discuss ......