Twemproxy flow
12 likes4,393 views
Twemproxy is a high performance proxy for Memcache and Redis. It was created by Twitter and uses memory pools and chained buffers (mbuf) to avoid data copying, allowing requests and responses to be forwarded very efficiently. It has separate receive and send loops for clients and servers that use these techniques to maximize throughput.
![mbuf
struct iovec array[]
array[0].iov_base Mbuf->pos
array[0].iov_len mlen
array[n].iov_base Mbuf->pos
array[n].iov_len mlen](https://image.slidesharecdn.com/twemproxyflow-121213152557-phpapp01/85/Twemproxy-flow-10-320.jpg)
Twemproxy flow
- 1. Twemproxy Flow charsyam@naver.com
- 2. Twemproxy • Server Side Proxy For Memcache, Redis • Made by Twitter. • Github.com/twitter/twemproxy
- 3. Recv Loop(common) core_loop core_core core_recv msg_recv
- 5. Send Loop(common) core_loop core_core core_send msg_send
- 7. Message • Using Memory Pool • Using mbuf
- 8. Message-req_get req_get rsp_get msg_get _msg_get Processing …… req_put rsp_put
- 9. mbuf • Using chained buffer • Using sendv, writev
- 10. mbuf struct iovec array[] array[0].iov_base Mbuf->pos array[0].iov_len mlen array[n].iov_base Mbuf->pos array[n].iov_len mlen
- 11. mbuf
- 12. Why is Twemproxy Fast? • Using mbuf and avoiding buffer copy. – Just forward packet.
- 13. Thank you