Lets talk about QoS by Megis.pdf
- 1. © MikroTik 2011 MikroTik RouterOS Workshop Lets talk about QoS Las Vegas MUM USA 2011
- 2. © MikroTik 2011 2 About Me Jānis Meģis, MikroTik Jānis (Tehnical, Trainer, NOT Sales) Support & Training Engineer for almost 7 years Specialization: QoS, PPP, Firewall, Routing Teaching MikroTik RouterOS classes since 2005
- 3. © MikroTik 2011 3 Workshop Plan Packet Flow Diagram HTB Queue Types (PCQ, multi-queue-fifo) Burst Queue Size Queue tree and Simple queues
- 4. © MikroTik 2011 4 Packet Flow Diagram
- 5. © MikroTik 2011 5 Packet Flow Diagram Packet flow diagram is “The Big Picture” of RouterOS It is impossible to properly manage and maintain complex configurations without the knowledge - what happens when and why? Packet flow Diagram consist of 2 parts Bridging or Layer-2 (MAC) where Routing part is simplified to one "Layer-3" box Routing or Layer-3 (IP) where Bridging part is simplified to one "Bridging" box
- 6. © MikroTik 2011 6 Bridging or Layer-2 (MAC)
- 7. © MikroTik 2011 7 Routing or Layer-3 (IP)
- 8. © MikroTik 2011 8 Diagram Abbreviations
- 9. © MikroTik 2011 9 Simple Routing
- 10. © MikroTik 2011 10 Bridging with IP firewall
- 11. © MikroTik 2011 11 Bridge-to-Bridge Routing (part1)
- 12. © MikroTik 2011 12 Bridge-to-Bridge Routing (part2)
- 13. © MikroTik 2011 13 IPSec Encryption
- 14. © MikroTik 2011 14 IPSec Decryption
- 15. © MikroTik 2011 15 Hierarchical Token Bucket
- 16. © MikroTik 2011 16 Lets Simplify! QoS Packet Flow Diagram
- 17. © MikroTik 2011 17 Global-Out or Interface HTB? There are two fundamental differences In case of SRC-NAT (masquerade) Global-Out will be aware of private client addresses, but Interface HTB will not – Interface HTB is after SRC-NAT Each Interface HTB only receives traffic that will be leaving through a particular interface – there is no need for to separate upload and download in mangle
- 18. © MikroTik 2011 18 Mangle The mangle facility allows you to mark IP packets with special marks. These marks are used by other router facilities like routing and bandwidth management to identify the packets. Additionally, the mangle facility is used to modify some fields in the IP header, like TOS (DSCP) and TTL fields.
- 19. © MikroTik 2011 19 Hierarchical Token Bucket All bandwidth management implementation in RouterOS is based on Hierarchical Token Bucket (HTB) HTB allows you to create hierarchical queue structure and determine relations between queues RouterOS supports 3 virtual HTBs (global-in, global-total, global-out) and one more just before every output interface
- 20. © MikroTik 2011 20 HTB (cont.) When packet travels through the router, it passes all 4 HTB trees When packet travels to the router, it passes only global-in and global-total HTB. When packet travels from the router, it passes global-out, global-total and interface HTB.
- 21. © MikroTik 2011 21 HTB Features - Structure As soon as queue have at least one child it become parent queue All child queues (don't matter how many levels of parents they have) are on the same bottom level of HTB Child queues make actual traffic consumption, parent queues are responsible only for traffic distribution Child queues will get limit-at first and then rest of the traffic will distributed by parents
- 22. © MikroTik 2011 22 HTB Features - Structure
- 23. © MikroTik 2011 23 HTB Features – Dual Limitation HTB has two rate limits: CIR (Committed Information Rate) – (limit-at in RouterOS) worst case scenario, flow will get this amount of traffic no matter what (assuming we can actually send so much data) MIR (Maximal Information Rate) – (max-limit in RouterOS) best case scenario, rate that flow can get up to, if there queue's parent has spare bandwidth At first HTB will try to satisfy every child queue's limit-at – only then it will try to reach max-limit
- 24. © MikroTik 2011 24 Dual Limitation Maximal rate of the parent should be equal or bigger than sum of committed rates of the children MIR (parent) ≥ CIR(child1) +...+ CIR(childN) Maximal rate of any child should be less or equal to maximal rate of the parent MIR (parent) ≥ MIR(child1) MIR (parent) ≥ MIR(child2) MIR (parent) ≥ MIR(childN)
- 25. © MikroTik 2011 25 HTB - limit-at
- 26. © MikroTik 2011 26 HTB - max-limit
- 27. © MikroTik 2011 27 HTB Features - Priority Work only for child queues to arrange them 8 is the lowest priority, 1 is the highest Queue with higher priority will get chance to satisfy its max-limit before other queues Actual traffic prioritization will work only if limits are specified. Queue without limits will not prioritize anything
- 28. © MikroTik 2011 28 QoS Myth buster HTB priority doesn't rearrange packet sequence – it doesn't put some packets before others In HTB “Priority” is an option that helps to decide what packets will pass and what packets will be dropped This drop decision is based on limitations, so if there are no limits there are no need to drop anything, so priority have no effect Priority doesn't affect CIR traffic – it just passes through QoS (even if parent's don't have such amount of traffic)
- 29. © MikroTik 2011 29 HTB – limit-at of the Parent
- 30. © MikroTik 2011 30 HTB – limit-at > parent's max-limit
- 31. © MikroTik 2011 31 QoS Myth Buster QoS can't control the amount of received traffic that you see on your interfaces. In Packet Flow diagram global-in is way after Input interface where statistic is registered Effect of traffic slowing down most probably is effect of TCP protocol behaviour If clients PC was able to send out traffic it have to arrive somewhere it can't just disappear Only way to see QoS in action is to monitor TX of opposite interface.
- 32. © MikroTik 2011 32 QoS Myth Buster QoS doesn't know how much actual bandwidth is available In Packet Flow diagram all HTB are before output interface and output interfaces driver is the first one that might know how much actual bandwidth you have. Interface driver knows the maximal hardware limitation of your interface, IF actual limitation is smaller, the only way to provide QoS with limitation information is to specify all limits yourself
- 33. © MikroTik 2011 33 Queue Types
- 34. © MikroTik 2011 34 Default Queue Types
- 35. © MikroTik 2011 35 FIFO Behaviour: What comes in first is handled first, what comes in next waits until the first is finished. Number of waiting units (Packets or Bytes) is limited by “queue size” option. If queue “is full” next units are dropped
- 36. © MikroTik 2011 36
- 37. © MikroTik 2011 37
- 38. © MikroTik 2011 38 MQ PFIFO Multi queue packet FIFO queue was designed multi-core router solutions (RB1100AHx2) MQ PFIFO should be used as default interface queue for any Ethernets that have several RX/TX queues (you can check that in /system resources IRQ menu) MQ FIFO is alternative to RPS (receive Packet Steering) – so do not use both on same interface it will result in performance loss.
- 39. © MikroTik 2011 39 RED Behaviour: Same as FIFO with an additional feature – additional drop probability even if queue is not full. This probability is based on comparison of average queue length over some period of time to minimal and maximal threshold – closer to maximal threshold the bigger the chance of a drop.
- 40. © MikroTik 2011 40
- 41. © MikroTik 2011 41 SFQ Behaviour: Based on a hash value from the source and destination address SFQ divides the traffic into 1024 sub-streams Then the Round Robin algorithm will distribute an equal amount of traffic to each sub- stream
- 42. © MikroTik 2011 42
- 43. © MikroTik 2011 43 SFQ Example SFQ should be used for equalizing similar connections Usually used to manage information flow to or from the servers, so it can offer services to every customer Ideal for p2p limitation, it is possible to place strict limitation without dropping connections,
- 44. © MikroTik 2011 44 PCQ PCQ was introduced to optimize massive QoS systems, where most of the queues are exactly the same for different sub-streams Starting from version 5.0rc5 PCQ have burst support and IPv6 support
- 45. © MikroTik 2011 45 PCQ Classification (1)
- 46. © MikroTik 2011 46 PCQ Classification (2)
- 47. © MikroTik 2011 47
- 48. © MikroTik 2011 48 PCQ Rate (1)
- 49. © MikroTik 2011 49 PCQ Rate (2)
- 50. © MikroTik 2011 50 Burst
- 51. © MikroTik 2011 51 QoS Feature “Burst” Burst is one of the best ways to increase HTTP performance Bursts are used to allow higher data rates for a short period of time If an average data rate is less than burst- threshold, burst could be used( actual data rate can reach burst-limit) Average data rate is calculated from the last burst-time seconds
- 52. © MikroTik 2011 52 Burst - Average Data Rate Average data rate is calculated as follows: burst-time is being divided into 16 periods router calculates the average data rate of each class over these small periods Note, that the actual burst period is not equal to the burst-time. It can be several times shorter than the burst-time depending on the max-limit, burst-limit, burst-threshold, and actual data rate history (see the graph example on the next slide)
- 53. © MikroTik 2011 53 Burst
- 54. © MikroTik 2011 54 Burst (Part 2)
- 55. © MikroTik 2011 55 Queue Size
- 56. © MikroTik 2011 56 Queue Size Queue size has a direct impact on the performance of the queue – it is a choice between packet loss and higher latency In RouterOS queue sizes are common between the queue types To understand Queue size's impact on the traffic we will look at simplified example We will ignore packet retransmits We will assume that process that run continuously can be divided into steps
- 57. © MikroTik 2011 57 There are 25 steps and there are total of 1610 incoming packets over this time frame.
- 58. © MikroTik 2011 58 With this type of limitation only 1250 out of 1610 packets were able to pass the queue (22,4% packet drop), but all packets arrive without delay.
- 59. © MikroTik 2011 59 There was no packet loss, but 630 (39,1%) packets had 1 step delay, and other 170 (10,6%) packets had 2 step delay. (delay = latency)
- 60. © MikroTik 2011 60 There were 320 (19,9%) packets dropped and 80 (5,0%) packets had 1 step delay.
- 61. © MikroTik 2011 61 There were 190 (11,8%) packets dropped and 400 (24,8%) packets had 1 step delay.
- 62. © MikroTik 2011 62 Simple Queues Simple queues are ordered - similar to firewall rules In order to get to 999th queue packet will have to be checked for match to all 998 previous queues Each simple queue might stand for 3 separate queues: One in Global-in (“direct” part) One in Global-out (“reverse” part) One in Global-total (“total” part)
- 63. © MikroTik 2011 63 Simple Queues and Mangle
- 64. © MikroTik 2011 64 Queue Tree Tree queue is one directional only and can be placed in any of the available HTBs Queue Tree queues don't have any order – all traffic is processed simultaneously All child queues must have packet marks from “/ip firewall mangle” facility assigned to them If placed in the same HTB, Simple queue will take all the traffic away from the Queue Tree queue
- 65. © MikroTik 2011 65 Queue Tree – Winbox View
- 66. © MikroTik 2011 66 Simple Queue and Queue Tree (Vegas Style) demonstration
- 67. © MikroTik 2011 67 Good luck!