I/O virtualization with InfiniBand and 40 Gigabit Ethernet
4 likes3,345 views
This document discusses I/O virtualization using InfiniBand and 40 Gigabit Ethernet. It covers technologies like RDMA, VPI, IPoIB, iSER and SRP that improve performance, CPU utilization, bandwidth and latency. Mellanox provides software solutions for RDMA storage and networking that integrate with VMware vSphere. Performance results show significant improvements in VM migration times, IOPS and bandwidth when using Mellanox's 40GbE adapters compared to 10GbE.
![© 2013 Mellanox Technologies 10
Multiple VM Migration Acceleration
Enabling Concurrent Migration of More VMs over 40GigE
vMotion Average Migration Duration
Duration[mm:ss]
# VM
Multiple VM Migration with VMware vMotion over
10/40GigE NIC I/O Controller](https://image.slidesharecdn.com/40geforvmworld13ali-131002120812-phpapp01/85/I-O-virtualization-with-InfiniBand-and-40-Gigabit-Ethernet-10-320.jpg)
I/O virtualization with InfiniBand and 40 Gigabit Ethernet
- 1. I/O virtualization with InfiniBand and 40 Gigabit Ethernet Ali Ayoub – Staff Architect VMworld 2013 San Francisco
- 2. © 2013 Mellanox Technologies 2 Remote Direct Memory Access What is RDMA? RDMA Engine Ethernet (RoCE) InfiniBand
- 3. © 2013 Mellanox Technologies 3 Virtual Protocol Interconnect Technology VPI Eth InfiniBand What is VPI?
- 4. © 2013 Mellanox Technologies 4 IPoIB iSER/SRP iSER • 10GigE • 40GigE VPI Eth InfiniBand InfiniBand Ethernet Mellanox Software Solutions
- 5. © 2013 Mellanox Technologies 5 Mellanox Software Solutions RDMA VPI TCP/IP 10GigE 40GigE iSCSI NFS NFS SRP iSER IPoIB TCP/IP Storage Solutions RDMA Storage Solutions Network Solutions Ethernet InfiniBand
- 6. © 2013 Mellanox Technologies 6 Mellanox Software Solutions 10GigE 40GigE IPoIB SRP iSER iSCSI NFS NFS RDMA Storage Solutions TCP/IP Storage Solutions Network Solutions CPU Utilization Bandwidth Latency Consolidation Performance More Virtual Machine
- 7. © 2013 Mellanox Technologies 7 Mellanox Software Solutions 10GigE 40GigE IPoIB SRP iSER RDMA Storage Solutions Network Solutions vSphere 5.5 In-box Part of ESX Distribution Downloadable from vmware.com vSphere 5.5 PVSP Partner Verified and Supported Products Downloadable from mellanox.com
- 8. © 2013 Mellanox Technologies 8 40GigE Performance Results 36Gbps I/O Bandwidth on vSphere 5.x !
- 9. © 2013 Mellanox Technologies 9 Single VM Migration Acceleration 0.00 5.00 10.00 15.00 20.00 Time(sec) Migration of Passive VM* 10GE 40GE 0.00 10.00 20.00 30.00 40.00 50.00 Time(sec) Migration of Active VM* 10GE C 40GE C >200% 2X to 3X Faster Execution Time over 40GigE >350% One VM Migration with VMware vMotion over 10/40GigE NIC I/O Controller * 16GB Memory
- 10. © 2013 Mellanox Technologies 10 Multiple VM Migration Acceleration Enabling Concurrent Migration of More VMs over 40GigE vMotion Average Migration Duration Duration[mm:ss] # VM Multiple VM Migration with VMware vMotion over 10/40GigE NIC I/O Controller
- 11. © 2013 Mellanox Technologies 11 iSER Performance Results 190 IOPS on vSphere 5 174 176 178 180 182 184 186 188 190 192 2 4 6 8 #VMs/LUNs (LUN per VM) IOPS 35.2 35.3 35.4 35.5 35.6 35.7 35.8 35.9 36 36.1 2 4 6 8 #VMs/LUNs (LUN per VM) Bandwidth (Gbps)
- 12. © 2013 Mellanox Technologies 12 SRIOV
- 13. © 2013 Mellanox Technologies 13 IPoIB
- 14. © 2013 Mellanox Technologies 14 iSER/SRP
- 15. © 2013 Mellanox Technologies 15 Leading Supplier of End-to-End Interconnect Solutions Virtual Protocol Interconnect Storage Front / Back-End Server / Compute Switch / Gateway 56G IB & FCoIB 56G InfiniBand 10/40/56GbE & FCoE 10/40/56GbE Virtual Protocol Interconnect Host/Fabric SoftwareICs Switches/GatewaysAdapter Cards Cables Comprehensive End-to-End InfiniBand and Ethernet Portfolio
- 16. © 2013 Mellanox Technologies Mellanox 40GbE In-Box with VMware vSphere 5.5
- 17. © 2013 Mellanox Technologies