How to measure your dataflow using fio, pktgen and bandwidthTest
2 likes199 views
The document provides a detailed guide on measuring data flow using tools like fio, dpdk-pktgen, and bandwidthtest, along with instructions for setup and configuration. It includes specific performance metrics for various hardware configurations, such as write and read speeds for RAM disks and devices. The guide is aimed at optimizing data flow measurements in high-performance computing environments.
How to measure your dataflow using fio, pktgen and bandwidthTest
- 1. How to measure your dataflow using fio, dpdk-pktgen and bandwidthTest 2018/04/12 SAKURA Internet, Inc. Research Center SR / Naoto MATSUMOTO (C) Copyright 1996-2018 SAKURA Internet Inc
- 2. How to measure your dataflow using fio, pktgen and bandwidthTest 2 WRITE: 12,648MB/s (bs=256KB) READ: 13,793MB/s (bs=256KB) RAMDISK DDR4 2133MHz 16GB x4 40Mpps (pkt=64B) 2,560MB/s 40GbE (max rate) 5,000MB/s Mellanox Connect X-4 Intel(R) Core(TM) i7-7800X CPU @ 3.50GHz WRITE: 12,648MB/s (bs=256KB) READ: 13,793MB/s (bs=256KB) RAMDISK DDR4 2133MHz 16GB x4 Intel(R) Core(TM) i7-7800X CPU @ 3.50GHz # cd /opt # git clone git://dpdk.org/dpdk # git clone git://dpdk.org/apps/pktgen-dpdk export RTE_SDK=/opt/dpdk export RTE_TARGET=x86_64-native-linuxapp-gcc # sysctl vm.nr_hugepages=2048 # cd /opt/dpdk # make install T=x86_64-native-linuxapp-gcc # /opt/dpdk/usertools/dpdk-devbind.py -u 0b:00.0 # /opt/dpdk/usertools/dpdk-devbind.py -u 13:00.0 # /opt/dpdk/usertools/dpdk-devbind.py -b igb_uio 0b:00.0 # /opt/dpdk/usertools/dpdk-devbind.py -b igb_uio 13:00.0 # /opt/dpdk/usertools/dpdk-devbind.py --status # cd /opt/pktgen-dpdk/ # make # /opt/pktgen-dpdk/tools/setup.sh # /opt/pktgen-dpdk/app/x86_64-native-linuxapp-gcc/pktgen -- -m "1.0, 2.1" Intel(R) Core(TM) i7-7800X CPU @ 3.50GHz Host to Device: 6,029MB/s Device to Host: 6,448MB/s GeForce GTX 1050 WRITE: 2,000MB/s (bs=4KB) READ: 2,500MB/s (bs=4KB) IntelOpate 900P (3DXP) WRITE: 2,000MB/s (bs=4KB) READ: 2,500MB/s (bs=4KB) IntelOpate 900P (3DXP) # mount -t tmpfs -o size=32G tmpfs /ramdisk # fio --directory=/ramdisk --rw=write --bs=4k --size=1G --numjobs=3 --runtime=100 --group_reporting --name=data # bash cuda_9.1.85_387.26_linux.run --silent --toolkit --override --no-opengl-libs --driver : # cd NVIDIA_CUDA-9.1_Samples/1_Utilities/bandwidthTest # ./bandwidthTest