Menu

#283 enable histogram latency reporting for isochronous workloads, add working load support too

1.0
pending
None
2023-11-28
2023-11-27
Greg White
No

Many latency sensitive applications are isochronous, some of these are constant bitrate. A useful (and commonly done) test is to generate isochronous, constant packet size, traffic in order to measure latency (e.g. pheist's iRTT test). This test is sometimes done in the presence of other workloads (e.g. multiple TCP connections) in order to test latency under load.
The bounceback test is a poor substitute when latency variability is high, since it makes more measurements when the latency is low and fewer measurements when the latency is high, thus biasing the resulting statistics toward the lower latency measurements.

Discussion

  • Robert McMahon

    Robert McMahon - 2023-11-27
    • assigned_to: Robert McMahon
     
  • Robert McMahon

    Robert McMahon - 2023-11-27

    Here is a run with UDP. Use --histograms on the server side. The T8 PDF is packets and F8 is frames. No working-load on this run. One can use the --ipg option too if that's needed between the 20 packet sends.

    root@rpi5-35:~# iperf -v
    iperf version 2.1.n (17 November 2023) pthreads
    
    
    root@rpi5-34:~# iperf -s -u -i 1 -e --histograms
    ------------------------------------------------------------
    Server listening on UDP port 5001 with pid 7696
    Read buffer size: 1470 Byte 
    Enabled receive histograms bin-width=0.100 ms, bins=100000 (clients should use --trip-times)
    UDP buffer size:  208 KByte (default)
    ------------------------------------------------------------
    [  1] local 192.168.1.34%eth0 port 5001 connected with 192.168.1.35 port 52304 (isoch) (trip-times) (sock=3) (peer 2.1.10-dev) on 2023-11-27 14:54:15.815 (PST)
    [ ID] Interval        Transfer     Bandwidth        Jitter   Lost/Total Latency avg/min/max/stdev  PPS  Frame:rx/lost  Frame-latency avg/min/max/stdev  NetPwr
    [  1] 0.00-1.00 sec  1.68 MBytes  14.1 Mbits/sec   0.012 ms 0/1201 (0%) 0.129/0.065/0.545/0.057 ms 1221 pps   61 / 0 0.286/0.278/0.595/0.041 ms 13687
    [  1] 0.00-1.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:269,2:911,5:9,6:11 (5.00/95.00/99.7%=1/2/6,Outliers=11,obl/obu=0/0) (0.545 ms/1701125655.816423)
    [  1] 0.00-1.00 sec F8-PDF: bin(w=100us):cnt(60)=3:58,4:1,6:1 (5.00/95.00/99.7%=3/3/6,Outliers=0,obl/obu=0/0) (0.595 ms/1701125655.816473)
    [  1] 1.00-2.00 sec  1.68 MBytes  14.1 Mbits/sec   0.011 ms 0/1200 (0%) 0.123/0.066/0.179/0.029 ms 1200 pps   60 / 0 0.283/0.277/0.595/0.029 ms 14298
    [  1] 1.00-2.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:253,2:947 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.179 ms/1701125657.682750)
    [  1] 1.00-2.00 sec F8-PDF: bin(w=100us):cnt(60)=3:60 (5.00/95.00/99.7%=3/3/3,Outliers=0,obl/obu=0/0) (0.287 ms/1701125656.832791)
    [  1] 2.00-3.00 sec  1.68 MBytes  14.1 Mbits/sec   0.012 ms 0/1200 (0%) 0.124/0.071/0.179/0.029 ms 1200 pps   60 / 0 0.282/0.277/0.595/0.024 ms 14231
    [  1] 2.00-3.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:251,2:949 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.179 ms/1701125658.549381)
    [  1] 2.00-3.00 sec F8-PDF: bin(w=100us):cnt(60)=3:60 (5.00/95.00/99.7%=3/3/3,Outliers=0,obl/obu=0/0) (0.288 ms/1701125657.832752)
    [  1] 3.00-4.00 sec  1.68 MBytes  14.1 Mbits/sec   0.012 ms 0/1200 (0%) 0.124/0.071/0.179/0.029 ms 1200 pps   60 / 0 0.282/0.277/0.595/0.021 ms 14210
    [  1] 3.00-4.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:252,2:948 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.179 ms/1701125658.882702)
    [  1] 3.00-4.00 sec F8-PDF: bin(w=100us):cnt(60)=3:60 (5.00/95.00/99.7%=3/3/3,Outliers=0,obl/obu=0/0) (0.292 ms/1701125658.832716)
    [  1] 4.00-5.00 sec  1.68 MBytes  14.1 Mbits/sec   0.012 ms 0/1200 (0%) 0.124/0.069/0.180/0.030 ms 1200 pps   60 / 0 0.282/0.277/0.595/0.019 ms 14186
    [  1] 4.00-5.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:254,2:946 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.180 ms/1701125660.149318)
    [  1] 4.00-5.00 sec F8-PDF: bin(w=100us):cnt(60)=3:60 (5.00/95.00/99.7%=3/3/3,Outliers=0,obl/obu=0/0) (0.289 ms/1701125659.932669)
    [  1] 5.00-6.00 sec  1.68 MBytes  14.1 Mbits/sec   0.011 ms 0/1200 (0%) 0.123/0.065/0.188/0.028 ms 1200 pps   60 / 0 0.282/0.277/0.595/0.017 ms 14377
    [  1] 5.00-6.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:259,2:941 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.188 ms/1701125660.915963)
    [  1] 5.00-6.00 sec F8-PDF: bin(w=100us):cnt(60)=3:60 (5.00/95.00/99.7%=3/3/3,Outliers=0,obl/obu=0/0) (0.292 ms/1701125660.982630)
    [  1] 6.00-7.00 sec  1.68 MBytes  14.1 Mbits/sec   0.012 ms 0/1200 (0%) 0.123/0.071/0.188/0.028 ms 1200 pps   60 / 0 0.282/0.277/0.595/0.016 ms 14308
    [  1] 6.00-7.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:262,2:938 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.188 ms/1701125661.915924)
    [  1] 6.00-7.00 sec F8-PDF: bin(w=100us):cnt(60)=3:60 (5.00/95.00/99.7%=3/3/3,Outliers=0,obl/obu=0/0) (0.293 ms/1701125661.849263)
    [  1] 7.00-8.00 sec  1.68 MBytes  14.1 Mbits/sec   0.012 ms 0/1200 (0%) 0.125/0.071/0.180/0.029 ms 1200 pps   60 / 0 0.282/0.277/0.595/0.015 ms 14103
    [  1] 7.00-8.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:243,2:957 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.180 ms/1701125663.249195)
    [  1] 7.00-8.00 sec F8-PDF: bin(w=100us):cnt(60)=3:60 (5.00/95.00/99.7%=3/3/3,Outliers=0,obl/obu=0/0) (0.293 ms/1701125663.115879)
    [  1] 8.00-9.00 sec  1.68 MBytes  14.1 Mbits/sec   0.011 ms 0/1200 (0%) 0.124/0.070/0.189/0.028 ms 1200 pps   60 / 0 0.282/0.277/0.595/0.014 ms 14280
    [  1] 8.00-9.00 sec T8-PDF: bin(w=100us):cnt(1200)=1:257,2:943 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.189 ms/1701125664.165833)
    [  1] 8.00-9.00 sec F8-PDF: bin(w=100us):cnt(60)=3:60 (5.00/95.00/99.7%=3/3/3,Outliers=0,obl/obu=0/0) (0.294 ms/1701125663.849184)
    [  1] 9.00-10.00 sec  1.69 MBytes  14.2 Mbits/sec   0.010 ms 0/1206 (0%) 0.123/0.070/0.190/0.028 ms 1186 pps   60 / 0 0.282/0.276/0.595/0.013 ms 14384
    [  1] 9.00-10.00 sec T8-PDF: bin(w=100us):cnt(1206)=1:264,2:942 (5.00/95.00/99.7%=1/2/2,Outliers=0,obl/obu=0/0) (0.190 ms/1701125665.132462)
    [  1] 9.00-10.00 sec F8-PDF: bin(w=100us):cnt(60)=3:59,4:1 (5.00/95.00/99.7%=3/3/4,Outliers=0,obl/obu=0/0) (0.309 ms/1701125664.982487)
    [  1] 0.00-10.02 sec  16.9 MBytes  14.1 Mbits/sec   0.012 ms 0/12023 (0%) 0.124/0.065/0.545/0.033 ms 1200 pps  602 / 0 0.282/0.276/0.595/0.013 ms 14198
    [  1] 0.00-10.02 sec T8(f)-PDF: bin(w=100us):cnt(12022)=1:2565,2:9437,5:9,6:11 (5.00/95.00/99.7%=1/2/2,Outliers=11,obl/obu=0/0) (0.545 ms/1701125655.816423)
    [  1] 0.00-10.02 sec F8(f)-PDF: bin(w=100us):cnt(601)=3:598,4:2,6:1 (5.00/95.00/99.7%=3/3/4,Outliers=0,obl/obu=0/0) (0.595 ms/1701125655.816473)
    
    root@rpi5-35:~# iperf -c 192.168.1.34 -i 1 -e --trip-times --isochronous=60:20pps -u
    ------------------------------------------------------------
    Client connecting to 192.168.1.34, UDP port 5001 with pid 7490 (1/0 flows/load)
    Isochronous: 60.00 frames/sec mean=14.1 Mbit/s, stddev=0.000 bit/s, Period/IPG=16.67/0.000 ms
    TOS set to 0x0 (Nagle on)
    UDP buffer size:  208 KByte (default)
    ------------------------------------------------------------
    [  1] local 192.168.1.35%eth0 port 43705 connected with 192.168.1.34 port 5001 (isoch) (trip-times) (sock=3) on 2023-11-27 14:53:35.598 (PST)
    [ ID] Interval        Transfer     Bandwidth      Write/Err  PPS  isoch:tx/miss/slip
    [  1] 0.00-1.00 sec  1.68 MBytes  14.1 Mbits/sec  1200/0    1221 pps   61/0/0
    [  1] 1.00-2.00 sec  1.68 MBytes  14.1 Mbits/sec  1201/0    1182 pps   60/0/0
    [  1] 2.00-3.00 sec  1.69 MBytes  14.2 Mbits/sec  1207/0    1207 pps   60/0/0
    [  1] 3.00-4.00 sec  1.69 MBytes  14.2 Mbits/sec  1206/0    1206 pps   60/0/0
    [  1] 4.00-5.00 sec  1.69 MBytes  14.2 Mbits/sec  1206/0    1206 pps   61/0/0
    [  1] 5.00-6.00 sec  1.68 MBytes  14.1 Mbits/sec  1200/0    1200 pps   60/0/0
    [  1] 6.00-7.00 sec  1.68 MBytes  14.1 Mbits/sec  1200/0    1200 pps   60/0/0
    [  1] 7.00-8.00 sec  1.68 MBytes  14.1 Mbits/sec  1200/0    1200 pps   60/0/0
    [  1] 8.00-9.00 sec  1.68 MBytes  14.1 Mbits/sec  1200/0    1200 pps   60/0/0
    [  1] 9.00-10.00 sec  1.68 MBytes  14.1 Mbits/sec  1200/0    1200 pps   60/0/0
    [  1] 0.00-10.02 sec  16.9 MBytes  14.1 Mbits/sec  12022/0    1200 pps  602/0/0
    [  1] Sent 12024 datagrams
    [  1] Isoch schedule errors (mean/min/max/stdev) = 0.056/0.055/0.103/0.002 ms
    [  1] Server Report:
    [ ID] Interval        Transfer     Bandwidth        Jitter   Lost/Total  Latency avg/min/max/stdev PPS  Rx/inP  Read/Timeo/Trunc  NetPwr
    [  1] 0.00-10.02 sec  16.9 MBytes  14.1 Mbits/sec   0.012 ms 0/12023 (0%) 0.125/0.050/0.666/0.037 ms 1200 pps 1200/0(0) pkts 0/0/0 14098
    
     
  • Robert McMahon

    Robert McMahon - 2023-11-28

    TCP run w/o a working load

    root@rpi5-34:~# iperf -s -i 1 -e --histograms
    ------------------------------------------------------------
    Server listening on TCP port 5001 with pid 7717
    Read buffer size:  128 KByte (Dist bin width=16.0 KByte)
    TCP congestion control default cubic
    Enabled receive histograms bin-width=0.100 ms, bins=100000 (clients should use --trip-times)
    TCP window size:  128 KByte (default)
    ------------------------------------------------------------
    [  1] local 192.168.1.34%eth0 port 5001 connected with 192.168.1.35 port 40658 (isoch) (trip-times) (sock=4) (peer 2.1.10-dev) (icwnd/mss/irtt=14/1448/211) on 2023-11-27 14:59:53.530 (PST)
    [ ID] Interval        Transfer    Bandwidth    Burst Latency avg/min/max/stdev (cnt/size) NetPwr  Reads=Dist
    [  1] 0.00-1.00 sec  1.67 MBytes  14.0 Mbits/sec  0.319/0.304/0.552/0.033 ms (60/29167) 5487  219=218:1:0:0:0:0:0:0
    [  1] 0.00-1.00 sec F8-PDF: bin(w=100us):cnt(60)=4:59,6:1 (5.00/95.00/99.7%=4/4/6,Outliers=0,obl/obu=0/0) (0.552 ms/1701125993.531145)
    [  1] 1.00-2.00 sec  1.67 MBytes  14.0 Mbits/sec  0.311/0.304/0.340/0.005 ms (60/29166) 5633  232=232:0:0:0:0:0:0:0
    [  1] 1.00-2.00 sec F8-PDF: bin(w=100us):cnt(60)=4:60 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.340 ms/1701125994.530888)
    [  1] 2.00-3.00 sec  1.67 MBytes  14.0 Mbits/sec  0.309/0.303/0.318/0.003 ms (60/29166) 5655  229=229:0:0:0:0:0:0:0
    [  1] 2.00-3.00 sec F8-PDF: bin(w=100us):cnt(60)=4:60 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.318 ms/1701125995.614156)
    [  1] 3.00-4.00 sec  1.67 MBytes  14.0 Mbits/sec  0.309/0.303/0.321/0.004 ms (60/29166) 5665  233=233:0:0:0:0:0:0:0
    [  1] 3.00-4.00 sec F8-PDF: bin(w=100us):cnt(60)=4:60 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.321 ms/1701125997.347428)
    [  1] 4.00-5.00 sec  1.67 MBytes  14.0 Mbits/sec  0.309/0.302/0.317/0.003 ms (60/29166) 5658  228=228:0:0:0:0:0:0:0
    [  1] 4.00-5.00 sec F8-PDF: bin(w=100us):cnt(60)=4:60 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.317 ms/1701125997.564079)
    [  1] 5.00-6.00 sec  1.67 MBytes  14.0 Mbits/sec  0.308/0.296/0.319/0.004 ms (60/29166) 5674  328=328:0:0:0:0:0:0:0
    [  1] 5.00-6.00 sec F8-PDF: bin(w=100us):cnt(60)=3:1,4:59 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.319 ms/1701125998.580710)
    [  1] 6.00-7.00 sec  1.67 MBytes  14.0 Mbits/sec  0.311/0.299/0.350/0.010 ms (60/29166) 5623  389=389:0:0:0:0:0:0:0
    [  1] 6.00-7.00 sec F8-PDF: bin(w=100us):cnt(60)=3:1,4:59 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.350 ms/1701126000.264007)
    [  1] 7.00-8.00 sec  1.67 MBytes  14.0 Mbits/sec  0.311/0.298/0.349/0.010 ms (60/29166) 5633  385=385:0:0:0:0:0:0:0
    [  1] 7.00-8.00 sec F8-PDF: bin(w=100us):cnt(60)=3:2,4:58 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.349 ms/1701126001.380623)
    [  1] 8.00-9.00 sec  1.67 MBytes  14.0 Mbits/sec  0.310/0.299/0.357/0.009 ms (60/29166) 5645  384=384:0:0:0:0:0:0:0
    [  1] 8.00-9.00 sec F8-PDF: bin(w=100us):cnt(60)=3:2,4:58 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.357 ms/1701126002.297261)
    [  1] 9.00-10.00 sec  1.67 MBytes  14.0 Mbits/sec  0.310/0.300/0.351/0.009 ms (60/29166) 5646  389=389:0:0:0:0:0:0:0
    [  1] 9.00-10.00 sec F8-PDF: bin(w=100us):cnt(60)=4:60 (5.00/95.00/99.7%=4/4/4,Outliers=0,obl/obu=0/0) (0.351 ms/1701126003.113890)
    [  1] 0.00-10.02 sec  16.7 MBytes  14.0 Mbits/sec  0.311/0.296/0.552/0.013 ms (602/29166) 5641  3028=3027:1:0:0:0:0:0:0
    [  1] 0.00-10.02 sec F8(f)-PDF: bin(w=100us):cnt(602)=3:6,4:595,6:1 (5.00/95.00/99.7%=4/4/4,Outliers=1,obl/obu=0/0) (0.552 ms/1701125993.531145)
    
    
    root@rpi5-35:~# iperf -c 192.168.1.34 -i 1 -e --trip-times --isochronous=60:14m
    ------------------------------------------------------------
    Client connecting to 192.168.1.34, TCP port 5001 with pid 7512 (1/0 flows/load)
    Write buffer size: 131072 Byte
    Isochronous: 60.00 frames/sec mean=14.0 Mbit/s, stddev=0.000 bit/s, Period/IPG=16.67/0.000 ms
    TCP congestion control using cubic
    TOS set to 0x0 (Nagle on)
    TCP window size: 85.0 KByte (default)
    Event based writes (pending queue watermark at 16384 bytes)
    ------------------------------------------------------------
    [  1] local 192.168.1.35%eth0 port 40658 connected with 192.168.1.34 port 5001 (prefetch=16384) (isoch) (trip-times) (sock=3) (icwnd/mss/irtt=14/1448/216) (ct=0.27 ms) on 2023-11-27 14:59:53.529 (PST)
    [ ID] Interval        Transfer     Bandwidth      Write/Err  Rtry     Cwnd/RTT     isoch:tx/miss/slip  NetPwr
    [  1] 0.00-1.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/279 us         61/0/0 6273
    [  1] 1.00-2.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/277 us         60/0/0 6318
    [  1] 2.00-3.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/280 us         60/0/0 6250
    [  1] 3.00-4.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/277 us         60/0/0 6318
    [  1] 4.00-5.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/276 us         60/0/0 6340
    [  1] 5.00-6.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/259 us         60/0/0 6757
    [  1] 6.00-7.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/1056 us         60/0/0 1657
    [  1] 7.00-8.00 sec  1.70 MBytes  14.2 Mbits/sec  61/0        0       67K/254 us         61/0/0 7004
    [  1] 8.00-9.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/260 us         60/0/0 6731
    [  1] 9.00-10.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       67K/263 us         60/0/0 6654
    [  1] 0.00-10.02 sec  16.7 MBytes  14.0 Mbits/sec  602/0        0       67K/1185 us        603/0/0 1478
    [  1] Isoch schedule errors (mean/min/max/stdev) = 0.056/0.054/0.064/0.001 ms
    
     

    Last edit: Robert McMahon 2023-11-28
  • Robert McMahon

    Robert McMahon - 2023-11-28

    Code fix for working load with tcp. A UDP flow with a TCP requires the use of pyflows or requires a separate server.

     
  • Robert McMahon

    Robert McMahon - 2023-11-28

    Run with TCP and working loads

    root@raspberrypi:/usr/local/src/iperf2-code# iperf -v
    iperf version 2.1.n (27 November 2023) pthreads
    
    root@raspberrypi:/usr/local/src/iperf2-code# iperf -s -i 1 -e --histograms
    ------------------------------------------------------------
    Server listening on TCP port 5001 with pid 17999
    Read buffer size:  128 KByte (Dist bin width=16.0 KByte)
    TCP congestion control default cubic
    Enabled receive histograms bin-width=0.100 ms, bins=100000 (clients should use --trip-times)
    TCP window size:  128 KByte (default)
    ------------------------------------------------------------
    [  1] local 192.168.1.31%eth0 port 5001 connected with 192.168.1.30 port 47512 (trip-times) (sock=4) (peer 2.1.10-dev) (icwnd/mss/irtt=14/1448/1366) on 2023-11-27 17:10:25.973 (PST)
    [  2] local 192.168.1.31%eth0 port 5001 connected with 192.168.1.30 port 47498 (isoch) (trip-times) (sock=5) (peer 2.1.10-dev) (icwnd/mss/irtt=14/1448/1355) on 2023-11-27 17:10:25.976 (PST)
    [  3] local 192.168.1.31%eth0 port 5001 connected with 192.168.1.30 port 47522 (trip-times) (sock=6) (peer 2.1.10-dev) (icwnd/mss/irtt=14/1448/1337) on 2023-11-27 17:10:25.978 (PST)
    [  4] local 192.168.1.31%eth0 port 5001 connected with 192.168.1.30 port 47528 (trip-times) (sock=7) (peer 2.1.10-dev) (icwnd/mss/irtt=14/1448/1329) on 2023-11-27 17:10:25.980 (PST)
    [  5] local 192.168.1.31%eth0 port 5001 connected with 192.168.1.30 port 47540 (trip-times) (sock=8) (peer 2.1.10-dev) (icwnd/mss/irtt=14/1448/809) on 2023-11-27 17:10:25.982 (PST)
    [ ID] Interval        Transfer    Bandwidth    Burst Latency avg/min/max/stdev (cnt/size) inP NetPwr  Reads=Dist
    [  5] 0.00-1.00 sec  24.8 MBytes   208 Mbits/sec  14.532/5.937/53.355/6.742 ms (198/131433)  376 KByte 1791  12030=12016:4:1:2:1:0:1:5
    [  5] 0.00-1.00 sec F8-PDF: bin(w=100us):cnt(198)=60:2,61:1,63:1,66:1,67:1,69:1,73:1,75:1,76:2,77:2,78:2,79:3,80:1,83:2,85:1,86:1,87:1,89:2,90:3,91:2,92:4,93:2,94:4,96:3,97:1,98:1,99:2,101:3,102:2,103:2,106:2,109:5,110:4,111:2,114:1,115:5,117:1,118:1,119:2,120:2,121:3,122:2,123:2,125:1,127:3,128:5,129:1,130:2,132:2,134:1,135:1,136:1,137:2,138:3,140:3,141:1,142:3,144:1,147:1,149:1,150:2,151:1,152:2,153:2,154:1,155:2,156:2,157:1,158:2,160:2,162:1,163:3,164:2,165:2,167:3,168:1,169:1,170:1,171:1,174:3,176:2,177:1,178:1,179:1,180:2,181:1,183:1,186:3,188:1,191:1,194:1,197:1,199:1,200:1,201:1,211:1,213:1,217:1,221:1,222:2,225:1,232:1,238:1,241:1,243:2,251:1,252:1,254:1,263:1,270:1,273:1,290:1,299:1,306:1,309:1,386:1,531:1,534:1 (5.00/95.00/99.7%=76/263/534,Outliers=0,obl/obu=0/0) (53.355 ms/1701133826.653431)
    [  1] 0.00-1.00 sec  9.14 MBytes  76.7 Mbits/sec  24.649/3.007/58.112/13.470 ms (73/131251)  245 KByte 389  3968=3959:5:0:1:0:0:0:3
    [  1] 0.00-1.00 sec F8-PDF: bin(w=100us):cnt(73)=31:1,50:1,62:1,65:1,67:1,69:1,70:1,73:1,75:1,77:2,78:1,79:1,81:2,96:1,108:1,120:1,186:1,192:1,195:1,203:1,204:1,205:1,210:1,217:1,221:1,224:1,229:1,233:2,234:1,236:1,238:1,239:1,241:1,244:1,246:1,247:1,248:1,249:1,251:2,253:1,260:1,263:2,270:1,277:1,278:1,290:3,292:2,306:1,313:1,315:1,318:1,324:1,329:1,351:1,377:1,455:1,462:1,476:1,478:1,490:1,508:1,522:1,524:1,552:1,582:1 (5.00/95.00/99.7%=65/522/582,Outliers=0,obl/obu=0/0) (58.112 ms/1701133826.723063)
    [ ID] Interval        Transfer    Bandwidth    Burst Latency avg/min/max/stdev (cnt/size) NetPwr  Reads=Dist
    [  2] 0.00-1.00 sec  1.66 MBytes  14.0 Mbits/sec  19.746/3.856/33.521/8.824 ms (59/29556) 88.31  773=772:1:0:0:0:0:0:0
    [  2] 0.00-1.00 sec F8-PDF: bin(w=100us):cnt(59)=39:1,40:1,41:1,44:1,48:1,49:1,53:1,79:1,97:1,101:1,105:1,114:1,116:1,117:1,131:1,143:1,146:1,149:1,151:1,154:1,168:1,176:1,177:1,180:1,191:2,193:1,195:2,202:2,208:1,215:1,225:1,226:1,229:1,237:1,243:1,246:1,256:1,257:1,259:1,263:1,265:1,268:1,277:1,283:1,284:1,285:1,286:1,298:1,303:1,305:1,320:1,326:1,331:2,333:1,336:1 (5.00/95.00/99.7%=41/331/336,Outliers=0,obl/obu=0/0) (33.521 ms/1701133826.690573)
    [  3] 0.00-1.00 sec  67.5 MBytes   566 Mbits/sec  11.913/2.657/52.571/7.411 ms (540/131111)  835 KByte 5943  33020=32983:6:2:7:6:0:1:15
    [  3] 0.00-1.00 sec F8-PDF: bin(w=100us):cnt(540)=27:1,28:3,29:4,30:1,31:1,32:2,33:5,34:3,35:1,36:2,37:1,38:2,39:2,40:1,43:2,44:2,45:1,46:3,47:5,48:8,49:5,50:4,51:3,52:2,53:3,54:5,55:5,57:1,59:2,60:2,61:2,62:3,63:5,64:3,65:1,66:1,67:5,68:1,69:2,70:2,71:6,72:2,73:4,74:4,75:2,76:2,77:1,78:5,79:1,80:2,81:2,83:4,84:3,85:2,86:3,87:2,88:7,89:6,90:2,91:2,92:4,93:4,94:4,95:2,96:5,97:7,98:2,99:7,100:6,101:9,102:6,103:9,104:6,105:5,106:4,107:4,108:6,109:6,110:5,111:7,112:9,113:3,114:7,115:3,116:9,117:6,118:2,119:5,120:4,121:7,122:6,123:6,124:4,125:7,126:2,127:5,128:1,129:9,130:10,131:8,132:4,134:4,135:3,136:1,137:3,138:2,139:1,140:1,141:6,142:3,143:2,144:4,145:2,146:5,147:1,148:3,149:2,150:1,152:3,153:1,154:4,155:2,156:4,157:2,158:1,159:2,161:2,162:2,163:3,164:1,165:2,166:2,167:1,168:2,170:3,171:2,172:4,173:2,174:4,175:3,176:3,177:1,178:3,180:1,181:4,182:2,183:1,184:1,186:2,187:1,188:2,189:1,191:1,193:1,197:1,200:1,211:1,218:1,236:1,251:1,272:1,317:1,325:1,349:1,362:1,374:1,385:1,396:1,425:1,441:1,452:1,458:1,465:1,473:1,486:1,498:1,507:1,512:1,514:1,526:1 (5.00/95.00/99.7%=39/193/514,Outliers=0,obl/obu=0/0) (52.571 ms/1701133826.652299)
    [  4] 0.00-1.00 sec  5.10 MBytes  42.8 Mbits/sec  30.039/2.999/390.706/71.517 ms (40/133708)  225 KByte 178  1161=1126:31:1:0:1:0:0:2
    [  4] 0.00-1.00 sec F8-PDF: bin(w=100us):cnt(40)=30:1,31:2,32:2,33:1,34:3,35:2,36:2,37:1,40:2,41:3,43:2,45:2,49:1,55:1,59:1,61:1,119:1,319:2,365:1,415:1,431:1,448:1,452:1,515:1,560:1,625:1,2484:1,3908:1 (5.00/95.00/99.7%=31/2484/3908,Outliers=2,obl/obu=0/0) (390.706 ms/1701133826.58717)
    [SUM-cnt] Interval        Transfer    Bandwidth  InP  Reads=Dist
    [SUM-5] 0.00-1.00 sec   108 MBytes   908 Mbits/sec 1.64 MByte  50952=50856:47:4:10:8:0:2:25
    [  5] 1.00-2.00 sec  22.3 MBytes   187 Mbits/sec  19.344/14.498/25.503/2.274 ms (178/131092)  443 KByte 1206  11774=11774:0:0:0:0:0:0:0
    [  5] 1.00-2.00 sec F8-PDF: bin(w=100us):cnt(178)=145:1,153:1,155:1,161:1,163:1,165:1,166:2,167:1,168:3,169:4,170:3,172:3,173:2,174:4,175:4,176:7,177:6,178:4,179:6,180:3,181:4,182:2,183:1,184:4,185:5,186:5,187:4,188:5,189:7,190:10,191:4,192:3,193:1,194:3,195:3,196:4,197:1,199:1,200:1,201:1,202:2,203:1,204:1,205:1,207:2,208:1,209:3,211:1,212:1,214:2,215:1,216:2,217:1,218:1,220:1,221:2,222:2,223:1,226:2,228:1,230:1,231:1,232:3,233:1,235:4,236:1,237:1,238:1,239:2,243:1,247:4,252:1,256:1 (5.00/95.00/99.7%=167/239/256,Outliers=0,obl/obu=0/0) (25.503 ms/1701133827.683512)
    [  1] 1.00-2.00 sec  11.6 MBytes  97.3 Mbits/sec  25.001/17.080/52.165/3.610 ms (92/132236)  290 KByte 487  5967=5966:1:0:0:0:0:0:0
    [  1] 1.00-2.00 sec F8-PDF: bin(w=100us):cnt(92)=171:1,175:1,199:1,221:2,224:1,225:2,226:2,227:1,229:2,231:2,232:2,233:5,234:2,235:2,236:1,237:1,238:3,239:2,240:1,241:3,242:4,243:4,245:3,247:4,248:1,249:2,251:1,252:1,253:3,254:2,256:1,259:1,260:1,261:1,262:1,263:1,264:4,265:1,266:1,267:1,268:1,269:1,270:1,271:1,272:2,273:1,274:1,276:1,279:1,280:1,286:1,288:1,294:1,296:1,305:1,522:1 (5.00/95.00/99.7%=221/288/522,Outliers=1,obl/obu=0/0) (52.165 ms/1701133826.946242)
    [  3] 1.00-2.00 sec  67.2 MBytes   563 Mbits/sec  15.411/12.288/17.451/0.914 ms (537/131164) 1.04 MByte 4570  35445=35444:1:0:0:0:0:0:0
    [  3] 1.00-2.00 sec F8-PDF: bin(w=100us):cnt(537)=123:1,124:1,125:2,126:1,127:5,128:3,130:3,131:1,133:4,134:3,135:2,136:2,137:4,138:3,139:1,142:2,143:4,144:5,145:11,146:17,147:12,148:20,149:15,150:25,151:23,152:27,153:26,154:30,155:23,156:29,157:29,158:27,159:17,160:18,161:26,162:14,163:17,164:18,165:17,166:16,167:6,168:4,169:4,170:3,171:5,172:3,173:2,174:4,175:2 (5.00/95.00/99.7%=136/168/175,Outliers=0,obl/obu=0/0) (17.451 ms/1701133827.782852)
    [  4] 1.00-2.00 sec  6.40 MBytes  53.7 Mbits/sec  39.867/26.069/345.113/43.293 ms (52/129135)  206 KByte 168  3329=3328:1:0:0:0:0:0:0
    [  4] 1.00-2.00 sec F8-PDF: bin(w=100us):cnt(52)=261:1,281:1,284:1,286:1,291:1,295:1,302:1,306:1,313:2,314:1,316:1,325:1,326:1,327:3,328:1,332:1,333:1,334:3,335:1,337:2,340:2,341:1,343:1,344:1,345:1,346:3,352:1,354:1,356:1,359:1,360:1,361:1,362:1,363:1,375:1,377:2,386:1,387:1,391:1,395:1,463:1,3452:1 (5.00/95.00/99.7%=284/395/3452,Outliers=1,obl/obu=0/0) (345.113 ms/1701133826.689235)
    [  2] 1.00-2.00 sec  1.67 MBytes  14.0 Mbits/sec  25.765/14.450/31.023/5.059 ms (60/29262) 68.14  845=845:0:0:0:0:0:0:0
    [  2] 1.00-2.00 sec F8-PDF: bin(w=100us):cnt(60)=145:1,149:1,157:1,161:1,162:1,183:2,184:1,187:1,197:1,199:1,213:1,219:1,221:2,228:2,231:1,237:1,243:2,244:1,246:2,249:1,250:1,255:1,257:1,259:1,260:1,263:1,284:1,294:1,295:1,297:2,298:1,299:1,300:1,302:5,303:1,304:3,305:3,306:4,307:2,308:1,310:1,311:1 (5.00/95.00/99.7%=157/308/311,Outliers=0,obl/obu=0/0) (31.023 ms/1701133827.838030)
    [SUM-5] 1.00-2.00 sec   109 MBytes   915 Mbits/sec 1.96 MByte  57360=57357:3:0:0:0:0:0:0
    [  5] 2.00-3.00 sec  22.4 MBytes   188 Mbits/sec  20.832/16.098/29.494/2.585 ms (179/131226)  478 KByte 1128  11732=11731:1:0:0:0:0:0:0
    [  5] 2.00-3.00 sec F8-PDF: bin(w=100us):cnt(179)=161:1,163:1,167:1,169:2,170:2,172:2,173:1,174:1,175:1,177:2,178:3,179:1,180:2,181:1,182:2,183:3,184:3,185:1,186:3,187:1,188:4,189:5,190:6,191:5,192:4,193:6,194:3,195:1,196:2,197:2,198:1,199:3,200:5,201:4,202:3,203:4,204:3,205:1,206:1,207:3,208:3,209:3,211:3,212:3,213:3,216:2,219:2,222:3,223:2,224:2,225:3,226:1,227:1,228:3,229:2,230:1,231:4,232:3,233:1,235:3,236:4,237:1,238:1,239:1,240:1,241:3,242:1,243:2,244:2,247:1,252:1,254:4,256:1,257:1,258:1,260:1,262:1,263:2,292:1,295:1 (5.00/95.00/99.7%=172/256/295,Outliers=0,obl/obu=0/0) (29.494 ms/1701133828.812424)
    [  1] 2.00-3.00 sec  12.2 MBytes   102 Mbits/sec  25.854/18.267/32.253/2.849 ms (98/130139)  319 KByte 493  6399=6398:1:0:0:0:0:0:0
    [  1] 2.00-3.00 sec F8-PDF: bin(w=100us):cnt(98)=183:1,208:2,212:1,214:1,215:1,219:2,221:1,224:3,225:1,226:2,227:1,229:1,230:1,231:1,232:1,233:3,235:1,236:1,238:2,239:1,242:2,244:1,245:2,246:2,247:1,248:1,249:2,250:1,252:1,253:1,254:2,255:1,256:1,258:1,262:2,265:3,266:1,267:2,268:2,269:3,270:3,272:1,274:3,275:2,276:2,277:1,278:2,279:1,280:2,281:1,283:2,284:2,287:1,292:3,293:1,294:1,295:2,297:1,298:1,299:1,303:1,316:1,322:2,323:1 (5.00/95.00/99.7%=214/303/323,Outliers=0,obl/obu=0/0) (32.253 ms/1701133828.563260)
    [  2] 2.00-3.00 sec  1.66 MBytes  13.9 Mbits/sec  28.777/17.368/32.095/3.302 ms (60/28972) 60.41  817=817:0:0:0:0:0:0:0
    [  2] 2.00-3.00 sec F8-PDF: bin(w=100us):cnt(60)=174:1,198:1,218:1,219:1,235:1,258:2,260:4,261:2,264:1,265:1,266:1,267:1,272:1,275:1,276:1,277:2,281:1,284:1,288:2,289:2,290:1,291:1,306:1,307:1,308:1,310:3,311:2,312:1,313:2,314:6,315:1,316:2,318:3,319:4,320:1,321:2 (5.00/95.00/99.7%=218/320/321,Outliers=0,obl/obu=0/0) (32.095 ms/1701133828.905721)
    [  3] 2.00-3.00 sec  66.0 MBytes   554 Mbits/sec  16.895/15.559/18.852/0.687 ms (528/131039) 1.12 MByte 4095  34569=34565:3:1:0:0:0:0:0
    [  3] 2.00-3.00 sec F8-PDF: bin(w=100us):cnt(528)=156:1,157:12,158:9,159:6,160:20,161:16,162:18,163:23,164:21,165:31,166:22,167:46,168:39,169:29,170:26,171:33,172:22,173:19,174:10,175:22,176:18,177:14,178:17,179:5,180:6,181:7,182:9,183:5,184:7,185:6,186:4,187:1,188:2,189:2 (5.00/95.00/99.7%=159/183/189,Outliers=0,obl/obu=0/0) (18.852 ms/1701133828.954532)
    [  4] 2.00-3.00 sec  6.92 MBytes  58.0 Mbits/sec  34.032/23.802/43.859/5.420 ms (55/131867)  244 KByte 213  2825=2790:28:3:4:0:0:0:0
    [  4] 2.00-3.00 sec F8-PDF: bin(w=100us):cnt(55)=239:1,242:1,248:2,263:1,272:1,273:1,274:1,275:1,282:2,287:1,289:1,306:2,307:1,311:2,316:1,318:3,331:1,332:2,335:1,337:2,347:1,351:1,353:1,354:1,355:1,359:1,363:2,376:1,377:1,380:1,383:1,388:1,389:2,390:1,392:1,395:1,399:2,402:1,408:1,420:1,423:1,426:1,437:1,439:1 (5.00/95.00/99.7%=248/426/439,Outliers=0,obl/obu=0/0) (43.859 ms/1701133828.870542)
    [SUM-5] 2.00-3.00 sec   109 MBytes   915 Mbits/sec 2.13 MByte  56342=56301:33:4:4:0:0:0:0
    [  1] 3.00-4.00 sec  12.2 MBytes   102 Mbits/sec  26.541/19.027/37.015/4.796 ms (97/131520)  336 KByte 481  6381=6381:0:0:0:0:0:0:0
    [  1] 3.00-4.00 sec F8-PDF: bin(w=100us):cnt(97)=191:1,193:1,195:1,200:1,206:1,208:1,209:1,210:1,214:1,216:1,218:3,220:2,224:1,225:1,226:2,227:1,229:1,230:2,232:2,233:1,234:4,235:2,236:4,237:2,238:1,239:1,240:2,241:2,243:2,249:1,250:1,251:1,252:1,253:1,254:1,255:1,256:2,258:1,259:1,261:1,262:1,263:1,265:1,267:1,268:2,287:1,288:1,296:1,299:1,305:3,306:1,307:1,309:1,310:1,311:1,312:2,314:3,320:1,326:1,329:1,330:1,339:1,343:1,345:1,346:1,350:1,353:1,357:2,358:1,362:1,371:2 (5.00/95.00/99.7%=206/357/371,Outliers=0,obl/obu=0/0) (37.015 ms/1701133829.872922)
    [  2] 3.00-4.00 sec  1.67 MBytes  14.0 Mbits/sec  30.668/25.346/32.809/1.968 ms (60/29214) 57.16  831=831:0:0:0:0:0:0:0
    [  2] 3.00-4.00 sec F8-PDF: bin(w=100us):cnt(60)=254:1,257:1,258:1,268:1,276:1,278:1,285:1,288:2,289:2,291:2,293:1,294:2,295:1,297:1,298:1,299:2,301:2,302:1,303:1,304:1,305:1,310:1,311:1,312:1,318:1,319:4,320:2,321:3,322:4,323:1,324:3,325:4,327:4,328:3,329:1 (5.00/95.00/99.7%=258/328/329,Outliers=0,obl/obu=0/0) (32.809 ms/1701133829.773072)
    [  3] 3.00-4.00 sec  66.7 MBytes   560 Mbits/sec  17.759/16.368/20.050/0.683 ms (534/130970) 1.18 MByte 3938  958=131:90:113:147:83:67:46:281
    [  3] 3.00-4.00 sec F8-PDF: bin(w=100us):cnt(534)=164:1,165:1,166:3,167:8,168:15,169:18,170:14,171:30,172:30,173:30,174:31,175:30,176:32,177:30,178:30,179:29,180:37,181:20,182:23,183:19,184:13,185:13,186:9,187:14,188:6,189:4,190:9,191:7,192:9,193:5,194:3,195:3,196:2,197:4,198:1,201:1 (5.00/95.00/99.7%=168/192/198,Outliers=0,obl/obu=0/0) (20.050 ms/1701133829.948589)
    [  4] 3.00-4.00 sec  6.97 MBytes  58.5 Mbits/sec  35.479/22.722/46.258/6.476 ms (56/130517)  252 KByte 206  3663=3663:0:0:0:0:0:0:0
    [  4] 3.00-4.00 sec F8-PDF: bin(w=100us):cnt(56)=228:1,235:1,239:1,244:1,251:1,261:1,271:1,274:1,277:1,283:1,288:1,292:1,309:1,311:1,312:3,322:1,323:1,327:1,329:1,332:1,334:1,340:1,344:1,350:2,361:2,368:1,372:1,380:1,381:2,383:1,389:1,390:1,392:1,395:1,403:1,407:1,414:1,416:2,420:1,422:1,423:1,426:1,428:1,429:1,430:1,441:1,447:1,450:1,458:1,463:1 (5.00/95.00/99.7%=239/450/463,Outliers=0,obl/obu=0/0) (46.258 ms/1701133829.527305)
    [  5] 3.00-4.00 sec  22.7 MBytes   191 Mbits/sec  21.582/16.648/29.061/2.603 ms (182/131040)  502 KByte 1105  11782=11781:1:0:0:0:0:0:0
    [  5] 3.00-4.00 sec F8-PDF: bin(w=100us):cnt(182)=167:1,170:1,171:1,175:3,176:1,177:3,178:1,179:2,181:2,182:3,183:2,184:3,185:1,186:3,187:3,188:1,189:1,190:1,191:2,192:4,193:2,194:2,195:2,196:2,197:2,198:2,199:2,201:4,202:2,203:3,204:2,205:1,208:1,209:2,210:2,211:3,212:3,213:1,214:2,215:4,216:4,217:4,218:4,219:5,220:8,221:3,222:4,223:4,224:2,225:2,226:2,228:1,229:4,230:4,231:4,232:1,233:1,234:3,235:4,236:1,237:1,239:5,240:3,242:4,243:1,244:1,246:1,248:2,249:1,253:1,258:1,261:1,262:2,264:3,277:1,282:1,283:1,284:1,287:2,291:1 (5.00/95.00/99.7%=177/264/291,Outliers=0,obl/obu=0/0) (29.061 ms/1701133829.232839)
    [SUM-5] 3.00-4.00 sec   110 MBytes   925 Mbits/sec 2.25 MByte  23615=22787:91:113:147:83:67:46:281
    [  5] 4.00-5.00 sec  22.6 MBytes   189 Mbits/sec  22.472/17.913/29.857/2.656 ms (181/130735)  518 KByte 1053  11721=11720:1:0:0:0:0:0:0
    [  5] 4.00-5.00 sec F8-PDF: bin(w=100us):cnt(181)=180:1,181:1,184:3,185:2,186:1,187:3,189:1,190:1,191:1,192:4,193:3,194:1,195:1,196:1,198:5,200:3,201:4,202:3,203:3,204:1,205:1,206:4,207:2,208:6,209:3,210:2,211:6,212:1,213:1,214:1,215:1,216:3,217:1,218:5,219:5,220:3,221:4,222:1,223:2,224:2,225:5,226:2,227:4,228:1,229:3,230:4,231:1,234:1,235:4,236:3,237:2,238:4,239:1,240:2,241:3,244:2,245:1,246:1,247:1,248:2,249:2,250:3,251:1,252:3,255:1,256:1,257:2,259:2,260:2,261:1,262:1,265:2,267:1,268:2,271:1,274:1,276:2,277:2,278:1,280:1,282:2,294:1,298:1,299:1 (5.00/95.00/99.7%=187/276/299,Outliers=0,obl/obu=0/0) (29.857 ms/1701133830.773455)
    [  1] 4.00-5.00 sec  12.2 MBytes   102 Mbits/sec  27.172/17.621/40.843/5.994 ms (98/130634)  336 KByte 471  6389=6388:1:0:0:0:0:0:0
    [  1] 4.00-5.00 sec F8-PDF: bin(w=100us):cnt(98)=177:1,184:1,185:1,186:1,188:4,193:2,195:1,196:2,197:1,202:1,203:1,208:2,210:1,216:1,220:1,222:1,224:2,226:1,228:1,233:1,235:2,237:1,242:2,243:2,244:1,245:1,246:1,247:1,248:1,250:1,251:2,253:1,254:1,255:3,256:1,257:1,258:1,261:1,262:1,263:2,266:1,270:1,276:2,280:1,281:1,282:1,284:1,287:1,289:1,297:1,302:1,309:1,313:2,316:1,318:1,321:1,322:1,323:1,324:1,325:3,332:1,333:1,335:1,344:1,347:1,348:1,351:1,354:1,355:1,357:1,359:1,360:1,364:1,365:1,366:1,368:1,373:1,399:1,405:1,409:1 (5.00/95.00/99.7%=188/368/409,Outliers=0,obl/obu=0/0) (40.843 ms/1701133830.753770)
    [  2] 4.00-5.00 sec  1.65 MBytes  13.8 Mbits/sec  32.191/27.279/33.607/1.373 ms (59/29316) 53.73  809=809:0:0:0:0:0:0:0
    [  2] 4.00-5.00 sec F8-PDF: bin(w=100us):cnt(59)=273:1,279:1,287:1,298:1,299:1,306:1,307:1,309:2,310:2,311:1,312:1,318:2,319:1,320:2,321:1,323:4,326:2,327:4,328:4,329:3,330:2,331:10,332:3,333:1,334:2,335:2,336:2,337:1 (5.00/95.00/99.7%=287/336/337,Outliers=0,obl/obu=0/0) (33.607 ms/1701133830.807158)
    [  3] 4.00-5.00 sec  66.6 MBytes   559 Mbits/sec  18.498/17.048/20.570/0.660 ms (533/131072) 1.24 MByte 3777  886=67:94:114:136:73:57:45:300
    [  3] 4.00-5.00 sec F8-PDF: bin(w=100us):cnt(533)=171:2,172:4,173:2,174:6,175:8,176:12,177:13,178:25,179:23,180:27,181:39,182:29,183:44,184:18,185:21,186:54,187:29,188:24,189:18,190:20,191:23,192:14,193:14,194:11,195:9,196:8,197:8,198:6,199:6,200:2,201:4,202:1,203:4,205:2,206:3 (5.00/95.00/99.7%=176/198/206,Outliers=0,obl/obu=0/0) (20.570 ms/1701133830.643850)
    [  4] 4.00-5.00 sec  7.11 MBytes  59.6 Mbits/sec  36.447/22.839/62.814/6.286 ms (56/133043)  269 KByte 204  3852=3852:0:0:0:0:0:0:0
    [  4] 4.00-5.00 sec F8-PDF: bin(w=100us):cnt(56)=229:1,261:1,262:1,277:1,284:2,322:1,328:3,331:2,332:1,333:2,335:2,337:1,340:2,341:1,342:1,343:2,344:5,347:1,350:1,353:2,358:1,360:1,377:1,379:1,386:1,396:1,399:1,406:1,410:1,411:1,414:1,417:1,419:1,422:1,423:1,425:1,426:1,431:1,435:1,449:1,465:2,629:1 (5.00/95.00/99.7%=262/465/629,Outliers=0,obl/obu=0/0) (62.814 ms/1701133830.524560)
    [SUM-5] 4.00-5.00 sec   110 MBytes   924 Mbits/sec 2.33 MByte  23657=22836:96:114:136:73:57:45:300
    [  5] 5.00-6.00 sec  22.4 MBytes   187 Mbits/sec  22.801/18.378/30.726/3.019 ms (179/130929)  524 KByte 1028  11662=11662:0:0:0:0:0:0:0
    [  5] 5.00-6.00 sec F8-PDF: bin(w=100us):cnt(179)=184:1,185:1,188:1,191:1,192:1,193:4,194:3,195:2,196:2,197:1,198:2,199:2,200:1,201:5,202:3,203:3,204:3,205:4,206:4,207:2,208:6,209:5,210:3,211:9,212:3,213:4,214:3,215:5,216:3,217:3,218:7,219:5,220:3,221:1,222:1,224:1,226:1,228:1,229:1,231:1,232:2,233:3,237:2,238:1,239:5,241:2,242:2,245:1,246:2,247:5,248:3,249:1,251:2,256:1,261:1,264:4,265:3,266:2,267:2,270:1,272:1,274:1,275:2,277:1,279:1,281:1,282:2,283:1,284:1,285:2,293:1,295:1,301:1,302:1,303:3,305:1,308:1 (5.00/95.00/99.7%=193/293/308,Outliers=0,obl/obu=0/0) (30.726 ms/1701133831.205729)
    [  1] 5.00-6.00 sec  11.9 MBytes  99.6 Mbits/sec  28.334/18.739/41.031/6.847 ms (95/131020)  349 KByte 439  6268=6268:0:0:0:0:0:0:0
    [  1] 5.00-6.00 sec F8-PDF: bin(w=100us):cnt(95)=188:1,192:2,195:1,196:2,199:4,202:2,203:2,204:1,205:2,206:1,207:1,208:3,210:2,219:1,223:1,227:1,231:1,234:1,239:3,242:1,243:1,244:1,245:1,250:1,251:1,255:1,256:1,259:1,261:1,262:1,263:1,276:2,278:2,279:1,283:1,285:2,286:2,288:2,292:1,300:1,302:1,306:1,307:1,309:1,310:1,317:1,321:1,325:1,330:1,333:1,343:1,346:2,347:1,352:1,354:1,355:1,360:1,363:1,364:1,369:1,372:1,373:1,375:1,376:1,377:1,378:1,382:1,384:1,390:1,392:1,394:1,395:1,398:2,409:1,411:1 (5.00/95.00/99.7%=196/395/411,Outliers=0,obl/obu=0/0) (41.031 ms/1701133831.658541)
    [  2] 5.00-6.00 sec  1.67 MBytes  14.0 Mbits/sec  28.705/17.352/34.089/7.174 ms (60/29162) 60.96  797=797:0:0:0:0:0:0:0
    [  2] 5.00-6.00 sec F8-PDF: bin(w=100us):cnt(60)=174:1,176:1,177:1,178:1,179:2,180:2,181:3,182:1,184:2,186:1,189:1,193:1,198:1,199:1,327:3,328:1,329:1,334:5,335:7,336:4,337:7,338:2,339:6,340:1,341:4 (5.00/95.00/99.7%=177/341/341,Outliers=0,obl/obu=0/0) (34.089 ms/1701133831.790934)
    [  3] 5.00-6.00 sec  66.9 MBytes   561 Mbits/sec  19.070/17.764/21.828/0.692 ms (535/131072) 1.27 MByte 3677  870=63:87:113:114:75:66:47:305
    [  3] 5.00-6.00 sec F8-PDF: bin(w=100us):cnt(535)=178:1,179:4,180:1,181:11,182:11,183:21,184:29,185:30,186:34,187:41,188:37,189:28,190:37,191:31,192:38,193:23,194:19,195:18,196:9,197:14,198:16,199:17,200:11,201:15,202:5,203:8,204:4,205:4,206:1,207:3,208:2,211:2,212:2,213:3,214:1,216:1,217:1,218:1,219:1 (5.00/95.00/99.7%=182/203/218,Outliers=0,obl/obu=0/0) (21.828 ms/1701133831.687847)
    [  4] 5.00-6.00 sec  7.60 MBytes  63.7 Mbits/sec  35.735/25.778/45.553/5.370 ms (61/130587)  275 KByte 223  4122=4122:0:0:0:0:0:0:0
    [  4] 5.00-6.00 sec F8-PDF: bin(w=100us):cnt(61)=258:1,259:1,261:1,271:2,276:1,290:1,295:1,301:1,305:1,307:1,308:1,310:1,313:1,314:1,315:1,318:1,327:1,329:1,331:1,332:1,338:1,340:1,341:1,344:1,345:1,347:1,351:1,353:1,356:1,357:1,358:1,362:1,365:2,366:1,370:1,373:1,374:2,383:1,386:1,387:2,389:1,392:1,400:1,401:1,402:1,408:1,410:1,430:2,435:1,437:1,440:1,443:1,445:1,448:1,454:1,456:1 (5.00/95.00/99.7%=271/445/456,Outliers=0,obl/obu=0/0) (45.553 ms/1701133831.323082)
    [SUM-5] 5.00-6.00 sec   110 MBytes   926 Mbits/sec 2.40 MByte  23719=22912:87:113:114:75:66:47:305
    [  5] 6.00-7.00 sec  22.9 MBytes   192 Mbits/sec  19.578/10.488/52.516/5.476 ms (183/131150)  456 KByte 1226  12049=12042:0:0:1:0:0:0:6
    [  5] 6.00-7.00 sec F8-PDF: bin(w=100us):cnt(183)=105:1,114:1,116:3,119:1,121:1,123:1,125:1,126:1,129:1,130:2,134:1,137:2,139:1,143:1,144:1,145:1,146:2,148:1,149:2,151:1,152:3,153:4,155:1,156:3,157:1,160:3,161:1,162:2,163:1,164:1,165:1,166:2,167:1,168:2,170:1,174:2,175:3,176:6,177:1,178:4,179:2,181:2,182:2,183:2,184:1,185:2,187:1,188:4,189:1,190:2,191:1,192:1,194:1,195:2,196:4,197:1,198:1,199:4,200:2,201:2,202:2,203:3,204:3,205:2,206:1,207:7,208:3,209:1,210:3,211:1,212:5,215:2,216:1,218:1,219:1,220:2,221:1,222:2,223:2,226:3,227:2,229:4,230:1,233:1,234:2,236:2,240:1,242:1,243:1,261:1,263:1,267:1,271:2,274:1,278:1,280:1,285:1,292:1,322:1,355:1,409:1,508:1,526:1 (5.00/95.00/99.7%=126/274/526,Outliers=1,obl/obu=0/0) (52.516 ms/1701133832.82823)
    [  1] 6.00-7.00 sec  12.7 MBytes   107 Mbits/sec  24.530/9.702/67.979/7.578 ms (102/130957)  315 KByte 545  4726=4616:71:29:8:0:2:0:0
    [  1] 6.00-7.00 sec F8-PDF: bin(w=100us):cnt(102)=98:1,185:1,188:1,193:1,195:2,196:3,198:1,199:2,202:1,203:1,206:1,207:1,208:3,210:4,211:1,212:1,213:1,214:1,215:1,216:2,217:2,218:3,220:3,221:3,222:3,223:1,224:3,225:2,227:3,228:1,229:1,230:1,231:1,232:4,233:3,234:1,236:1,237:2,238:2,241:1,242:4,243:2,245:1,246:1,247:1,249:1,251:1,259:2,261:1,262:1,266:1,277:1,279:1,280:1,289:1,299:1,305:1,329:1,354:1,362:1,368:1,371:1,487:1,530:1,539:1,680:1 (5.00/95.00/99.7%=195/368/680,Outliers=1,obl/obu=0/0) (67.979 ms/1701133832.147591)
    [  3] 6.00-7.00 sec  64.5 MBytes   541 Mbits/sec  16.060/7.658/51.981/5.279 ms (515/131240) 1.03 MByte 4209  31182=31070:28:18:8:2:9:9:38
    [  3] 6.00-7.00 sec F8-PDF: bin(w=100us):cnt(515)=77:1,89:1,92:1,99:2,100:1,101:1,103:2,104:2,107:3,108:4,109:1,110:1,111:1,112:1,113:3,114:5,115:5,116:3,117:2,118:2,119:1,120:4,121:9,122:4,123:8,124:5,125:8,126:6,127:6,128:5,129:2,130:2,131:4,132:4,133:2,134:3,135:1,136:1,137:1,138:4,139:5,140:2,141:1,142:2,143:3,144:1,145:1,146:1,147:3,148:7,149:4,150:10,151:20,152:22,153:25,154:35,155:16,156:20,157:16,158:17,159:13,160:15,161:9,162:7,163:10,164:6,165:6,166:6,168:2,169:4,170:4,171:3,172:2,173:5,174:2,175:1,177:1,183:1,184:1,185:5,186:6,187:2,188:4,189:7,190:4,191:6,192:3,193:4,194:3,195:3,197:3,198:3,199:3,200:1,202:1,204:1,206:1,209:1,211:1,218:1,222:1,234:1,247:1,249:1,260:1,274:1,292:1,310:1,328:1,356:1,370:1,394:1,415:1,428:1,442:1,454:1,470:1,484:1,513:1,515:1,520:1 (5.00/95.00/99.7%=114/204/515,Outliers=9,obl/obu=0/0) (51.981 ms/1701133832.80065)
    [  4] 6.00-7.00 sec  7.64 MBytes  64.1 Mbits/sec  31.313/21.853/228.940/26.131 ms (61/131265)  245 KByte 256  4119=4119:0:0:0:0:0:0:0
    [  4] 6.00-7.00 sec F8-PDF: bin(w=100us):cnt(61)=219:1,225:1,231:1,234:1,238:1,239:1,244:1,245:4,247:2,248:2,250:1,255:2,259:1,261:2,262:4,263:1,264:1,265:1,266:1,267:1,268:2,270:1,271:1,272:1,273:1,276:1,277:1,281:2,282:1,286:1,287:1,289:2,290:1,291:1,293:1,296:2,319:2,333:1,347:1,353:1,398:1,400:1,406:2,413:1,2290:1 (5.00/95.00/99.7%=234/406/2290,Outliers=1,obl/obu=0/0) (228.940 ms/1701133832.138923)
    [  2] 6.00-7.00 sec  1.70 MBytes  14.2 Mbits/sec  25.096/12.560/34.327/6.110 ms (61/29169) 70.90  825=825:0:0:0:0:0:0:0
    [  2] 6.00-7.00 sec F8-PDF: bin(w=100us):cnt(61)=126:1,129:1,153:2,154:1,155:1,164:1,168:1,178:1,183:1,184:1,185:1,189:1,194:2,196:1,205:1,207:1,224:1,228:1,229:1,232:1,233:1,234:1,235:2,240:1,244:1,251:1,253:1,256:1,261:1,262:1,271:1,272:1,276:1,284:1,294:1,296:2,300:1,301:3,302:1,303:6,305:1,306:2,337:2,339:2,341:2,344:1 (5.00/95.00/99.7%=153/339/344,Outliers=0,obl/obu=0/0) (34.327 ms/1701133832.24506)
    [SUM-5] 6.00-7.00 sec   109 MBytes   918 Mbits/sec 2.03 MByte  52901=52672:99:47:17:2:11:9:44
    [  5] 7.00-8.00 sec  23.1 MBytes   194 Mbits/sec  18.695/11.199/25.573/3.471 ms (185/131166)  441 KByte 1298  12660=12659:1:0:0:0:0:0:0
    [  5] 7.00-8.00 sec F8-PDF: bin(w=100us):cnt(185)=112:1,119:1,121:1,122:1,124:1,130:2,131:2,133:1,134:2,135:2,136:1,137:2,138:2,141:1,144:1,145:1,147:3,148:2,149:3,150:4,151:3,152:1,153:1,154:1,156:3,157:2,158:1,159:1,160:2,161:1,162:1,164:2,165:1,166:1,167:3,169:3,170:2,171:1,172:2,173:1,174:1,175:2,176:1,178:1,179:4,180:2,182:1,184:2,185:6,186:3,187:3,188:1,189:2,190:3,191:2,192:1,193:3,194:3,195:3,196:4,197:2,198:3,200:1,201:1,202:2,204:2,205:1,206:1,208:1,209:3,211:1,213:1,214:3,216:3,219:3,220:2,221:1,222:4,224:2,226:2,227:2,228:1,229:2,230:1,232:1,233:1,234:1,235:2,236:1,237:1,238:5,239:1,240:2,241:2,242:1,247:1,248:1,249:1,250:1,251:1,255:1,256:1 (5.00/95.00/99.7%=133/241/256,Outliers=0,obl/obu=0/0) (25.573 ms/1701133833.30024)
    [  1] 7.00-8.00 sec  13.7 MBytes   115 Mbits/sec  24.231/18.994/46.424/4.340 ms (109/131795)  342 KByte 593  4658=4539:63:31:14:3:4:0:4
    [  1] 7.00-8.00 sec F8-PDF: bin(w=100us):cnt(109)=190:1,194:2,195:1,199:1,205:2,206:2,208:2,209:1,210:1,211:1,213:3,215:6,216:1,217:1,219:4,220:3,221:2,224:3,225:1,226:2,227:2,229:1,230:2,231:1,232:1,234:1,235:5,236:1,238:4,239:2,240:3,241:1,242:2,243:3,244:4,245:2,246:1,248:2,249:1,250:2,254:2,255:5,257:1,258:1,259:2,261:1,262:2,265:2,266:1,267:1,270:1,274:1,276:1,283:1,299:1,372:1,373:1,389:1,457:1,465:1 (5.00/95.00/99.7%=205/299/465,Outliers=2,obl/obu=0/0) (46.424 ms/1701133833.651159)
    [  2] 7.00-8.00 sec  1.67 MBytes  14.0 Mbits/sec  25.488/10.878/31.196/5.436 ms (60/29166) 68.66  828=828:0:0:0:0:0:0:0
    [  2] 7.00-8.00 sec F8-PDF: bin(w=100us):cnt(60)=109:1,124:1,149:1,152:1,155:1,163:1,184:1,186:1,193:2,198:1,205:1,206:1,211:1,217:1,218:1,232:1,243:1,244:1,245:1,246:1,248:1,249:2,251:1,253:1,257:1,258:1,259:1,260:1,261:1,263:1,270:1,273:1,275:1,276:1,290:1,292:1,300:1,302:1,303:2,305:4,306:1,307:1,308:4,309:1,310:2,312:5 (5.00/95.00/99.7%=149/312/312,Outliers=0,obl/obu=0/0) (31.196 ms/1701133833.604647)
    [  3] 7.00-8.00 sec  60.4 MBytes   507 Mbits/sec  15.806/9.197/43.491/3.534 ms (483/131158)  976 KByte 4008  32202=32186:0:0:0:0:1:0:15
    [  3] 7.00-8.00 sec F8-PDF: bin(w=100us):cnt(483)=92:1,97:1,103:1,104:1,107:2,108:4,109:1,112:2,113:1,114:3,115:1,116:1,117:5,119:1,120:3,122:3,123:3,124:4,125:4,126:2,127:6,128:7,129:3,130:5,131:10,132:6,133:6,134:5,135:2,136:4,137:3,138:3,139:3,140:3,141:2,142:3,143:2,144:3,146:3,148:1,151:4,152:4,153:4,154:10,155:11,156:24,157:23,158:22,159:21,160:19,161:24,162:19,163:16,164:10,165:17,166:15,167:16,168:9,169:14,170:15,171:8,172:12,173:4,174:2,175:5,176:2,177:3,178:1,179:4,180:3,181:3,183:1,195:1,208:1,232:1,246:1,267:1,287:1,317:1,344:1,357:1,371:1,389:1,409:1,418:1,435:1 (5.00/95.00/99.7%=119/179/418,Outliers=8,obl/obu=0/0) (43.491 ms/1701133833.653690)
    [  4] 7.00-8.00 sec  10.4 MBytes  87.2 Mbits/sec  26.390/16.473/76.639/6.911 ms (84/129796)  276 KByte 413  5747=5747:0:0:0:0:0:0:0
    [  4] 7.00-8.00 sec F8-PDF: bin(w=100us):cnt(84)=165:1,174:1,192:3,193:1,202:1,203:1,204:1,206:1,207:1,211:1,213:1,215:1,216:1,219:2,220:1,222:1,224:1,225:1,231:2,232:2,233:1,234:1,235:1,236:1,244:2,246:1,248:1,249:1,250:2,252:1,254:1,256:1,258:5,260:1,262:1,264:2,265:1,266:1,267:1,275:2,278:2,281:2,283:1,285:1,288:1,289:1,290:1,291:1,294:2,295:1,298:1,299:3,301:1,304:2,308:1,312:1,316:1,317:1,321:2,329:1,338:1,342:1,351:1,767:1 (5.00/95.00/99.7%=192/329/767,Outliers=1,obl/obu=0/0) (76.639 ms/1701133833.701216)
    [SUM-5] 7.00-8.00 sec   109 MBytes   917 Mbits/sec 1.99 MByte  56095=55959:64:31:14:3:5:0:19
    [  5] 8.00-9.00 sec  27.2 MBytes   228 Mbits/sec  16.207/13.220/23.115/2.147 ms (217/131282)  451 KByte 1758  14939=14938:0:1:0:0:0:0:0
    [  5] 8.00-9.00 sec F8-PDF: bin(w=100us):cnt(217)=133:2,135:4,136:2,137:4,138:3,139:5,140:2,141:2,142:6,143:6,144:4,145:5,146:8,147:4,148:6,149:11,150:4,151:8,152:4,153:8,154:4,156:4,157:4,158:5,159:3,160:3,161:3,162:6,163:7,164:4,165:3,166:5,167:6,168:4,169:5,170:3,171:2,172:2,176:1,179:1,180:1,181:1,183:1,185:2,187:2,191:2,192:2,193:1,194:1,195:4,196:1,198:1,199:2,200:2,201:2,202:1,203:1,204:3,205:3,206:2,207:1,208:1,210:2,212:1,214:1,215:1,216:1,232:1 (5.00/95.00/99.7%=137/206/232,Outliers=0,obl/obu=0/0) (23.115 ms/1701133834.551836)
    [  1] 8.00-9.00 sec  10.1 MBytes  85.1 Mbits/sec  24.642/20.157/29.423/2.209 ms (81/131286)  256 KByte 432  5660=5660:0:0:0:0:0:0:0
    [  1] 8.00-9.00 sec F8-PDF: bin(w=100us):cnt(81)=202:1,203:1,207:1,208:1,211:1,212:2,213:1,216:1,219:1,220:2,221:1,222:1,224:3,226:1,227:1,230:1,231:1,233:2,234:3,236:1,238:1,239:2,240:2,241:1,243:1,244:1,246:2,248:1,250:3,251:1,252:4,255:2,256:1,257:3,258:2,259:1,260:2,261:3,262:3,263:1,266:2,267:1,268:2,271:1,272:1,274:1,275:2,277:1,280:2,282:2,291:1,295:1 (5.00/95.00/99.7%=211/280/295,Outliers=0,obl/obu=0/0) (29.423 ms/1701133834.708500)
    [  3] 8.00-9.00 sec  56.1 MBytes   471 Mbits/sec  13.845/12.127/18.270/0.867 ms (449/131047)  798 KByte 4250  31257=31256:1:0:0:0:0:0:0
    [  3] 8.00-9.00 sec F8-PDF: bin(w=100us):cnt(449)=122:2,125:4,126:4,127:11,128:8,129:15,130:26,131:25,132:13,133:21,134:26,135:14,136:24,137:26,138:27,139:20,140:27,141:16,142:10,143:16,144:16,145:12,146:8,147:5,148:17,149:7,150:7,151:6,152:6,153:2,154:5,155:2,156:2,157:4,158:2,159:2,160:1,161:1,162:1,163:1,164:2,165:1,166:1,167:1,179:1,183:1 (5.00/95.00/99.7%=128/155/179,Outliers=0,obl/obu=0/0) (18.270 ms/1701133834.748090)
    [  4] 8.00-9.00 sec  14.0 MBytes   118 Mbits/sec  21.365/15.197/26.306/2.733 ms (112/131252)  308 KByte 688  7752=7752:0:0:0:0:0:0:0
    [  4] 8.00-9.00 sec F8-PDF: bin(w=100us):cnt(112)=152:1,153:1,156:1,158:1,159:1,160:1,163:1,172:1,173:1,176:1,177:1,179:1,180:1,182:2,185:1,186:1,187:1,188:2,191:2,192:2,194:2,195:1,197:3,199:5,200:4,202:3,203:1,206:3,208:2,209:3,210:1,211:2,212:1,213:1,214:1,216:2,217:1,218:1,219:1,220:2,221:2,223:2,224:1,225:1,226:1,228:1,230:1,231:1,232:2,233:3,234:1,235:2,236:3,237:1,238:4,239:1,240:1,242:3,244:1,246:1,247:2,249:2,253:1,254:3,256:2,257:1,258:2,259:1,264:1 (5.00/95.00/99.7%=160/256/264,Outliers=0,obl/obu=0/0) (26.306 ms/1701133834.902654)
    [  2] 8.00-9.00 sec  1.67 MBytes  14.0 Mbits/sec  22.664/12.425/28.819/5.153 ms (60/29166) 77.21  825=825:0:0:0:0:0:0:0
    [  2] 8.00-9.00 sec F8-PDF: bin(w=100us):cnt(60)=125:1,133:1,143:1,164:1,167:2,169:1,171:2,172:1,174:1,175:1,176:2,178:1,179:4,183:3,185:1,186:1,199:1,210:1,213:1,227:1,228:1,233:1,235:1,237:1,242:1,244:1,250:1,261:1,264:1,278:2,279:1,280:5,281:1,282:3,283:6,284:1,285:1,286:2,289:1 (5.00/95.00/99.7%=143/286/289,Outliers=0,obl/obu=0/0) (28.819 ms/1701133834.885546)
    [SUM-5] 8.00-9.00 sec   109 MBytes   915 Mbits/sec 1.77 MByte  60433=60431:1:1:0:0:0:0:0
    [  5] 9.00-10.00 sec  26.2 MBytes   220 Mbits/sec  17.171/13.315/26.012/3.229 ms (210/131020)  463 KByte 1602  14576=14576:0:0:0:0:0:0:0
    [  5] 9.00-10.00 sec F8-PDF: bin(w=100us):cnt(210)=134:3,135:4,136:1,137:7,138:6,139:3,140:9,141:8,142:5,143:6,144:8,145:6,146:3,147:2,148:4,149:6,150:4,151:1,152:3,153:1,156:2,158:2,160:2,165:1,167:3,168:2,169:1,170:5,171:4,172:1,173:6,174:1,175:1,176:1,177:4,178:2,179:1,181:4,182:3,183:2,184:2,186:1,187:1,189:4,190:6,191:1,192:7,193:2,194:2,195:4,196:3,197:2,198:1,199:1,200:2,203:2,204:1,206:2,207:1,208:2,212:1,216:2,217:2,219:1,220:1,221:1,223:2,235:1,236:2,237:1,241:1,243:1,244:1,250:1,254:1,255:1,256:1,258:1,259:1,260:1,261:1 (5.00/95.00/99.7%=137/241/261,Outliers=0,obl/obu=0/0) (26.012 ms/1701133835.684041)
    [  1] 9.00-10.00 sec  10.9 MBytes  91.4 Mbits/sec  24.326/18.181/30.610/3.908 ms (87/131255)  272 KByte 469  6042=6041:1:0:0:0:0:0:0
    [  1] 9.00-10.00 sec F8-PDF: bin(w=100us):cnt(87)=182:1,192:1,195:1,196:2,198:4,199:3,200:2,201:1,202:4,203:1,204:3,205:3,206:1,207:1,208:2,209:3,211:1,212:2,214:1,218:2,220:1,237:1,241:2,255:1,256:2,258:1,270:2,271:1,272:1,273:1,274:3,275:3,276:2,277:3,278:2,279:1,280:2,281:1,283:2,284:3,285:1,289:4,290:1,292:2,295:1,303:1,305:2,307:1 (5.00/95.00/99.7%=196/295/307,Outliers=0,obl/obu=0/0) (30.610 ms/1701133835.393374)
    [  2] 9.00-10.00 sec  1.67 MBytes  14.0 Mbits/sec  24.458/15.230/29.179/4.545 ms (60/29162) 71.54  829=829:0:0:0:0:0:0:0
    [  2] 9.00-10.00 sec F8-PDF: bin(w=100us):cnt(60)=153:1,157:1,181:1,187:1,189:1,191:3,192:2,193:1,194:3,195:2,196:1,200:1,202:1,203:1,204:3,218:1,229:1,254:1,255:1,260:1,261:1,262:1,265:1,269:1,272:2,278:1,281:1,285:3,286:4,287:3,288:1,289:3,290:2,291:5,292:3 (5.00/95.00/99.7%=181/292/292,Outliers=0,obl/obu=0/0) (29.179 ms/1701133835.685875)
    [  3] 9.00-10.00 sec  55.9 MBytes   469 Mbits/sec  14.586/13.025/17.568/0.930 ms (448/130848)  832 KByte 4019  31156=31153:3:0:0:0:0:0:0
    [  3] 9.00-10.00 sec F8-PDF: bin(w=100us):cnt(448)=131:1,132:1,133:1,134:3,135:10,136:15,137:27,138:28,139:29,140:29,141:34,142:20,143:29,144:24,145:14,146:14,147:18,148:12,149:7,150:8,151:12,152:6,153:4,154:10,155:9,156:8,157:5,158:8,159:10,160:4,161:5,162:6,163:4,164:7,165:4,166:6,167:2,168:6,170:1,171:1,172:2,173:1,175:1,176:2 (5.00/95.00/99.7%=136/165/176,Outliers=0,obl/obu=0/0) (17.568 ms/1701133835.795211)
    [  4] 9.00-10.00 sec  14.4 MBytes   121 Mbits/sec  21.769/16.541/28.403/2.199 ms (115/131544)  323 KByte 695  8081=8081:0:0:0:0:0:0:0
    [  4] 9.00-10.00 sec F8-PDF: bin(w=100us):cnt(115)=166:1,178:1,180:2,183:1,184:1,185:1,186:2,188:1,190:5,192:1,194:1,195:1,196:3,197:1,200:1,201:1,203:3,204:4,206:2,207:1,208:4,209:4,210:3,211:2,212:1,213:2,214:3,215:2,217:1,218:3,219:3,220:2,221:2,222:1,223:5,224:3,227:1,228:5,229:1,230:1,231:2,232:2,233:2,234:1,235:3,237:2,239:2,240:1,241:2,242:3,243:1,244:1,246:1,248:1,251:1,259:1,260:1,262:1,263:1,264:1,282:1,285:1 (5.00/95.00/99.7%=184/260/285,Outliers=0,obl/obu=0/0) (28.403 ms/1701133835.137538)
    [SUM-5] 9.00-10.00 sec   109 MBytes   915 Mbits/sec 1.85 MByte  60684=60680:4:0:0:0:0:0:0
    [  3] 0.00-10.01 sec   639 MBytes   535 Mbits/sec  16.037/2.657/52.571/3.826 ms (5109/131072)  943 KByte 4170  232008=229381:313:361:412:239:200:148:954
    [  3] 0.00-10.01 sec F8(f)-PDF: bin(w=100us):cnt(5109)=27:1,28:3,29:4,30:1,31:1,32:2,33:5,34:3,35:1,36:2,37:1,38:2,39:2,40:1,43:2,44:2,45:1,46:3,47:5,48:8,49:5,50:4,51:3,52:2,53:3,54:5,55:5,57:1,59:2,60:2,61:2,62:3,63:5,64:3,65:1,66:1,67:5,68:1,69:2,70:2,71:6,72:2,73:4,74:4,75:2,76:2,77:2,78:5,79:1,80:2,81:2,83:4,84:3,85:2,86:3,87:2,88:7,89:7,90:2,91:2,92:6,93:4,94:4,95:2,96:5,97:8,98:2,99:9,100:7,101:10,102:6,103:12,104:9,105:5,106:4,107:9,108:14,109:8,110:6,111:8,112:12,113:7,114:15,115:9,116:13,117:13,118:4,119:7,120:11,121:16,122:15,123:18,124:14,125:25,126:15,127:33,128:24,129:29,130:46,131:49,132:28,133:34,134:44,135:32,136:47,137:64,138:68,139:60,140:62,141:60,142:41,143:56,144:53,145:40,146:48,147:39,148:60,149:35,150:52,151:65,152:68,153:63,154:94,155:63,156:88,157:91,158:86,159:71,160:77,161:84,162:67,163:74,164:66,165:79,166:71,167:80,168:77,169:69,170:66,171:84,172:79,173:65,174:59,175:72,176:69,177:62,178:77,179:66,180:75,181:84,182:74,183:93,184:69,185:75,186:109,187:88,188:75,189:60,190:70,191:68,192:64,193:47,194:36,195:34,196:19,197:30,198:26,199:26,200:15,201:20,202:7,203:12,204:5,205:6,206:5,207:3,208:3,209:1,211:4,212:2,213:3,214:1,216:1,217:1,218:3,219:1,222:1,232:1,234:1,236:1,246:1,247:1,249:1,251:1,260:1,267:1,272:1,274:1,287:1,292:1,310:1,317:2,325:1,328:1,344:1,349:1,356:1,357:1,362:1,370:1,371:1,374:1,385:1,389:1,394:1,396:1,409:1,415:1,418:1,425:1,428:1,435:1,441:1,442:1,452:1,454:1,458:1,465:1,470:1,473:1,484:1,486:1,498:1,507:1,512:1,513:1,514:1,515:1,520:1,526:1 (5.00/95.00/99.7%=105/195/452,Outliers=28,obl/obu=0/0) (52.571 ms/1701133826.652299)
    [  5] 0.00-10.02 sec   237 MBytes   199 Mbits/sec  19.175/5.937/53.355/4.540 ms (1897/131072)  455 KByte 1295  125229=125203:8:2:3:1:0:1:11
    [  5] 0.00-10.02 sec F8(f)-PDF: bin(w=100us):cnt(1897)=60:2,61:1,63:1,66:1,67:1,69:1,73:1,75:1,76:2,77:2,78:2,79:3,80:1,83:2,85:1,86:1,87:1,89:2,90:3,91:2,92:4,93:2,94:4,96:3,97:1,98:1,99:2,101:3,102:2,103:2,105:1,106:2,109:5,110:4,111:2,112:1,114:2,115:5,116:3,117:1,118:1,119:4,120:2,121:5,122:3,123:3,124:1,125:2,126:1,127:3,128:5,129:2,130:6,131:2,132:2,133:4,134:7,135:11,136:5,137:17,138:14,139:9,140:14,141:12,142:14,143:13,144:15,145:14,146:14,147:10,148:14,149:23,150:14,151:14,152:13,153:17,154:6,155:4,156:14,157:8,158:10,159:4,160:12,161:7,162:10,163:13,164:9,165:9,166:10,167:19,168:12,169:16,170:18,171:9,172:10,173:10,174:12,175:14,176:19,177:17,178:16,179:18,180:11,181:16,182:13,183:12,184:19,185:20,186:19,187:19,188:17,189:21,190:29,191:20,192:27,193:22,194:20,195:22,196:23,197:12,198:16,199:16,200:18,201:24,202:18,203:20,204:19,205:14,206:15,207:18,208:24,209:20,210:12,211:25,212:18,213:11,214:12,215:14,216:21,217:12,218:18,219:22,220:20,221:14,222:19,223:13,224:9,225:11,226:13,227:9,228:8,229:16,230:12,231:11,232:12,233:9,234:7,235:18,236:14,237:9,238:13,239:15,240:9,241:12,242:9,243:8,244:6,245:2,246:4,247:12,248:8,249:5,250:5,251:5,252:6,253:1,254:6,255:3,256:6,257:3,258:3,259:3,260:4,261:5,262:4,263:4,264:7,265:5,266:2,267:4,268:2,270:2,271:3,272:1,273:1,274:3,275:2,276:2,277:4,278:2,279:1,280:2,281:1,282:5,283:2,284:2,285:3,287:2,290:1,291:1,292:2,293:1,294:1,295:2,298:1,299:2,301:1,302:1,303:3,305:1,306:1,308:1,309:1,322:1,355:1,386:1,409:1,508:1,526:1,531:1,534:1 (5.00/95.00/99.7%=122/261/386,Outliers=0,obl/obu=0/0) (53.355 ms/1701133826.653431)
    [  2] 0.00-10.02 sec  16.7 MBytes  14.0 Mbits/sec  26.297/3.618/34.327/6.447 ms (602/29166) 66.63  8205=8204:1:0:0:0:0:0:0
    [  2] 0.00-10.02 sec F8(f)-PDF: bin(w=100us):cnt(602)=37:1,39:1,40:1,41:1,44:1,48:1,49:1,53:1,79:1,97:1,101:1,105:1,109:1,114:1,116:1,117:1,124:1,125:1,126:1,129:1,131:1,133:1,143:2,145:1,146:1,149:3,151:1,152:1,153:3,154:2,155:2,157:2,161:1,162:1,163:1,164:2,167:2,168:2,169:1,171:2,172:1,174:3,175:1,176:4,177:2,178:3,179:6,180:3,181:4,182:1,183:6,184:5,185:2,186:3,187:2,189:3,191:5,192:2,193:5,194:5,195:4,196:2,197:1,198:3,199:3,200:1,202:3,203:2,204:3,205:2,206:2,207:1,208:1,210:1,211:1,213:2,215:1,217:1,218:3,219:2,221:2,224:1,225:1,226:1,227:1,228:4,229:3,231:1,232:2,233:2,234:1,235:4,237:3,240:1,242:1,243:4,244:4,245:1,246:4,248:1,249:3,250:2,251:2,253:2,254:2,255:2,256:2,257:4,258:4,259:3,260:7,261:6,262:2,263:3,264:2,265:3,266:1,267:1,268:2,269:1,270:1,271:1,272:4,273:2,275:2,276:4,277:3,278:4,279:2,280:5,281:3,282:3,283:7,284:5,285:6,286:7,287:4,288:5,289:8,290:4,291:8,292:4,293:1,294:4,295:2,296:2,297:3,298:4,299:4,300:3,301:5,302:8,303:11,304:4,305:10,306:9,307:5,308:6,309:3,310:9,311:5,312:8,313:2,314:6,315:1,316:2,318:6,319:9,320:6,321:6,322:4,323:5,324:3,325:4,326:3,327:11,328:8,329:5,330:2,331:12,332:3,333:2,334:7,335:9,336:7,337:10,338:2,339:8,340:1,341:6,344:1 (5.00/95.00/99.7%=152/336/341,Outliers=0,obl/obu=0/0) (34.327 ms/1701133832.24506)
    [  1] 0.00-10.02 sec   117 MBytes  97.9 Mbits/sec  25.542/3.007/67.979/6.251 ms (935/131072)  174 KByte 479  56584=56342:143:60:23:3:6:0:7
    [  1] 0.00-10.02 sec F8(f)-PDF: bin(w=100us):cnt(935)=31:1,50:1,62:1,65:1,67:1,69:1,70:1,73:1,75:1,77:2,78:1,79:1,81:2,96:1,98:1,108:1,120:1,163:1,171:1,175:1,177:1,182:1,183:1,184:1,185:2,186:3,188:6,190:1,191:1,192:4,193:4,194:2,195:8,196:9,197:1,198:5,199:11,200:3,201:1,202:9,203:7,204:5,205:8,206:6,207:4,208:16,209:5,210:10,211:4,212:6,213:5,214:4,215:8,216:6,217:4,218:8,219:8,220:12,221:10,222:5,223:2,224:17,225:7,226:10,227:10,228:2,229:7,230:7,231:7,232:10,233:17,234:13,235:12,236:10,237:7,238:14,239:12,240:8,241:11,242:15,243:15,244:9,245:10,246:8,247:8,248:7,249:8,250:9,251:9,252:7,253:7,254:8,255:14,256:9,257:5,258:7,259:8,260:4,261:9,262:12,263:8,264:4,265:7,266:7,267:6,268:7,269:4,270:9,271:3,272:5,273:2,274:9,275:7,276:10,277:7,278:7,279:5,280:9,281:3,282:3,283:6,284:6,285:3,286:3,287:4,288:4,289:6,290:4,291:1,292:8,293:1,294:2,295:4,296:2,297:2,298:1,299:4,300:1,302:2,303:2,305:7,306:3,307:3,309:3,310:2,311:1,312:2,313:3,314:3,315:1,316:2,317:1,318:2,320:1,321:2,322:3,323:2,324:2,325:4,326:1,329:3,330:2,332:1,333:2,335:1,339:1,343:2,344:1,345:1,346:3,347:2,348:1,350:1,351:2,352:1,353:1,354:3,355:2,357:3,358:1,359:1,360:2,362:2,363:1,364:2,365:1,366:1,368:2,369:1,371:3,372:2,373:3,375:1,376:1,377:2,378:1,382:1,384:1,389:1,390:1,392:1,394:1,395:1,398:2,399:1,405:1,409:2,411:1,455:1,457:1,462:1,465:1,476:1,478:1,487:1,490:1,508:1,522:2,524:1,530:1,539:1,552:1,582:1,680:1 (5.00/95.00/99.7%=193/368/552,Outliers=0,obl/obu=0/0) (67.979 ms/1701133832.147591)
    [  4] 0.00-10.02 sec  87.0 MBytes  72.8 Mbits/sec  29.384/2.999/390.706/23.347 ms (696/131072)  334 KByte 310  44871=44800:60:4:4:1:0:0:2
    [  4] 0.00-10.02 sec F8(f)-PDF: bin(w=100us):cnt(696)=30:1,31:2,32:2,33:1,34:3,35:2,36:2,37:1,40:2,41:3,43:2,45:2,49:1,55:1,59:1,61:1,115:1,119:1,152:1,153:1,156:1,158:1,159:1,160:1,163:1,165:1,166:1,172:1,173:1,174:1,176:1,177:1,178:1,179:1,180:3,182:2,183:1,184:1,185:2,186:3,187:1,188:3,190:5,191:2,192:7,193:1,194:3,195:2,196:3,197:4,199:5,200:5,201:1,202:4,203:5,204:5,206:6,207:2,208:6,209:7,210:4,211:5,212:3,213:4,214:4,215:3,216:3,217:2,218:4,219:7,220:5,221:4,222:2,223:7,224:6,225:3,226:1,227:1,228:7,229:2,230:2,231:6,232:6,233:6,234:4,235:7,236:4,237:3,238:5,239:6,240:2,241:2,242:7,243:1,244:6,245:4,246:3,247:4,248:6,249:3,250:3,251:2,252:1,253:1,254:4,255:2,256:3,257:1,258:8,259:4,260:2,261:6,262:7,263:3,264:5,265:2,266:2,267:2,268:2,270:1,271:4,272:2,273:2,274:2,275:3,276:2,277:3,278:2,281:5,282:4,283:2,284:3,285:2,286:2,287:2,288:2,289:4,290:3,291:3,292:1,293:1,294:2,295:3,296:2,298:1,299:3,301:2,302:1,304:2,305:1,306:3,307:2,308:2,309:1,310:1,311:3,312:4,313:3,314:2,315:1,316:3,317:1,318:4,319:4,321:2,322:2,323:1,325:1,326:1,327:5,328:4,329:3,331:4,332:6,333:4,334:4,335:4,337:5,338:2,340:6,341:3,342:2,343:3,344:8,345:2,346:3,347:4,350:3,351:3,352:1,353:5,354:2,355:1,356:2,357:1,358:2,359:2,360:2,361:3,362:2,363:3,365:3,366:1,368:1,370:1,372:1,373:1,374:2,375:1,376:1,377:4,379:1,380:2,381:2,383:3,386:3,387:3,388:1,389:4,390:2,391:1,392:3,395:3,396:1,398:1,399:3,400:2,401:1,402:2,403:1,406:3,407:1,408:2,410:2,411:1,413:1,414:2,415:1,416:2,417:1,419:1,420:2,422:2,423:3,425:1,426:3,428:1,429:1,430:3,431:2,435:2,437:2,439:1,440:1,441:1,443:1,445:1,447:1,448:2,449:1,450:1,452:1,454:1,456:1,458:1,463:2,465:2,515:1,560:1,625:1,629:1,767:1,2290:1,2484:1,3452:1,3908:1 (5.00/95.00/99.7%=160/430/2484,Outliers=4,obl/obu=0/0) (390.706 ms/1701133826.58717)
    [SUM-5] 0.00-10.02 sec  1.07 GBytes   918 Mbits/sec 1.86 MByte  932655=463930:525:427:442:244:206:149:974
    
    
    root@raspberrypi:/usr/local/src/iperf2-code# iperf -c 192.168.1.31 -i 1 -e --trip-times --isochronous=60:14m --working-load=up,4
    ------------------------------------------------------------
    Client connecting to 192.168.1.31, TCP port 5001 with pid 8061 (1/4 flows/load)
    Write buffer size: 131072 Byte
    TCP congestion control using cubic
    TOS set to 0x0 (Nagle on)
    TCP window size: 85.0 KByte (default)
    Event based writes (pending queue watermark at 16384 bytes)
    ------------------------------------------------------------
    [  1] local 192.168.1.30%eth0 port 47498 connected with 192.168.1.31 port 5001 (prefetch=16384) (isoch) (trip-times) (sock=3) (icwnd/mss/irtt=14/1448/1639) (ct=1.90 ms) on 2023-11-27 17:10:25.970 (PST)
    [  5] local 192.168.1.30%eth0 port 47540 connected with 192.168.1.31 port 5001 (prefetch=16384) (trip-times) (sock=7) (icwnd/mss/irtt=14/1448/881) (ct=0.98 ms) on 2023-11-27 17:10:25.972 (PST)
    [  3] local 192.168.1.30%eth0 port 47522 connected with 192.168.1.31 port 5001 (prefetch=16384) (trip-times) (sock=5) (icwnd/mss/irtt=14/1448/1381) (ct=1.47 ms) on 2023-11-27 17:10:25.971 (PST)
    [  4] local 192.168.1.30%eth0 port 47528 connected with 192.168.1.31 port 5001 (prefetch=16384) (trip-times) (sock=6) (icwnd/mss/irtt=14/1448/1077) (ct=1.16 ms) on 2023-11-27 17:10:25.971 (PST)
    [  2] local 192.168.1.30%eth0 port 47512 connected with 192.168.1.31 port 5001 (prefetch=16384) (trip-times) (sock=4) (icwnd/mss/irtt=14/1448/1495) (ct=1.63 ms) on 2023-11-27 17:10:25.970 (PST)
    [ ID] Interval        Transfer    Bandwidth       Write/Err  Rtry     Cwnd/RTT(var)        NetPwr
    [  3] 0.00-1.00 sec  68.5 MBytes   575 Mbits/sec  548/0        27     1766K/21442(90) us  3350
    [ ID] Interval        Transfer     Bandwidth      Write/Err  Rtry     Cwnd/RTT     isoch:tx/miss/slip  NetPwr
    [  1] 0.00-1.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       66K/21970 us         61/0/0 79.66
    [  5] 0.00-1.00 sec  25.1 MBytes   211 Mbits/sec  201/0         5      579K/21459(131) us  1228
    [  2] 0.00-1.00 sec  9.25 MBytes  77.6 Mbits/sec  74/0         3      292K/27137(1622) us  357
    [  4] 0.00-1.00 sec  5.13 MBytes  43.0 Mbits/sec  41/0         1      168K/176808(170226) us  30.39
    [  3] 1.00-2.00 sec  67.2 MBytes   564 Mbits/sec  538/0         0     1951K/28283(103) us  2493
    [  1] 1.00-2.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       66K/28303 us         60/0/0 61.83
    [  5] 1.00-2.00 sec  22.4 MBytes   188 Mbits/sec  179/0         0      657K/28198(73) us  832
    [  4] 1.00-2.00 sec  6.50 MBytes  54.5 Mbits/sec  52/0         0      209K/29901(1296) us  228
    [  2] 1.00-2.00 sec  11.8 MBytes  98.6 Mbits/sec  94/0         0      356K/28533(295) us  432
    [  3] 2.00-3.00 sec  66.1 MBytes   555 Mbits/sec  529/0         0     2094K/30578(130) us  2268
    [  1] 2.00-3.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       66K/30716 us         60/0/0 56.97
    [  5] 2.00-3.00 sec  22.2 MBytes   187 Mbits/sec  178/0         0      714K/30515(87) us  765
    [  2] 2.00-3.00 sec  12.1 MBytes   102 Mbits/sec  97/0         0      388K/30471(92) us  417
    [  4] 2.00-3.00 sec  7.00 MBytes  58.7 Mbits/sec  56/0         0      227K/30338(251) us  242
    [  3] 3.00-4.00 sec  66.6 MBytes   559 Mbits/sec  533/0         0     2208K/31909(167) us  2189
    [  1] 3.00-4.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0       66K/32059 us         60/0/0 54.59
    [  5] 3.00-4.00 sec  22.9 MBytes   192 Mbits/sec  183/0         0      755K/31919(78) us  751
    [  4] 3.00-4.00 sec  7.00 MBytes  58.7 Mbits/sec  56/0         0      238K/32175(268) us  228
    [  2] 3.00-4.00 sec  12.2 MBytes   103 Mbits/sec  98/0         0      407K/31847(145) us  403
    [  3] 4.00-5.00 sec  66.8 MBytes   560 Mbits/sec  534/0         0     2297K/33388(227) us  2096
    [  2] 4.00-5.00 sec  12.1 MBytes   102 Mbits/sec  97/0         0      417K/33071(76) us  384
    [  1] 4.00-5.00 sec  1.70 MBytes  14.2 Mbits/sec  61/0        0       80K/33104 us         61/0/0 53.74
    [  5] 4.00-5.00 sec  22.6 MBytes   190 Mbits/sec  181/0         0      779K/33300(61) us  712
    [  4] 4.00-5.00 sec  7.00 MBytes  58.7 Mbits/sec  56/0         0      260K/33358(389) us  220
    [  3] 5.00-6.00 sec  66.8 MBytes   560 Mbits/sec  534/0         0     2361K/34190(97) us  2047
    [  1] 5.00-6.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0      103K/34240 us         60/0/0 51.11
    [  5] 5.00-6.00 sec  22.5 MBytes   189 Mbits/sec  180/0         0      791K/34110(67) us  692
    [  4] 5.00-6.00 sec  7.62 MBytes  64.0 Mbits/sec  61/0         0      282K/34592(301) us  231
    [  2] 5.00-6.00 sec  12.0 MBytes   101 Mbits/sec  96/0         0      419K/34282(366) us  367
    [  3] 6.00-7.00 sec  64.2 MBytes   539 Mbits/sec  514/0         9     1750K/27336(201) us  2465
    [  1] 6.00-7.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0      103K/27765 us         60/0/0 63.03
    [  5] 6.00-7.00 sec  22.6 MBytes   190 Mbits/sec  181/0         3      598K/27124(98) us  875
    [  4] 6.00-7.00 sec  7.75 MBytes  65.0 Mbits/sec  62/0         0      302K/27397(607) us  297
    [  2] 6.00-7.00 sec  12.8 MBytes   107 Mbits/sec  102/0         0      434K/27296(165) us  490
    [  3] 7.00-8.00 sec  60.1 MBytes   504 Mbits/sec  481/0         1     1296K/22029(223) us  2862
    [  1] 7.00-8.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0      103K/23221 us         60/0/0 75.36
    [  5] 7.00-8.00 sec  23.2 MBytes   195 Mbits/sec  186/0         0      633K/21899(70) us  1113
    [  4] 7.00-8.00 sec  10.4 MBytes  87.0 Mbits/sec  83/0         0      328K/22872(798) us  476
    [  2] 7.00-8.00 sec  13.5 MBytes   113 Mbits/sec  108/0         2      227K/22327(331) us  634
    [  3] 8.00-9.00 sec  56.2 MBytes   472 Mbits/sec  450/0         0     1381K/23604(143) us  2499
    [  1] 8.00-9.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0      103K/24162 us         60/0/0 72.43
    [  5] 8.00-9.00 sec  27.0 MBytes   226 Mbits/sec  216/0         0      657K/23579(241) us  1201
    [  4] 8.00-9.00 sec  14.1 MBytes   118 Mbits/sec  113/0         0      359K/23591(103) us  628
    [  2] 8.00-9.00 sec  10.2 MBytes  86.0 Mbits/sec  82/0         0      260K/23682(156) us  454
    [  3] 9.00-10.00 sec  55.9 MBytes   469 Mbits/sec  447/0         0     1443K/24272(111) us  2414
    [  5] 9.00-10.00 sec  26.4 MBytes   221 Mbits/sec  211/0         0      670K/23996(72) us  1153
    [  4] 9.00-10.00 sec  14.4 MBytes   121 Mbits/sec  115/0         0      388K/25940(1031) us  581
    [  2] 9.00-10.00 sec  10.8 MBytes  90.2 Mbits/sec  86/0         0      289K/24394(318) us  462
    [  3] 0.00-10.02 sec   639 MBytes   535 Mbits/sec  5109/0        37     1445K/19317(286) us  3459
    [  5] 0.00-10.02 sec   237 MBytes   198 Mbits/sec  1897/0         8      671K/15398(235) us  1611
    [  4] 0.00-10.03 sec  87.0 MBytes  72.8 Mbits/sec  696/0         1      388K/5527(2678) us  1646
    [  1] 9.00-10.00 sec  1.67 MBytes  14.0 Mbits/sec  60/0        0      103K/25851 us         60/0/0 67.69
    [  2] 0.00-10.03 sec   117 MBytes  97.8 Mbits/sec  935/0         5      289K/13438(1753) us  910
    [  1] 0.00-10.03 sec  16.7 MBytes  14.0 Mbits/sec  602/0        0      103K/7857 us        603/0/0 223
    [  1] Isoch schedule errors (mean/min/max/stdev) = 0.069/0.040/0.409/0.020 ms
    [ CT] final connect times (min/avg/max) = 0.981/1.427/1.897 ms (tot/err) = 5/0
    
     
  • Robert McMahon

    Robert McMahon - 2023-11-28
    • status: open --> pending
     
  • Robert McMahon

    Robert McMahon - 2023-11-28
    • summary: enable histogram latency reporting for isochronous workloads --> enable histogram latency reporting for isochronous workloads, add working load support too
     
  • Robert McMahon

    Robert McMahon - 2023-11-28

    Use the --working-load option on the server so the server side can start two threads, one for TCP and one for UDP

    root@raspberrypi:/usr/local/src/iperf2-code# iperf -s -u -i 1 -e --working-load
    ------------------------------------------------------------
    Server listening on UDP port 5001 with pid 20024
    Working load listening on TCP port 5001
    Read buffer size: 1470 Byte 
    UDP buffer size:  208 KByte (default)
    ------------------------------------------------------------
    
     

Log in to post a comment.

MongoDB Logo MongoDB