diff --git a/bench/RESULTS.md b/bench/RESULTS.md index 9295852..976f94e 100644 --- a/bench/RESULTS.md +++ b/bench/RESULTS.md @@ -3,47 +3,39 @@ 3proxy against nginx, haproxy, envoy, squid, tinyproxy, dante and stunnel on two machines, as an HTTP proxy, through CONNECT and SOCKSv5 tunnels, as a TCP relay, ending or beginning TLS, and with 20000 connections open at once; and -devel against 1.0.1. The current figures are from the evening of 13 October -2026, for devel with 16 KB buffers, the automatic splice() mode by default, -the thread pool and the half-close fix; the sessions before them are at the -end. How the benchmark works is in [README.md](README.md); the measurements -are in [data/](data/), and `bench/report.py` turns them into the tables -below. +the version ladder 0.9.9.2 / 1.0.2 / devel / experimental against them all. +The current figures are from 29-30 October 2026: the four 3proxy versions, +every proxy, the plain suite and the mix over a shaped link (the section +[The four 3proxy versions](#the-four-3proxy-versions-and-every-proxy-30-october-2026) +below); the sessions before them are at the end. How the benchmark works is +in [README.md](README.md); the measurements are in [data/](data/), and +`bench/report.py` turns them into the older tables. ## In short Ranges are over the two machines, ARM and Intel; the tables give each. -* **Bulk data:** devel splices 32-48 Gbit/s through CONNECT, SOCKS and - `tcppm` and 25-35 in 1 MB HTTP answers, the fastest everywhere: 2.2-3.1 - times squid, 2-4.3 times dante, 2.7-6.1 times nginx and haproxy copying 1 MB - answers and 1.5-2.2 times envoy, the fastest copying proxy. haproxy - `splice-auto` is level with it as a relay on Intel and behind on ARM. - Copying with its 16 KB buffers (`-s0`) devel does 9.4-14.4 Gbit/s, level - with nginx and haproxy; the automatic mode, the default, is what makes 16 - KB enough. -* **Small requests:** nginx and haproxy answer 1.5-2.3 times more 1 KB - requests as relays and 1.8-2.9 times as HTTP proxies; squid 1.2-1.85 times - more through CONNECT; through SOCKS dante leads on ARM, devel on Intel. - 3proxy runs a thread per connection; splice() cannot change that. -* **A new connection per request:** nginx and haproxy do 1.35-1.5 times more - as relays, 2.3-2.8 times as HTTP proxies, where they keep their connections - to the origin and a forward proxy cannot. -* **2000 clients, 50 KB answers:** on Intel devel leads as an HTTP proxy, - through CONNECT and through SOCKS; on ARM nginx and envoy are 12% ahead of - it as HTTP proxies, squid 41% through CONNECT, dante 29% through SOCKS. As - a relay haproxy `splice-auto` leads on both. -* **HTTPS:** with TLS ended or begun in the proxy devel moves bulk data as - fast as nginx, ahead of haproxy and stunnel, with the least memory; envoy - (BoringSSL) leads, by 30-50% on ARM. devel answers half to two thirds of - nginx's 1 KB requests and does 60-95% of its handshakes. See - [HTTPS](#https-tls-in-the-proxy). -* **20000 connections:** devel does 63-95% of the best as an HTTP proxy and - a relay and leads through CONNECT and SOCKS on Intel, with no failed - exchange; it needs 65-90 KB per connection against 8-36 KB for nginx, - haproxy and envoy. See [the mix scenarios](#many-connections-the-mix-scenarios). -* **Memory with few connections:** 3proxy needs 4-23 MB, envoy 16-31 MB, - nginx and haproxy 28-44 MB. +* **The version ladder:** 0.9.9.2 collapses on small kept-alive requests as + an HTTP proxy (1.5k req/s against 17.7k for 1.0.2 on Intel; fixed in + 1.0.2) and is otherwise level with 1.0.2. devel adds splice(): streams go + from 18-25 to 30-63 Gbit/s. experimental (the current head) adds the + buffer pool and loop relay work: +50-100% over devel on every request + scenario, close-1k and all mixes, with half the memory (28-35 MB + idle-scale against 130+ MB). +* **experimental against everyone:** best of all proxies as an HTTP proxy + from 2000 clients (14.2k against nginx 8.7k on Intel), best through + CONNECT and SOCKS on both machines, best 3proxy everywhere in the mix - + 9.2k against nginx 7.4k req/s on Intel plain, 5.4-6.0k shaped - and the + only proxy with no failed exchange anywhere. nginx and haproxy still lead + the small-request scenarios (44-50k against 34.9k on ka-1k, 15.4k against + 7.0k on close-1k, Intel). +* **dante** manages 40-65% of experimental through SOCKS with the only + nonzero errors of the set, and cannot stand 20000 connections at all: on + 8 GB machines its per-connection processes exhaust memory, and it is only + measurable with a smaller pool (2.5k req/s at 2000, 2.13k at 10000, ARM + shaped, against 2.58k/2.43k for experimental). +* **Memory with few connections:** experimental needs 4-35 MB, envoy 16-31, + nginx and haproxy 28-44. ## Setup @@ -52,12 +44,12 @@ Ranges are over the two machines, ARM and Intel; the tables give each. | host | Apple M4 Pro laptop, UTM (Apple Virtualization) | OpenStack virtual machine, KVM | | virtual machine | 8 CPUs, 8 GB | 8 CPUs (Intel Xeon, Skylake, 2.0 GHz), 8 GB | | system | Ubuntu 24.04, Linux 6.8, aarch64 | AlmaLinux 10, Linux 6.12, x86_64 | -| nginx | 1.24.0 | 1.26.3 | -| haproxy | 2.8.16 | 3.0.5 | -| squid | 6.14 | 6.10 | -| tinyproxy | 1.11.1 | 1.11.2 | -| dante | 1.4.3 | 1.4.4 | -| wrk, iperf3 | 4.1.0, 3.16 | 4.2.0, 3.17.1 | +| nginx | 1.28.3 | 1.26.3 | +| haproxy | 3.2.25 | 3.0.5 | +| squid | 7.7 | 6.10 | +| tinyproxy | 1.11.2 (built from source) | 1.11.2 | +| dante | 1.4.4 | 1.4.4 | +| wrk, iperf3 | 4.2.0, 3.20 | 4.2.0, 3.17.1 | | proxychains-ng | 4.17 | 4.17 | | envoy | 1.34.1 (BoringSSL) | 1.34.1 (BoringSSL) | | stunnel, OpenSSL | 5.72, 3.0.13 | 5.72, 3.5.8 | @@ -93,10 +85,12 @@ Ranges are over the two machines, ARM and Intel; the tables give each. | column | configuration | |---|---| -| devel | devel as of the evening of 13 October (98fd0f3): 16 KB buffers, the thread pool, splice() in its automatic mode, the default: each direction switched to splice() once two reads in a row fill 16 KB and back to copying after three small ones; an HTTP body of known length is spliced when 16 KB or more of it remain; a half-closed connection relays the rest of the answer; an idle kept-alive connection gives up its request buffer | -| devel -s0 | devel, no splice (TCP_NODELAY is on by default) | -| 1.0.1 | 1.0.1 built without splice, 64 KB buffers, with TCP_NODELAY on both sides (`-ocTCP_NODELAY -osTCP_NODELAY`) as devel sets it by default | -| nginx | `proxy_pass` to an upstream with `keepalive 1024`, `stream` with `proxy_half_close on` for the TCP relay, `reuseport` | +| 0.9.9.2 | the 0.9 LTS line's last release, no splice(), 64 KB buffers, a thread per connection | +| 1.0.2 | release 1.0.2, no splice(), 64 KB buffers | +| devel | devel as of 30 October (c3702866): 16 KB buffers, the thread pool, splice() in its automatic mode | +| experimental (bp) | the experimental head (5de7ae2): devel plus the event loops relaying by default (loopmode cb) and the pool of 16 KB buffers | +| nginx | `proxy_pass` to an upstream with `keepalive 1024`, `stream` for the TCP relay, `reuseport` | +| nginx-halfclose | the same with `proxy_half_close on` on the relays (not nginx's default) | | haproxy | `mode http` with `http-reuse always`, `mode tcp` for the TCP relay | | haproxy splice-auto | `option splice-auto`: splices a direction once reads fill the buffer three times in a row | | envoy | one worker (`--concurrency 1`), `http_connection_manager` with the router filter as an HTTP proxy for the origin, `tcp_proxy` for the TCP relay | @@ -134,1147 +128,300 @@ a TCP relay to the origin (3proxy `tcppm`, nginx `stream`, haproxy two are different machines in different conditions, and an average of them would mean nothing. Each cell is the median of three runs; TCP streams and 1 MB answers in Gbit/s, the other HTTP scenarios in thousands of requests - per second. ‡: most runs were limited by the client or the origin rather - than by the proxy, which can then do at least that much. -* Each table has the proxies copying through user space first, then, after - `‖`, those using splice(): devel, whose automatic mode is its default, and - haproxy with `splice-auto`. -* HTTP proxy and TCP relay: **bold** is the best median of its group - (copying, or splice()) in the row, and any other of the group whose runs - cannot be told apart from it: its fastest run reaches the best one's - slowest. - \* marks the best of the row over both groups, by the same rule. -* CONNECT and SOCKS, where devel is the only proxy using splice(): only the - best of the row is marked, bold and with \*. -* Latency tables: each cell the medians over the runs of their 50th and - 99th percentile, in ms; bold is the lowest 99th percentile of its group - and any other whose runs overlap it, \* the lowest of the row. iperf3 - streams have none. wrk runs a closed loop, each connection sending its - next request once the answer is in, so a proxy answering fewer requests - shows a longer median by that alone (64 connections at 16k requests a - second are 4 ms each); what compares is the 99th percentile against the - median, how evenly a proxy serves its connections, which matters most with - 2000 clients. wrk leaves requests over 2 seconds out (they are counted as - timeouts). The mix `-3k` runs are an open loop at a fixed rate, the ones - where latency compares directly; mix counts in steps of a sixteenth of a - power of two (16.4 means 16.4-17.4 ms). -* CPU time per gigabyte or request and peak memory are in the data. CPU adds - little: every proxy ran at its CPU limit, so its CPU per unit of work is the - inverse of its throughput. - -## HTTP proxy - -Measured on the evening of 13 October 2026, as were the CONNECT, SOCKS and -relay tables ([data/](data/) `*-full-*.csv`). - -**ARM (M4)** - -| scenario (ARM) | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| ka-1k, k req/s | 15.3 | 5.9 | **45.1** * | 37.3 | 24.1 | 4.1 | 21.3 | ‖ | 15.4 | **44.8** * | -| ka-1m, Gbit/s | 13.5 | 12.3 | 5.7 ‡ | 12.8 | **23.9 ‡** | 1.1 | 3.2 ‡ | ‖ | **35.0 ‡** * | 5.9 ‡ | -| ka-50k-2000, k req/s | 8.9 | 9.2 | 9.6 | **11.3** * | **11.2** * | 1.7 | 4.6 | ‖ | **10.0** | 9.8 | -| ka-2k-50k-2000, k req/s | 8.1 | 7.8 | 8.8 | 10.3 | **11.3** * | 1.6 | 3.5 | ‖ | **9.0** | 8.8 | -| close-1k, k req/s | 5.9 | 4.5 | **16.8** * | 13.4 | 15.3 | 4.0 | 7.2 | ‖ | 5.9 | **16.7** * | - -**Intel (Skylake)** - -| scenario (Intel) | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| ka-1k, k req/s | 17.2 | 6.1 | **32.7** * | **31.6** * | 9.9 | 3.8 | 8.8 | ‖ | 17.9 | **33.9** * | -| ka-1m, Gbit/s | 9.4 | **12.4** | 7.3 | 5.8 | **11.8** | 1.1 | 2.1 | ‖ | **25.3 ‡** * | **22.5 ‡** * | -| ka-50k-2000, k req/s | 8.1 | **9.4** * | 7.1 | **8.9** * | 6.1 | 1.6 | 2.1 | ‖ | **9.6** * | 7.1 | -| ka-2k-50k-2000, k req/s | **7.5** | **8.8** * | 7.3 | **8.3** | 4.9 | 1.6 | 1.8 | ‖ | **9.4** * | 7.1 | -| close-1k, k req/s | 5.8 | 3.9 | **14.8** * | 12.9 | 5.8 | 3.6 | 3.9 | ‖ | 5.5 | **15.0** * | - -Latency, the 50th / 99th percentile in ms: - -**ARM (M4)** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| ka-1k | 3.99 / 8.25 | 10.7 / 12.4 | **1.36 / 2.06** * | 1.68 / 2.18 * | 2.60 / 3.82 | 15.2 / 24.8 | 2.93 / 3.62 | ‖ | 3.98 / 8.14 | **1.37 / 2.05** * | -| ka-1m | 9.75 / 16.0 | 10.9 / 11.8 | 23.1 / 27.6 | 10.3 / 15.9 | **5.58 / 8.26** * | 123 / 148 | 39.7 / 48.1 | ‖ | **3.62 / 7.92** * | 22.5 / 25.2 | -| ka-50k-2000 | 67.9 / 256 | 69.5 / 226 | 196 / 539 | **83.4 / 96.9** * | 172 / 394 | 625 / 1,490 | 224 / 367 | ‖ | **52.2 / 165** | 194 / 640 | -| ka-2k-50k-2000 | 79.9 / 176 | 89.9 / 211 | 218 / 726 | **77.2 / 96.9** * | 172 / 261 | 634 / 1,680 | 266 / 369 | ‖ | **68.1 / 171** | 217 / 700 | -| close-1k | 10.7 / 16.9 | 13.9 / 21.9 | **3.66 / 4.33** * | 4.64 / 5.31 | 3.96 / 5.68 | 15.4 / 25.2 | 8.70 / 9.54 | ‖ | 10.7 / 17.1 | **3.69 / 4.34** * | - -**Intel (Skylake)** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| ka-1k | 3.51 / 7.53 | 10.4 / 11.9 | **1.90 / 3.12** * | **1.86 / 2.90** * | 6.05 / 10.2 | 16.2 / 26.9 | 6.94 / 10.5 | ‖ | 3.40 / 7.01 | **1.74 / 2.96** * | -| ka-1m | 13.6 / 31.0 | **10.7 / 12.1** | 19.5 / 26.2 | 22.6 / 36.3 | 11.1 / 16.6 | 117 / 157 | 60.0 / 81.7 | ‖ | 5.01 / 11.9 | **5.62 / 9.29** * | -| ka-50k-2000 | 67.8 / 139 | **49.2 / 101** * | 266 / 710 | 124 / 166 | 314 / 540 | 646 / 1,700 | 485 / 578 | ‖ | **60.4 / 127** * | 261 / 673 | -| ka-2k-50k-2000 | 76.4 / 150 | **56.3 / 101** * | 262 / 658 | 130 / 174 | 383 / 608 | 657 / 1,680 | 560 / 631 | ‖ | **56.4 / 108** * | 268 / 728 | -| close-1k | 10.5 / 19.6 | 15.5 / 27.5 | **3.94 / 5.99** * | 4.56 / 6.71 | 10.7 / 16.9 | 16.6 / 28.1 | 15.6 / 21.2 | ‖ | 10.8 / 22.1 | **3.99 / 5.86** * | - -* 1 MB answers: devel splices them at 35 Gbit/s on ARM and 25 on Intel, 2.7 - to 6.1 times nginx and haproxy copying and 1.5-2.1 times envoy, the fastest - of the copying proxies here. haproxy `splice-auto` keeps up on Intel (22.5) - but hardly splices on ARM (5.9). -* 2000 clients with 50 KB answers: nginx and envoy lead on ARM (11.3k - requests a second against devel's 10.0k), devel on Intel (9.6k against - nginx's 8.9k); haproxy is behind both on both. With a 2 KB POST each, the - same order, envoy first on ARM. -* nginx and haproxy answer 2.4-2.9 times more 1 KB requests over kept-alive - connections on ARM, 1.8-1.9 times on Intel, and 2.3-2.8 times more with a - new connection for each. That last gap is not the thread pool's: nginx - (`keepalive 1024`) and haproxy (`http-reuse always`) keep their connections - to the origin and only accept and close the client's, while a forward proxy - such as 3proxy also opens and closes one to the server for every client - connection. As a TCP relay, where every proxy does, the gap is 1.5 times on - ARM and 1.35 on Intel. -* envoy is close to nginx on ARM and well behind it on Intel (9.9k 1 KB - requests against 31.6k, 5.8k new connections a second against 12.9k). -* 1.0.1, with TCP_NODELAY set this time, answers 6k 1 KB requests a second - over kept-alive connections (1.5k without it): one every 10.6 ms on each of - the 64 connections, held by a 10 ms sleep removed in devel. -* Latency: with 2000 clients devel's 99th percentile is 108-171 ms, nginx's - 97-174 ms and the closest to its median, haproxy's 540-730 ms and envoy's - 260-610 ms. With 1 KB requests devel's is 7-8 ms against 2-3 for nginx and - haproxy, which answer twice as many. - -## CONNECT tunnel - -**ARM (M4)** - -| scenario (ARM) | devel -s0 | 1.0.1 | tinyproxy | squid | ‖ | devel | -|---|---:|---:|---:|---:|:-:|---:| -| stream1-down, Gbit/s | 14.4 | 22.7 | 1.3 | 15.2 | ‖ | **47.3 ‡** * | -| stream16, Gbit/s | 13.7 | 21.1 | 1.3 | 17.7 | ‖ | **38.5 ‡** * | -| ka-1k, k req/s | 19.7 | 19.7 | 17.1 | **36.4 ‡** * | ‖ | 19.7 | -| ka-50k-2000, k req/s | 9.5 | 11.2 | 2.2 | **16.1** * | ‖ | 11.4 | -| ka-2k-50k-2000, k req/s | 8.7 | 10.4 | 2.2 | **15.1** * | ‖ | 10.6 | -| close-1k, k req/s | 4.6 ‡ | 3.7 ‡ | 4.1 ‡ | **5.3 ‡** * | ‖ | 4.6 ‡ | - -**Intel (Skylake)** - -| scenario (Intel) | devel -s0 | 1.0.1 | tinyproxy | squid | ‖ | devel | -|---|---:|---:|---:|---:|:-:|---:| -| stream1-down, Gbit/s | 10.0 | 20.3 | 1.2 | 13.9 | ‖ | **33.9** * | -| stream16, Gbit/s | 10.1 | 19.6 | 1.3 | 13.2 | ‖ | **32.4** * | -| ka-1k, k req/s | 31.6 | 31.8 | 30.2 | **37.0** * | ‖ | 30.8 | -| ka-50k-2000, k req/s | 10.5 | 13.3 | 2.5 | 11.7 | ‖ | **15.8** * | -| ka-2k-50k-2000, k req/s | 9.8 | 12.8 | 2.4 | 11.4 | ‖ | **14.6** * | -| close-1k, k req/s | 5.3 ‡ | 3.7 | 5.1 ‡ | 3.7 | ‖ | **5.3 ‡** * | - -Latency, the 50th / 99th percentile in ms: - -**ARM (M4)** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | tinyproxy | squid | ‖ | devel | -|---|---:|---:|---:|---:|:-:|---:| -| ka-1k | 3.04 / 6.80 | 3.04 / 6.78 | 3.59 / 6.71 | **1.74 / 2.13** * | ‖ | **3.04 / 6.74** | -| ka-50k-2000 | 178 / 354 | 147 / 320 | 757 / 1,120 | **118 / 130** * | ‖ | **145 / 318** | -| ka-2k-50k-2000 | 195 / 367 | 157 / 326 | 750 / 1,190 | **126 / 136** * | ‖ | **159 / 321** | -| close-1k | 5.49 / 13.6 | 6.34 / 15.7 | 5.99 / 15.0 | **5.34 / 10.5** * | ‖ | **5.20 / 13.3** | - -**Intel (Skylake)** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | tinyproxy | squid | ‖ | devel | -|---|---:|---:|---:|---:|:-:|---:| -| ka-1k | 1.94 / 3.42 | 1.92 / 3.54 | 2.03 / 3.55 | **1.63 / 2.63** * | ‖ | **1.97 / 3.54** | -| ka-50k-2000 | 135 / 253 | 109 / 223 | 477 / 1,390 | **160 / 185** * | ‖ | **82.4 / 213** | -| ka-2k-50k-2000 | 118 / 270 | 110 / 203 | 463 / 1,380 | **163 / 177** * | ‖ | **86.0 / 176** * | -| close-1k | **3.75 / 11.8** * | 5.29 / 16.0 | **3.70 / 11.0** * | 6.80 / 15.2 | ‖ | **3.31 / 11.3** * | - -* With splice() devel moves 32-47 Gbit/s through a tunnel, 2.2-3.1 times - squid; copying with 16 KB buffers (`-s0`) it does 10-14, below 1.0.1's - 20-23 with its 64 KB buffers, which is what the automatic mode is for. -* squid answers 1 KB requests 1.85 times as fast as devel on ARM, 20% faster - on Intel; with 2000 clients squid leads on ARM (16.1k against 11.4k), devel - on Intel (15.8k against 11.7k). -* With a new tunnel per request proxychains on the client sets the pace on - ARM; on Intel devel does 5.3k a second, squid 3.7k. -* Latency: squid serves 2000 clients the most evenly, its 99th percentile - 130-185 ms against devel's 210-320. - -## SOCKSv5 tunnel - -**ARM (M4)** - -| scenario (ARM) | devel -s0 | 1.0.1 | dante | ‖ | devel | -|---|---:|---:|---:|:-:|---:| -| stream1-down, Gbit/s | 13.9 | 22.8 | 11.2 | ‖ | **48.1 ‡** * | -| stream16, Gbit/s | 14.2 | 21.0 | 14.6 | ‖ | **38.5 ‡** * | -| ka-1k, k req/s | 19.7 | 19.7 | **28.5** * | ‖ | 19.7 | -| ka-50k-2000, k req/s | 9.4 | 11.1 | **14.7** * | ‖ | 11.4 | -| ka-2k-50k-2000, k req/s | 8.7 | 10.3 | **13.9** * | ‖ | 10.5 | -| close-1k, k req/s | **4.4** * | 3.6 | 3.8 | ‖ | **4.4** * | - -**Intel (Skylake)** - -| scenario (Intel) | devel -s0 | 1.0.1 | dante | ‖ | devel | -|---|---:|---:|---:|:-:|---:| -| stream1-down, Gbit/s | 10.2 | 20.7 | 8.2 | ‖ | **33.3** * | -| stream16, Gbit/s | 10.2 | 19.3 | 15.9 | ‖ | **31.9** * | -| ka-1k, k req/s | **31.4** * | **31.2** * | 25.6 | ‖ | **30.4** * | -| ka-50k-2000, k req/s | 10.4 | 13.4 | 12.5 | ‖ | **15.8** * | -| ka-2k-50k-2000, k req/s | 10.1 | 12.7 | 11.5 | ‖ | **14.7** * | -| close-1k, k req/s | **5.3** * | 3.9 | 1.6 | ‖ | **5.1** * | - -Latency, the 50th / 99th percentile in ms: - -**ARM (M4)** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | dante | ‖ | devel | -|---|---:|---:|---:|:-:|---:| -| ka-1k | 3.03 / 6.75 | 3.03 / 6.75 | **1.15 / 4.34** * | ‖ | **3.03 / 6.73** | -| ka-50k-2000 | 183 / 355 | 144 / 610 | **185 / 198** * | ‖ | **150 / 321** | -| ka-2k-50k-2000 | 203 / 367 | 163 / 331 | **186 / 201** * | ‖ | **164 / 322** | -| close-1k | **5.48 / 14.0** * | 5.91 / 15.8 | 6.11 / 17.8 | ‖ | **5.40 / 14.0** * | - -**Intel (Skylake)** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | dante | ‖ | devel | -|---|---:|---:|---:|:-:|---:| -| ka-1k | **1.93 / 3.62** * | **1.97 / 3.48** * | 1.46 / 5.66 | ‖ | **1.98 / 3.72** * | -| ka-50k-2000 | 137 / 257 | **118 / 221** | 2.25 / 328 | ‖ | **82.0 / 186** * | -| ka-2k-50k-2000 | 152 / 267 | **119 / 218** | 2.35 / 331 | ‖ | **101 / 195** * | -| close-1k | **3.49 / 11.2** * | 4.81 / 15.0 | 14.1 / 40.0 | ‖ | **3.75 / 12.2** * | - -* devel moves 32-48 Gbit/s with splice(), 2-4.3 times dante. -* On ARM dante answers 45% more 1 KB requests and 29% more with 2000 clients; - on Intel devel leads both (by 19% and 26%). -* With a new tunnel per request devel manages 4.4-5.3k a second, dante 3.8k - on ARM and 1.6k on Intel. -* Latency: with 2000 clients dante's 99th percentile is 200-330 ms, devel's - 190-320. - -## TCP relay - -**ARM (M4)** - -| scenario (ARM) | devel -s0 | 1.0.1 | haproxy | nginx | envoy | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|:-:|---:|---:| -| stream1-down, Gbit/s | 14.0 | 22.5 | 13.4 | 13.4 | **29.2** | ‖ | **48.0 ‡** * | 30.4 | -| stream16, Gbit/s | 13.8 | **21.0** | 9.7 ‡ | 13.7 | 20.3 | ‖ | **38.3 ‡** * | 16.4 ‡ | -| ka-1k, k req/s | 20.3 | 20.1 | **46.2** * | 44.2 | 35.5 | ‖ | 20.2 | **43.9** * | -| ka-50k-2000, k req/s | 10.4 | 12.2 | 11.2 | 14.5 | **15.1** | ‖ | 12.6 | **17.4** * | -| ka-2k-50k-2000, k req/s | 9.7 | 11.3 | 11.3 | 13.4 | **13.9** | ‖ | 11.6 | **17.1** * | -| close-1k, k req/s | 6.4 | 5.1 | **9.7** * | 8.8 | **9.6** * | ‖ | 6.4 | **9.7** * | - -**Intel (Skylake)** - -| scenario (Intel) | devel -s0 | 1.0.1 | haproxy | nginx | envoy | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|:-:|---:|---:| -| stream1-down, Gbit/s | 10.1 | **19.3** | 9.8 | 9.4 | 18.2 | ‖ | **33.2** * | **32.7** * | -| stream16, Gbit/s | 9.7 | **19.2** | 9.2 | 9.7 | 14.7 | ‖ | **32.3** * | 30.7 ‡ | -| ka-1k, k req/s | 29.8 | 30.9 | **48.3** * | **49.3** * | 36.6 | ‖ | 30.6 | **46.8** | -| ka-50k-2000, k req/s | 11.0 | **15.0** | 10.2 | 12.3 | 12.8 | ‖ | 18.1 | **19.9** * | -| ka-2k-50k-2000, k req/s | 10.5 | **13.8** | 9.7 | 12.1 | 12.4 | ‖ | 16.4 | **18.6** * | -| close-1k, k req/s | 6.8 | 4.8 | **8.8** * | **8.6** * | 5.4 | ‖ | 6.5 | **8.7** * | - -Latency, the 50th / 99th percentile in ms: - -**ARM (M4)** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | haproxy | nginx | envoy | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|:-:|---:|---:| -| ka-1k | 2.96 / 6.86 | 2.98 / 6.92 | 1.33 / 1.98 | **1.41 / 1.89** * | 1.72 / 2.70 | ‖ | 2.97 / 6.97 | **1.38 / 2.13** | -| ka-50k-2000 | 55.3 / 169 | 47.8 / 162 | 177 / 1,010 | **55.8 / 77.5** * | 130 / 219 | ‖ | **43.8 / 309** | 82.5 / 932 | -| ka-2k-50k-2000 | 58.6 / 156 | 52.1 / 153 | 172 / 1,110 | **65.5 / 81.0** * | 140 / 234 | ‖ | **50.1 / 260** | 82.5 / 1,180 | -| close-1k | 9.71 / 16.3 | 12.3 / 19.5 | **6.49 / 7.28** * | 7.11 / 7.99 | 6.34 / 9.16 | ‖ | 9.72 / 16.3 | **6.47 / 7.29** * | - -**Intel (Skylake)** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | haproxy | nginx | envoy | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|:-:|---:|---:| -| ka-1k | 2.02 / 4.14 | 1.98 / 3.99 | **1.28 / 1.84** * | **1.24 / 1.82** * | 1.64 / 2.87 | ‖ | 1.98 / 3.98 | **1.29 / 1.87** * | -| ka-50k-2000 | **36.3 / 86.2** | **28.9 / 65.7** | 190 / 978 | 79.8 / 105 | 150 / 348 | ‖ | **23.4 / 49.9** * | 90.8 / 744 | -| ka-2k-50k-2000 | **40.5 / 94.5** | **32.6 / 68.7** * | 196 / 1,110 | 80.9 / 100 | 154 / 386 | ‖ | **25.4 / 47.5** * | 97.2 / 750 | -| close-1k | 9.16 / 16.6 | 12.7 / 24.0 | **6.99 / 9.78** * | **7.09 / 10.2** * | 11.3 / 16.8 | ‖ | 9.33 / 17.7 | **7.08 / 10.0** * | - -* On streams devel splices 32-48 Gbit/s; haproxy `splice-auto` is level on - Intel (32.7 and 30.7), behind on ARM (30 and 16). Of the copying proxies - envoy is level with 1.0.1 and its 64 KB buffers on one stream (18-29), - devel splicing 1.6-2.2 times either. -* nginx and haproxy answer 2.2-2.3 times more 1 KB requests on ARM, 1.5-1.6 - times on Intel. -* With 2000 clients and 50 KB answers haproxy `splice-auto` leads, 38% ahead - of devel on ARM and 10% on Intel. -* nginx runs with `proxy_half_close on` (`nginx::halfclose`), off by default, - without which its relays cut short the exchanges whose client shuts down - its sending side first. -* Latency: with 2000 clients nginx's 99th percentile is 78-105 ms; devel's - is 48-50 ms on Intel, the lowest, and 260-310 ms on ARM; haproxy's about a - second, with or without splice(). - -## HTTPS: TLS in the proxy - -Measured on 13 October 2026 with devel as of the evening: 16 KB buffers, -splice() in its automatic mode, the thread pool, TLS read a record ahead and -relayed a full record per write ([data/](data/) `*-tls.csv`). Every proxy -relays TCP, ending TLS (`term`: TLS from the client, plain TCP to the origin) -or beginning it (`init`: plain TCP from the client, TLS to the origin): 3proxy -`tcppm` under `ssl_serv` / `ssl_cli`, nginx `stream` with `ssl` and -`proxy_ssl`, haproxy `mode tcp` with `ssl crt` and `server ... ssl`, envoy -`tcp_proxy` with TLS transport sockets, stunnel. ECDSA P-256 certificate, -TLS 1.3; envoy uses BoringSSL, the others OpenSSL (3.0.13 on ARM, 3.5.8 on -Intel). "no proxy" is the client speaking TLS to the origin itself. The -`*-ka-*` and `*-close-*` scenarios are wrk over HTTPS, the `*-stream*` ones -iperf3 wrapped in TLS by `bench/mix tls`; on one stream that wrapper, a Go -program on one core, can set the pace (‡). - -### ARM (M4) - -**throughput, Gbit/s (thousands of requests per second for HTTP)** - -| scenario | no proxy | ‖ | devel | haproxy | nginx | envoy | stunnel | -|---|---:|:-:|---:|---:|---:|---:|---:| -| tls-term-ka-1k | 1.43 (139.2k/s) | ‖ | 0.17 (16.8k/s) | 0.33 (31.9k/s) | **0.34 (33.4k/s)** | 0.32 (30.9k/s) | 0.14 (13.9k/s) | -| tls-term-ka-1m | 29.81 (3.5k/s) | ‖ | 7.20 (0.9k/s) | 4.88 (0.6k/s) ‡ | 7.24 (0.9k/s) | **10.57 (1.3k/s) ‡** | 4.66 (0.6k/s) | -| tls-term-close-1k | 0.13 (12.3k/s) | ‖ | 0.03 (2.7k/s) ‡ | 0.03 (2.8k/s) ‡ | 0.03 (3.3k/s) ‡ | **0.04 (3.9k/s) ‡** | 0.02 (1.9k/s) ‡ | -| tls-term-stream1-down | 9.3 | ‖ | 9.2 ‡ | 8.8 ‡ | 8.6 ‡ | **9.6 ‡** | 4.7 | -| tls-term-stream16 | 19.3 | ‖ | 6.7 | 5.0 | 6.7 | **9.4** | 4.3 | -| tls-init-ka-1k | 1.43 (138.8k/s) | ‖ | 0.18 (17.2k/s) | 0.33 (32.4k/s) | **0.35 (33.7k/s)** | 0.32 (31.3k/s) | 0.15 (14.2k/s) | -| tls-init-ka-1m | 28.69 (3.4k/s) | ‖ | 6.14 (0.7k/s) | 4.63 (0.6k/s) | 5.84 (0.7k/s) | **8.59 (1.0k/s)** | 4.19 (0.5k/s) | -| tls-init-close-1k | 0.13 (12.2k/s) | ‖ | 0.02 (2.0k/s) | 0.03 (2.5k/s) | 0.03 (3.4k/s) | **0.06 (5.7k/s)** | 0.02 (1.9k/s) | -| tls-init-stream1-down | 9.2 | ‖ | 7.2 | 5.8 | 7.2 | **10.9** | 4.4 | -| tls-init-stream16 | 19.6 | ‖ | 8.3 ‡ | 5.9 ‡ | 7.8 ‡ | **11.0 ‡** | 5.2 ‡ | - -**proxy CPU time per gigabyte or per request** - -| scenario | no proxy | ‖ | devel | haproxy | nginx | envoy | stunnel | -|---|---:|:-:|---:|---:|---:|---:|---:| -| tls-term-ka-1k | – | ‖ | 60 µs/req | 31 µs/req | **30 µs/req** | 32 µs/req | 72 µs/req | -| tls-term-ka-1m | – | ‖ | 1.11 s/GB | 1.66 s/GB | 1.10 s/GB | **0.76 s/GB** | 1.72 s/GB | -| tls-term-close-1k | – | ‖ | 370 µs/req | 358 µs/req | 307 µs/req | **255 µs/req** | 514 µs/req | -| tls-term-stream1-down | – | ‖ | 0.85 s/GB | 0.87 s/GB | 0.91 s/GB | **0.77 s/GB** | 1.70 s/GB | -| tls-term-stream16 | – | ‖ | 1.20 s/GB | 1.60 s/GB | 1.20 s/GB | **0.85 s/GB** | 1.88 s/GB | -| tls-init-ka-1k | – | ‖ | 58 µs/req | 31 µs/req | **30 µs/req** | 32 µs/req | 71 µs/req | -| tls-init-ka-1m | – | ‖ | 1.31 s/GB | 1.75 s/GB | 1.37 s/GB | **0.93 s/GB** | 1.92 s/GB | -| tls-init-close-1k | – | ‖ | 499 µs/req | 408 µs/req | 297 µs/req | **176 µs/req** | 518 µs/req | -| tls-init-stream1-down | – | ‖ | 1.11 s/GB | 1.37 s/GB | 1.11 s/GB | **0.74 s/GB** | 1.81 s/GB | -| tls-init-stream16 | – | ‖ | 0.96 s/GB | 1.35 s/GB | 1.03 s/GB | **0.73 s/GB** | 1.53 s/GB | - -**proxy peak memory, MB** - -| scenario | no proxy | ‖ | devel | haproxy | nginx | envoy | stunnel | -|---|---:|:-:|---:|---:|---:|---:|---:| -| tls-term-ka-1k | – | ‖ | **12** | 36 | 32 | 18 | 13 | -| tls-term-ka-1m | – | ‖ | **15** | 43 | 44 | 41 | **13** | -| tls-term-close-1k | – | ‖ | **14** | 37 | 32 | 19 | 21 | -| tls-term-stream1-down | – | ‖ | 7 | 40 | 34 | 26 | **5** | -| tls-term-stream16 | – | ‖ | **26** | 55 | 53 | 66 | **21** | -| tls-init-ka-1k | – | ‖ | **13** | 37 | 33 | 17 | 14 | -| tls-init-ka-1m | – | ‖ | **16** | 49 | 44 | 41 | **18** | -| tls-init-close-1k | – | ‖ | **17** | 38 | 33 | **19** | **19** | -| tls-init-stream1-down | – | ‖ | **6** | 40 | 37 | 25 | **6** | -| tls-init-stream16 | – | ‖ | **62** | **59** | 72 | 122 | **56** | - -### Intel (Skylake) - -**throughput, Gbit/s (thousands of requests per second for HTTP)** - -| scenario | no proxy | ‖ | devel | haproxy | nginx | envoy | stunnel | -|---|---:|:-:|---:|---:|---:|---:|---:| -| tls-term-ka-1k | 0.97 (95.0k/s) | ‖ | 0.23 (22.5k/s) | 0.33 (32.5k/s) | **0.34 (33.4k/s)** | 0.28 (27.1k/s) | 0.19 (18.2k/s) | -| tls-term-ka-1m | 19.50 (2.3k/s) | ‖ | **5.90 (0.7k/s)** | **5.48 (0.7k/s)** | **5.82 (0.7k/s)** | **5.80 (0.7k/s)** | 4.51 (0.5k/s) | -| tls-term-close-1k | 0.03 (3.3k/s) | ‖ | 0.01 (1.2k/s) ‡ | 0.01 (1.3k/s) ‡ | 0.01 (1.3k/s) ‡ | **0.02 (2.0k/s) ‡** | 0.01 (1.0k/s) ‡ | -| tls-term-stream1-down | 7.1 | ‖ | **5.6** | 6.1 | 5.9 | **6.9** | 5.1 | -| tls-term-stream16 | 16.2 | ‖ | 5.9 | 5.0 | 5.7 | **6.8** | 4.7 | -| tls-init-ka-1k | 0.97 (95.2k/s) | ‖ | 0.24 (23.1k/s) | **0.32 (31.1k/s)** | **0.31 (30.6k/s)** | **0.30 (29.3k/s)** | 0.19 (18.4k/s) | -| tls-init-ka-1m | 20.70 (2.5k/s) | ‖ | 5.22 (0.6k/s) | 4.85 (0.6k/s) | 5.34 (0.6k/s) | **6.35 (0.8k/s)** | 4.41 (0.5k/s) | -| tls-init-close-1k | 0.03 (3.3k/s) | ‖ | 0.01 (0.8k/s) | 0.01 (1.0k/s) | 0.01 (1.2k/s) | **0.03 (3.0k/s)** | 0.01 (0.9k/s) | -| tls-init-stream1-down | 7.5 | ‖ | 6.1 | 5.2 | 6.0 | **7.8** | 4.7 | -| tls-init-stream16 | 16.7 | ‖ | **7.1** | 5.9 ‡ | 6.8 | **7.3** | 5.6 | - -**proxy CPU time per gigabyte or per request** - -| scenario | no proxy | ‖ | devel | haproxy | nginx | envoy | stunnel | -|---|---:|:-:|---:|---:|---:|---:|---:| -| tls-term-ka-1k | – | ‖ | 44 µs/req | 31 µs/req | **30 µs/req** | 37 µs/req | 55 µs/req | -| tls-term-ka-1m | – | ‖ | **1.36 s/GB** | **1.47 s/GB** | **1.38 s/GB** | **1.38 s/GB** | 1.78 s/GB | -| tls-term-close-1k | – | ‖ | 821 µs/req | 774 µs/req | 781 µs/req | **510 µs/req** | 1,022 µs/req | -| tls-term-stream1-down | – | ‖ | **1.38 s/GB** | 1.28 s/GB | 1.32 s/GB | **1.08 s/GB** | 1.57 s/GB | -| tls-term-stream16 | – | ‖ | 1.35 s/GB | 1.61 s/GB | 1.40 s/GB | **1.18 s/GB** | 1.69 s/GB | -| tls-init-ka-1k | – | ‖ | 43 µs/req | **32 µs/req** | **33 µs/req** | **34 µs/req** | 55 µs/req | -| tls-init-ka-1m | – | ‖ | 1.53 s/GB | 1.67 s/GB | 1.50 s/GB | **1.26 s/GB** | 1.82 s/GB | -| tls-init-close-1k | – | ‖ | 1,187 µs/req | 1,041 µs/req | 828 µs/req | **336 µs/req** | 1,070 µs/req | -| tls-init-stream1-down | – | ‖ | 1.30 s/GB | 1.53 s/GB | 1.34 s/GB | **1.03 s/GB** | 1.71 s/GB | -| tls-init-stream16 | – | ‖ | **1.14 s/GB** | 1.37 s/GB | 1.17 s/GB | **1.11 s/GB** | 1.43 s/GB | - -**proxy peak memory, MB** - -| scenario | no proxy | ‖ | devel | haproxy | nginx | envoy | stunnel | -|---|---:|:-:|---:|---:|---:|---:|---:| -| tls-term-ka-1k | – | ‖ | **14** | 37 | 35 | 24 | 16 | -| tls-term-ka-1m | – | ‖ | **20** | 49 | 48 | 46 | **20** | -| tls-term-close-1k | – | ‖ | **24** | **38** | **34** | **26** | **34** | -| tls-term-stream1-down | – | ‖ | 8 | 39 | 36 | 33 | **8** | -| tls-term-stream16 | – | ‖ | 80 | **44** | 85 | 138 | 89 | -| tls-init-ka-1k | – | ‖ | **16** | 41 | 36 | 24 | 17 | -| tls-init-ka-1m | – | ‖ | **18** | 50 | 46 | 48 | 21 | -| tls-init-close-1k | – | ‖ | 59 | 40 | 35 | **27** | 34 | -| tls-init-stream1-down | – | ‖ | **11** | 39 | 35 | 32 | **10** | -| tls-init-stream16 | – | ‖ | 95 | **55** | 114 | 148 | 97 | - -* **Bulk data:** devel is level with nginx and ahead of stunnel on both - machines, and ahead of haproxy but for one stream ending TLS on Intel; envoy leads on ARM by 30-50% with a third less CPU per - gigabyte, and on Intel by 0-30%. BoringSSL's ciphers on ARM are the likely - difference: on Intel, ending TLS for 1 MB answers, the four are level. -* **1 KB requests over kept-alive connections:** devel answers half of what - nginx, haproxy and envoy do on ARM and two thirds on Intel, the same share - as without TLS: the thread per connection sets it, not TLS. stunnel, a - thread per connection too, is below devel. -* **A handshake for every request:** ending TLS devel does 80-95% of nginx - and haproxy, beginning it 60-80%; nginx and haproxy resume the session to - the server, devel makes a full handshake each time. envoy does 1.2-1.5 - times nginx ending TLS and 1.7-2.5 times beginning it. -* **Memory:** with one connection or a few dozen, devel and stunnel need the - least, mostly 6-24 MB (devel 59 MB beginning a TLS connection per request - on Intel), against 32-50 MB for nginx and haproxy and 17-48 MB for - envoy. With 16 streams on Intel haproxy needs the least (44-55 MB, devel - 80-95), and envoy the most everywhere (66-148 MB). - -## Kernel TLS - -Measured on 14 October 2026 on Intel only, whose OpenSSL (3.5.8) and nginx -are built with kernel TLS and whose kernel has the tls module; the ARM -machine's OpenSSL (Ubuntu 24.04) is not. devel with `ssl_ktls` (bench option -`3proxy::ktls`) and without, nginx with `ssl_conf_command Options -KTLS` / `proxy_ssl_conf_command Options KTLS` (`nginx::ktls`) and without, in -the TLS scenarios of the HTTPS section; `/proc/net/tls_stat` confirmed the -sessions in the kernel. Each cell is throughput and the CPU busy time per -gigabyte or per request. - -**devel splicing over kernel TLS** ([data/](data/) `skylake-ktls-splice.csv`): -a connection whose TLS sockets the kernel took both ways is spliced as a -plain one is. - -| scenario (Intel) | 3proxy | 3proxy ssl_ktls | nginx | nginx KTLS | -|---|---:|---:|---:|---:| -| tls-term-ka-1k | 23.5k/s, 43 µs | 21.2k/s, 47 µs | 34.5k/s, 29 µs | 32.3k/s, 31 µs | -| tls-term-ka-1m | 5.82 Gbit/s, 1.38 s/GB | 6.80 Gbit/s, 1.18 s/GB | 5.77 Gbit/s, 1.39 s/GB | 5.59 Gbit/s, 1.43 s/GB | -| tls-term-close-1k | 1.3k/s, 782 µs | 1.2k/s, 820 µs | 1.3k/s, 781 µs | 1.3k/s, 783 µs | -| tls-term-stream1-down | 6.56 Gbit/s, 1.20 s/GB | 7.49 Gbit/s, 0.79 s/GB | 6.27 Gbit/s, 1.26 s/GB | 6.01 Gbit/s, 1.30 s/GB | -| tls-term-stream16 | 6.31 Gbit/s, 1.27 s/GB | 6.94 Gbit/s, 1.15 s/GB | 6.20 Gbit/s, 1.29 s/GB | 5.63 Gbit/s, 1.43 s/GB | -| tls-init-ka-1k | 24.6k/s, 41 µs | 22.0k/s, 45 µs | 32.7k/s, 31 µs | 31.5k/s, 32 µs | -| tls-init-ka-1m | 5.59 Gbit/s, 1.43 s/GB | 5.90 Gbit/s, 1.36 s/GB | 5.44 Gbit/s, 1.47 s/GB | 5.03 Gbit/s, 1.59 s/GB | -| tls-init-close-1k | 0.8k/s, 1243 µs | 0.8k/s, 1265 µs | 1.3k/s, 798 µs | 1.2k/s, 861 µs | -| tls-init-stream1-down | 6.09 Gbit/s, 1.31 s/GB | 6.91 Gbit/s, 1.16 s/GB | 6.15 Gbit/s, 1.30 s/GB | 5.59 Gbit/s, 1.43 s/GB | -| tls-init-stream16 | 7.03 Gbit/s, 1.14 s/GB | 7.65 Gbit/s, 1.05 s/GB | 6.24 Gbit/s, 1.29 s/GB | 6.01 Gbit/s, 1.33 s/GB | - -* With splice() kernel TLS pays for bulk data: 3proxy moves 6-17% more at - 5-34% less CPU per gigabyte (ending TLS for one stream it is no longer - held by its CPU: 7.5 Gbit/s at 0.79 s/GB against 6.6 at 1.20), ahead of - nginx with or without it by 8-23%. -* Small requests, which are not spliced, are 0-11% slower with it: the - kernel does the same encryption with a layer more for every record. -* nginx, which relays TLS through user space with or without it, is 0-9% - slower with kernel TLS. - -**Before splice() over kernel TLS** ([data/](data/) `skylake-ktls.csv`), the -same with devel copying TLS connections: - -| scenario (Intel) | 3proxy | 3proxy ssl_ktls | nginx | nginx KTLS | -|---|---:|---:|---:|---:| -| tls-term-ka-1k | 24.1k/s, 42 µs | 22.9k/s, 44 µs | 35.1k/s, 29 µs | 33.5k/s, 30 µs | -| tls-term-ka-1m | 6.20 Gbit/s, 1.29 s/GB | 5.48 Gbit/s, 1.46 s/GB | 5.86 Gbit/s, 1.37 s/GB | 5.75 Gbit/s, 1.39 s/GB | -| tls-term-close-1k | 1.3k/s, 785 µs | 1.2k/s, 814 µs | 1.4k/s, 712 µs | 1.3k/s, 782 µs | -| tls-term-stream1-down | 7.11 Gbit/s, 1.06 s/GB | 6.00 Gbit/s, 1.32 s/GB | 5.98 Gbit/s, 1.32 s/GB | 6.70 Gbit/s, 1.16 s/GB | -| tls-term-stream16 | 6.57 Gbit/s, 1.22 s/GB | 5.00 Gbit/s, 1.61 s/GB | 6.31 Gbit/s, 1.27 s/GB | 5.74 Gbit/s, 1.40 s/GB | -| tls-init-ka-1k | 25.7k/s, 39 µs | 22.6k/s, 44 µs | 35.9k/s, 28 µs | 33.3k/s, 30 µs | -| tls-init-ka-1m | 5.66 Gbit/s, 1.42 s/GB | 4.58 Gbit/s, 1.75 s/GB | 5.62 Gbit/s, 1.43 s/GB | 5.07 Gbit/s, 1.58 s/GB | -| tls-init-close-1k | 0.9k/s, 1124 µs | 0.8k/s, 1197 µs | 1.3k/s, 796 µs | 1.2k/s, 834 µs | -| tls-init-stream1-down | 6.43 Gbit/s, 1.24 s/GB | 5.00 Gbit/s, 1.60 s/GB | 6.17 Gbit/s, 1.30 s/GB | 5.58 Gbit/s, 1.43 s/GB | -| tls-init-stream16 | 7.20 Gbit/s, 1.11 s/GB | 6.37 Gbit/s, 1.26 s/GB | 6.43 Gbit/s, 1.25 s/GB | 6.14 Gbit/s, 1.31 s/GB | - -* Without splice() kernel TLS did not pay: 3proxy did 5-24% less, at 4-32% - more CPU per gigabyte or request. - -## Many connections: the mix scenarios - -Measured on the evening of 13 October 2026 with the same devel -([data/](data/) `*-full-mix.csv`), 20000 connections open through the proxy, -`--mix-active` 2000; `-3k` at a fixed 3000 exchanges a second. dante is left -out on Intel: with 20000 connections it needs more memory than the machine -has (6.5 GB on ARM) and the OOM killer ended the origin. ‡: limited by the -client. - -### ARM (M4) - -**throughput, Gbit/s (thousands of requests per second for HTTP)** - -| scenario | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | dante | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| mix-http | 1.72 (4.7k/s) | 1.48 (4.1k/s) | 2.02 (6.8k/s) ‡ | **2.92 (8.0k/s) ‡** | 2.52 (6.9k/s) ‡ | 0.62 (1.6k/s) | 0.99 (2.9k/s) ‡ | – (–k/s) | ‖ | 1.84 (5.0k/s) | **2.06 (7.0k/s) ‡** | -| mix-connect | 2.25 (6.0k/s) | 2.02 (5.4k/s) | – (–k/s) | – (–k/s) | – (–k/s) | 0.78 (2.2k/s) | **2.78 (7.4k/s) ‡** | – (–k/s) | ‖ | **2.13 (5.7k/s) ‡** | – (–k/s) | -| mix-socks | **2.11 (5.7k/s)** | **2.07 (5.5k/s)** | – (–k/s) | – (–k/s) | – (–k/s) | – (–k/s) | – (–k/s) | 1.34 (3.6k/s) | ‖ | **2.21 (6.0k/s) ‡** | – (–k/s) | -| mix-relay | 2.17 (6.0k/s) | 2.15 (5.9k/s) | 2.49 (7.2k/s) ‡ | **2.86 (7.8k/s) ‡** | 2.77 (7.6k/s) ‡ | – (–k/s) | – (–k/s) | – (–k/s) | ‖ | 2.28 (6.3k/s) ‡ | **2.66 (7.6k/s) ‡** | -| mix-http-3k | 1.08 (3.0k/s) | 1.08 (3.0k/s) | 1.08 (3.0k/s) | **1.09 (3.0k/s)** | **1.09 (3.0k/s)** | 0.63 (1.6k/s) | **1.09 (3.0k/s)** | – (–k/s) | ‖ | **1.08 (3.0k/s)** | **1.08 (3.0k/s)** | -| mix-connect-3k | **1.08 (3.0k/s)** | **1.09 (3.0k/s)** | – (–k/s) | – (–k/s) | – (–k/s) | 0.78 (2.1k/s) | 1.08 (3.0k/s) | – (–k/s) | ‖ | **1.08 (3.0k/s)** | – (–k/s) | -| mix-socks-3k | 1.08 (3.0k/s) | 1.08 (3.0k/s) | – (–k/s) | – (–k/s) | – (–k/s) | – (–k/s) | – (–k/s) | **1.14 (3.0k/s)** | ‖ | **1.08 (3.0k/s)** | – (–k/s) | -| mix-relay-3k | **1.09 (3.0k/s)** | 1.09 (3.0k/s) | 1.08 (3.0k/s) | **1.09 (3.0k/s)** | **1.09 (3.0k/s)** | – (–k/s) | – (–k/s) | – (–k/s) | ‖ | **1.08 (3.0k/s)** | **1.08 (3.0k/s)** | - -**proxy CPU time per gigabyte or per request** - -| scenario | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | dante | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| mix-http | 215 µs/req | 257 µs/req | 150 µs/req | **127 µs/req** | 147 µs/req | 660 µs/req | 351 µs/req | – µs/req | ‖ | 210 µs/req | **146 µs/req** | -| mix-connect | 173 µs/req | 189 µs/req | – µs/req | – µs/req | – µs/req | 477 µs/req | **139 µs/req** | – µs/req | ‖ | **184 µs/req** | – µs/req | -| mix-socks | **180 µs/req** | **191 µs/req** | – µs/req | – µs/req | – µs/req | – µs/req | – µs/req | 294 µs/req | ‖ | **172 µs/req** | – µs/req | -| mix-relay | 172 µs/req | 179 µs/req | 140 µs/req | **130 µs/req** | **139 µs/req** | – µs/req | – µs/req | – µs/req | ‖ | 164 µs/req | **134 µs/req** | -| mix-http-3k | 224 µs/req | 255 µs/req | **154 µs/req** | 162 µs/req | 184 µs/req | 631 µs/req | 295 µs/req | – µs/req | ‖ | 230 µs/req | **155 µs/req** | -| mix-connect-3k | **201 µs/req** | **211 µs/req** | – µs/req | – µs/req | – µs/req | 482 µs/req | **193 µs/req** | – µs/req | ‖ | **202 µs/req** | – µs/req | -| mix-socks-3k | **212 µs/req** | **206 µs/req** | – µs/req | – µs/req | – µs/req | – µs/req | – µs/req | 343 µs/req | ‖ | **201 µs/req** | – µs/req | -| mix-relay-3k | 205 µs/req | 207 µs/req | 170 µs/req | **167 µs/req** | 174 µs/req | – µs/req | – µs/req | – µs/req | ‖ | 206 µs/req | **167 µs/req** | - -**proxy peak memory, MB** - -| scenario | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | dante | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| mix-http | 1,613 | 2,730 | 531 | **151** | 587 | 819 | 839 | – | ‖ | 1,681 | **548** | -| mix-connect | 1,494 | 3,220 | – | – | – | **1,007** | 1,774 | – | ‖ | **1,774** | – | -| mix-socks | **1,462** | 1,948 | – | – | – | – | – | 6,518 | ‖ | **1,496** | – | -| mix-relay | 1,248 | 1,789 | **292** | 617 | 645 | – | – | – | ‖ | 1,284 | **269** | -| mix-http-3k | 1,564 | 2,756 | 150 | **144** | 386 | 800 | 609 | – | ‖ | 1,592 | **156** | -| mix-connect-3k | 1,412 | 2,835 | – | – | – | **1,027** | 1,292 | – | ‖ | **1,428** | – | -| mix-socks-3k | **1,405** | 1,559 | – | – | – | – | – | 6,627 | ‖ | **1,422** | – | -| mix-relay-3k | 1,293 | 1,462 | **268** | 576 | 598 | – | – | – | ‖ | 1,308 | **268** | - -**latency, 50th / 99th percentile, ms** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | dante | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| mix-http | 19.5 / 6,291 | 12.8 / 8,126 | 8.70 / 3,146 | 4.35 / 3,932 | **262 / 393** * | 65.5 / 6,291 | 262 / 5,243 | – | ‖ | 17.4 / 6,291 | **8.19 / 3,146** | -| mix-connect | 47.1 / 4,456 | 38.9 / 5,505 | – | – | – | 98.3 / 6,816 | **13.8 / 3,670** * | – | ‖ | **57.3 / 4,719** | – | -| mix-socks | **69.6 / 4,456** * | 36.9 / 5,243 | – | – | – | – | – | **131 / 5,243** * | ‖ | **45.1 / 4,456** * | – | -| mix-relay | 13.8 / 5,243 | 7.42 / 5,243 | 34.8 / 3,277 | 4.10 / 3,801 | **246 / 393** * | – | – | – | ‖ | 13.8 / 4,719 | **30.7 / 3,277** | -| mix-http-3k | **1.47 / 16.4** * | 1.86 / 21.5 | **1.15 / 16.4** * | **1.22 / 16.4** * | **1.28 / 16.4** * | 1,507 / 6,291 | 2.18 / 26.6 | – | ‖ | **1.47 / 16.4** * | **1.15 / 16.4** * | -| mix-connect-3k | **1.28 / 16.4** * | **1.28 / 16.4** * | – | – | – | 1,507 / 6,291 | **1.28 / 16.4** * | – | ‖ | **1.28 / 16.4** * | – | -| mix-socks-3k | **1.34 / 16.4** * | **1.28 / 16.4** * | – | – | – | – | – | 63.5 / 5,243 | ‖ | **1.28 / 16.4** * | – | -| mix-relay-3k | **1.28 / 16.4** * | **1.28 / 16.4** * | **1.22 / 16.4** * | **1.15 / 16.4** * | **1.22 / 16.4** * | – | – | – | ‖ | **1.28 / 16.4** * | **1.22 / 16.4** * | - -### Intel (Skylake) - -**throughput, Gbit/s (thousands of requests per second for HTTP)** - -| scenario | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| mix-http | 2.14 (5.9k/s) | 2.04 (5.6k/s) | 2.42 (7.4k/s) | **2.94 (8.0k/s)** | 2.04 (5.6k/s) | 0.65 (1.7k/s) | 0.82 (2.4k/s) | ‖ | 2.43 (6.7k/s) | **3.19 (9.1k/s)** | -| mix-connect | **3.02 (8.1k/s)** | **3.03 (8.1k/s)** | – (–k/s) | – (–k/s) | – (–k/s) | 1.04 (2.9k/s) | **2.86 (7.6k/s)** | ‖ | **3.48 (9.3k/s)** | – (–k/s) | -| mix-socks | 3.08 (8.4k/s) | **3.25 (8.7k/s)** | – (–k/s) | – (–k/s) | – (–k/s) | – (–k/s) | – (–k/s) | ‖ | **3.41 (9.2k/s)** | – (–k/s) | -| mix-relay | 3.09 (8.5k/s) | 3.26 (9.0k/s) | 2.53 (7.9k/s) | **3.66 (10.0k/s) ‡** | 3.24 (8.9k/s) | – (–k/s) | – (–k/s) | ‖ | **3.46 (9.5k/s)** | 3.27 (9.2k/s) | -| mix-http-3k | 1.08 (3.0k/s) | **1.08 (3.0k/s)** | 1.08 (3.0k/s) | **1.09 (3.0k/s)** | **1.09 (3.0k/s)** | 0.66 (1.7k/s) | 0.79 (2.3k/s) | ‖ | **1.09 (3.0k/s)** | 1.08 (3.0k/s) | -| mix-connect-3k | **1.08 (3.0k/s)** | **1.08 (3.0k/s)** | – (–k/s) | – (–k/s) | – (–k/s) | 1.06 (2.9k/s) | 1.08 (3.0k/s) | ‖ | **1.08 (3.0k/s)** | – (–k/s) | -| mix-socks-3k | **1.08 (3.0k/s)** | **1.08 (3.0k/s)** | – (–k/s) | – (–k/s) | – (–k/s) | – (–k/s) | – (–k/s) | ‖ | **1.08 (3.0k/s)** | – (–k/s) | -| mix-relay-3k | 1.08 (3.0k/s) | 1.08 (3.0k/s) | 1.08 (3.0k/s) | 1.08 (3.0k/s) | **1.22 (3.3k/s)** | – (–k/s) | – (–k/s) | ‖ | **1.09 (3.0k/s)** | **1.08 (3.0k/s)** | - -**proxy CPU time per gigabyte or per request** - -| scenario | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| mix-http | 178 µs/req | 186 µs/req | 140 µs/req | **129 µs/req** | 188 µs/req | 630 µs/req | 436 µs/req | ‖ | 155 µs/req | **115 µs/req** | -| mix-connect | **127 µs/req** | **126 µs/req** | – µs/req | – µs/req | – µs/req | 362 µs/req | **137 µs/req** | ‖ | **113 µs/req** | – µs/req | -| mix-socks | **127 µs/req** | **122 µs/req** | – µs/req | – µs/req | – µs/req | – µs/req | – µs/req | ‖ | **115 µs/req** | – µs/req | -| mix-relay | 122 µs/req | 116 µs/req | 133 µs/req | **104 µs/req** | 117 µs/req | – µs/req | – µs/req | ‖ | **110 µs/req** | 113 µs/req | -| mix-http-3k | 217 µs/req | 223 µs/req | **166 µs/req** | 181 µs/req | 236 µs/req | 626 µs/req | 459 µs/req | ‖ | 204 µs/req | **154 µs/req** | -| mix-connect-3k | **171 µs/req** | **167 µs/req** | – µs/req | – µs/req | – µs/req | 358 µs/req | 185 µs/req | ‖ | **160 µs/req** | – µs/req | -| mix-socks-3k | 179 µs/req | **165 µs/req** | – µs/req | – µs/req | – µs/req | – µs/req | – µs/req | ‖ | **167 µs/req** | – µs/req | -| mix-relay-3k | 173 µs/req | 167 µs/req | **162 µs/req** | **159 µs/req** | **158 µs/req** | – µs/req | – µs/req | ‖ | 166 µs/req | **154 µs/req** | - -**proxy peak memory, MB** - -| scenario | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| mix-http | 1,765 | 2,851 | 489 | **220** | 609 | 786 | 650 | ‖ | 1,813 | **434** | -| mix-connect | 1,411 | 3,280 | – | – | – | **1,062** | 1,839 | ‖ | **1,442** | – | -| mix-socks | **1,408** | 2,157 | – | – | – | – | – | ‖ | **1,444** | – | -| mix-relay | 1,289 | 1,809 | **477** | 662 | 723 | – | – | ‖ | 1,324 | **340** | -| mix-http-3k | 1,622 | 2,817 | 172 | **153** | 414 | 765 | 613 | ‖ | 1,625 | **179** | -| mix-connect-3k | 1,403 | 2,837 | – | – | – | **1,034** | 1,378 | ‖ | **1,416** | – | -| mix-socks-3k | **1,400** | 1,573 | – | – | – | – | – | ‖ | **1,413** | – | -| mix-relay-3k | 1,357 | 1,529 | **315** | 625 | 614 | – | – | ‖ | 1,372 | **321** | - -**latency, 50th / 99th percentile, ms** - -| scenario, p50 / p99 ms | devel -s0 | 1.0.1 | haproxy | nginx | envoy | tinyproxy | squid | ‖ | devel | haproxy splice-auto | -|---|---:|---:|---:|---:|---:|---:|---:|:-:|---:|---:| -| mix-http | 6.14 / 5,767 | 4.86 / 5,767 | 115 / 2,621 | 8.19 / 3,801 | **344 / 475** * | 81.9 / 5,505 | 36.9 / 7,340 | ‖ | 4.61 / 4,981 | **139 / 1,311** | -| mix-connect | **4.35 / 3,539** | **5.89 / 3,408** | – | – | – | 77.8 / 5,505 | 12.8 / 3,670 | ‖ | **3.07 / 3,146** * | – | -| mix-socks | **4.61 / 3,277** * | **4.86 / 3,146** * | – | – | – | – | – | ‖ | **3.33 / 3,146** * | – | -| mix-relay | 2.56 / 3,670 | 3.33 / 3,277 | 111 / 2,621 | 3.46 / 2,884 | **213 / 344** * | – | – | ‖ | 1.98 / 3,146 | **69.6 / 2,359** | -| mix-http-3k | **1.34 / 16.4** * | 1.47 / 21.5 | **1.22 / 16.4** * | **1.28 / 19.5** * | **1.66 / 17.4** * | 1,049 / 5,767 | 1,245 / 7,078 | ‖ | **1.34 / 17.4** * | **1.15 / 17.4** * | -| mix-connect-3k | **1.15 / 16.4** * | **1.15 / 17.4** * | – | – | – | 24.6 / 2,228 | 1.28 / 18.4 | ‖ | **1.15 / 17.4** * | – | -| mix-socks-3k | **1.15 / 16.4** * | **1.15 / 16.4** * | – | – | – | – | – | ‖ | **1.15 / 17.4** * | – | -| mix-relay-3k | **1.15 / 16.4** * | **1.15 / 17.4** * | **1.15 / 16.4** * | **1.15 / 16.4** * | 1.47 / 1,114 | – | – | ‖ | **1.15 / 16.4** * | **1.15 / 16.4** * | - -* Many small exchanges: devel does 63% of nginx's as an HTTP proxy on ARM, - 74% of haproxy `splice-auto`'s on Intel, and 81-95% of nginx's as a relay; - through CONNECT and SOCKS it leads on Intel. At a fixed rate it takes 8-23% - more CPU than the best as a relay, 32-49% more as an HTTP proxy; through - CONNECT 5% more than squid on ARM and 14% less on Intel, through SOCKS 41% - less than dante. -* Memory is where a thread per connection shows: 65-75 KB a connection for a - relay or a SOCKS tunnel (the thread's stack and two 16 KB buffers), 70-90 KB - for an HTTP proxy or CONNECT connection, against 8-36 KB for nginx, haproxy - and envoy. That is 30-45% less than in the morning session (120-140 KB - for HTTP and CONNECT): devel now frees the request buffer of a kept-alive - connection idle for a second, and before relaying a CONNECT tunnel. -* No exchange failed through devel, or through nginx relaying with - `proxy_half_close on`. 1.0.1 still loses 1-5 a run in the tunnels and - relays, exchanges half-closed by the client with a large answer cut short, - the bug fixed in devel (and in master and 0.9) since the morning session. -* envoy at the fixed rate on Intel relays more than 3000 a second: it fell - behind at times (p99 0.7-1.2 s) and the client made up the delayed - exchanges. -* Latency: at the fixed rate devel answers in 1.15-1.47 ms (median) and - 16.4-17.4 ms (99th percentile), as nginx and haproxy do; tinyproxy, squid - as an HTTP proxy on Intel and dante on ARM fall behind, to seconds. With - 2000 exchanges in flight every proxy queues them, to 99th percentiles of - 1.3-8 seconds, but envoy, which keeps them to 340-480 ms around a median of - 210-340. - -## Grace delay on a slow link - -Measured on 14 October 2026 ([data/](data/) `*-grace-link.csv`) with devel -as in the tables above, and nginx for reference, over an emulated link -between the client and the proxy: each connection limited to 20 Mbit/s each -way (`--flow-rate 20mbit`), 5 ms of delay and 0.5% of the packets lost, each -way (`--netem "delay 5ms loss 0.5%"`), segmentation offload and GRO off. The -emulation runs in the client's namespace, on its CPUs; the link from the -proxy to the origin is left as it is ([README](README.md)). Scenarios: one -iperf3 download stream and 16 upload streams through a TCP relay -(`tcppm`), and the mix scenarios at a fixed 3000 exchanges a second with -20000 connections open. - -`-gTRAFF,NUM,DELAY`: once a second has seen NUM reads in a row in one -direction averaging TRAFF bytes or less, 3proxy waits DELAY ms before it -polls again, so that data gathers and is read in fewer, larger pieces. A -read takes at most 16 KB, so the wait also caps a connection: 16 KB per -DELAY, 13 Mbit/s at 10 ms, 26 at 5 ms, 65 at 2 ms. `-g65536,2,5` waits after -any two reads. - -**ARM (M4)** - -| | devel | -g8000,3,10 | -g8000,3,5 | -g8000,3,2 | -g65536,2,5 | nginx | -|---|---:|---:|---:|---:|---:|---:| -| relay-stream1-down, Mbit/s | 13.9 | 13.4 | 14.7 | 14.2 | 15.0 | 14.9 | -| relay-stream16, Mbit/s | 290 | 238 | 261 | 279 | 227 | 289 | -| relay-stream16, proxy CPU s/GB | 18.7 | 12.6 | 13.3 | 13.9 | 10.8 | 16.7 | -| mix-relay-3k, k/s | 1.86 | 1.86 | 1.86 | 1.90 | 1.85 | 1.94 | -| mix-relay-3k, µs/exchange | 460 | 462 | 465 | 459 | 476 | 366 | -| mix-relay-3k, p50 / p90 / p99 ms | 2,097 / 3,801 / 6,554 | 2,097 / 3,932 / 6,554 | 2,097 / 3,801 / 6,816 | 2,097 / 3,801 / 6,554 | 2,097 / 3,932 / 6,554 | 1,966 / 3,670 / 6,291 | -| mix-http-3k, k/s | 1.78 | 1.79 | 1.82 | 1.82 | 1.83 | 1.95 | -| mix-http-3k, µs/exchange | 523 | 470 | 506 | 517 | 512 | 337 | -| mix-http-3k, p50 / p90 / p99 ms | 2,621 / 4,194 / 7,078 | 2,359 / 4,194 / 6,816 | 2,359 / 4,063 / 6,816 | 2,359 / 4,063 / 6,816 | 2,359 / 4,194 / 6,816 | 1,901 / 3,539 / 6,291 | - -**Intel (Skylake)** - -| | devel | -g8000,3,10 | -g8000,3,5 | -g8000,3,2 | -g65536,2,5 | nginx | -|---|---:|---:|---:|---:|---:|---:| -| relay-stream1-down, Mbit/s | 16.0 | 14.7 | 15.3 | 16.3 | 16.0 | 15.5 | -| relay-stream16, Mbit/s | 291 | 239 | 259 | 281 | 236 | 293 | -| relay-stream16, proxy CPU s/GB | 10.5 | 5.7 | 6.3 | 6.7 | 4.3 | 9.8 | -| mix-relay-3k, k/s | 2.98 | 2.99 | 2.99 | 2.99 | 2.99 | 2.98 | -| mix-relay-3k, µs/exchange | 253 | 237 | 257 | 244 | 244 | 241 | -| mix-relay-3k, p50 / p90 / p99 ms | 20.5 / 63.5 / 279 | 20.5 / 65.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 21.5 / 65.5 / 279 | 20.5 / 63.5 / 279 | -| mix-http-3k, k/s | 2.99 | 3.01 | 3.10 | 2.99 | 3.01 | 2.99 | -| mix-http-3k, µs/exchange | 294 | 306 | 303 | 300 | 312 | 264 | -| mix-http-3k, p50 / p90 / p99 ms | 22.5 / 73.7 / 311 | 24.6 / 147 / 557 | 34.8 / 590 / 1,769 | 23.6 / 77.8 / 311 | 25.6 / 115 / 393 | 20.5 / 65.5 / 295 | - -* 16 streams: every wait costs throughput and saves CPU. 2 ms costs 3-4% and - saves 26% of the proxy's CPU per gigabyte on ARM, 36% on Intel; 5 ms costs - 10-11% and saves 29-40%; 10 ms, whose cap (13 Mbit/s) is under the link's - rate, costs 18% and saves 33-46%; `-g65536,2,5` costs 19-22% and saves - 42-59%. Without a wait devel needs 7-12% more CPU per gigabyte than nginx, - with any of them less. -* One stream is held to 13-16 Mbit/s by the loss (TCP at 0.5% loss and a - 10 ms round trip), whatever the setting. -* The mix scenarios show no difference: on Intel the proxy's CPU per - exchange is within 8% across the settings and the latency the same but - for runs which stalled and caught up (more than 3000 exchanges a second), - several in every setting, devel without a wait among them. On ARM the client - could not keep 3000 exchanges a second over the shaped link (1.8-1.9k, its - CPUs the limit), so the latency there is the client's backlog; the CPU per - exchange does not move with the setting either. devel needs 5-11% more CPU - per exchange than nginx on Intel, 26-55% on ARM. -* For slow clients moving bulk data `-g8000,3,2` keeps 96% of the - throughput for a quarter to a third less CPU; longer waits trade more of - one for the other. - -### Seven settings, 5 client CPUs - -The same link (20 Mbit/s, 5 ms, 0.5% loss), the client given a fifth CPU -(`--cpus cli=0-4,prx=5,srv=6-7`), the origin two, the proxy one as before -([data/](data/) `*-grace-link2.csv`). Each cell is the median of three runs; -"process" is the CPU time of the proxy's own processes (its threads, and the -kernel's work in their system calls), "busy" the time its CPU was busy, -the kernel's work on the network there included. - -**Intel (Skylake)** - -| | nginx | devel | -g8000,3,2 | -g4000,3,2 | -g6000,3,2 | -g8000,3,1 | -g8000,2,2 | -|---|---:|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 292 | 293 | 276 | 288 | 283 | 289 | 281 | -| stream16, process / busy CPU s/GB | 4.1 / 9.8 | 4.8 / 11.4 | 2.8 / 7.0 | 3.9 / 9.4 | 3.1 / 7.4 | 4.9 / 10.7 | 2.8 / 6.9 | -| mix-relay-3k, k/s | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | -| mix-relay-3k, process / busy CPU µs | 68 / 239 | 78 / 257 | 84 / 260 | 83 / 267 | 77 / 251 | 80 / 258 | 77 / 251 | -| mix-relay-3k, CPU busy % | 72 | 77 | 78 | 80 | 75 | 77 | 75 | -| mix-relay-3k, p50 / p90 / p99 ms | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 295 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | -| mix-http-3k, k/s | 3.00 | 3.09 | 3.06 | 3.04 | 3.00 | 3.01 | 3.00 | -| mix-http-3k, process / busy CPU µs | 113 / 265 | 131 / 298 | 142 / 315 | 144 / 319 | 121 / 290 | 119 / 287 | 131 / 306 | -| mix-http-3k, CPU busy % | 79 | 93 | 96 | 98 | 87 | 87 | 92 | -| mix-http-3k, p50 / p90 / p99 ms | 20.5 / 63.5 / 279 | 36.9 / 492 / 1,507 | 45.1 / 393 / 2,228 | 34.8 / 164 / 819 | 21.5 / 65.5 / 279 | 22.5 / 73.7 / 295 | 25.6 / 213 / 721 | - -**ARM (M4)** - -| | nginx | devel | -g8000,3,2 | -g4000,3,2 | -g6000,3,2 | -g8000,3,1 | -g8000,2,2 | -|---|---:|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 289 | 286 | 274 | 284 | 280 | 281 | 277 | -| stream16, process / busy CPU s/GB | 8.1 / 16.7 | 9.9 / 18.8 | 7.2 / 13.9 | 8.5 / 16.8 | 7.3 / 14.4 | 11.3 / 16.5 | 7.1 / 13.7 | -| mix-relay-3k, k/s | 1.88 | 1.82 | 1.84 | 1.83 | 1.85 | 1.85 | 1.85 | -| mix-relay-3k, process / busy CPU µs | 186 / 378 | 297 / 476 | 271 / 464 | 273 / 467 | 266 / 454 | 281 / 467 | 259 / 450 | -| mix-relay-3k, CPU busy % | 72 | 87 | 85 | 87 | 86 | 88 | 84 | -| mix-relay-3k, p50 / p90 / p99 ms | 2,097 / 3,801 / 6,291 | 2,359 / 4,063 / 6,816 | 2,097 / 3,932 / 6,554 | 2,228 / 3,932 / 6,554 | 2,228 / 3,932 / 6,816 | 2,097 / 3,932 / 6,554 | 2,097 / 3,932 / 6,554 | -| mix-http-3k, k/s | 1.93 | 1.79 | 1.74 | 1.77 | 1.80 | 1.76 | 1.79 | -| mix-http-3k, process / busy CPU µs | 167 / 351 | 356 / 508 | 424 / 577 | 350 / 523 | 348 / 511 | 350 / 521 | 323 / 502 | -| mix-http-3k, CPU busy % | 68 | 92 | 100 | 91 | 92 | 90 | 89 | -| mix-http-3k, p50 / p90 / p99 ms | 1,901 / 3,539 / 6,291 | 2,490 / 4,194 / 6,554 | 2,490 / 4,194 / 6,554 | 2,359 / 4,194 / 6,816 | 2,359 / 4,194 / 6,554 | 2,359 / 4,194 / 6,816 | 2,228 / 4,194 / 6,816 | - -* On streams `-g8000,2,2` and `-g8000,3,2` save the most: 27-42% of the - process CPU per gigabyte for 3-6% of the throughput, below nginx's. A wait - of 1 ms (`-g8000,3,1`) saves nothing, a threshold of 4000 bytes little. -* On ARM the fifth CPU did not help the client: it still managed 1.8-1.9k - exchanges a second, with its CPUs 79% busy, likely held by the ifb, whose - one queue takes all it receives on one CPU. - -### Three link qualities - -Each connection each way: better 100 Mbit/s, 2 ms, 0.1% loss; current 20 -Mbit/s, 5 ms, 0.5%; worse 5 Mbit/s, 25 ms, 1%. 5 client CPUs ([data/](data/) -`*-grace3-*.csv`). - -**Intel (Skylake), better: 100 Mbit/s, 2 ms, 0.1%** - -| | nginx | devel | -g8000,2,2 | -g6000,2,2 | -g6000,3,2 | -g8000,2,3 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 1527 | 1527 | 1527 | 1527 | 1527 | 1527 | -| stream16, process / busy CPU s/GB | 1.1 / 2.8 | 1.1 / 2.9 | 1.1 / 3.0 | 1.1 / 2.9 | 1.1 / 2.9 | 1.2 / 3.0 | -| mix-relay-3k, k/s | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | -| mix-relay-3k, process / busy CPU µs | 65 / 191 | 72 / 207 | 71 / 202 | 74 / 207 | 70 / 197 | 71 / 199 | -| mix-relay-3k, CPU busy % | 57 | 62 | 61 | 62 | 59 | 60 | -| mix-relay-3k, p50 / p90 / p99 ms | 8.2 / 20.5 / 65.5 | 8.2 / 20.5 / 81.9 | 8.7 / 21.5 / 81.9 | 8.7 / 21.5 / 81.9 | 8.2 / 20.5 / 86.0 | 8.7 / 21.5 / 81.9 | -| mix-http-3k, k/s | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | -| mix-http-3k, process / busy CPU µs | 109 / 218 | 114 / 243 | 115 / 244 | 116 / 242 | 114 / 243 | 114 / 245 | -| mix-http-3k, CPU busy % | 65 | 73 | 73 | 74 | 73 | 73 | -| mix-http-3k, p50 / p90 / p99 ms | 8.2 / 20.5 / 63.5 | 8.7 / 21.5 / 86.0 | 8.7 / 21.5 / 81.9 | 8.7 / 21.5 / 86.0 | 8.7 / 21.5 / 86.0 | 8.7 / 21.5 / 81.9 | - -**Intel (Skylake), current: 20 Mbit/s, 5 ms, 0.5%** - -| | nginx | devel | -g8000,2,2 | -g6000,2,2 | -g6000,3,2 | -g8000,2,3 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 293 | 292 | 282 | 282 | 282 | 272 | -| stream16, process / busy CPU s/GB | 4.0 / 9.8 | 4.6 / 10.6 | 2.7 / 6.6 | 3.0 / 7.4 | 3.0 / 7.4 | 2.5 / 6.4 | -| mix-relay-3k, k/s | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | -| mix-relay-3k, process / busy CPU µs | 72 / 243 | 71 / 239 | 82 / 257 | 87 / 268 | 72 / 240 | 82 / 255 | -| mix-relay-3k, CPU busy % | 73 | 72 | 77 | 80 | 72 | 76 | -| mix-relay-3k, p50 / p90 / p99 ms | 20.5 / 63.5 / 262 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | -| mix-http-3k, k/s | 3.00 | 3.05 | 3.00 | 3.02 | 3.01 | 3.02 | -| mix-http-3k, process / busy CPU µs | 112 / 263 | 140 / 308 | 123 / 294 | 130 / 305 | 129 / 304 | 122 / 293 | -| mix-http-3k, CPU busy % | 79 | 97 | 88 | 92 | 92 | 88 | -| mix-http-3k, p50 / p90 / p99 ms | 20.5 / 63.5 / 279 | 29.7 / 328 / 1,442 | 22.5 / 73.7 / 295 | 25.6 / 123 / 442 | 23.6 / 86.0 / 344 | 23.6 / 77.8 / 295 | - -**Intel (Skylake), worse: 5 Mbit/s, 25 ms, 1%** - -| | nginx | devel | -g8000,2,2 | -g6000,2,2 | -g6000,3,2 | -g8000,2,3 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 58 | 60 | 59 | 59 | 58 | 58 | -| stream16, process / busy CPU s/GB | 5.6 / 15.3 | 6.4 / 16.9 | 7.9 / 19.8 | 7.8 / 19.0 | 7.8 / 18.6 | 7.2 / 17.2 | -| mix-relay-3k, k/s | 2.99 | 2.99 | 2.99 | 2.99 | 3.00 | 3.00 | -| mix-relay-3k, process / busy CPU µs | 72 / 285 | 77 / 286 | 93 / 309 | 87 / 302 | 89 / 310 | 93 / 313 | -| mix-relay-3k, CPU busy % | 85 | 86 | 92 | 90 | 93 | 94 | -| mix-relay-3k, p50 / p90 / p99 ms | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 328 / 1,180 | -| mix-http-3k, k/s | 3.00 | 2.99 | 2.94 | 3.02 | 2.97 | 2.96 | -| mix-http-3k, process / busy CPU µs | 115 / 308 | 151 / 357 | 149 / 355 | 151 / 356 | 152 / 361 | 147 / 355 | -| mix-http-3k, CPU busy % | 92 | 105 | 106 | 107 | 106 | 106 | -| mix-http-3k, p50 / p90 / p99 ms | 102 / 311 / 1,180 | 475 / 1,114 / 3,801 | 557 / 1,376 / 3,539 | 254 / 1,180 / 3,670 | 344 / 1,049 / 2,621 | 524 / 1,245 / 3,277 | - -**ARM (M4), better: 100 Mbit/s, 2 ms, 0.1%** - -| | nginx | devel | -g8000,2,2 | -g6000,2,2 | -g6000,3,2 | -g8000,2,3 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 1523 | 1518 | 1520 | 1522 | 1521 | 1520 | -| stream16, process / busy CPU s/GB | 2.8 / 4.4 | 4.1 / 5.0 | 4.2 / 5.1 | 4.2 / 5.1 | 4.2 / 5.1 | 4.2 / 5.1 | -| mix-relay-3k, k/s | 1.98 | 1.92 | 1.97 | 1.92 | 1.92 | 1.88 | -| mix-relay-3k, process / busy CPU µs | 181 / 371 | 272 / 455 | 240 / 432 | 255 / 441 | 251 / 445 | 284 / 474 | -| mix-relay-3k, CPU busy % | 74 | 87 | 85 | 85 | 85 | 89 | -| mix-relay-3k, p50 / p90 / p99 ms | 1,704 / 3,277 / 6,029 | 2,032 / 3,670 / 6,291 | 1,901 / 3,408 / 6,291 | 1,835 / 3,539 / 6,291 | 1,966 / 3,539 / 6,291 | 1,901 / 3,539 / 6,291 | -| mix-http-3k, k/s | 1.96 | 1.89 | 1.87 | 1.81 | 1.84 | 1.85 | -| mix-http-3k, process / busy CPU µs | 165 / 354 | 337 / 475 | 355 / 511 | 342 / 500 | 401 / 544 | 387 / 519 | -| mix-http-3k, CPU busy % | 69 | 93 | 96 | 91 | 100 | 96 | -| mix-http-3k, p50 / p90 / p99 ms | 1,704 / 3,408 / 6,029 | 2,032 / 3,670 / 6,291 | 2,097 / 3,801 / 6,554 | 2,097 / 3,932 / 6,554 | 2,359 / 3,932 / 6,291 | 2,228 / 3,932 / 6,554 | - -**ARM (M4), current: 20 Mbit/s, 5 ms, 0.5%** - -| | nginx | devel | -g8000,2,2 | -g6000,2,2 | -g6000,3,2 | -g8000,2,3 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 290 | 290 | 275 | 279 | 277 | 272 | -| stream16, process / busy CPU s/GB | 7.7 / 15.9 | 10.3 / 18.7 | 7.2 / 13.7 | 7.3 / 14.7 | 7.4 / 14.5 | 5.8 / 13.2 | -| mix-relay-3k, k/s | 1.90 | 1.86 | 1.85 | 1.83 | 1.86 | 1.86 | -| mix-relay-3k, process / busy CPU µs | 197 / 393 | 281 / 471 | 296 / 485 | 273 / 464 | 263 / 454 | 279 / 471 | -| mix-relay-3k, CPU busy % | 75 | 88 | 90 | 86 | 85 | 88 | -| mix-relay-3k, p50 / p90 / p99 ms | 2,097 / 3,670 / 6,291 | 2,228 / 3,932 / 6,816 | 2,228 / 3,932 / 6,554 | 2,228 / 4,063 / 6,554 | 2,097 / 3,801 / 6,554 | 2,359 / 4,063 / 6,816 | -| mix-http-3k, k/s | 1.90 | 1.78 | 1.76 | 1.77 | 1.80 | 1.78 | -| mix-http-3k, process / busy CPU µs | 175 / 364 | 379 / 533 | 441 / 581 | 392 / 545 | 375 / 533 | 335 / 508 | -| mix-http-3k, CPU busy % | 69 | 97 | 102 | 98 | 95 | 90 | -| mix-http-3k, p50 / p90 / p99 ms | 2,032 / 3,670 / 6,291 | 2,359 / 4,194 / 6,816 | 2,621 / 4,456 / 6,554 | 2,490 / 4,194 / 6,554 | 2,359 / 4,063 / 6,554 | 2,228 / 4,063 / 6,554 | - -**ARM (M4), worse: 5 Mbit/s, 25 ms, 1%** - -| | nginx | devel | -g8000,2,2 | -g6000,2,2 | -g6000,3,2 | -g8000,2,3 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 56 | 53 | 53 | 52 | 54 | 51 | -| stream16, process / busy CPU s/GB | 20.7 / 50.0 | 22.7 / 53.8 | 28.6 / 47.5 | 30.4 / 50.8 | 29.4 / 49.2 | 25.7 / 46.7 | -| mix-relay-3k, k/s | 1.84 | 1.83 | 1.82 | 1.80 | 1.83 | 1.78 | -| mix-relay-3k, process / busy CPU µs | 205 / 409 | 255 / 454 | 287 / 486 | 308 / 499 | 263 / 463 | 310 / 505 | -| mix-relay-3k, CPU busy % | 74 | 83 | 88 | 90 | 85 | 90 | -| mix-relay-3k, p50 / p90 / p99 ms | 2,228 / 4,063 / 6,554 | 2,228 / 4,063 / 6,554 | 2,228 / 4,063 / 6,554 | 2,359 / 4,194 / 6,816 | 2,359 / 4,063 / 6,554 | 2,228 / 4,194 / 6,554 | -| mix-http-3k, k/s | 1.89 | 1.75 | 1.73 | 1.76 | 1.74 | 1.75 | -| mix-http-3k, process / busy CPU µs | 163 / 352 | 361 / 527 | 376 / 534 | 348 / 515 | 389 / 554 | 332 / 510 | -| mix-http-3k, CPU busy % | 67 | 92 | 95 | 90 | 96 | 90 | -| mix-http-3k, p50 / p90 / p99 ms | 2,097 / 3,932 / 6,291 | 2,621 / 4,456 / 6,816 | 2,490 / 4,456 / 6,816 | 2,490 / 4,194 / 6,816 | 2,621 / 4,456 / 6,816 | 2,490 / 4,194 / 6,816 | - -* Better link: 16 streams reach the 100 Mbit/s per connection for every - proxy and setting; reads are large, the wait never applies, and nothing - changes. In the mix scenarios on Intel the settings are within 5% of each - other. -* Current link: on streams the wait saves 35-46% of the process CPU per - gigabyte on Intel (3-7% of the throughput), 28-44% on ARM. In - `mix-http-3k` on Intel devel's CPU was 97% busy and its latency jumped - (p90 328 ms); the settings brought it to 88-92% and p90 74-123 ms, near - nginx's (79%, 64 ms). The earlier runs on this link did not show that gain - in the mix: it is within the noise of a CPU this close to full. -* Worse link: loss holds 16 streams to 51-60 Mbit/s in all; reads are small - and frequent, and the wait costs CPU instead: 13-23% more per gigabyte on - Intel. As an HTTP proxy at 3000 exchanges a second every 3proxy setting - ran out of CPU on Intel (latency p50 0.25-0.56 s), nginx did not (92%, - p50 102 ms); as a relay all kept up. -* Grace delay does not help when the proxy's CPU is exhausted, and degrades - slightly: on the worse link, with the proxy's CPU at its limit on Intel, - the waits added 13-21% process CPU per exchange as a relay (86% busy - without them, 90-94% with), and as an HTTP proxy, out of CPU, no setting - made the latency reliably better (p50 0.25-0.56 s against 0.48 s). -* ARM's client held every mix run at 1.8-2.0k exchanges a second: latency - there is its backlog. 1-3 exchanges were lost in each link's 3proxy - `mix-relay-3k` runs on ARM, none on Intel. - -### Splice and grace delay - -devel copying (`-s0`) and splicing (`-s`), without grace delay and with two -settings, over the better and current links with 5 client CPUs -([data/](data/) `*-splice-g-*.csv`, `*-connect-g-*.csv`). - -**Intel (Skylake), better: 100 Mbit/s, 2 ms, 0.1%** - -| | -s0 | -s | -s0 -g8000,2,2 | -s -g8000,2,2 | -s0 -g6000,3,2 | -s -g6000,3,2 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 1527 | 1526 | 1527 | 1527 | 1527 | 1527 | -| stream16, process / busy CPU s/GB | 1.2 / 2.9 | 1.1 / 2.9 | 1.2 / 2.8 | 1.1 / 2.8 | 1.2 / 2.9 | 1.1 / 2.8 | -| mix-relay-3k, k/s | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | -| mix-relay-3k, process / busy CPU µs | 76 / 205 | 71 / 207 | 80 / 208 | 75 / 211 | 79 / 214 | 72 / 204 | -| mix-relay-3k, CPU busy % | 62 | 62 | 62 | 63 | 64 | 61 | -| mix-relay-3k, p50 / p90 / p99 ms | 8.2 / 20.5 / 81.9 | 8.2 / 20.5 / 86.0 | 8.7 / 21.5 / 98.3 | 8.7 / 21.5 / 81.9 | 8.2 / 20.5 / 86.0 | 8.2 / 20.5 / 86.0 | -| mix-http-3k, k/s | 3.00 | 3.01 | 3.00 | 3.00 | 3.00 | 3.00 | -| mix-http-3k, process / busy CPU µs | 125 / 251 | 124 / 257 | 125 / 254 | 120 / 255 | 124 / 251 | 113 / 244 | -| mix-http-3k, CPU busy % | 76 | 78 | 76 | 76 | 75 | 73 | -| mix-http-3k, p50 / p90 / p99 ms | 8.7 / 21.5 / 86.0 | 8.7 / 22.5 / 106 | 8.7 / 21.5 / 86.0 | 8.7 / 21.5 / 86.0 | 8.7 / 21.5 / 86.0 | 8.7 / 21.5 / 77.8 | -| mix-connect-3k, k/s | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | -| mix-connect-3k, process / busy CPU µs | 77 / 201 | 72 / 203 | 86 / 221 | 81 / 217 | 82 / 211 | 79 / 213 | -| mix-connect-3k, CPU busy % | 60 | 61 | 66 | 65 | 63 | 64 | -| mix-connect-3k, p50 / p90 / p99 ms | 8.2 / 20.5 / 63.5 | 8.2 / 20.5 / 65.5 | 8.7 / 21.5 / 65.5 | 8.7 / 21.5 / 65.5 | 8.2 / 21.5 / 65.5 | 8.2 / 21.5 / 63.5 | - -**Intel (Skylake), current: 20 Mbit/s, 5 ms, 0.5%** - -| | -s0 | -s | -s0 -g8000,2,2 | -s -g8000,2,2 | -s0 -g6000,3,2 | -s -g6000,3,2 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 292 | 293 | 281 | 280 | 282 | 281 | -| stream16, process / busy CPU s/GB | 4.8 / 10.6 | 4.9 / 10.9 | 3.1 / 7.4 | 2.7 / 6.6 | 3.1 / 7.5 | 3.2 / 7.6 | -| mix-relay-3k, k/s | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | 3.00 | -| mix-relay-3k, process / busy CPU µs | 80 / 250 | 81 / 258 | 82 / 255 | 80 / 261 | 79 / 248 | 73 / 245 | -| mix-relay-3k, CPU busy % | 75 | 77 | 76 | 78 | 74 | 73 | -| mix-relay-3k, p50 / p90 / p99 ms | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | 20.5 / 63.5 / 279 | -| mix-http-3k, k/s | 3.02 | 3.00 | 3.06 | 3.04 | 3.02 | 3.02 | -| mix-http-3k, process / busy CPU µs | 139 / 309 | 122 / 293 | 143 / 314 | 140 / 315 | 147 / 318 | 138 / 318 | -| mix-http-3k, CPU busy % | 93 | 88 | 95 | 95 | 96 | 96 | -| mix-http-3k, p50 / p90 / p99 ms | 24.6 / 86.0 / 311 | 23.6 / 115 / 410 | 31.7 / 344 / 819 | 36.9 / 459 / 1,442 | 30.7 / 147 / 721 | 30.7 / 229 / 950 | -| mix-connect-3k, k/s | 2.99 | 3.00 | 3.00 | 3.00 | 2.99 | 3.00 | -| mix-connect-3k, process / busy CPU µs | 87 / 264 | 93 / 285 | 85 / 257 | 82 / 261 | 90 / 270 | 76 / 249 | -| mix-connect-3k, CPU busy % | 79 | 86 | 77 | 78 | 81 | 74 | -| mix-connect-3k, p50 / p90 / p99 ms | 20.5 / 63.5 / 262 | 20.5 / 63.5 / 262 | 20.5 / 63.5 / 279 | 20.5 / 65.5 / 279 | 20.5 / 65.5 / 262 | 20.5 / 63.5 / 279 | - -**ARM (M4), better: 100 Mbit/s, 2 ms, 0.1%** - -| | -s0 | -s | -s0 -g8000,2,2 | -s -g8000,2,2 | -s0 -g6000,3,2 | -s -g6000,3,2 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 1522 | 1520 | 1523 | 1518 | 1523 | 1521 | -| stream16, process / busy CPU s/GB | 3.5 / 4.9 | 4.2 / 5.1 | 3.6 / 4.9 | 4.1 / 5.0 | 3.5 / 4.9 | 4.2 / 5.1 | -| mix-relay-3k, k/s | 1.96 | 1.89 | 1.94 | 1.93 | 1.89 | 1.89 | -| mix-relay-3k, process / busy CPU µs | 276 / 456 | 305 / 495 | 275 / 455 | 257 / 445 | 294 / 473 | 288 / 481 | -| mix-relay-3k, CPU busy % | 89 | 90 | 90 | 86 | 89 | 90 | -| mix-relay-3k, p50 / p90 / p99 ms | 1,835 / 3,408 / 6,291 | 1,966 / 3,670 / 6,291 | 1,769 / 3,408 / 6,029 | 1,901 / 3,539 / 6,291 | 1,966 / 3,670 / 6,291 | 2,032 / 3,801 / 6,554 | -| mix-http-3k, k/s | 1.85 | 1.88 | 1.86 | 1.85 | 1.86 | 1.89 | -| mix-http-3k, process / busy CPU µs | 399 / 536 | 340 / 495 | 417 / 537 | 379 / 527 | 361 / 512 | 336 / 484 | -| mix-http-3k, CPU busy % | 98 | 93 | 99 | 95 | 93 | 92 | -| mix-http-3k, p50 / p90 / p99 ms | 2,097 / 3,801 / 6,291 | 2,097 / 3,801 / 6,554 | 2,097 / 3,801 / 6,291 | 2,097 / 3,932 / 6,291 | 2,097 / 3,932 / 6,554 | 2,097 / 3,801 / 6,291 | -| mix-connect-3k, k/s | 2.02 | 2.02 | 1.97 | 1.97 | 2.00 | 1.98 | -| mix-connect-3k, process / busy CPU µs | 272 / 450 | 247 / 432 | 312 / 479 | 274 / 454 | 284 / 463 | 255 / 437 | -| mix-connect-3k, CPU busy % | 91 | 87 | 94 | 91 | 93 | 86 | -| mix-connect-3k, p50 / p90 / p99 ms | 1,769 / 3,277 / 6,029 | 1,573 / 3,146 / 6,029 | 1,704 / 3,277 / 6,029 | 1,638 / 3,277 / 6,029 | 1,573 / 3,146 / 6,029 | 1,638 / 3,277 / 6,029 | - -**ARM (M4), current: 20 Mbit/s, 5 ms, 0.5%** - -| | -s0 | -s | -s0 -g8000,2,2 | -s -g8000,2,2 | -s0 -g6000,3,2 | -s -g6000,3,2 | -|---|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 291 | 290 | 279 | 278 | 278 | 278 | -| stream16, process / busy CPU s/GB | 9.8 / 18.8 | 9.8 / 18.6 | 7.0 / 14.3 | 7.2 / 13.7 | 7.2 / 14.4 | 7.3 / 14.6 | -| mix-relay-3k, k/s | 1.85 | 1.88 | 1.89 | 1.87 | 1.87 | 1.86 | -| mix-relay-3k, process / busy CPU µs | 280 / 474 | 254 / 450 | 273 / 467 | 262 / 456 | 254 / 443 | 254 / 446 | -| mix-relay-3k, CPU busy % | 87 | 84 | 88 | 86 | 83 | 82 | -| mix-relay-3k, p50 / p90 / p99 ms | 2,228 / 3,932 / 6,554 | 2,032 / 3,801 / 6,554 | 2,032 / 3,801 / 6,291 | 2,097 / 3,801 / 6,554 | 2,097 / 3,801 / 6,554 | 2,032 / 3,801 / 6,554 | -| mix-http-3k, k/s | 1.79 | 1.80 | 1.79 | 1.78 | 1.80 | 1.78 | -| mix-http-3k, process / busy CPU µs | 347 / 514 | 324 / 498 | 325 / 493 | 300 / 478 | 313 / 486 | 355 / 528 | -| mix-http-3k, CPU busy % | 92 | 88 | 88 | 87 | 87 | 94 | -| mix-http-3k, p50 / p90 / p99 ms | 2,359 / 4,194 / 6,816 | 2,359 / 4,063 / 6,554 | 2,490 / 4,194 / 6,816 | 2,359 / 4,194 / 6,816 | 2,359 / 4,063 / 6,554 | 2,359 / 4,194 / 6,816 | -| mix-connect-3k, k/s | 1.92 | 1.96 | 1.92 | 1.95 | 1.93 | 1.91 | -| mix-connect-3k, process / busy CPU µs | 269 / 454 | 257 / 444 | 266 / 452 | 247 / 439 | 266 / 455 | 276 / 462 | -| mix-connect-3k, CPU busy % | 87 | 87 | 87 | 86 | 88 | 88 | -| mix-connect-3k, p50 / p90 / p99 ms | 1,901 / 3,670 / 6,291 | 1,901 / 3,539 / 6,291 | 1,966 / 3,670 / 6,554 | 1,901 / 3,539 / 6,291 | 1,835 / 3,539 / 6,291 | 1,966 / 3,670 / 6,554 | - -* Conclusion: for web traffic `-s`, the default, and `-s0` show no - significant difference; `-s` increases the speed and decreases the CPU - usage for high-speed large uploads and downloads, especially for traffic - inside high-speed local networks and virtual environments (the synthetic - tables above: 3 times the speed at 60-70% less CPU per gigabyte). -* Over these links splice() and copying cost about the same in the mix - scenarios, within the 7-10% the runs move by; the threefold gains of the - synthetic tables above come from links with no limit. On streams at 20 - Mbit/s with grace delay, splice() saves a little more than copying - (`-g8000,2,2`: 2.7 against 3.1 s/GB of process CPU on Intel). -* On the better link grace delay changes nothing on streams, and costs - 6-12% of process CPU through CONNECT on Intel. - -### The slow link with longer waits - -5 Mbit/s, 25 ms and 1% loss each way, the client with 4 CPUs -(`--cpus cli=0-3,prx=4,srv=5-7`), waits of 2, 10 and 20 ms: at this rate -8000 bytes take 13-17 ms to come, so a 2 ms wait gathers next to nothing; 10 -ms caps a copying connection at 13 Mbit/s, 20 ms at 6.5 ([data/](data/) -`*-slow-g.csv`). - -**Intel (Skylake)** - -| | -s0 | -s | -s0 -g8000,2,2 | -s -g8000,2,2 | -s0 -g8000,2,10 | -s -g8000,2,10 | -s0 -g8000,2,20 | -s -g8000,2,20 | -|---|---:|---:|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 58 | 60 | 61 | 57 | 55 | 55 | 50 | 51 | -| stream16, process / busy CPU s/GB | 6.3 / 16.6 | 6.2 / 15.8 | 7.6 / 18.5 | 7.6 / 18.5 | 4.5 / 11.5 | 4.9 / 12.3 | 4.3 / 11.0 | 4.3 / 12.1 | -| mix-relay-3k, k/s | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | -| mix-relay-3k, process / busy CPU µs | 92 / 301 | 84 / 302 | 94 / 302 | 87 / 304 | 93 / 304 | 88 / 306 | 96 / 313 | 100 / 326 | -| mix-relay-3k, CPU busy % | 90 | 90 | 90 | 91 | 91 | 91 | 93 | 97 | -| mix-relay-3k, p50 / p90 / p99 ms | 102 / 311 / 1,114 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 106 / 328 / 1,180 | -| mix-http-3k, k/s | 2.51 | 2.88 | 2.77 | 2.94 | 2.98 | 2.82 | 2.89 | 2.51 | -| mix-http-3k, process / busy CPU µs | 179 / 413 | 161 / 376 | 173 / 387 | 151 / 357 | 161 / 360 | 161 / 379 | 169 / 376 | 173 / 419 | -| mix-http-3k, CPU busy % | 105 | 107 | 105 | 105 | 107 | 107 | 108 | 105 | -| mix-http-3k, p50 / p90 / p99 ms | 1,376 / 2,097 / 4,063 | 885 / 1,704 / 3,539 | 786 / 1,573 / 3,277 | 557 / 1,507 / 4,063 | 377 / 1,180 / 3,670 | 950 / 1,704 / 4,063 | 819 / 1,638 / 3,670 | 1,049 / 1,901 / 4,456 | -| mix-connect-3k, k/s | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | -| mix-connect-3k, process / busy CPU µs | 91 / 304 | 85 / 298 | 102 / 319 | 95 / 315 | 89 / 297 | 87 / 299 | 87 / 295 | 88 / 308 | -| mix-connect-3k, CPU busy % | 91 | 89 | 95 | 94 | 88 | 89 | 88 | 92 | -| mix-connect-3k, p50 / p90 / p99 ms | 102 / 311 / 1,114 | 102 / 311 / 1,180 | 106 / 328 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | - -**ARM (M4)** - -| | -s0 | -s | -s0 -g8000,2,2 | -s -g8000,2,2 | -s0 -g8000,2,10 | -s -g8000,2,10 | -s0 -g8000,2,20 | -s -g8000,2,20 | -|---|---:|---:|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 56 | 56 | 54 | 53 | 51 | 49 | 47 | 48 | -| stream16, process / busy CPU s/GB | 21.3 / 52.1 | 23.0 / 53.8 | 29.9 / 51.4 | 30.1 / 49.3 | 19.6 / 44.8 | 22.5 / 47.6 | 18.7 / 42.4 | 19.7 / 44.4 | -| mix-relay-3k, k/s | 1.74 | 1.80 | 1.80 | 1.81 | 1.81 | 1.78 | 1.75 | 1.71 | -| mix-relay-3k, process / busy CPU µs | 366 / 550 | 286 / 478 | 284 / 470 | 296 / 486 | 289 / 487 | 333 / 522 | 361 / 540 | 375 / 557 | -| mix-relay-3k, CPU busy % | 96 | 86 | 85 | 88 | 88 | 93 | 94 | 95 | -| mix-relay-3k, p50 / p90 / p99 ms | 2,621 / 4,456 / 6,816 | 2,359 / 4,194 / 6,554 | 2,359 / 4,194 / 6,554 | 2,359 / 4,194 / 6,554 | 2,359 / 4,194 / 6,816 | 2,359 / 4,194 / 6,816 | 2,490 / 4,194 / 6,816 | 2,490 / 4,456 / 6,816 | -| mix-http-3k, k/s | 1.68 | 1.70 | 1.65 | 1.67 | 1.70 | 1.68 | 1.68 | 1.71 | -| mix-http-3k, process / busy CPU µs | 420 / 582 | 385 / 550 | 476 / 618 | 397 / 560 | 434 / 584 | 411 / 581 | 451 / 590 | 368 / 536 | -| mix-http-3k, CPU busy % | 99 | 94 | 101 | 95 | 99 | 95 | 100 | 92 | -| mix-http-3k, p50 / p90 / p99 ms | 2,753 / 4,456 / 6,816 | 2,621 / 4,456 / 7,078 | 2,884 / 4,719 / 7,078 | 2,884 / 4,456 / 7,078 | 2,621 / 4,456 / 6,816 | 2,621 / 4,456 / 7,078 | 2,884 / 4,719 / 6,816 | 2,753 / 4,456 / 7,078 | -| mix-connect-3k, k/s | 1.78 | 1.77 | 1.76 | 1.77 | 1.80 | 1.81 | 1.80 | 1.79 | -| mix-connect-3k, process / busy CPU µs | 291 / 484 | 325 / 515 | 326 / 514 | 329 / 517 | 305 / 494 | 289 / 487 | 300 / 492 | 316 / 510 | -| mix-connect-3k, CPU busy % | 86 | 91 | 90 | 91 | 89 | 86 | 88 | 91 | -| mix-connect-3k, p50 / p90 / p99 ms | 2,359 / 4,194 / 6,816 | 2,490 / 4,194 / 7,078 | 2,359 / 4,194 / 6,816 | 2,490 / 4,194 / 6,816 | 2,359 / 4,194 / 6,816 | 2,359 / 4,194 / 6,816 | 2,359 / 4,194 / 6,554 | 2,359 / 4,194 / 6,816 | - -* 16 streams, held by the loss to 50-61 Mbit/s: a wait matched to the rate - pays. 10 ms takes 21-29% off the process CPU per gigabyte on Intel for 5-8% - of the throughput; 20 ms 31-32% for 12-17%; 2 ms adds 21-23%. -* The mix scenarios do not change with the setting beyond the noise. As an - HTTP proxy at 3000 exchanges a second the proxy's CPU ran out in every - configuration on Intel (2.5-3.0k a second, p90 1.2-2.1 s), with no - setting consistently ahead. -* ARM's client again set the pace of the mix (1.7-1.8k a second); 3 - exchanges were lost there (`mix-connect-3k` and `mix-relay-3k`), none on - Intel. - -### The slow link, two CPUs for the proxy - -The same, with the client's 4 CPUs kept and a second CPU for the proxy -(`--cpus cli=0-3,prx=4-5,srv=6-7`), so that the HTTP proxy is not held by -its CPU ([data/](data/) `*-slow-gp2.csv`). "CPU busy" is of both of the -proxy's CPUs, 200% for both full. - -**Intel (Skylake)** - -| | -s0 | -s | -s0 -g8000,2,2 | -s -g8000,2,2 | -s0 -g8000,2,10 | -s -g8000,2,10 | -s0 -g8000,2,20 | -s -g8000,2,20 | -|---|---:|---:|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 59 | 60 | 57 | 58 | 57 | 55 | 51 | 54 | -| stream16, process / busy CPU s/GB | 8.3 / 20.8 | 8.1 / 20.2 | 9.9 / 24.2 | 9.1 / 22.7 | 5.5 / 13.9 | 5.9 / 14.6 | 5.2 / 13.4 | 5.4 / 13.6 | -| mix-relay-3k, k/s | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | -| mix-relay-3k, process / busy CPU µs | 103 / 351 | 95 / 342 | 119 / 358 | 105 / 342 | 107 / 346 | 108 / 362 | 104 / 329 | 95 / 337 | -| mix-relay-3k, CPU busy % | 105 | 102 | 107 | 102 | 103 | 108 | 98 | 100 | -| mix-relay-3k, p50 / p90 / p99 ms | 98.3 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,114 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | -| mix-http-3k, k/s | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | -| mix-http-3k, process / busy CPU µs | 137 / 367 | 135 / 373 | 160 / 417 | 135 / 394 | 140 / 377 | 144 / 392 | 147 / 379 | 134 / 378 | -| mix-http-3k, CPU busy % | 109 | 111 | 124 | 117 | 112 | 117 | 113 | 113 | -| mix-http-3k, p50 / p90 / p99 ms | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,114 | 102 / 311 / 1,180 | 102 / 311 / 1,114 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | -| mix-connect-3k, k/s | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | 2.98 | -| mix-connect-3k, process / busy CPU µs | 97 / 335 | 91 / 330 | 113 / 350 | 98 / 337 | 111 / 354 | 105 / 345 | 99 / 325 | 108 / 352 | -| mix-connect-3k, CPU busy % | 100 | 98 | 104 | 100 | 106 | 103 | 97 | 105 | -| mix-connect-3k, p50 / p90 / p99 ms | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | 102 / 311 / 1,180 | - -**ARM (M4)** - -| | -s0 | -s | -s0 -g8000,2,2 | -s -g8000,2,2 | -s0 -g8000,2,10 | -s -g8000,2,10 | -s0 -g8000,2,20 | -s -g8000,2,20 | -|---|---:|---:|---:|---:|---:|---:|---:|---:| -| stream16, Mbit/s | 55 | 57 | 53 | 53 | 54 | 53 | 49 | 46 | -| stream16, process / busy CPU s/GB | 26.9 / 66.8 | 26.2 / 66.8 | 34.9 / 67.2 | 34.5 / 63.1 | 23.6 / 48.4 | 23.4 / 47.6 | 22.6 / 43.2 | 24.5 / 48.9 | -| mix-relay-3k, k/s | 1.81 | 1.77 | 1.78 | 1.77 | 1.72 | 1.76 | 1.75 | 1.76 | -| mix-relay-3k, process / busy CPU µs | 340 / 629 | 369 / 678 | 375 / 669 | 363 / 667 | 438 / 736 | 362 / 670 | 405 / 691 | 378 / 682 | -| mix-relay-3k, CPU busy % | 114 | 120 | 118 | 118 | 127 | 118 | 121 | 120 | -| mix-relay-3k, p50 / p90 / p99 ms | 2,359 / 4,194 / 6,554 | 2,490 / 4,194 / 6,816 | 2,359 / 4,194 / 6,816 | 2,490 / 4,194 / 6,816 | 2,621 / 4,456 / 7,078 | 2,490 / 4,194 / 6,816 | 2,490 / 4,194 / 6,816 | 2,359 / 4,194 / 6,816 | -| mix-http-3k, k/s | 1.70 | 1.74 | 1.74 | 1.74 | 1.74 | 1.67 | 1.66 | 1.73 | -| mix-http-3k, process / busy CPU µs | 472 / 737 | 395 / 671 | 401 / 685 | 391 / 662 | 397 / 658 | 478 / 757 | 478 / 764 | 383 / 666 | -| mix-http-3k, CPU busy % | 125 | 117 | 120 | 116 | 115 | 127 | 127 | 114 | -| mix-http-3k, p50 / p90 / p99 ms | 2,621 / 4,456 / 7,078 | 2,621 / 4,456 / 6,816 | 2,621 / 4,456 / 6,816 | 2,621 / 4,456 / 6,816 | 2,621 / 4,456 / 6,816 | 2,753 / 4,719 / 7,078 | 2,621 / 4,719 / 7,078 | 2,490 / 4,456 / 6,816 | -| mix-connect-3k, k/s | 1.77 | 1.81 | 1.78 | 1.74 | 1.78 | 1.75 | 1.77 | 1.74 | -| mix-connect-3k, process / busy CPU µs | 367 / 662 | 329 / 626 | 409 / 694 | 473 / 769 | 388 / 668 | 416 / 722 | 358 / 654 | 412 / 700 | -| mix-connect-3k, CPU busy % | 117 | 113 | 123 | 134 | 119 | 126 | 116 | 122 | -| mix-connect-3k, p50 / p90 / p99 ms | 2,359 / 4,194 / 6,816 | 2,228 / 4,063 / 6,816 | 2,359 / 4,194 / 6,816 | 2,490 / 4,194 / 6,816 | 2,359 / 4,194 / 6,816 | 2,228 / 4,194 / 6,816 | 2,359 / 4,194 / 6,816 | 2,490 / 4,194 / 6,816 | - -* With two CPUs the HTTP proxy kept the 3000 exchanges a second in every - configuration on Intel, at the latency of the relay (p90 311 ms). -* The settings rank as with one: on streams 10 ms takes 27-34% off the - process CPU per gigabyte for 3-8% of the throughput, 20 ms 33-37% for - 10-14%, 2 ms adds 12-19%. In the mix a 2 ms wait adds up to 17% per - exchange; 10 and 20 ms move it by less than the runs do. -* On two CPUs the proxy spends 7-13% more process CPU per exchange as a - relay and through CONNECT than on one, the cost of spreading its threads. -* ARM's client set the pace of the mix again (1.7-1.8k a second); 1 exchange - was lost there, none on Intel. - -### CONNECT at 10 Mbit/s - -Intel only: 10 Mbit/s, 10 ms and 0.5% loss each way, two CPUs for the proxy -(`--cpus cli=0-3,prx=4-5,srv=6-7`), `mix-connect-3k` only ([data/](data/) -`skylake-10m-connect.csv`); each cell the three runs. - -| | -s0 | -s | -s0 -g8000,2,5 | -s -g8000,2,5 | -|---|---:|---:|---:|---:| -| exchanges a second | 2.98k | 2.98k | 2.98k | 2.98k | -| CPU busy, % of 200 | 98, 98, 105 | 94, 96, 100 | 96, 96, 101 | 94, 97, 102 | -| process CPU µs per exchange | 104, 108, 114 | 98, 98, 102 | 97, 103, 111 | 97, 100, 105 | -| p50 / p90 / p99 ms | 41 / 123-127 / 508 | 41 / 123-127 / 508 | 41 / 127 / 508 | 41 / 127 / 508 | - -* `-s` takes about 9% off the process CPU per exchange; a wait matched to - the rate (5 ms: 8000 bytes take about 6 ms to come) changes nothing beyond - the spread of the runs, as on the other links, and no setting moves the - latency. - -### splice() heuristics in the mix - -Intel only, `-s` (the default, `-s:16384,2,4096`) against `-s:8192`, which -splices after two reads of 8K rather than 16K: the mix scenarios, whose -answers have a median of 12K, unshaped and over the 20 Mbit/s, 5 ms, 0.5% -loss link with 5 client CPUs ([data/](data/) `skylake-mixsh-*.csv`); process -CPU per exchange, three runs each. - -| scenario | -s | -s:8192 | -|---|---:|---:| -| mix-relay, unshaped | 62-65 µs | 61-65 µs | -| mix-http, unshaped | 96-100 µs | 93-104 µs | -| mix-connect, unshaped | 61-62 µs | 61-64 µs | -| mix-connect-3k, unshaped | 76-88 µs | 77-93 µs | -| mix-http-3k, 20 Mbit/s | 122-143 µs, p99 0.8 s | 152-172 µs, p99 3.1 s | -| mix-relay-3k, mix-connect-3k, 20 Mbit/s | 80-94 µs | 80-98 µs | - -* Splicing the 8-16K exchanges too is never better and, as an HTTP proxy on - the slow link, costs 20% more CPU and a longer tail: the default stays. - -### The TLS splice() threshold - -Intel only, splicing over kernel TLS (`ssl_ktls`): from a TLS socket a read -of SMALL counts as large, 4K by default (`-s`), against 8K -(`-s:16384,2,8192`) and 16K (`-s:16384,2,16384`), in the new -`tls-term-ka-2k-50k-2000` and `tls-init-ka-2k-50k-2000` scenarios (2000 -clients, a 2K POST and a 50K answer each) over 20, 10 and 5 Mbit/s links -(5 ms 0.5%, 10 ms 0.5%, 25 ms 1% loss), 5 client CPUs ([data/](data/) -`skylake-tls8-*.csv`). The proxy's CPU was 99-100% busy in every run, so -the requests a second and the process CPU per request compare. - -| link, scenario | 4K (default) | 8K | 16K | -|---|---|---|---| -| 20 Mbit/s, term | 5.3-5.6k/s, 107-111 µs | 5.5-5.8k/s, 105-108 µs | 5.4-5.5k/s, 106-108 µs | -| 20 Mbit/s, init | 4.3-4.4k/s, 122-123 µs | 4.0-4.4k/s, 121-131 µs | 4.2-4.3k/s, 124-129 µs | -| 10 Mbit/s, term | 4.4-5.0k/s, 111-124 µs | 4.7-4.9k/s, 112-117 µs | 4.8-4.9k/s, 113-116 µs | -| 10 Mbit/s, init | 4.0-4.2k/s, 128-134 µs | 4.1k/s, 130-131 µs | 4.0-4.1k/s, 129-134 µs | -| 5 Mbit/s, term | 3.7-3.9k/s, 129-136 µs | 3.6k/s, 139-141 µs | 3.4-3.7k/s, 133-146 µs | -| 5 Mbit/s, init | 3.0-3.4k/s, 154-171 µs | 2.6-3.3k/s, 158-201 µs | 3.1-3.2k/s, 162-169 µs | - -* At 20 and 10 Mbit/s the three cannot be told apart; at 5 Mbit/s 4K is a - little ahead (5-7% less CPU per request ending TLS): the default stays. - -## Earlier sessions - -The morning session of 13 October ([data/](data/) `*-16k-*.csv`, `*-mix.csv`) -ran devel before the half-close fix, the idle buffer release and the TLS -changes, 1.0.1 without TCP_NODELAY and nginx relays without -`proxy_half_close`, and had no envoy. Its ARM figures are 5-15% lower for -every proxy alike, probably because two stray 3proxy processes were spinning -on the host's CPUs at the time. - -The session of 11-12 October, devel with 64 KB buffers, splice() by direction -(`-s1`, `-s3`) and the automatic mode as an option, against 0.9.4, 1.0.1 and -the same proxies, is in [data/](data/) (`*-auto-http.csv`, `*-tunnels.csv`). - -The tables below are older still: from devel before the automatic mode, whose `-s` then -spliced both directions always, making a pair of pipes for each mapping -(`sockmap()` call), and before squid, tinyproxy and dante were added. In the -first table "devel" is `-s0` and "devel splice" `-s3` of today. The haproxy -splice columns there come from a second session an hour later, with plain -haproxy run again to see how far the conditions moved: by 2.5% or less on the -M4 and 7.5% or less on the Skylake host, except for one origin-bound case -(-9.7%). - -* A few results were limited by the client or the origin rather than by the - proxy, which can then do more than shown: on the M4, devel splice with single - and 16 streams (the receiving iperf3 thread at a full core), haproxy with 16 - streams, and several of the 1 MB HTTP runs. The per-run `bound` column in - [data/](data/) has the detail; `bench/report.py` on one machine's files marks - them. -* http-ka-50k-2000: every proxy but haproxy leaves some requests waiting longer - than wrk's 2 second limit (counted as timeouts in the data, 140-540 a run); - haproxy serves the 2000 connections more evenly, with none over 2 seconds but - a median wait 2 to 3 times longer. - -### Throughput - -| scenario (M4 / Intel / average) | no proxy | ‖ | 0.9.4 | 1.0.1 | devel | nginx | haproxy | ‖ | 0.9.4 splice | devel splice | haproxy splice-auto | -|---|---:|:-:|---:|---:|---:|---:|---:|:-:|---:|---:|---:| -| stream1, Gbit/s | 62.0 / 44.4 / 53.2 | ‖ | 8.3 / 5.5 / 6.9 | 22.1 / 19.1 / 20.6 | **22.0 / 19.9 / 21.0** | 13.5 / 9.8 / 11.6 | 13.6 / 9.7 / 11.7 | ‖ | 25.1 / 29.2 / 27.1 | **45.7 / 31.4 / 38.6** * | 29.5 / 30.6 / 30.1 | -| stream16, Gbit/s | 141.2 / 150.5 / 145.9 | ‖ | 8.7 / 5.6 / 7.2 | **20.9 / 18.9 / 19.9** | **20.9 / 18.8 / 19.8** | 13.5 / 9.9 / 11.7 | 9.5 / 9.2 / 9.3 | ‖ | 24.5 / 28.3 / 26.4 | **37.8 / 31.2 / 34.5** * | 15.9 / 30.3 / 23.1 | -| stream1-down, Gbit/s | 61.8 / 43.1 / 52.5 | ‖ | 8.8 / 5.6 / 7.2 | **22.4 / 18.8 / 20.6** | **22.1 / 19.4 / 20.8** | 13.6 / 9.7 / 11.7 | 13.6 / 9.3 / 11.5 | ‖ | **47.9 / 34.4 / 41.1** * | 47.4 / 32.0 / 39.7 | 30.4 / 31.0 / 30.7 | -| http-ka-1k, k req/s | 120.3 / 127.1 / 123.7 | ‖ | 14.1 / 19.2 / 16.7 | 6.0 / 6.1 / 6.1 | 15.8 / 18.1 / 17.0 | 37.0 / 36.5 / 36.8 | **44.3 / 37.3 / 40.8** * | ‖ | 13.4 / 14.6 / 14.0 | 14.9 / 13.8 / 14.4 | **44.1 / 37.2 / 40.7** * | -| http-ka-1m, Gbit/s | 71.6 / 67.5 / 69.5 | ‖ | 8.3 / 5.8 / 7.1 | 12.5 / 12.4 / 12.4 | **21.9 / 18.3 / 20.1** | 12.6 / 5.8 / 9.2 | 6.0 / 7.6 / 6.8 | ‖ | **33.0 / 26.6 / 29.8** * | **35.3 / 23.9 / 29.6** * | 5.9 / 24.2 / 15.1 | -| http-ka-50k-2000, k req/s | 84.5 / 85.7 / 85.1 | ‖ | 7.6 / 7.0 / 7.3 | 9.0 / 10.3 / 9.6 | **10.4 / 10.5 / 10.5** * | 11.0 / 9.2 / 10.1 | 9.6 / 7.3 / 8.4 | ‖ | 9.1 / 9.4 / 9.3 | 9.9 / 9.0 / 9.4 | 9.6 / 7.7 / 8.6 | -| http-close-1k, k req/s | 48.7 / 52.1 / 50.4 | ‖ | 5.0 / 4.8 / 4.9 | 4.4 / 4.0 / 4.2 | 5.2 / 4.8 / 5.0 | 13.3 / 12.9 / 13.1 | **16.6 / 15.1 / 15.9** * | ‖ | 4.8 / 4.4 / 4.6 | 5.0 / 4.4 / 4.7 | **16.7 / 15.1 / 15.9** * | + per second. "–" marks a proxy that does not serve the scenario. +* wrk runs a closed loop, each connection sending its next request once the + answer is in, so a proxy answering fewer requests shows a longer median + by that alone; what compares is the 99th percentile against the median, + how evenly a proxy serves its connections, which matters most with 2000 + clients and in the mix. wrk leaves requests over 2 seconds out (they are + counted as timeouts). +* CPU time per gigabyte or request and peak memory are in the tables of the + section below. Every proxy ran at its CPU limit in the plain runs, so its + CPU per unit of work is close to the inverse of its throughput; the shaped + link runs, where the pace is set by netem, are where it separates proxies. + +## The four 3proxy versions and every proxy (30 October 2026) + +3proxy 0.9.9.2, 1.0.2, devel (c3702866) and experimental (5de7ae2, the +head) against nginx, nginx with `proxy_half_close on`, haproxy, haproxy +`splice-auto`, envoy, squid and tinyproxy: the whole plain suite (streams, +1 KB / 1 MB / 50 KB and 2 KB+50 KB requests, a new connection per request, +the 20000-connection mix) and the same mix over a shaped link of 20 Mbit/s, +5 ms delay and 0.5% loss. Three runs of 10 s per cell plain, 20 s shaped; +medians. The proxy's cgroup is capped at 6 GB (`--prx-mem-mb`). The data is +in [data/results-full7/](data/results-full7/). + +Notes on the tables: + +* **dante\*** numbers are from the rerun of 30 October, same conditions as + the rest of the tables. dante cannot take part in a + 20000-connection mix on these 8 GB machines - its process per connection + exhausts memory and the kernel kills the benchmark's origin - so the + common tables have no dante mix cells; its mix behaviour, measured with + smaller pools where it survives, is in + [its own table](#dante-in-the-shaped-mix-by-pool-size-arm-earlier-runs). +* **nginx errors:** the plain `nginx` column runs its relays without + `proxy_half_close`, nginx's default, and that is what its 518 (Intel) and + 213 (ARM) errors in mix-relay shaped are: exchanges cut short on a + half-closed connection. nginx-halfclose, with it on, has none. nginx's + own default configuration, in other words, is what fails - it is marked + in the tables as nginx, and the fix is one directive. +* **Logging is off for every proxy**: 3proxy runs with no log or dlog + directive at all, nginx with `access_log off`, envoy at `--log-level + error`, squid with `access_log none`, tinyproxy at critical level; dante + and stunnel write their error files. No proxy was doing per-request + logging during any run. +* The Intel figures are from a clean rerun after a dante run had killed the + host's sshd; the ARM shaped mix is client-bound (2.4-2.5k req/s for every + proxy alike), so compare Intel for differences there. +* tinyproxy's 22-24k errors in the shaped mix are its connection-per-request + behaviour under loss; they are real, not a measurement artifact. + + +### Intel — throughput (Gbit/s for streams, k req/s else) — bold = row winner + +| scenario | 0.9.9.2 | 1.0.2 | devel | exp | nginx | nginx-hc | haproxy | hap-sa | envoy | squid | tiny | dante* | +|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| stream1 | 18.1 | 18.4 | **32.1** | 30.4 | 9.3 | 9.4 | 9.3 | 31.2 | 17.7 | – | – | – | +| stream1-down | 19.5 | 19.6 | **31.1** | **31.3** | 9.7 | 9.7 | 9.5 | 29.1 | 17.9 | – | – | – | +| stream16 | 18.6 | 18.6 | **30.4** | 29.9 | 9.6 | 9.1 | 8.8 | 28.3 | 14.7 | – | – | – | +| http-ka-1k | 1.5 | 17.7 | 22.2 | **34.9** | **34.8** | 32.9 | **34.9** | 34.7 | 10.5 | 9.1 | 3.7 | – | +| http-ka-1m | 1.7 | 2.1 | **3.3** | **3.3** | 0.7 | 0.7 | 0.9 | 2.9 | 1.5 | 0.2 | 0.1 | – | +| http-ka-50k-2000 | 10.0 | 10.2 | 11.4 | **14.2** | 8.7 | 8.8 | 7.1 | 7.2 | 6.3 | 2.2 | 1.6 | – | +| http-ka-2k-50k-2000 | 9.2 | 9.2 | 10.2 | **12.4** | 8.3 | 8.4 | 7.2 | 7.3 | 5.9 | 1.8 | 1.5 | – | +| http-close-1k | 4.7 | 4.7 | 5.9 | 7.0 | 12.7 | 12.9 | 15.4 | **15.4** | 6.2 | 4.1 | 3.7 | – | +| relay-stream1-down | 18.4 | 19.7 | **32.1** | 31.2 | 9.3 | 9.7 | 9.4 | 31.5 | 18.6 | – | – | – | +| relay-stream16 | 18.7 | 18.1 | 30.2 | **31.0** | 9.4 | 9.6 | 9.1 | 29.6 | 14.5 | – | – | – | +| relay-ka-1k | 30.3 | 30.4 | 30.7 | 41.4 | 46.9 | **49.1** | 45.4 | 46.5 | 35.7 | – | – | – | +| relay-ka-50k-2000 | 14.7 | 14.6 | 18.0 | **21.3** | 12.4 | 12.0 | 9.6 | 19.5 | 12.5 | – | – | – | +| relay-ka-2k-50k-2000 | 13.5 | 13.5 | 15.7 | **20.0** | 11.9 | 12.2 | 9.1 | 18.0 | 11.9 | – | – | – | +| relay-close-1k | 5.3 | 5.0 | 6.1 | 7.0 | 7.9 | 8.2 | **8.4** | 8.1 | 5.0 | – | – | – | +| connect-stream1-down | 19.1 | 19.7 | **32.4** | 32.0 | – | – | – | – | – | 13.4 | 1.2 | – | +| connect-stream16 | 19.0 | 18.7 | 30.8 | **32.1** | – | – | – | – | – | 13.1 | 1.2 | – | +| connect-ka-1k | 30.8 | 30.0 | 30.1 | **39.9** | – | – | – | – | – | 37.7 | 29.3 | – | +| connect-ka-50k-2000 | 13.6 | 13.0 | 15.0 | **20.2** | – | – | – | – | – | 10.7 | 2.3 | – | +| connect-ka-2k-50k-2000 | 12.2 | 12.4 | 13.8 | **19.7** | – | – | – | – | – | 10.7 | 2.4 | – | +| connect-close-1k | 4.6 | 4.3 | 5.3 | **5.5** | – | – | – | – | – | 3.6 | 4.8 | – | +| socks-stream1-down | 19.2 | 20.3 | **32.4** | 31.4 | – | – | – | – | – | – | – | 8.3* | +| socks-stream16 | 19.2 | 18.8 | **30.5** | 29.8 | – | – | – | – | – | – | – | 16.1* | +| socks-ka-1k | 31.0 | 29.1 | 30.1 | **42.0** | – | – | – | – | – | – | – | 25.3* | +| socks-ka-50k-2000 | 13.7 | 13.1 | 14.7 | **21.5** | – | – | – | – | – | – | – | 11.7* | +| socks-ka-2k-50k-2000 | 12.1 | 12.0 | 14.3 | **19.4** | – | – | – | – | – | – | – | 11.3* | +| socks-close-1k | 4.5 | 4.4 | **5.0** | **5.1** | – | – | – | – | – | – | – | 1.6* | +| mix-http | 6.0 | 6.1 | 7.8 | **9.2** | 7.4 | 7.4 | 7.2 | 8.3 | 5.4 | 2.4 | 1.6 | – | +| mix-connect | 5.6 | 8.6 | 8.3 | **11.2** | – | – | – | – | – | 7.0 | 2.7 | – | +| mix-socks | 8.1 | 8.3 | 8.3 | **11.0** | – | – | – | – | – | – | – | – | +| mix-relay | 8.7 | 8.5 | 9.5 | **11.4** | 9.4 | 9.8 | 7.7 | 9.3 | 8.9 | – | – | – | +| mix-http [shaped] | 4.0 | 3.8 | 4.2 | 5.4 | 4.3 | 4.4 | 5.0 | **5.5** | 3.3 | 1.8 | 1.5 | – | +| mix-connect [shaped] | 4.6 | 4.6 | 4.8 | **5.8** | – | – | – | – | – | 4.4 | 2.5 | – | +| mix-socks [shaped] | 4.8 | 4.6 | 4.9 | **5.8** | – | – | – | – | – | – | – | – | +| mix-relay [shaped] | 4.7 | 4.7 | 4.9 | **6.0** | 5.5 | 5.8 | 5.4 | 5.8 | 5.1 | – | – | – | + +### Intel — peak memory MB / errors (medians) + +| scenario | 0.9.9.2 | 1.0.2 | devel | exp | nginx | nginx-hc | haproxy | hap-sa | envoy | squid | tiny | dante* | +|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| stream1 | 7 / 0 | 9 / 0 | 12 / 0 | 13 / 0 | 32 / 0 | 33 / 0 | 31 / 0 | 44 / 0 | 32 / 0 | – | – | – | +| stream1-down | 8 / 0 | 7 / 0 | 13 / 0 | 10 / 0 | 33 / 0 | 33 / 0 | 31 / 0 | 43 / 0 | 32 / 0 | – | – | – | +| stream16 | 93 / 0 | 89 / 0 | 97 / 0 | 103 / 0 | 108 / 0 | 107 / 0 | 53 / 0 | 105 / 0 | 152 / 0 | – | – | – | +| http-ka-1k | 10 / 0 | 10 / 0 | 8 / 0 | 5 / 0 | 32 / 0 | 32 / 0 | 30 / 0 | 36 / 0 | 26 / 0 | 22 / 0 | 8 / 37007 | – | +| http-ka-1m | 13 / 0 | 16 / 0 | 17 / 0 | 17 / 0 | 45 / 0 | 44 / 0 | 45 / 0 | 51 / 0 | 45 / 0 | 43 / 0 | 9 / 1332 | – | +| http-ka-50k-2000 | 159 / 0 | 173 / 0 | 83 / 0 | 162 / 0 | 113 / 0 | 114 / 0 | 179 / 0 | 184 / 0 | 364 / 0 | 184 / 0 | 30 / 16222 | – | +| http-ka-2k-50k-2000 | 156 / 0 | 179 / 0 | 80 / 0 | 162 / 0 | 119 / 0 | 117 / 0 | 179 / 0 | 184 / 0 | 367 / 0 | 190 / 0 | 30 / 15445 | – | +| http-close-1k | 174 / 0 | 49 / 0 | 9 / 0 | 7 / 0 | 32 / 0 | 32 / 0 | 31 / 0 | 36 / 0 | 29 / 0 | 19 / 0 | 8 / 37575 | – | +| relay-stream1-down | 9 / 0 | 7 / 0 | 13 / 0 | 12 / 0 | 32 / 0 | 33 / 0 | 31 / 0 | 44 / 0 | 33 / 0 | – | – | – | +| relay-stream16 | 90 / 0 | 92 / 0 | 95 / 0 | 105 / 0 | 111 / 0 | 106 / 0 | 54 / 0 | 101 / 0 | 151 / 0 | – | – | – | +| relay-ka-1k | 6 / 0 | 6 / 0 | 7 / 0 | 5 / 0 | 31 / 0 | 32 / 0 | 29 / 0 | 35 / 0 | 23 / 0 | – | – | – | +| relay-ka-50k-2000 | 104 / 0 | 78 / 0 | 55 / 0 | 120 / 0 | 107 / 0 | 115 / 0 | 151 / 0 | 126 / 0 | 300 / 0 | – | – | – | +| relay-ka-2k-50k-2000 | 105 / 0 | 88 / 0 | 59 / 0 | 116 / 0 | 109 / 0 | 104 / 0 | 150 / 0 | 130 / 0 | 297 / 0 | – | – | – | +| relay-close-1k | 13 / 0 | 13 / 0 | 11 / 0 | 6 / 0 | 32 / 0 | 32 / 0 | 29 / 0 | 36 / 0 | 24 / 0 | – | – | – | +| connect-stream1-down | 8 / 0 | 10 / 0 | 12 / 0 | 13 / 0 | – | – | – | – | – | 21 / 0 | 2 / 0 | – | +| connect-stream16 | 78 / 0 | 74 / 0 | 96 / 0 | 101 / 0 | – | – | – | – | – | 65 / 0 | 71 / 0 | – | +| connect-ka-1k | 10 / 0 | 9 / 0 | 7 / 0 | 5 / 0 | – | – | – | – | – | 20 / 0 | 6 / 0 | – | +| connect-ka-50k-2000 | 388 / 2 | 255 / 0 | 220 / 2 | 120 / 1 | – | – | – | – | – | 244 / 0 | 130 / 0 | – | +| connect-ka-2k-50k-2000 | 391 / 1 | 261 / 1 | 224 / 0 | 115 / 1 | – | – | – | – | – | 251 / 0 | 136 / 0 | – | +| connect-close-1k | 11 / 26 | 12 / 14 | 8 / 22 | 5 / 27 | – | – | – | – | – | 21 / 2 | 7 / 18 | – | +| socks-stream1-down | 7 / 0 | 7 / 0 | 10 / 0 | 11 / 0 | – | – | – | – | – | – | – | 31 / 0* | +| socks-stream16 | 81 / 0 | 81 / 0 | 98 / 0 | 101 / 0 | – | – | – | – | – | – | – | 84 / 0* | +| socks-ka-1k | 6 / 0 | 6 / 0 | 7 / 0 | 5 / 0 | – | – | – | – | – | – | – | 98 / 0* | +| socks-ka-50k-2000 | 258 / 2 | 258 / 1 | 217 / 0 | 122 / 2 | – | – | – | – | – | – | – | 1453 / 2* | +| socks-ka-2k-50k-2000 | 263 / 2 | 266 / 2 | 220 / 1 | 121 / 1 | – | – | – | – | – | – | – | 1423 / 2* | +| socks-close-1k | 7 / 18 | 7 / 25 | 7 / 17 | 5 / 22 | – | – | – | – | – | – | – | 131 / 9* | +| mix-http | 2950 / 0 | 2366 / 0 | 1414 / 0 | 674 / 0 | 222 / 0 | 226 / 0 | 497 / 0 | 423 / 0 | 606 / 0 | 656 / 0 | 789 / 9749 | – | +| mix-connect | 3217 / 20497 | 2080 / 0 | 1501 / 0 | 452 / 0 | – | – | – | – | – | 1805 / 329 | 1075 / 124 | – | +| mix-socks | 2139 / 0 | 1979 / 0 | 1514 / 0 | 472 / 0 | – | – | – | – | – | – | – | – | +| mix-relay | 1785 / 0 | 1788 / 0 | 1324 / 0 | 429 / 0 | 645 / 455 | 662 / 0 | 480 / 0 | 342 / 0 | 713 / 0 | – | – | – | +| mix-http [shaped] | 2995 / 0 | 2288 / 0 | 1507 / 0 | 724 / 0 | 261 / 0 | 258 / 0 | 446 / 0 | 414 / 0 | 625 / 0 | 830 / 0 | 792 / 22353 | – | +| mix-connect [shaped] | 3320 / 2 | 2028 / 0 | 1488 / 0 | 473 / 0 | – | – | – | – | – | 1860 / 408 | 1090 / 312 | – | +| mix-socks [shaped] | 1958 / 0 | 1957 / 0 | 1505 / 0 | 493 / 0 | – | – | – | – | – | – | – | – | +| mix-relay [shaped] | 1917 / 0 | 1895 / 0 | 1411 / 0 | 472 / 0 | 688 / 518 | 706 / 0 | 458 / 0 | 418 / 0 | 719 / 0 | – | – | – | + +### Intel — p75 / p90 / p99, ms (medians; streams have none) + +| scenario | 0.9.9.2 | 1.0.2 | devel | exp | nginx | nginx-hc | haproxy | hap-sa | envoy | squid | tiny | dante* | +|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| stream1 | – | – | – | – | – | – | – | – | – | – | – | – | +| stream1-down | – | – | – | – | – | – | – | – | – | – | – | – | +| stream16 | – | – | – | – | – | – | – | – | – | – | – | – | +| http-ka-1k | 41 / 41 / 42 | 4 / 5 / 7 | 3 / 4 / 5 | 17 / 28 / 36 | 2 / 2 / 3 | 2 / 2 / 3 | 2 / 2 / 3 | 2 / 2 / 3 | 6 / 7 / 10 | 7 / 9 / 11 | 19 / 22 / 27 | – | +| http-ka-1m | 25 / 41 / 45 | 9 / 12 / 17 | 6 / 7 / 10 | 6 / 8 / 11 | 24 / 27 / 32 | 24 / 26 / 31 | 21 / 23 / 27 | 6 / 7 / 8 | 12 / 13 / 15 | 69 / 74 / 84 | 126 / 136 / 160 | – | +| http-ka-50k-2000 | 59 / 67 / 115 | 63 / 70 / 116 | 52 / 62 / 120 | 157 / 163 / 1010 | 144 / 158 / 187 | 136 / 147 / 166 | 287 / 307 / 686 | 282 / 294 / 637 | 321 / 349 / 512 | 516 / 579 / 642 | 681 / 869 / 1710 | – | +| http-ka-2k-50k-2000 | 67 / 79 / 139 | 77 / 88 / 126 | 58 / 66 / 113 | 163 / 196 / 893 | 147 / 153 / 167 | 138 / 145 / 164 | 279 / 297 / 697 | 283 / 295 / 641 | 347 / 384 / 539 | 539 / 586 / 596 | 730 / 811 / 1690 | – | +| http-close-1k | 16 / 19 / 23 | 15 / 19 / 24 | 12 / 14 / 20 | 11 / 14 / 21 | 5 / 6 / 7 | 5 / 6 / 7 | 4 / 5 / 6 | 4 / 5 / 6 | 11 / 12 / 16 | 16 / 18 / 23 | 19 / 21 / 27 | – | +| relay-stream1-down | – | – | – | – | – | – | – | – | – | – | – | – | +| relay-stream16 | – | – | – | – | – | – | – | – | – | – | – | – | +| relay-ka-1k | 2 / 3 / 4 | 2 / 3 / 4 | 2 / 3 / 4 | 16 / 28 / 36 | 1 / 2 / 2 | 1 / 2 / 2 | 1 / 2 / 2 | 1 / 2 / 2 | 2 / 2 / 3 | – | – | – | +| relay-ka-50k-2000 | 37 / 45 / 68 | 33 / 38 / 56 | 25 / 30 / 50 | 97 / 126 / 826 | 77 / 78 / 93 | 84 / 89 / 95 | 220 / 233 / 1040 | 95 / 106 / 769 | 167 / 192 / 368 | – | – | – | +| relay-ka-2k-50k-2000 | 41 / 47 / 75 | 33 / 39 / 62 | 30 / 35 / 51 | 98 / 138 / 865 | 83 / 92 / 106 | 79 / 85 / 95 | 226 / 260 / 1140 | 106 / 115 / 715 | 174 / 192 / 383 | – | – | – | +| relay-close-1k | 13 / 16 / 20 | 15 / 17 / 21 | 11 / 13 / 19 | 11 / 14 / 20 | 8 / 9 / 11 | 8 / 9 / 11 | 8 / 9 / 11 | 8 / 9 / 11 | 13 / 14 / 17 | – | – | – | +| connect-stream1-down | – | – | – | – | – | – | – | – | – | – | – | – | +| connect-stream16 | – | – | – | – | – | – | – | – | – | – | – | – | +| connect-ka-1k | 2 / 3 / 4 | 2 / 3 / 4 | 2 / 3 / 4 | 16 / 28 / 36 | – | – | – | – | – | 2 / 2 / 2 | 2 / 3 / 4 | – | +| connect-ka-50k-2000 | 138 / 154 / 228 | 140 / 159 / 231 | 111 / 130 / 205 | 96 / 104 / 141 | – | – | – | – | – | 179 / 191 / 218 | 618 / 715 / 1090 | – | +| connect-ka-2k-50k-2000 | 148 / 169 / 228 | 142 / 159 / 225 | 121 / 149 / 190 | 97 / 102 / 142 | – | – | – | – | – | 177 / 183 / 195 | 614 / 718 / 1340 | – | +| connect-close-1k | 7 / 10 / 13 | 8 / 11 / 14 | 6 / 9 / 12 | 5 / 8 / 11 | – | – | – | – | – | 12 / 13 / 17 | 7 / 10 / 12 | – | +| socks-stream1-down | – | – | – | – | – | – | – | – | – | – | – |– | +| socks-stream16 | – | – | – | – | – | – | – | – | – | – | – |– | +| socks-ka-1k | 2 / 3 / 3 | 2 / 3 / 4 | 2 / 3 / 4 | 16 / 28 / 36 | – | – | – | – | – | – | – | 3 / 5 / 6* | +| socks-ka-50k-2000 | 132 / 149 / 230 | 140 / 160 / 236 | 114 / 141 / 210 | 94 / 98 / 136 | – | – | – | – | – | – | – | 308 / 316 / 331* | +| socks-ka-2k-50k-2000 | 147 / 174 / 283 | 143 / 162 / 211 | 122 / 137 / 188 | 97 / 105 / 143 | – | – | – | – | – | – | – | 311 / 317 / 328* | +| socks-close-1k | 7 / 10 / 14 | 8 / 11 / 14 | 7 / 9 / 12 | 6 / 9 / 13 | – | – | – | – | – | – | – | 23 / 29 / 39* | +| mix-http | 11 / 49 / 5505 | 12 / 90 / 5505 | 7 / 14 / 4194 | 229 / 344 / 1769 | 164 / 254 / 4194 | 139 / 229 / 3932 | 229 / 557 / 2753 | 311 / 557 / 1442 | 377 / 426 / 508 | 86 / 1376 / 7340 | 1901 / 3670 / 5767 | – | +| mix-connect | 90 / 213 / 3408 | 18 / 221 / 3277 | 11 / 238 / 3539 | 139 / 254 / 1901 | – | – | – | – | – | 131 / 188 / 4063 | 188 / 1901 / 5505 | – | +| mix-socks | 47 / 238 / 3408 | 33 / 238 / 3408 | 16 / 262 / 3539 | 147 / 262 / 1966 | – | – | – | – | – | – | – | – | +| mix-relay | 9 / 27 / 3408 | 8 / 18 / 3539 | 4 / 11 / 3277 | 22 / 205 / 2228 | 6 / 12 / 3146 | 5 / 12 / 3015 | 188 / 590 / 2621 | 111 / 246 / 2490 | 229 / 254 / 344 | – | – | – | +| mix-http [shaped] | 98 / 819 / 6554 | 115 / 852 / 7340 | 188 / 885 / 6291 | 377 / 623 / 3539 | 262 / 442 / 6291 | 262 / 393 / 6291 | 344 / 819 / 3801 | 459 / 852 / 2032 | 623 / 721 / 950 | 754 / 1704 / 8389 | 1769 / 3277 / 6291 | – | +| mix-connect [shaped] | 123 / 459 / 5767 | 102 / 524 / 5767 | 90 / 475 / 5243 | 279 / 557 / 3408 | – | – | – | – | – | 188 / 295 / 5767 | 123 / 1507 / 11534 | – | +| mix-socks [shaped] | 119 / 410 / 5243 | 123 / 393 / 5767 | 127 / 524 / 5243 | 279 / 524 / 3408 | – | – | – | – | – | – | – | – | +| mix-relay [shaped] | 102 / 492 / 5505 | 115 / 492 / 5767 | 86 / 508 / 5243 | 262 / 524 / 3277 | 156 / 311 / 4456 | 139 / 262 / 4194 | 328 / 623 / 2621 | 393 / 590 / 1245 | 410 / 492 / 721 | – | – | – | + +### ARM (M4) — throughput (Gbit/s for streams, k req/s else) — bold = row winner + +| scenario | 0.9.9.2 | 1.0.2 | devel | exp | nginx | nginx-hc | haproxy | hap-sa | envoy | squid | tiny | dante* | +|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| stream1 | 24.2 | 25.2 | **62.7** | 62.0 | 18.7 | 19.3 | 9.0 | 27.0 | 34.8 | – | – | – | +| stream1-down | 24.5 | 25.0 | **61.1** | 59.9 | 19.7 | 20.0 | 8.9 | 26.3 | 33.7 | – | – | – | +| stream16 | 23.8 | 24.3 | **55.6** | 48.2 | 18.8 | 18.7 | 9.6 | 27.4 | 20.0 | – | – | – | +| http-ka-1k | 1.5 | 15.5 | 16.6 | 35.6 | 44.2 | 44.9 | **50.0** | **50.0** | 25.0 | 22.2 | 4.5 | – | +| http-ka-1m | 2.3 | 3.1 | 5.5 | **5.5** | 1.7 | 1.6 | 0.7 | 2.2 | 3.0 | 0.4 | 0.1 | – | +| http-ka-50k-2000 | 10.1 | 10.1 | 10.3 | **16.5** | 14.4 | 14.4 | 10.3 | 10.2 | 11.0 | 4.3 | 1.9 | – | +| http-ka-2k-50k-2000 | 8.9 | 9.3 | 9.3 | **14.1** | 13.3 | 13.1 | 9.7 | 9.7 | 11.2 | 3.2 | 1.9 | – | +| http-close-1k | 4.6 | 4.8 | 5.7 | 9.4 | 14.1 | 14.0 | **16.6** | **16.5** | 15.5 | 7.4 | 4.6 | – | +| relay-stream1-down | 24.2 | 24.3 | **64.3** | 61.3 | 19.5 | 19.5 | 9.2 | 27.4 | 33.8 | – | – | – | +| relay-stream16 | 24.2 | 23.8 | **55.7** | 48.5 | 18.8 | 18.6 | 8.8 | 28.0 | 19.9 | – | – | – | +| relay-ka-1k | 21.0 | 20.7 | 20.8 | 37.5 | **52.4** | **52.2** | 51.8 | 50.1 | 38.0 | – | – | – | +| relay-ka-50k-2000 | 12.6 | 12.4 | 12.7 | 23.0 | 18.1 | 18.0 | 14.2 | **25.2** | 14.7 | – | – | – | +| relay-ka-2k-50k-2000 | 11.5 | 11.5 | 11.7 | 21.4 | 16.3 | 16.4 | 13.2 | **23.5** | 14.2 | – | – | – | +| relay-close-1k | 5.3 | 5.3 | 6.2 | **10.2** | 8.8 | 8.8 | **10.2** | **10.2** | 9.3 | – | – | – | +| connect-stream1-down | 24.4 | 25.5 | **63.6** | 59.6 | – | – | – | – | – | 15.3 | 1.5 | – | +| connect-stream16 | 24.1 | 24.1 | **55.0** | 48.1 | – | – | – | – | – | 20.0 | 1.5 | – | +| connect-ka-1k | 20.5 | 20.2 | 20.2 | 35.1 | – | – | – | – | – | **42.2** | 17.4 | – | +| connect-ka-50k-2000 | 11.7 | 11.7 | 11.8 | **22.9** | – | – | – | – | – | 16.1 | 2.6 | – | +| connect-ka-2k-50k-2000 | 10.8 | 10.7 | 10.9 | **21.4** | – | – | – | – | – | 15.2 | 2.5 | – | +| connect-close-1k | 4.1 | 4.1 | 4.7 | **6.0** | – | – | – | – | – | 5.4 | 4.3 | – | +| socks-stream1-down | 24.6 | 25.0 | 61.0 | **69.3** | – | – | – | – | – | – | – | 11.3* | +| socks-stream16 | 24.1 | 24.2 | **55.8** | 47.2 | – | – | – | – | – | – | – | 15.5* | +| socks-ka-1k | 20.6 | 20.5 | 20.2 | **35.4** | – | – | – | – | – | – | – | 28.2* | +| socks-ka-50k-2000 | 11.8 | 11.8 | 12.0 | **23.0** | – | – | – | – | – | – | – | 14.3* | +| socks-ka-2k-50k-2000 | 10.9 | 10.8 | 11.0 | **21.6** | – | – | – | – | – | – | – | 14.2* | +| socks-close-1k | 3.9 | 3.9 | 4.4 | **5.7** | – | – | – | – | – | – | – | 3.6* | +| mix-http | 4.9 | 4.7 | 5.6 | 8.6 | 9.2 | 9.2 | 7.5 | **9.3** | 7.2 | 3.0 | 1.8 | – | +| mix-connect | 5.7 | 6.2 | 6.0 | **9.8** | – | – | – | – | – | 7.9 | 2.4 | – | +| mix-socks | 6.2 | 6.3 | 6.1 | **9.8** | – | – | – | – | – | – | – | – | +| mix-relay | 6.6 | 6.5 | 6.3 | **9.8** | 8.8 | 8.9 | 7.5 | 8.9 | 7.9 | – | – | – | +| mix-http [shaped] | 2.3 | 2.3 | 2.3 | 2.4 | 2.5 | **2.5** | 2.5 | 2.5 | **2.5** | 2.5 | 1.6 | – | +| mix-connect [shaped] | 2.4 | 2.4 | 2.4 | **2.5** | – | – | – | – | – | 2.5 | 2.1 | – | +| mix-socks [shaped] | 2.4 | 2.4 | 2.4 | **2.5** | – | – | – | – | – | – | – | – | +| mix-relay [shaped] | 2.4 | 2.4 | 2.4 | 2.5 | **2.5** | **2.5** | 2.5 | **2.5** | 2.5 | – | – | – | + +### ARM (M4) — peak memory MB / errors (medians) + +| scenario | 0.9.9.2 | 1.0.2 | devel | exp | nginx | nginx-hc | haproxy | hap-sa | envoy | squid | tiny | dante* | +|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| stream1 | 18 / 0 | 18 / 0 | 23 / 0 | 35 / 0 | 33 / 0 | 33 / 0 | 34 / 0 | 41 / 0 | 22 / 0 | – | – | – | +| stream1-down | 20 / 0 | 20 / 0 | 22 / 0 | 34 / 0 | 37 / 0 | 36 / 0 | 34 / 0 | 43 / 0 | 24 / 0 | – | – | – | +| stream16 | 107 / 0 | 126 / 0 | 126 / 0 | 111 / 0 | 60 / 0 | 58 / 0 | 46 / 0 | 134 / 0 | 184 / 0 | – | – | – | +| http-ka-1k | 131 / 0 | 131 / 0 | 134 / 0 | 28 / 0 | 34 / 0 | 34 / 0 | 35 / 0 | 41 / 0 | 19 / 0 | 26 / 0 | 135 / 44575 | – | +| http-ka-1m | 55 / 0 | 58 / 0 | 58 / 0 | 43 / 0 | 47 / 0 | 45 / 0 | 38 / 0 | 47 / 0 | 39 / 0 | 36 / 0 | 41 / 1475 | – | +| http-ka-50k-2000 | 241 / 0 | 231 / 0 | 229 / 0 | 185 / 0 | 77 / 0 | 73 / 0 | 159 / 0 | 165 / 0 | 255 / 0 | 158 / 0 | 158 / 19051 | – | +| http-ka-2k-50k-2000 | 254 / 0 | 240 / 0 | 232 / 0 | 184 / 0 | 72 / 0 | 76 / 0 | 156 / 0 | 166 / 0 | 325 / 0 | 175 / 0 | 175 / 18947 | – | +| http-close-1k | 197 / 0 | 161 / 0 | 136 / 0 | 31 / 0 | 33 / 0 | 34 / 0 | 35 / 0 | 41 / 0 | 20 / 0 | 25 / 0 | 133 / 45992 | – | +| relay-stream1-down | 20 / 0 | 19 / 0 | 23 / 0 | 35 / 0 | 35 / 0 | 34 / 0 | 34 / 0 | 43 / 0 | 24 / 0 | – | – | – | +| relay-stream16 | 95 / 0 | 101 / 0 | 103 / 0 | 125 / 0 | 63 / 0 | 57 / 0 | 39 / 0 | 100 / 0 | 127 / 0 | – | – | – | +| relay-ka-1k | 130 / 0 | 130 / 0 | 16 / 0 | 28 / 0 | 33 / 0 | 35 / 0 | 34 / 0 | 40 / 0 | 17 / 0 | – | – | – | +| relay-ka-50k-2000 | 197 / 0 | 197 / 0 | 101 / 0 | 143 / 0 | 114 / 0 | 114 / 0 | 165 / 0 | 142 / 0 | 242 / 0 | – | – | – | +| relay-ka-2k-50k-2000 | 199 / 0 | 198 / 0 | 112 / 0 | 143 / 0 | 110 / 0 | 107 / 0 | 165 / 0 | 140 / 0 | 225 / 0 | – | – | – | +| relay-close-1k | 146 / 0 | 149 / 0 | 18 / 0 | 30 / 0 | 35 / 0 | 35 / 0 | 34 / 0 | 40 / 0 | 19 / 0 | – | – | – | +| connect-stream1-down | 19 / 0 | 20 / 0 | 25 / 0 | 34 / 0 | – | – | – | – | – | 23 / 0 | 23 / 0 | – | +| connect-stream16 | 133 / 0 | 116 / 0 | 132 / 0 | 108 / 0 | – | – | – | – | – | 122 / 0 | 122 / 0 | – | +| connect-ka-1k | 131 / 0 | 133 / 0 | 132 / 0 | 29 / 0 | – | – | – | – | – | 32 / 0 | 133 / 0 | – | +| connect-ka-50k-2000 | 434 / 0 | 341 / 1 | 340 / 0 | 147 / 0 | – | – | – | – | – | 368 / 0 | 368 / 0 | – | +| connect-ka-2k-50k-2000 | 436 / 0 | 344 / 0 | 343 / 0 | 140 / 0 | – | – | – | – | – | 375 / 0 | 375 / 0 | – | +| connect-close-1k | 132 / 5 | 132 / 1 | 134 / 6 | 30 / 4 | – | – | – | – | – | 32 / 0 | 129 / 1 | – | +| socks-stream1-down | 20 / 0 | 19 / 0 | 21 / 0 | 35 / 0 | – | – | – | – | – | – | – | 13 / 0* | +| socks-stream16 | 109 / 0 | 123 / 0 | 94 / 0 | 81 / 0 | – | – | – | – | – | – | – | 116 / 0* | +| socks-ka-1k | 131 / 0 | 131 / 0 | 18 / 0 | 28 / 0 | – | – | – | – | – | – | – | 40 / 0* | +| socks-ka-50k-2000 | 333 / 0 | 333 / 1 | 225 / 0 | 143 / 1 | – | – | – | – | – | – | – | 785 / 0* | +| socks-ka-2k-50k-2000 | 335 / 2 | 336 / 0 | 228 / 0 | 145 / 1 | – | – | – | – | – | – | – | 787 / 0* | +| socks-close-1k | 132 / 5 | 134 / 4 | 18 / 5 | 29 / 5 | – | – | – | – | – | – | – | 59 / 2* | +| mix-http | 3031 / 0 | 2457 / 0 | 1676 / 0 | 721 / 0 | 192 / 0 | 188 / 0 | 311 / 0 | 306 / 0 | 635 / 0 | 873 / 0 | 976 / 11770 | – | +| mix-connect | 3323 / 0 | 2603 / 0 | 1626 / 0 | 494 / 0 | – | – | – | – | – | 2850 / 382 | 1135 / 108 | – | +| mix-socks | 2137 / 0 | 2167 / 0 | 1523 / 0 | 526 / 0 | – | – | – | – | – | – | – | – | +| mix-relay | 1932 / 0 | 1952 / 0 | 1333 / 0 | 480 / 0 | 794 / 422 | 794 / 0 | 474 / 0 | 358 / 0 | 644 / 0 | – | – | – | +| mix-http [shaped] | 3348 / 0 | 2602 / 0 | 1871 / 0 | 1079 / 0 | 657 / 0 | 660 / 0 | 504 / 0 | 479 / 0 | 775 / 144 | 846 / 0 | 968 / 24582 | – | +| mix-connect [shaped] | 3423 / 1 | 2613 / 0 | 1872 / 0 | 696 / 0 | – | – | – | – | – | 3007 / 224 | 1137 / 471 | – | +| mix-socks [shaped] | 2156 / 0 | 2154 / 0 | 1777 / 0 | 716 / 0 | – | – | – | – | – | – | – | – | +| mix-relay [shaped] | 2054 / 1 | 2052 / 0 | 1678 / 0 | 688 / 0 | 1090 / 213 | 1093 / 0 | 530 / 0 | 529 / 0 | 831 / 0 | – | – | – | + +### ARM (M4) — p75 / p90 / p99, ms (medians; streams have none) + +| scenario | 0.9.9.2 | 1.0.2 | devel | exp | nginx | nginx-hc | haproxy | hap-sa | envoy | squid | tiny | dante* | +|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| stream1 | – | – | – | – | – | – | – | – | – | – | – | – | +| stream1-down | – | – | – | – | – | – | – | – | – | – | – | – | +| stream16 | – | – | – | – | – | – | – | – | – | – | – | – | +| http-ka-1k | 44 / 46 / 53 | 5 / 6 / 10 | 5 / 6 / 10 | 3 / 4 / 8 | 2 / 2 / 2 | 1 / 2 / 2 | 1 / 2 / 2 | 1 / 2 / 2 | 3 / 3 / 4 | 3 / 3 / 4 | 16 / 19 / 23 | – | +| http-ka-1m | 27 / 36 / 43 | 6 / 8 / 12 | 4 / 5 / 8 | 4 / 5 / 8 | 11 / 14 / 19 | 11 / 14 / 20 | 25 / 26 / 28 | 8 / 8 / 9 | 6 / 6 / 7 | 47 / 48 / 52 | 118 / 123 / 136 | – | +| http-ka-50k-2000 | 77 / 101 / 474 | 78 / 101 / 256 | 75 / 99 / 257 | 120 / 124 / 561 | 58 / 64 / 70 | 55 / 61 / 69 | 191 / 197 / 705 | 196 / 200 / 682 | 184 / 193 / 324 | 280 / 295 / 507 | 572 / 617 / 1430 | – | +| http-ka-2k-50k-2000 | 96 / 124 / 299 | 90 / 114 / 243 | 85 / 110 / 591 | 144 / 146 / 538 | 53 / 58 / 66 | 57 / 63 / 68 | 207 / 214 / 761 | 205 / 214 / 760 | 182 / 201 / 305 | 312 / 340 / 359 | 568 / 603 / 1400 | – | +| http-close-1k | 15 / 18 / 22 | 15 / 17 / 21 | 12 / 15 / 19 | 8 / 10 / 14 | 5 / 5 / 5 | 5 / 5 / 5 | 4 / 4 / 5 | 4 / 4 / 5 | 4 / 5 / 6 | 9 / 9 / 10 | 16 / 18 / 22 | – | +| relay-stream1-down | – | – | – | – | – | – | – | – | – | – | – | – | +| relay-stream16 | – | – | – | – | – | – | – | – | – | – | – | – | +| relay-ka-1k | 4 / 5 / 8 | 4 / 5 / 8 | 4 / 5 / 8 | 2 / 4 / 6 | 1 / 1 / 2 | 1 / 1 / 2 | 1 / 1 / 2 | 1 / 2 / 2 | 2 / 2 / 3 | – | – | – | +| relay-ka-50k-2000 | 64 / 86 / 531 | 67 / 88 / 400 | 63 / 85 / 274 | 95 / 95 / 353 | 58 / 66 / 73 | 56 / 64 / 147 | 140 / 145 / 948 | 81 / 85 / 1290 | 139 / 148 / 268 | – | – | – | +| relay-ka-2k-50k-2000 | 74 / 97 / 404 | 71 / 91 / 224 | 70 / 91 / 432 | 96 / 99 / 366 | 54 / 60 / 66 | 54 / 61 / 66 | 151 / 154 / 905 | 88 / 92 / 1280 | 143 / 150 / 261 | – | – | – | +| relay-close-1k | 14 / 16 / 19 | 14 / 16 / 20 | 11 / 13 / 18 | 8 / 10 / 14 | 7 / 8 / 9 | 7 / 8 / 8 | 6 / 7 / 7 | 6 / 7 / 7 | 7 / 8 / 9 | – | – | – | +| connect-stream1-down | – | – | – | – | – | – | – | – | – | – | – | – | +| connect-stream16 | – | – | – | – | – | – | – | – | – | – | – | – | +| connect-ka-1k | 4 / 5 / 7 | 4 / 5 / 7 | 4 / 5 / 8 | 3 / 4 / 7 | – | – | – | – | – | 2 / 2 / 2 | 4 / 5 / 8 | – | +| connect-ka-50k-2000 | 186 / 234 / 358 | 184 / 232 / 347 | 186 / 234 / 352 | 95 / 95 / 98 | – | – | – | – | – | 123 / 127 / 130 | 761 / 879 / 1600 | – | +| connect-ka-2k-50k-2000 | 196 / 244 / 367 | 202 / 248 / 368 | 194 / 239 / 358 | 96 / 97 / 109 | – | – | – | – | – | 129 / 134 / 139 | 795 / 918 / 1670 | – | +| connect-close-1k | 9 / 12 / 14 | 10 / 12 / 14 | 8 / 11 / 13 | 6 / 8 / 11 | – | – | – | – | – | 8 / 9 / 10 | 10 / 12 / 15 | – | +| socks-stream1-down | – | – | – | – | – | – | – | – | – | – | – |– | +| socks-stream16 | – | – | – | – | – | – | – | – | – | – | – |– | +| socks-ka-1k | 4 / 5 / 7 | 4 / 5 / 7 | 4 / 5 / 8 | 3 / 4 / 7 | – | – | – | – | – | – | – | 4 / 4 / 4* | +| socks-ka-50k-2000 | 187 / 234 / 351 | 188 / 233 / 347 | 184 / 231 / 351 | 95 / 95 / 98 | – | – | – | – | – | – | – | 188 / 191 / 203* | +| socks-ka-2k-50k-2000 | 196 / 242 / 355 | 201 / 246 / 360 | 195 / 239 / 350 | 95 / 96 / 102 | – | – | – | – | – | – | – | 188 / 191 / 200* | +| socks-close-1k | 10 / 12 / 15 | 10 / 12 / 15 | 9 / 11 / 14 | 7 / 9 / 12 | – | – | – | – | – | – | – | 11 / 15 / 19* | +| mix-http | 19 / 51 / 6554 | 16 / 35 / 7078 | 16 / 30 / 5767 | 188 / 295 / 2097 | 6 / 11 / 3277 | 6 / 11 / 3277 | 262 / 295 / 2228 | 213 / 221 / 1835 | 279 / 311 / 377 | 459 / 1049 / 4981 | 1016 / 3146 / 5243 | – | +| mix-connect | 180 / 344 / 5243 | 164 / 344 / 4719 | 172 / 344 / 4719 | 197 / 262 / 1245 | – | – | – | – | – | 90 / 156 / 3408 | 655 / 819 / 4456 | – | +| mix-socks | 147 / 311 / 4456 | 147 / 311 / 4719 | 188 / 344 / 4719 | 197 / 262 / 1114 | – | – | – | – | – | – | – | – | +| mix-relay | 14 / 29 / 4719 | 15 / 27 / 4719 | 16 / 32 / 4719 | 139 / 221 / 1966 | 6 / 13 / 3408 | 6 / 12 / 3277 | 94 / 655 / 3539 | 66 / 254 / 2884 | 254 / 279 / 377 | – | – | – | +| mix-http [shaped] | 852 / 1966 / 6291 | 819 / 1966 / 6554 | 819 / 1835 / 6291 | 786 / 1835 / 6291 | 786 / 1769 / 6029 | 754 / 1769 / 6029 | 754 / 1769 / 6029 | 754 / 1769 / 6029 | 754 / 1704 / 6029 | 524 / 1376 / 8389 | 1638 / 3015 / 6029 | – | +| mix-connect [shaped] | 786 / 1835 / 6554 | 754 / 1835 / 6554 | 786 / 1835 / 6291 | 754 / 1769 / 6291 | – | – | – | – | – | 754 / 1769 / 6291 | 442 / 786 / 9437 | – | +| mix-socks [shaped] | 786 / 1835 / 6291 | 754 / 1835 / 6291 | 754 / 1769 / 6291 | 754 / 1769 / 6291 | – | – | – | – | – | – | – | – | +| mix-relay [shaped] | 786 / 1835 / 6291 | 786 / 1835 / 6291 | 754 / 1835 / 6291 | 786 / 1769 / 6029 | 786 / 1769 / 6029 | 786 / 1769 / 6029 | 786 / 1769 / 6029 | 786 / 1769 / 6029 | 754 / 1769 / 6291 | – | – | – | + +### dante in the shaped mix, by pool size (ARM, earlier runs) + +Dante keeps a process per connection, so its memory grows with the pool; +20000 connections cannot be measured on an 8 GB machine at all. + +| pool | dante: rate, p99, cpu s/GB, peak | experimental: the same | +|---|---|---| +| 2000 | 2.50k, 0.48 s, 8.8, 796 MB | 2.58k, 0.72 s, 6.1, 110 MB | +| 10000 | 2.13k, 6.29 s, 10.1, 3710 MB | 2.43k, 3.80 s, 7.8, 403 MB | +| 20000 | OOM: the origin is killed (ARM), or 0 req/s with 5 GB (Intel) | 6.0k req/s on Intel plain | ## Caveats @@ -1282,8 +429,8 @@ M4 and 7.5% or less on the Skylake host, except for one origin-bound case client, the proxy and the origin have no bandwidth limit and no delay, and one or a few kinds of request are repeated, so each connection goes as fast as the CPUs allow. The mix scenarios, many connections with web-like - exchanges, and above all over the emulated links of the grace delay - section, are the closest to a proxy giving clients access to the Internet. + exchanges, and above all over the shaped link, are the closest to a proxy + giving clients access to the Internet. * Both machines are virtual: their CPUs cannot be pinned to physical cores, so absolute figures move between sessions; compare within a table. * The roles have CPUs of their own but share the memory, and memory bandwidth, @@ -1293,10 +440,11 @@ M4 and 7.5% or less on the Skylake host, except for one origin-bound case * wrk measures in a closed loop: a slower proxy is offered less load, so latencies compare only between runs of similar throughput, and requests over 2 seconds are left out of its latency figures. -* The haproxy versions differ between the machines (2.8 and 3.0), and so, - slightly, do squid, tinyproxy and dante. +* The tool versions differ between the machines (haproxy 3.2 against 3.0, + nginx 1.28 against 1.26, squid 7.7 against 6.10); both envoy builds are + the same 1.34.1 binary. * In the tunnel scenarios proxychains-ng's work is done in the client: with a - new tunnel for every request it sets the pace on the M4. Runs with a new - tunnel per request or 2000 clients count a few failed requests (at most 34 - in a run of 40,000 or more), every proxy alike. - + new tunnel for every request it sets the pace on the M4. +* The shaped ARM mix is client-bound: every proxy lands at 2.4-2.5k req/s, + so the shaped tables' differences are meaningful on Intel only; ARM still + separates the proxies by errors and CPU. diff --git a/bench/bench.py b/bench/bench.py index e11ac66..cff2a5d 100644 --- a/bench/bench.py +++ b/bench/bench.py @@ -909,6 +909,8 @@ class Proxy: def start(self, args, work): cg_remove("prx") cg_make("prx", args.cpus["prx"]) + if args.prx_mem_mb: + cg_write(f"{CG}/prx/memory.max", str(args.prx_mem_mb * 2**20)) if self.kind == "none": return None argv = [self.binary] + proxy_conf(self.kind, work, len(cpulist(args.cpus["prx"])), @@ -1244,6 +1246,7 @@ def main(): ap.add_argument("--mix-active", type=int, default=2000, help="exchanges going at once at most (%(default)s)") ap.add_argument("--seed", type=int, default=1, help="what the mix-* scenarios draw from (%(default)s)") + ap.add_argument("--prx-mem-mb", type=int, help="memory.max of the proxy cgroup, MB") args = ap.parse_args() if os.geteuid(): sys.exit("needs root") diff --git a/bench/data/results-full7/arm-base.csv b/bench/data/results-full7/arm-base.csv new file mode 100644 index 0000000..2f7f916 --- /dev/null +++ b/bench/data/results-full7/arm-base.csv @@ -0,0 +1,271 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,stream1,0,84.81501832318266,nan,nan,nan,nan,nan,0,0,0,0.23,0.0,0.002169105430657038,nan,0.0,0.2590646347871781,0.04693877551020408,0.32269138345348436,0.9225335770579332,0.9565004172864453,origin +3proxy-0.9.9.2,stream1,0,24.205869610386298,nan,nan,nan,nan,nan,0,0,0,10.01,10.00223,0.32946040300345336,nan,19.05078125,0.1867109634551495,0.9515209125475285,0.11148936170212766,0.24070296152094411,0.38121613483450245,proxy +3proxy-1.0.2,stream1,0,24.484499984403584,nan,nan,nan,nan,nan,0,0,0,10.01,9.998255,0.32698898447401264,nan,18.42578125,0.19511658600967885,0.9515209125475285,0.10683760683760683,0.24548557932445703,0.37738547542756595,proxy +3proxy-devel-c37,stream1,0,64.7648272841229,nan,nan,nan,nan,nan,0,0,0,9.99,9.807416,0.12337265349569995,nan,24.453125,0.15556112224448898,0.9496197718631179,0.19699306090979182,0.513659108889308,0.5236331259762065,proxy +3proxy-bp,stream1,0,65.94858688444113,nan,nan,nan,nan,nan,0,0,0,9.98,9.689173,0.12104239813857312,nan,34.44921875,0.14292993630573247,0.9504761904761905,0.2250453720508167,0.5042377699753459,0.5455186546662996,proxy +nginx,stream1,0,18.64939833000252,nan,nan,nan,nan,nan,0,0,0,10.01,9.991295000000001,0.4293091795414748,nan,31.63671875,0.09175981284117495,0.9980059820538385,0.12397447584320875,0.17885384001206747,0.3853945957724652,proxy +nginx-halfclose,stream1,0,19.594722104646866,nan,nan,nan,nan,nan,0,0,0,10.01,9.989152,0.40859583678588246,nan,33.69140625,0.04775425916365514,0.9506172839506173,0.2782002534854246,0.16649991417579307,0.4656566803395699,proxy +haproxy,stream1,0,9.04609731137025,nan,nan,nan,nan,nan,0,0,0,10.0,10.00035,0.8841881779700302,nan,35.6171875,0.025931520644511583,0.949667616334283,0.10642826734780758,0.08847731234569871,0.34495416013467267,proxy +haproxy-splice-auto,stream1,0,26.5079867199187,nan,nan,nan,nan,nan,0,0,0,10.0,9.996325,0.30174315116237677,nan,41.32421875,0.09016811003565971,0.9505703422053232,0.13549459684123025,0.24170547649844182,0.40491892323327705,proxy +envoy,stream1,0,34.76522773304316,nan,nan,nan,nan,nan,0,0,0,10.02,10.004161,0.2305217149637089,nan,91.109375,0.09958907420836355,0.9515669515669516,0.203751617076326,0.2692982395998501,0.4221139705536521,proxy +direct,stream16,0,210.73480644905928,nan,nan,nan,nan,nan,0,0,5033,1.49,0.0,0.005653680006148387,nan,0.0,0.8224343675417661,0.43440233236151604,0.996349153667441,2.9443241666356945,2.984830762463862,origin +3proxy-0.9.9.2,stream16,0,25.384906148691503,nan,nan,nan,nan,nan,0,0,2166,10.05,10.051237,0.3162916221395203,nan,134.265625,0.15796703296703296,0.9553231939163498,0.22840827980014275,0.23399836087560938,0.40374460846530913,proxy +3proxy-1.0.2,stream16,0,25.25121556317548,nan,nan,nan,nan,nan,0,0,2105,10.03,10.024093,0.3172640804509092,nan,126.35546875,0.15510486287162942,0.9525166191832859,0.223589001447178,0.23685017850139656,0.41146257453443863,proxy +3proxy-devel-c37,stream16,0,56.0271028997443,nan,nan,nan,nan,nan,0,0,1339,10.03,10.021734,0.1430025828998206,nan,130.453125,0.20136921624173748,0.9525166191832859,0.2594890510948905,0.4973079389206685,0.6563340529251444,proxy +3proxy-bp,stream16,0,48.17414823635281,nan,nan,nan,nan,nan,0,0,4199,10.02,10.014078,0.16626546524497265,nan,111.03125,0.2989015631601183,0.9515669515669516,0.38275193798449614,0.4593823087288993,0.6023277138266212,proxy +nginx,stream16,0,19.322601610329624,nan,nan,nan,nan,nan,0,0,5824,10.03,10.020915,0.4145466653761092,nan,66.62109375,0.16412213740458015,0.9525166191832859,0.2882332994235334,0.18739099241392024,0.4171130850246073,proxy +nginx-halfclose,stream16,0,18.027501286043048,nan,nan,nan,nan,nan,0,0,13156,10.02,10.013332,0.44423705263750474,nan,48.9375,0.22210414452709884,0.9515669515669516,0.3627750611246944,0.1920319389058544,0.4168211187859724,proxy +haproxy,stream16,0,10.029760408436152,nan,nan,nan,nan,nan,0,0,0,10.03,10.007874,0.7997452776685495,nan,49.55859375,0.15701017249004864,0.9516129032258065,0.6368188512518409,0.11126560995979248,0.9003296888421619,origin +haproxy-splice-auto,stream16,0,26.64519160578085,nan,nan,nan,nan,nan,0,0,2,10.02,10.00196,0.3007598344590209,nan,98.5859375,0.3335247941795903,0.9515669515669516,0.6866840731070496,0.28157564463199714,0.8088426989943356,proxy +envoy,stream16,0,20.04623892522051,nan,nan,nan,nan,nan,0,0,7160,10.04,10.027906,0.3999515514943531,nan,176.0078125,0.15396509829909433,0.9534662867996201,0.18283093053735255,0.19975087491544982,0.29450212399703285,proxy +direct,stream1-down,0,87.63767381932965,nan,nan,nan,nan,nan,0,0,0,0.65,0.0,0.0059328822796332675,nan,0.0,0.24187356027642692,0.1262135922330097,0.3482532751091703,0.9000848513011042,0.9579660570317067,origin +3proxy-0.9.9.2,stream1-down,0,24.524548897263625,nan,nan,nan,nan,nan,0,0,1,10.0,9.997171999999999,0.32618050077810695,nan,19.8515625,0.09948834565093803,0.9514747859181731,0.26339410939691443,0.3852096318082172,0.24702969029836092,proxy +3proxy-1.0.2,stream1-down,0,23.80458223596161,nan,nan,nan,nan,nan,0,0,0,10.01,10.001199,0.33636905457473915,nan,17.8984375,0.07735130383826545,0.9506172839506173,0.0835102618542109,0.3813209036152117,0.21656821134039095,proxy +3proxy-devel-c37,stream1-down,0,61.046320429786036,nan,nan,nan,nan,nan,0,0,0,10.0,9.964839,0.1310437705684625,nan,21.71875,0.10537129439389492,0.9505703422053232,0.184975194897236,0.5241485798072087,0.48847050798980957,proxy +3proxy-bp,stream1-down,0,59.91783774098466,nan,nan,nan,nan,nan,0,0,0,10.0,9.892175,0.13350005304117307,nan,34.28515625,0.1343741287984388,0.949667616334283,0.18677453394301793,0.5431145276950023,0.488410241246591,proxy +nginx,stream1-down,0,19.035336708886074,nan,nan,nan,nan,nan,0,0,0,10.02,9.996609,0.42107238258529234,nan,37.12109375,0.14366729678638943,0.9506641366223909,0.0683339203945051,0.3977028198234143,0.17963888825060467,proxy +nginx-halfclose,stream1-down,0,20.010077564652377,nan,nan,nan,nan,nan,0,0,0,10.0,9.997183,0.39975449726751616,nan,34.7421875,0.20355256841094574,0.9514747859181731,0.14816010329244675,0.43384121614739996,0.18726548563038325,proxy +haproxy,stream1-down,0,10.290431777304496,nan,nan,nan,nan,nan,0,0,0,10.0,9.981892,0.777335710483148,nan,34.1015625,0.17307692307692307,0.9970089730807578,0.04560028500178126,0.38363471366025326,0.1067852915765161,proxy +haproxy-splice-auto,stream1-down,0,26.29074031733208,nan,nan,nan,nan,nan,0,0,0,10.01,10.000599000000001,0.30455753857429274,nan,41.6640625,0.08016476552598226,0.9980059820538385,0.09988649262202043,0.39352433355658883,0.25641129934063184,proxy +envoy,stream1-down,0,35.94787481673407,nan,nan,nan,nan,nan,0,0,0,10.0,10.003902,0.2225182587731067,nan,24.10546875,0.15768032590462497,0.9514747859181731,0.09774182676103808,0.428144539994383,0.27464542745763093,proxy +direct,http-ka-1k,0,1.4540813107200001,142220.62,0.429,0.519,0.593,0.729,0,0,0,0.82,0.0,0.4511439595322055,0.5754313278849811,0.0,0.8040089086859689,0.2586750788643533,0.9469864310508047,2.395030011588393,0.9475231750412558,origin +3proxy-0.9.9.2,http-ka-1k,0,0.01476395008,1472.34,42.79,43.97,45.69,52.6,0,0,0,4.04,3.137186,218.91160444779828,272.3289518031682,131.234375,0.12747150500116305,0.3814919735599622,0.1598336304218657,0.1888905955932162,0.0578486115193811,none +3proxy-1.0.2,http-ka-1k,0,0.15552479232,15502.27,3.93,5.0,6.15,9.63,0,0,0,10.02,10.014069,51.5416216310174,64.57641865111333,131.04296875,0.4324553950722175,0.9515669515669516,0.4392967450700879,0.44428849342593696,0.17580618327356076,proxy +3proxy-devel-c37,http-ka-1k,0,0.16701718528,16646.73,3.62,4.73,5.91,9.35,0,0,0,10.1,10.103541,48.37825512658526,60.071848309661455,133.76171875,0.4335009537020981,0.9600760456273765,0.46036514906401665,0.47867574483023095,0.19013161512262713,proxy +3proxy-bp,http-ka-1k,0,0.35676749824000004,35558.96,1.8,2.86,4.28,7.99,0,0,0,10.1,10.091642,22.64780295251146,28.122894263486458,28.33984375,0.5201081446434607,0.9600760456273765,0.5747072599531616,0.7828861523716192,0.3050310509993727,proxy +nginx,http-ka-1k,0,0.45281705984,44288.49,1.4,1.51,1.63,1.91,0,0,0,10.1,10.097533,17.843850677478926,22.580226875388448,33.76953125,0.4654199011997177,0.9609895337773549,0.5200803212851406,0.6765914006840036,0.3119087780923698,proxy +nginx-halfclose,http-ka-1k,0,0.45952794624,44943.69,1.39,1.48,1.59,1.87,0,0,0,10.01,10.007697,17.42657887409011,22.25290054665217,33.2734375,0.4559243397573162,0.9515209125475285,0.5089013224821973,0.6706244955548042,0.32978795208023187,proxy +haproxy,http-ka-1k,0,0.50189041664,50027.4,1.22,1.35,1.54,1.9,0,0,0,10.09,10.098664999999999,16.083192131938933,19.969639814197247,34.67578125,0.5058120225838592,0.9600380589914367,0.5398269358775238,0.7410216644596486,0.3192517045236506,proxy +haproxy-splice-auto,http-ka-1k,0,0.50130321408,49968.3,1.22,1.35,1.54,1.9,0,0,0,10.1,10.095573,16.117989617977116,20.014465901096834,40.66796875,0.5038117335101093,0.9600760456273765,0.5422753430721559,0.7317204960995526,0.3060194772064678,proxy +envoy,http-ka-1k,0,0.25602031616,24980.27,2.52,2.8,3.06,3.62,0,0,0,10.09,10.089673000000001,31.528747878568357,39.992231439680694,18.7109375,0.4731560461615655,0.9591254752851711,0.5116491548652353,0.5861269637372727,0.24806435771953522,proxy +squid,http-ka-1k,0,0.23462936575999999,22249.81,2.78,2.97,3.22,3.72,0,0,0,10.11,10.098758,34.47138841211007,44.98851925028034,33.47265625,0.4845057328788348,0.9601139601139601,0.4505971769815418,0.45100936189766655,0.15019912477453418,proxy +tinyproxy,http-ka-1k,0,0.044627394560000005,4451.21,13.88,16.3,18.99,22.97,44575,0,0,10.03,9.873719,179.79987581869713,225.00897343862167,142.640625,0.36425467598715283,0.9534220532319392,0.44944582673603256,0.32829804187983785,0.08840550236442116,proxy +direct,http-ka-1m,0,148.69176778751998,17721.61,0.767,0.99,1.22,1.73,0,0,0,0.76,0.0,0.004088995705995169,4.24595237829201,0.0,0.8472380086383269,0.22551928783382788,0.8353413654618473,3.011511585509408,0.9405762110722259,origin +3proxy-0.9.9.2,http-ka-1m,0,18.98375544832,2257.99,2.14,27.12,35.77,42.77,0,0,0,8.14,6.636566,0.3430301247678731,359.8108120054812,52.1484375,0.22558300623412605,0.7420237010027347,0.21821164889253486,0.43291718809398533,0.07698145025944694,none +3proxy-1.0.2,http-ka-1m,0,26.37109919744,3140.68,4.73,6.04,8.03,11.73,0,0,0,10.01,10.011744,0.3036657645570339,318.35384664313204,58.38671875,0.35082930925887046,0.9515209125475285,0.3554345252190386,0.5782769803551936,0.08549382365143189,proxy +3proxy-devel-c37,http-ka-1m,0,45.78435137536,5452.2,2.73,3.69,4.85,7.61,0,0,0,10.01,10.005249000000001,0.17490692254973622,183.4509300833868,57.78125,0.44387464387464387,0.9515209125475285,0.4682642487046632,0.7897848089821977,0.1473114743756841,proxy +3proxy-bp,http-ka-1m,0,46.55744548864,5549.63,2.68,3.73,4.94,7.95,0,0,0,10.01,9.993749,0.1720025640572129,180.23046453006842,42.91015625,0.4603629417382999,0.9515209125475285,0.4667535853976532,0.8638966583591742,0.17488470181355037,proxy +nginx,http-ka-1m,0,13.3143986176,1590.59,9.98,11.52,13.62,19.16,0,0,0,10.0,10.007047,0.6008532739454701,627.8646323852578,46.94921875,0.34651724895627334,0.9523809523809523,0.25869448903156766,0.5660037999382606,0.0579637672625982,proxy +nginx-halfclose,http-ka-1m,0,13.572096655360001,1618.5,9.43,10.98,13.11,19.76,0,0,0,10.01,10.016619,0.5900341121456292,617.2915638875185,44.5234375,0.34463028169014087,0.9524262607040913,0.25341914722445696,0.5699067908535833,0.0513197923547535,proxy +haproxy,http-ka-1m,0,5.91807905792,705.04,22.52,23.41,24.27,25.78,0,0,0,10.1,10.097091,1.3653078846905164,1418.340120769555,38.8984375,0.5986911547392865,0.9600760456273765,0.19837202291227013,1.1561324007797602,0.03137769617867845,client +haproxy-splice-auto,http-ka-1m,0,18.55425871872,2207.0,7.21,7.58,7.9,8.67,0,0,0,10.1,10.071356999999999,0.4354795372044598,453.0976627338388,47.34765625,0.5206793206793207,0.9591642924976258,0.21805685723211496,0.9700152495130923,0.05890096644509095,client +envoy,http-ka-1m,0,25.42620639232,3027.21,5.2,5.61,6.04,7.15,0,0,0,10.03,10.016561,0.3155799129524746,330.7938392533228,38.5234375,0.3707627118644068,0.9516129032258065,0.34699782975645044,0.5250209963652379,0.10355928719236397,proxy +squid,http-ka-1m,0,2.98231791616,355.26,45.34,46.6,48.33,51.79,0,0,0,10.1,10.102077999999999,2.7093020352450283,2814.938684503902,36.2421875,0.5828074364659731,0.9600760456273765,0.06552795031055901,1.0142909671752993,0.023764587673946836,client +tinyproxy,http-ka-1m,0,1.2297699328,145.59,112.73,117.74,122.81,140.58,1457,0,0,10.02,9.999732,6.518292394536579,6877.144818119424,40.7890625,0.22756165776760742,0.9506641366223909,0.1664291821031633,0.44515772979009777,0.014245586480847278,proxy +direct,http-ka-50k-2000,0,40.3726925824,98064.59,19.41,20.52,21.34,631.96,0,475,0,0.9,0.0,0.017833836535190016,0.9128020487334871,0.0,0.8238636363636364,0.27692307692307694,0.9543726235741445,2.7362136162708737,0.9507890338346742,origin +3proxy-0.9.9.2,http-ka-50k-2000,0,4.17022869504,10135.07,46.08,63.08,81.02,160.15,0,448,0,10.46,10.438234999999999,2.006604580212294,102.74039878204499,226.63671875,0.47694915254237286,0.9952426260704091,0.4963550600343053,0.5176334720290138,0.1226500311915159,proxy +3proxy-1.0.2,http-ka-50k-2000,0,4.1611689984,10113.21,58.2,78.42,101.42,250.59,0,461,0,10.42,10.399104,2.00328321277152,102.60955194485476,231.27734375,0.4632867132867133,0.9914367269267365,0.5072311884300985,0.37583575500777444,0.12646114236278821,proxy +3proxy-devel-c37,http-ka-50k-2000,0,4.24807497728,10324.28,53.97,74.84,99.22,415.48,0,440,0,10.37,10.336722,1.952884552266506,99.96433288026452,219.6015625,0.47060713138451654,0.9866793529971456,0.5013756613756614,0.41770483184341384,0.12736709958905493,proxy +3proxy-bp,http-ka-50k-2000,0,6.79905067008,16524.32,119.78,120.41,123.83,561.17,0,0,0,10.17,10.1386,1.1966376476356322,61.23149357882125,184.29296875,0.5134342940889106,0.9667300380228137,0.5418166419648528,0.576674160845772,0.16356463845568125,proxy +nginx,http-ka-50k-2000,0,5.61004937216,13628.18,52.64,62.8,68.68,72.48,0,415,0,10.14,10.106656,1.4459765791466985,73.95467905565563,80.53125,0.4439788668245582,0.9647954329210275,0.4566728452270621,0.4851950719617341,0.15206839173589587,proxy +nginx-halfclose,http-ka-50k-2000,0,5.93762451456,14424.02,35.85,51.69,57.61,75.99,0,466,0,10.14,10.097534,1.3662029284789035,69.9788131206824,70.546875,0.44590884129599123,0.9638783269961977,0.4660238751147842,0.5127556009366607,0.15873214209272216,proxy +haproxy,http-ka-50k-2000,0,4.19237462016,10181.25,192.4,197.49,202.61,705.23,0,0,0,10.15,10.10736,1.9368498132187684,99.31701207460029,160.9140625,0.5377885331347729,0.964828897338403,0.43946285466753304,0.7793349845359697,0.09220383762061729,proxy +haproxy-splice-auto,http-ka-50k-2000,0,4.16754434048,10123.36,192.31,195.74,200.05,745.45,0,0,0,10.15,10.107475,1.948389587875332,99.77783457523151,164.8828125,0.5404031232976212,0.964828897338403,0.4230171073094868,0.7515640310975792,0.09218330754254211,proxy +envoy,http-ka-50k-2000,0,4.50812182528,10950.49,178.81,183.96,193.21,224.63,0,0,0,10.15,10.121148999999999,1.8011935601353601,92.16464328196933,246.8203125,0.28562615669339914,0.964828897338403,0.3311081441922563,0.34442457505190455,0.1131304238596264,proxy +squid,http-ka-50k-2000,0,1.73191200768,4158.98,231.18,284.19,332.28,868.27,0,550,0,10.17,10.144176,4.697698245593123,243.26651676792804,168.859375,0.3724137931034483,0.9676498572787822,0.07162965279949952,0.6517014781231883,0.03516565621848014,proxy +tinyproxy,http-ka-50k-2000,0,0.77879836672,1892.69,548.06,572.12,617.32,1430.0,19051,327,0,10.26,10.155032000000002,10.539313320043219,538.5544065928298,168.859375,0.2836644591611479,0.9762131303520457,0.296972860125261,0.3301890232456672,0.04659103485124338,proxy +direct,http-ka-2k-50k-2000,0,38.654705664,93954.47,19.37,21.06,22.65,724.4,0,689,0,0.43,0.0,0.00889930460188124,0.45541343596728223,0.0,0.8378613344925017,0.11748633879781421,0.9549349412884799,2.6972126176454614,0.9510977450694561,origin +3proxy-0.9.9.2,http-ka-2k-50k-2000,0,3.5878076416,8718.59,70.92,95.98,123.5,261.3,0,505,0,10.42,10.385167000000001,2.323424451006108,118.91176336330854,254.21875,0.3893027698185291,0.9904942965779467,0.5118336651183366,0.44916979917504973,0.16067732621095193,proxy +3proxy-1.0.2,http-ka-2k-50k-2000,0,3.81153181696,9263.28,65.16,87.36,110.7,242.88,0,469,0,10.43,10.388860000000001,2.189146096819153,112.03127853145577,232.796875,0.3586773771716794,0.9923882017126546,0.5092243186582809,0.34726968984130635,0.12736283081239394,proxy +3proxy-devel-c37,http-ka-2k-50k-2000,0,3.83350996992,9316.55,62.34,83.08,105.26,177.63,0,548,0,10.41,10.386645,2.1724216358758537,111.19656476318657,271.1484375,0.3703634319970026,0.9914285714285714,0.5086352148272957,0.3796848388179636,0.1340394315999885,proxy +3proxy-bp,http-ka-2k-50k-2000,0,5.7910755328,14074.48,143.27,143.93,146.43,538.37,0,0,0,10.18,10.136733999999999,1.406301809374321,71.92059062488961,184.89453125,0.4206539811564752,0.967680608365019,0.545841310359498,0.499583523398852,0.17686781764050644,proxy +nginx,http-ka-2k-50k-2000,0,5.41602086912,13156.84,41.57,53.35,57.26,63.88,0,429,0,10.15,10.10812,1.4992556705785636,76.70508218401663,70.30078125,0.4200075642965204,0.9639126305792972,0.4515294117647059,0.47867047748342706,0.15878339943104913,proxy +nginx-halfclose,http-ka-2k-50k-2000,0,5.34631153664,12987.52,46.42,56.46,63.05,67.04,0,410,0,10.15,10.10499,1.518804122122517,77.66529700280819,75.40625,0.4069364161849711,0.9639126305792972,0.4414715719063545,0.47376765956919825,0.1625122707387159,proxy +haproxy,http-ka-2k-50k-2000,0,3.93786425344,9566.17,203.27,209.23,217.04,761.02,0,0,0,10.16,10.118642,2.0640630242395033,105.65943551238587,156.45703125,0.5081967213114754,0.9657794676806084,0.40802598005103224,0.7431446282571335,0.10457925281143757,proxy +haproxy-splice-auto,http-ka-2k-50k-2000,0,3.9262879744,9536.37,203.95,209.79,221.88,796.6,0,0,0,10.14,10.111251999999999,2.06607361785266,105.8355686835266,160.2109375,0.5129186602870813,0.9657142857142857,0.4118188089215912,0.7517358176996604,0.10361564294106164,proxy +envoy,http-ka-2k-50k-2000,0,4.43103051776,10763.34,181.32,192.37,200.85,300.2,0,0,0,10.16,10.126738999999999,1.8343362717593992,93.84207560937313,284.1015625,0.2689727463312369,0.966698382492864,0.28647736856901884,0.34915878795995114,0.1102556151157246,proxy +squid,http-ka-2k-50k-2000,0,1.33353701376,3204.4,244.07,311.81,340.31,358.83,0,558,0,10.21,10.158451000000001,6.125064333212438,316.59896430897084,145.99609375,0.31726315789473686,0.9696106362773029,0.24506045414332056,0.5013869034431793,0.0893442373159894,proxy +tinyproxy,http-ka-2k-50k-2000,0,0.76898369536,1868.84,551.56,573.97,605.44,1400.0,18808,404,0,10.29,10.181262,10.705038415861582,547.1076137813697,150.41015625,0.28278598192638305,0.9781368821292775,0.3117154811715481,0.3282948987242591,0.06083360399653902,proxy +direct,http-close-1k,0,0.50532974592,49617.29,0.785,1.12,1.49,2.16,0,0,0,4.58,0.0,7.2507111041511045,9.139180945805455,0.0,0.7624950019992003,0.5105908584169454,0.926625386996904,2.1981349472431457,0.8666097584945968,origin +3proxy-0.9.9.2,http-close-1k,0,0.04680843264,4595.81,13.31,15.16,17.85,22.19,0,0,0,10.04,9.895503,171.593013202845,218.12809594160078,182.58203125,0.34378041658555575,0.9552806850618458,0.38488057128786013,0.3263728508627266,0.08176991639935585,proxy +3proxy-1.0.2,http-close-1k,0,0.04798283776,4709.51,13.02,14.78,17.35,21.43,0,0,0,10.03,9.893479999999998,167.22645792927776,212.61261261261262,156.39453125,0.33352601156069367,0.9543292102759277,0.39316239316239315,0.29594118513184453,0.08460244023087898,proxy +3proxy-devel-c37,http-close-1k,0,0.05695864832,5589.48,10.93,12.24,14.87,19.83,0,0,0,10.01,10.0072,140.5932239650451,178.83302962089542,137.59375,0.40810906515580736,0.9524262607040913,0.45394736842105265,0.35585626042130913,0.09316013957369676,proxy +3proxy-bp,http-close-1k,0,0.09462349823999999,9289.64,6.61,8.52,10.51,14.83,0,0,0,10.01,9.991495,84.63014102151209,107.60779592143878,32.171875,0.45616883116883117,0.9515209125475285,0.5230900191530112,0.5461442479920351,0.1302269742740491,proxy +nginx,http-close-1k,0,0.14336131072,14074.89,4.41,4.56,4.72,5.27,0,0,0,10.1,10.08384,56.36109184144602,71.04670793472144,31.74609375,0.5502246181491465,0.9600760456273765,0.3965473470423965,0.7869365743110467,0.1520945641239588,proxy +nginx-halfclose,http-close-1k,0,0.1434451968,14086.97,4.41,4.55,4.72,5.26,0,0,0,10.1,10.084453,56.32813213861476,70.98528988002784,34.12109375,0.548659830904839,0.9600760456273765,0.39893617021276595,0.7856598525932673,0.1434400760272832,proxy +haproxy,http-close-1k,0,0.16877879296,16572.3,3.7,3.87,4.09,4.68,0,0,0,10.1,10.076318,47.87331309991612,60.34570320668702,35.24609375,0.5469563655952595,0.9591642924976258,0.46236323851203504,0.8352817224672794,0.19576483621762633,proxy +haproxy-splice-auto,http-close-1k,0,0.16919822336,16611.38,3.71,3.86,4.03,4.51,0,0,0,10.1,10.082506,47.75463855083353,60.20146629313942,40.94140625,0.5474308300395256,0.9591642924976258,0.46929065743944637,0.8360885055330415,0.1729209790633693,proxy +envoy,http-close-1k,0,0.16097738752000001,15477.81,3.92,4.31,4.72,5.91,0,0,0,10.01,9.982503,49.746117286224916,64.58106181330201,20.10546875,0.46539210479730925,0.9506172839506173,0.20899854862119013,0.623900843185478,0.10356139142120985,proxy +squid,http-close-1k,0,0.0784334848,7465.3,8.43,8.63,8.87,9.85,0,0,0,10.01,9.980465,102.09925034466912,133.95784543325527,25.31640625,0.4798024342917622,0.9515209125475285,0.2905511811023622,0.5471419280232973,0.09313733550525946,proxy +tinyproxy,http-close-1k,0,0.04605345792,4592.75,13.45,15.79,18.5,22.47,45992,0,0,10.03,9.885283999999999,174.23230225054073,218.0766638401496,132.53515625,0.36835181356887803,0.9525166191832859,0.4513653802753329,0.3367865562613957,0.08838137332418321,proxy +3proxy-0.9.9.2,stream1,1,24.107088259769252,nan,nan,nan,nan,nan,0,0,0,10.01,9.9938,0.3308147506348682,nan,17.73828125,0.10503067484662576,0.9497153700189753,0.15053763440860216,0.21781569433531248,0.3886013089804427,proxy +3proxy-1.0.2,stream1,1,25.45543426428103,nan,nan,nan,nan,nan,0,0,0,10.01,9.999564,0.3145319277851968,nan,17.33984375,0.19555653321601407,0.9506172839506173,0.21433666191155493,0.2519973790236235,0.42645474602489153,proxy +3proxy-devel-c37,stream1,1,62.2450665338444,nan,nan,nan,nan,nan,0,0,0,9.99,9.805059,0.12836570594419153,nan,22.23046875,0.21582385676264215,0.998001998001998,0.19584199584199585,0.5404754263369858,0.5281082366499725,proxy +3proxy-bp,stream1,1,59.51252765701322,nan,nan,nan,nan,nan,0,0,0,10.0,9.896854,0.1344014877161737,nan,35.48046875,0.17659831121833536,0.9505703422053232,0.15950413223140497,0.5068485123407673,0.5071027254640853,proxy +nginx,stream1,1,19.213357804373054,nan,nan,nan,nan,nan,0,0,0,10.0,9.990314999999999,0.4162926027855077,nan,33.65625,0.08654797230464886,0.9505703422053232,0.22550052687038988,0.1731479588857954,0.4143220467337538,proxy +nginx-halfclose,stream1,1,19.026038101032828,nan,nan,nan,nan,nan,0,0,0,10.01,9.998681,0.42079121535832154,nan,32.19921875,0.05456509994597515,0.9980059820538385,0.11878453038674033,0.17079307601569144,0.3841895781251383,proxy +haproxy,stream1,1,8.826162037017134,nan,nan,nan,nan,nan,0,0,0,10.0,9.993318,0.9062330179182306,nan,33.8125,0.02665325622328388,0.9505703422053232,0.08893709327548807,0.08462818550961228,0.33715528785416177,proxy +haproxy-splice-auto,stream1,1,27.1711043324367,nan,nan,nan,nan,nan,0,0,0,10.0,10.000748999999999,0.2943439248167438,nan,43.27734375,0.1003193187865886,0.999000999000999,0.1478029294274301,0.24476650827497032,0.42427273958003886,proxy +envoy,stream1,1,34.97847764203663,nan,nan,nan,nan,nan,0,0,0,10.0,10.003243,0.22867282897181976,nan,21.51953125,0.10210930009587728,0.9505703422053232,0.17701227830832197,0.2654635069768936,0.38961794656539517,proxy +direct,stream1,1,97.98959509229935,nan,nan,nan,nan,nan,0,0,0,0.08,0.0,0.0006530268683464399,nan,0.0,0.23458646616541354,0.0128,0.3162230671736375,0.8199068925184713,0.9434208234106701,origin +3proxy-0.9.9.2,stream16,1,23.386790962003765,nan,nan,nan,nan,nan,0,0,2293,10.04,10.023700999999999,0.34227819177517516,nan,83.3671875,0.16285452881976212,0.9516587677725118,0.2233115468409586,0.22810739468416136,0.3920465201281573,proxy +3proxy-1.0.2,stream16,1,24.261051492898044,nan,nan,nan,nan,nan,0,0,2014,10.04,10.032371999999999,0.3302312554697873,nan,128.37109375,0.1615909090909091,0.9534662867996201,0.22804481387784603,0.22816836914302688,0.41009541329586524,proxy +3proxy-devel-c37,stream16,1,55.55184567279055,nan,nan,nan,nan,nan,0,0,1364,10.02,10.016881,0.14411610724294044,nan,117.890625,0.20482774783220062,0.9524714828897338,0.25857038657913933,0.490740089707541,0.6395997437673465,proxy +3proxy-bp,stream16,1,50.42532105701612,nan,nan,nan,nan,nan,0,0,3913,10.03,10.017372,0.15892855363835223,nan,156.23046875,0.31313550529155426,0.9516129032258065,0.3414549251653324,0.46417499577114657,0.6199784449058003,proxy +nginx,stream16,1,18.808418359008186,nan,nan,nan,nan,nan,0,0,10302,10.03,10.016891999999999,0.4260950000191407,nan,56.09765625,0.17304678755316769,0.9516129032258065,0.33574575204531154,0.18733366278761718,0.42640139809045224,proxy +nginx-halfclose,stream16,1,18.745053728400556,nan,nan,nan,nan,nan,0,0,8259,10.03,10.01568,0.42750182764490224,nan,57.56640625,0.17500555926173003,0.9516129032258065,0.327114827918945,0.18349716749292458,0.4177546531642232,proxy +haproxy,stream16,1,8.798811235929449,nan,nan,nan,nan,nan,0,0,0,10.03,10.007948,0.9116046263349832,nan,45.10546875,0.1675093427126841,0.9507109004739337,0.6205652435357787,0.10746618227757093,0.9203096057409044,origin +haproxy-splice-auto,stream16,1,27.3507448377702,nan,nan,nan,nan,nan,0,0,0,10.02,10.009061,0.292978293724059,nan,134.1484375,0.3165173354109856,0.9515669515669516,0.6998873873873874,0.28346899561171673,0.8026081214541124,proxy +envoy,stream16,1,19.796030876206412,nan,nan,nan,nan,nan,0,0,6166,10.03,10.028191,0.40471779829613064,nan,184.37109375,0.15204936095196123,0.9525166191832859,0.17867719644619942,0.19385491718813838,0.29130898101506275,proxy +direct,stream16,1,207.10273011237146,nan,nan,nan,nan,nan,0,0,11617,1.36,0.0,0.005251630161360447,nan,0.0,0.818931010124794,0.39882697947214074,0.9953580901856764,2.903084063240242,2.98159113428861,origin +3proxy-0.9.9.2,stream1-down,1,25.06778314648276,nan,nan,nan,nan,nan,0,0,1,10.0,10.002070999999999,0.3190986955335185,nan,21.1171875,0.08920323325635104,0.9505703422053232,0.12973516594032852,0.38137544557627256,0.22711026405692963,proxy +3proxy-1.0.2,stream1-down,1,26.155605011483225,nan,nan,nan,nan,nan,0,0,0,10.01,9.999872,0.3061336339388075,nan,19.53125,0.19016152716593246,0.9497153700189753,0.2522238163558106,0.445035972602913,0.25550711946094995,proxy +3proxy-devel-c37,stream1-down,1,67.90398949258068,nan,nan,nan,nan,nan,0,0,0,9.99,9.74044,0.11768012526045366,nan,21.859375,0.15781083953241232,0.9496197718631179,0.21435759812143576,0.535543291239442,0.5226021448672655,proxy +3proxy-bp,stream1-down,1,69.93863848807331,nan,nan,nan,nan,nan,0,0,0,9.99,9.598699,0.11425940677900198,nan,33.80078125,0.18184123763631752,0.9496197718631179,0.19226786330686918,0.5421692409323552,0.5016249550493052,proxy +nginx,stream1-down,1,19.774189887613485,nan,nan,nan,nan,nan,0,0,0,10.01,9.996084999999999,0.40492375165856764,nan,37.25390625,0.21444809295276585,0.9980059820538385,0.07592592592592592,0.4575613445838519,0.17768031722404967,proxy +nginx-halfclose,stream1-down,1,20.956902611278107,nan,nan,nan,nan,nan,0,0,0,10.02,9.9951,0.38245066289347424,nan,35.5390625,0.14950078822911192,0.9497630331753555,0.238230289279637,0.4041810118097918,0.19662155335163953,proxy +haproxy,stream1-down,1,8.852252966421913,nan,nan,nan,nan,nan,0,0,0,10.0,9.975284,0.9036247979119043,nan,34.078125,0.07440910417274584,0.949667616334283,0.24583223074887536,0.3357028858820975,0.08929534703622544,proxy +haproxy-splice-auto,stream1-down,1,27.3967155568626,nan,nan,nan,nan,nan,0,0,0,10.0,9.997502,0.2919906513955811,nan,42.84765625,0.09737827715355805,0.9505703422053232,0.09811589050835406,0.4053170417723424,0.24137317870966074,proxy +envoy,stream1-down,1,33.71684658893485,nan,nan,nan,nan,nan,0,0,0,10.0,10.004997,0.23724717119379313,nan,23.5078125,0.1154543101216671,0.9514747859181731,0.09716193656093489,0.3453011257802194,0.2574997870510356,proxy +direct,stream1-down,1,93.78614004470711,nan,nan,nan,nan,nan,0,0,0,0.04,0.0,0.0003411645469820416,nan,0.0,0.24987518721917124,0.005813953488372093,0.30692004302617426,0.9439342238178886,0.8569499866768552,client +3proxy-0.9.9.2,http-ka-1k,1,0.01451229184,1442.28,43.42,45.37,47.74,53.75,0,0,0,3.79,2.730479,208.9263386809068,260.46319840560784,131.19921875,0.12829845313921748,0.3477064220183486,0.16287878787878787,0.16899288485071026,0.057836963820394466,none +3proxy-1.0.2,http-ka-1k,1,0.15284043776,15239.31,3.99,5.09,6.28,9.54,0,0,0,10.11,10.100927,52.91793270508885,65.68560569145308,131.0234375,0.4282284342308352,0.9610266159695817,0.44300212414444184,0.4434409176709743,0.1778067595939068,proxy +3proxy-devel-c37,http-ka-1k,1,0.16668164096000002,16611.83,3.63,4.75,5.95,10.11,0,0,0,10.1,10.09918,48.475644668863225,60.200748635052335,134.4375,0.43781094527363185,0.9600760456273765,0.4582846459453143,0.47949412719109674,0.17674016902468828,proxy +3proxy-bp,http-ka-1k,1,0.36062625792,35948.23,1.78,2.73,4.01,7.47,0,0,0,10.1,10.086932000000001,22.405467773210336,27.81733102348499,28.3828125,0.49955697324118375,0.9582542694497154,0.5700621712099474,0.809385821673664,0.36186275589848493,proxy +nginx,http-ka-1k,1,0.45189431296,44198.62,1.41,1.51,1.62,1.87,0,0,0,10.02,10.010441,17.73866094373608,22.640230469411964,33.76953125,0.46722895800386577,0.9506641366223909,0.5202413879808901,0.6886039237512377,0.32203003236043076,proxy +nginx-halfclose,http-ka-1k,1,0.46204452864,45188.95,1.38,1.47,1.58,1.85,0,0,0,10.09,10.100588,17.47017765529968,22.107509541942918,33.7109375,0.4553906669050599,0.9600380589914367,0.5181818181818182,0.6659052940737,0.3259281953392997,proxy +haproxy,http-ka-1k,1,0.50692358144,50533.75,1.21,1.33,1.52,1.85,0,0,0,10.1,10.098303,15.939286109056964,19.789641983823437,34.546875,0.5095332018408941,0.9600760456273765,0.547190517998244,0.7364592272969399,0.3270481194434635,proxy +haproxy-splice-auto,http-ka-1k,1,0.51355058176,51190.34,1.2,1.31,1.5,1.82,0,0,0,10.1,10.09941,15.733601103729375,19.535556647311637,40.67578125,0.5105928723928396,0.9591642924976258,0.5486551497922589,0.7431873467179058,0.3266454570425422,proxy +envoy,http-ka-1k,1,0.25761415168,25136.37,2.51,2.78,3.05,3.65,0,0,0,10.09,10.078067,31.33368235929359,39.74475125064009,18.7578125,0.4675084175084175,0.9591254752851711,0.5091743119266054,0.5851636045185891,0.24806606095203634,proxy +squid,http-ka-1k,1,0.23739760640000002,22514.78,2.77,2.9,3.14,3.6,0,0,0,10.11,10.103447000000001,34.06942522567911,44.45851637841189,25.80859375,0.5015001500150015,0.9601139601139601,0.47008006742520014,0.46427386060495135,0.173879255530984,proxy +tinyproxy,http-ka-1k,1,0.046389002240000005,4622.36,13.39,15.71,18.34,22.15,46275,0,0,10.01,9.878988999999999,172.62712309632118,216.3155051323609,132.9375,0.36878634402551114,0.9506172839506173,0.4523166891587944,0.33194464003749463,0.09024232576275713,proxy +direct,http-ka-1k,1,1.43336144896,140194.39,0.432,0.551,0.647,0.795,0,0,0,0.76,0.0,0.4241777260307544,0.5367421166001625,0.0,0.8088137102158914,0.25333333333333335,0.9567140600315955,2.509195344119918,0.9572585876815849,origin +3proxy-0.9.9.2,http-ka-1m,1,18.98375544832,2258.76,2.13,27.17,35.74,42.74,0,0,0,8.1,6.596517,0.341344473049112,357.9161327382794,55.703125,0.2174217655301261,0.7377049180327869,0.22046815459989114,0.4271820512096973,0.0646252282826679,none +3proxy-1.0.2,http-ka-1m,1,27.23009265664,3242.63,4.59,5.83,7.85,11.24,0,0,0,10.03,10.013995,0.29467398811966083,308.891010440085,57.984375,0.3615621788283659,0.9525166191832859,0.3271211378126533,0.5984350275332303,0.10737444511581049,proxy +3proxy-devel-c37,http-ka-1m,1,46.042049413120004,5488.49,2.68,3.65,4.85,7.72,0,0,0,10.01,10.006874,0.17392796589367424,182.20207866906932,57.4296875,0.4423998466551658,0.9515209125475285,0.46261172879877915,0.8048873607652487,0.14918179379929739,proxy +3proxy-bp,http-ka-1m,1,47.41643894784,5647.29,2.64,3.66,4.87,7.95,0,0,0,10.02,9.992116000000001,0.16905529343563577,177.31061209322078,43.18359375,0.4613466334164589,0.9506641366223909,0.4661867364746946,0.8658571409548166,0.17485653722663116,proxy +nginx,http-ka-1m,1,13.915694039040002,1660.98,8.97,11.01,13.34,18.87,0,0,0,10.02,10.013101,0.576040259114018,602.4168821018458,46.7421875,0.33985921689397275,0.9506641366223909,0.24872551650120742,0.5934051232468588,0.04559291013150809,proxy +nginx-halfclose,http-ka-1m,1,13.82979469312,1644.03,9.48,11.12,13.76,18.2,0,0,0,10.02,10.017174,0.5796181489221797,608.4897066860995,43.32421875,0.34292035398230086,0.9515669515669516,0.24335322843190452,0.5677528058195218,0.05888854712007057,proxy +haproxy,http-ka-1m,1,5.63362136064,670.12,23.53,24.63,25.84,27.81,0,0,0,10.1,10.100904,1.4342461948990626,1492.3167848699763,36.390625,0.5988544760288502,0.9591642924976258,0.2234769687964339,1.1751147065928844,0.03326291882063708,client +haproxy-splice-auto,http-ka-1m,1,18.81195675648,2245.62,7.09,7.45,7.77,8.64,0,0,0,10.1,9.972517,0.42951406409207005,445.30664432785153,50.48046875,0.5352952490863627,0.9591642924976258,0.25593824228028506,0.9635428882983227,0.06650386880492887,client +envoy,http-ka-1m,1,26.54289788928,3162.72,4.99,5.34,5.72,6.68,0,0,0,10.02,10.014265,0.30200168924424253,316.41772191871667,39.3515625,0.38972809667673713,0.9524714828897338,0.3411850412821758,0.5385434643439345,0.11789882122871873,proxy +squid,http-ka-1m,1,3.0865883136,367.43,43.26,45.08,47.51,57.57,0,0,0,10.11,10.101936,2.620368892204698,2724.3330638641874,35.75390625,0.5850711684872558,0.959203036053131,0.0688909484090207,0.9538219443848588,0.01709904278391703,client +tinyproxy,http-ka-1m,1,1.26978359296,150.41,112.0,117.59,122.91,132.31,1505,0,0,10.01,10.000897,6.306586448587278,6651.162790697675,40.7421875,0.23501259445843828,0.9515209125475285,0.17902097902097902,0.45282878719993086,0.011406152893374068,proxy +direct,http-ka-1m,1,158.22659518464002,18854.21,0.6930000000000001,0.87,1.09,1.65,0,0,0,0.63,0.0,0.003185305222626229,3.337960559081902,0.0,0.8597212702764451,0.19090909090909092,0.8625999407758366,3.072368031701746,0.869373038252713,client +3proxy-0.9.9.2,http-ka-50k-2000,1,4.24950104064,10327.71,55.83,76.69,100.57,474.37,0,414,0,10.4,10.379987,1.9578769178856252,100.17434188347028,241.39453125,0.4997555809027212,0.9885931558935361,0.5152205425553945,0.523240543782331,0.1235469372167066,proxy +3proxy-1.0.2,http-ka-50k-2000,1,4.29698056192,10443.3,56.5,78.89,104.37,468.95,0,482,0,10.41,10.366433,1.938105113577437,99.16174509430368,240.03125,0.47803897309000926,0.9886039886039886,0.517319587628866,0.3796531671371136,0.12639282821253986,proxy +3proxy-devel-c37,http-ka-50k-2000,1,4.47314132992,10871.36,52.64,73.97,97.38,257.04,0,472,0,10.39,10.368262,1.8582019629924496,95.1186465504614,261.8828125,0.4892389270118528,0.9885823025689819,0.518019884009942,0.43183776481220754,0.1349331244210148,proxy +3proxy-bp,http-ka-50k-2000,1,7.05918140416,17156.44,119.08,119.7,121.72,522.08,0,0,0,10.16,10.11842,1.1514082915067378,58.883872426003954,184.72265625,0.523771410276933,0.9648622981956315,0.5492249685798073,0.5898437585767112,0.16439436699620172,proxy +nginx,http-ka-50k-2000,1,5.986781757439999,14543.51,45.89,58.15,63.78,69.25,0,446,0,10.14,10.094576,1.3549850869240243,69.34660994925524,76.87109375,0.46943422665966017,0.9629629629629629,0.47703338561505715,0.5023198203945395,0.15583885657219962,proxy +nginx-halfclose,http-ka-50k-2000,1,6.06555078656,14734.8,46.04,57.11,63.6,68.77,0,452,0,10.14,10.098076,1.3373888514748744,68.51351351351352,76.94921875,0.4650914904956475,0.9629629629629629,0.4796965640339134,0.5176002174659129,0.15585224220291707,proxy +haproxy,http-ka-50k-2000,1,4.33573593088,10529.14,186.0,190.56,196.04,774.9,0,0,0,10.14,10.104788000000001,1.8709626530123005,95.9155489131463,158.2578125,0.564965617082881,0.9629629629629629,0.4586924532268236,0.8418564200300264,0.09217288827120225,proxy +haproxy-splice-auto,http-ka-50k-2000,1,4.371051970560001,10616.53,184.12,188.27,192.82,682.21,0,0,0,10.14,10.104965,1.8558461566314266,94.99451954694922,162.69140625,0.5579723170950925,0.9638783269961977,0.46496153046371386,0.7953196194510508,0.09408222923961068,proxy +envoy,http-ka-50k-2000,1,4.80633683968,11674.82,167.37,171.94,181.91,416.64,0,0,0,10.14,10.105568000000002,1.6877718459158362,86.34196185286103,279.87890625,0.3354675979821498,0.9638783269961977,0.3158598555763573,0.36253987245958275,0.10923641779798368,proxy +squid,http-ka-50k-2000,1,2.01150431232,4829.63,199.38,247.9,277.47,462.96,0,647,0,10.17,10.12482,4.044734058072298,209.38851142680667,157.91015625,0.4030487804878049,0.9658119658119658,0.06826045926391947,0.6935569472247131,0.0361079169952358,proxy +tinyproxy,http-ka-50k-2000,1,0.80371253248,1953.08,523.07,541.47,566.0,945.8,19633,295,0,10.25,10.14635,10.202652899659808,522.0801711404268,157.91015625,0.3310601363918165,0.9743346007604563,0.3404669260700389,0.33761825090201414,0.044642125716817894,proxy +direct,http-ka-50k-2000,1,41.48938407936,100882.41,18.54,20.08,21.07,679.32,0,515,0,0.87,0.0,0.016775375567608,0.857486696635991,0.0,0.8251150558842867,0.2779552715654952,0.9540412044374009,2.753430932030432,0.9512724789644871,origin +3proxy-0.9.9.2,http-ka-2k-50k-2000,1,3.7078486220799998,9010.12,72.64,96.98,123.64,547.64,0,390,0,10.41,10.370231,2.2460463866856095,114.9044670353323,261.4765625,0.42052679382379654,0.9895437262357415,0.5249621785173979,0.4538999422428006,0.17116323071236397,proxy +3proxy-1.0.2,http-ka-2k-50k-2000,1,3.91982874624,9526.32,67.9,90.45,114.22,676.54,0,466,0,10.4,10.367262,2.1225417074612656,108.57309892679667,250.73046875,0.39558127301420304,0.9876543209876543,0.5190886699507389,0.3442771202873616,0.12634168822914565,proxy +3proxy-devel-c37,http-ka-2k-50k-2000,1,4.03584319488,9807.81,63.19,85.27,109.73,591.08,0,485,0,10.37,10.324343,2.0555803581577625,105.23752016967902,231.7734375,0.40824960338445265,0.9848053181386515,0.5167255350093497,0.3861323263872386,0.1377433279458947,proxy +3proxy-bp,http-ka-2k-50k-2000,1,5.984768491520001,14545.28,142.22,143.07,144.77,521.28,0,0,0,10.17,10.131488000000001,1.3594510817800463,69.59651812109931,184.31640625,0.4569686411149826,0.9658119658119658,0.5556962025316455,0.513831761537781,0.1834428646087635,proxy +nginx,http-ka-2k-50k-2000,1,5.64016447488,13701.34,42.78,53.91,61.96,66.48,0,434,0,10.15,10.101371,1.4396743279676716,73.6745833575286,75.7890625,0.44127332601536773,0.9639126305792972,0.4779197489352163,0.4843304302556027,0.16633196093445796,proxy +nginx-halfclose,http-ka-2k-50k-2000,1,5.64544929792,13714.18,46.92,59.88,64.06,69.13,0,428,0,10.15,10.103171999999999,1.438326618749675,73.53580432955633,83.2734375,0.42936906756002235,0.9639126305792972,0.46329113924050636,0.47846623730076665,0.15867003357164347,proxy +haproxy,http-ka-2k-50k-2000,1,4.14841831424,10077.34,192.96,199.19,208.61,691.77,0,0,0,10.16,10.105058999999999,1.9593009634779492,100.30011056705102,155.80078125,0.5301382488479263,0.9639468690702088,0.432269582682437,0.7448793107683386,0.10736750547137655,proxy +haproxy-splice-auto,http-ka-2k-50k-2000,1,4.17324859392,10138.92,191.75,196.22,204.26,726.49,0,0,0,10.15,10.105388999999999,1.9457264088772512,99.64755200816815,170.234375,0.5319778188539741,0.9639126305792972,0.4229374433363554,0.7590224956583692,0.10734643663302125,proxy +envoy,http-ka-2k-50k-2000,1,4.89164898304,11882.18,163.65,177.29,193.37,304.86,0,0,0,10.17,10.13481,1.6632428099826044,84.96950455342969,353.890625,0.25267436884895167,0.9667300380228137,0.23711943793911008,0.3634247441752433,0.10643469610960407,proxy +squid,http-ka-2k-50k-2000,1,1.4930044518399999,3597.9,256.08,297.87,334.54,354.75,0,535,0,10.21,10.15438,5.470847719130135,281.9585208914418,174.66796875,0.3251469353484467,0.9686907020872866,0.26664736537348005,0.532790636898662,0.0931259133935953,proxy +tinyproxy,http-ka-2k-50k-2000,1,0.79507226624,1932.2,534.94,556.36,591.02,1530.0,19440,202,0,10.29,10.188486999999999,10.353775813273172,529.320987654321,174.66796875,0.3258124611881598,0.9781368821292775,0.3523088199364769,0.32820219525913263,0.059885500075740415,proxy +direct,http-ka-2k-50k-2000,1,39.17010173952,95077.91,19.81,20.85,21.68,628.17,0,514,0,0.38,0.0,0.007761021455128989,0.3976438555129658,0.0,0.8409832499456167,0.10919540229885058,0.954099398543843,2.7168357511586105,0.9507131198169159,origin +3proxy-0.9.9.2,http-close-1k,1,0.049325015039999996,4844.69,12.68,14.41,16.79,21.11,0,0,0,10.06,9.933753,163.16264665045708,207.30300032970655,197.91796875,0.379763226045135,0.9562737642585551,0.4276787780606341,0.33967767783218095,0.08650003109346187,proxy +3proxy-1.0.2,http-close-1k,1,0.050751078399999996,4979.83,12.31,13.97,16.26,20.85,0,0,0,10.04,9.919624,158.2626468879132,201.27904412501755,185.875,0.3713764813126709,0.9543726235741445,0.4293628808864266,0.3016175347784344,0.08838516627534199,proxy +3proxy-devel-c37,http-close-1k,1,0.059643002880000004,5855.89,10.41,11.69,14.53,19.01,0,0,0,10.03,10.007736000000001,134.53380300358208,170.92123649500698,133.5234375,0.42250346740638,0.9525166191832859,0.4664279319606088,0.3605311981924193,0.09977431483674976,proxy +3proxy-bp,http-close-1k,1,0.09705619456,9526.46,6.46,8.29,10.16,14.1,0,0,0,10.01,9.998647,82.50890153177669,104.89803617462746,30.453125,0.46069436949091563,0.9524262607040913,0.5283898305084745,0.555663367940756,0.1368655285146443,proxy +nginx,http-close-1k,1,0.14386462719999998,14126.68,4.39,4.55,4.72,5.3,0,0,0,10.1,10.084819,56.16391017902697,70.79224229170609,33.9375,0.5493415118167058,0.9600760456273765,0.4009588695432753,0.7915764201903539,0.15395800958867636,proxy +nginx-halfclose,http-close-1k,1,0.14227079168,13973.41,4.43,4.61,4.86,5.43,0,0,0,10.12,10.083912,56.90556652141066,71.70642877893589,34.60546875,0.5495867768595041,0.9601518026565465,0.4026104417670683,0.7840964049493563,0.15403111287839114,proxy +haproxy,http-close-1k,1,0.16961765376,16654.94,3.7,3.85,4.02,4.49,0,0,0,10.1,10.081384,47.63655091841308,60.045777473915756,34.73828125,0.548445083587992,0.9600760456273765,0.4823779193205945,0.8420727986772959,0.20623472761413772,proxy +haproxy-splice-auto,http-close-1k,1,0.16852713472,16544.86,3.73,3.88,4.03,4.47,0,0,0,10.09,10.081381,47.89733127197144,60.381558789735735,40.77734375,0.5491464510332434,0.9600380589914367,0.4877637130801688,0.8468508280474499,0.16253956466719122,proxy +envoy,http-close-1k,1,0.1639972864,15771.49,3.85,4.25,4.66,5.73,0,0,0,10.0,9.981273,48.781294956841435,63.31438122855225,20.16796875,0.4674933569530558,0.9505703422053232,0.2089508863702412,0.6326731954602335,0.10168232240438273,proxy +squid,http-close-1k,1,0.0780140544,7425.32,8.47,8.68,8.91,9.91,0,0,0,10.02,9.983508,102.75071667086694,134.78067874581333,24.6484375,0.48087336244541484,0.9524714828897338,0.2666849015317287,0.5290901593165014,0.1035865056694562,proxy +tinyproxy,http-close-1k,1,0.046221230079999995,4605.74,13.43,15.77,18.42,22.23,46117,0,0,10.02,9.890903999999999,173.42679946262479,217.26874539225466,133.1875,0.3687182382834557,0.9515669515669516,0.45173658096526836,0.33776482975753636,0.09027938678087738,proxy +direct,http-close-1k,1,0.51933872128,50994.81,0.777,1.12,1.48,2.13,0,0,0,4.59,0.0,7.070529982724418,8.911496607224331,0.0,0.7770545158665582,0.5186440677966102,0.9296560272699101,2.2844647467298986,0.8691497866672084,origin +3proxy-1.0.2,stream1,2,25.21978063045967,nan,nan,nan,nan,nan,0,0,0,10.0,10.000562,0.3171487820707344,nan,19.61328125,0.059875583203732506,0.9505703422053232,0.21267454350161116,0.21308689099933625,0.42761384571864575,proxy +3proxy-devel-c37,stream1,2,62.66481695497513,nan,nan,nan,nan,nan,0,0,0,10.01,9.936311,0.12775856810782157,nan,23.375,0.13783367556468173,0.9506172839506173,0.1645360824742268,0.4861480447805523,0.5264128931993086,proxy +3proxy-bp,stream1,2,61.992540194736705,nan,nan,nan,nan,nan,0,0,0,10.0,9.880338,0.12902703747408262,nan,35.1953125,0.14374661613427178,0.999000999000999,0.17086092715231788,0.4736131649064216,0.5411500405699571,proxy +nginx,stream1,2,18.71614931488347,nan,nan,nan,nan,nan,0,0,0,10.0,9.994655999999999,0.42733326973702634,nan,33.46875,0.09124356144223694,0.949667616334283,0.1074665515753129,0.17601270573137076,0.3639791051563991,proxy +nginx-halfclose,stream1,2,19.272919842077307,nan,nan,nan,nan,nan,0,0,0,10.01,9.988531,0.41542817884414013,nan,33.09765625,0.08360128617363344,0.9506172839506173,0.15684713375796178,0.1740716316181516,0.3915044183469176,proxy +haproxy,stream1,2,9.065499163341896,nan,nan,nan,nan,nan,0,0,0,10.01,9.972633,0.8831992512757314,nan,33.77734375,0.1323166629289078,0.9506172839506173,0.1500789889415482,0.09893935461411683,0.3496832292479893,proxy +haproxy-splice-auto,stream1,2,27.004009435675272,nan,nan,nan,nan,nan,0,0,0,10.0,9.998915,0.29621699446927136,nan,41.38671875,0.13541416566626652,0.949667616334283,0.13649484536082473,0.25581229502604663,0.4025924912829179,proxy +envoy,stream1,2,32.81037743680414,nan,nan,nan,nan,nan,0,0,0,10.01,10.003708999999999,0.24402322082103156,nan,20.984375,0.07841691248770895,0.9515209125475285,0.10410334346504559,0.25689228908969935,0.34496849434001997,proxy +direct,stream1,2,60.34304224044134,nan,nan,nan,nan,nan,0,0,0,0.03,0.0,0.0003976680727248245,nan,0.0,0.23884140550807217,0.005681818181818182,0.16253207869974337,0.9518169598004133,0.5384729272694515,client +3proxy-0.9.9.2,stream1,2,24.765870972599153,nan,nan,nan,nan,nan,0,0,0,9.99,9.999770999999999,0.3213656621769695,nan,17.98828125,0.0646573930963421,0.950523311132255,0.25977835723598436,0.207437540562367,0.4143959830398076,proxy +3proxy-1.0.2,stream16,2,23.679477421834747,nan,nan,nan,nan,nan,0,0,2234,10.04,10.020187,0.338743808097883,nan,90.14453125,0.15591024751330096,0.952561669829222,0.22016684802321365,0.23111655494393063,0.40837022430567066,proxy +3proxy-devel-c37,stream16,2,55.404709165208075,nan,nan,nan,nan,nan,0,0,1352,10.02,10.021645,0.14444205089262432,nan,126.44921875,0.20141010575793183,0.9524714828897338,0.2561648877438351,0.4897068958762872,0.6306671747901776,proxy +3proxy-bp,stream16,2,48.06327558248399,nan,nan,nan,nan,nan,0,0,4093,10.02,10.015899999999998,0.16660680580573134,nan,82.95703125,0.31294215563878486,0.9524714828897338,0.35122282608695654,0.4584569782975822,0.5965467968320153,proxy +nginx,stream16,2,18.80027046984262,nan,nan,nan,nan,nan,0,0,8135,10.02,10.018551,0.4257412979607208,nan,59.7734375,0.1750278706800446,0.9524714828897338,0.32430689877498386,0.18548855420379293,0.41914172445358666,proxy +nginx-halfclose,stream16,2,18.9587506790337,nan,nan,nan,nan,nan,0,0,7000,10.03,10.018828,0.42258660246980645,nan,62.6640625,0.16700519070187317,0.9516129032258065,0.3247081098138214,0.18822394662737515,0.43192718306168404,proxy +haproxy,stream16,2,9.61931512256917,nan,nan,nan,nan,nan,0,0,0,10.02,10.007496999999999,0.8330594468880086,nan,46.3359375,0.1992738146091414,0.9506641366223909,0.6157846436219028,0.11414712876755685,0.9024711871345832,origin +haproxy-splice-auto,stream16,2,29.684277411847813,nan,nan,nan,nan,nan,0,0,0,10.02,10.005668,0.26996978180058057,nan,143.140625,0.29848363926576216,0.9515669515669516,0.6981915209012748,0.29300321382643263,0.894119919501933,proxy +envoy,stream16,2,20.63963372645727,nan,nan,nan,nan,nan,0,0,5449,10.04,10.025910999999999,0.3885617525743779,nan,192.83203125,0.16021011162179907,0.9534662867996201,0.1828345938835909,0.19972414243480083,0.3030052424197337,proxy +direct,stream16,2,214.49869616331912,nan,nan,nan,nan,nan,0,0,13828,1.27,0.0,0.0047352319493776576,nan,0.0,0.8206288708909004,0.37797619047619047,0.9946932006633499,2.935045320990916,2.980568386312345,origin +3proxy-0.9.9.2,stream16,2,23.827916918960785,nan,nan,nan,nan,nan,0,0,2220,10.05,10.030482000000001,0.33554952381792463,nan,106.96875,0.1455902939804013,0.9535104364326376,0.22785714285714287,0.22531311858115188,0.3987604615876691,proxy +3proxy-1.0.2,stream1-down,2,24.98025667851414,nan,nan,nan,nan,nan,0,0,0,10.01,9.999791,0.32053185060841893,nan,20.7578125,0.14942528735632185,0.999001996007984,0.14982578397212543,0.41360576189149234,0.2355834171561328,proxy +3proxy-devel-c37,stream1-down,2,61.1366969067015,nan,nan,nan,nan,nan,0,0,0,10.01,9.844299,0.13096943014296064,nan,24.12890625,0.133769322235434,0.9980059820538385,0.298879202988792,0.49048463086683913,0.590747632551403,proxy +3proxy-bp,stream1-down,2,58.57200817263727,nan,nan,nan,nan,nan,0,0,0,10.01,9.888371,0.13670449449355324,nan,35.95703125,0.1137467847956559,0.9506172839506173,0.2859259259259259,0.4871105480118185,0.5434952602721664,proxy +nginx,stream1-down,2,19.746162242589932,nan,nan,nan,nan,nan,0,0,0,10.0,9.998653000000001,0.40511852017788397,nan,35.484375,0.18818001978239368,0.949667616334283,0.06497175141242938,0.4652379576476339,0.16630975932227846,proxy +nginx-halfclose,stream1-down,2,19.33888067742664,nan,nan,nan,nan,nan,0,0,0,10.01,9.996708,0.4140407981404953,nan,36.2890625,0.15912636505460218,0.9497153700189753,0.05921985815602837,0.4423419031654408,0.16816657427294393,proxy +haproxy,stream1-down,2,8.580598685905077,nan,nan,nan,nan,nan,0,0,0,9.99,9.865871,0.9313007254055169,nan,33.80859375,0.07708089097303635,0.9478178368121443,0.06143001007049345,0.34057458763282356,0.09692412736705366,proxy +haproxy-splice-auto,stream1-down,2,25.821294153513577,nan,nan,nan,nan,nan,0,0,0,9.99,9.993391,0.3094768590386817,nan,43.76171875,0.09662532448803,0.9496197718631179,0.14135948596550557,0.41079327176986485,0.2592408643543215,proxy +envoy,stream1-down,2,32.96347757072422,nan,nan,nan,nan,nan,0,0,0,10.02,10.003397,0.2431497775233698,nan,23.43359375,0.10727367870225013,0.9515669515669516,0.1343093570973902,0.3510668800547299,0.2576311764044577,proxy +direct,stream1-down,2,90.53678434986274,nan,nan,nan,nan,nan,0,0,0,0.04,0.0,0.00035340904814017046,nan,0.0,0.22717622080679406,0.007858546168958742,0.34662799129804206,0.8463470846982103,0.9385398640216112,origin +3proxy-0.9.9.2,stream1-down,2,23.907314385634287,nan,nan,nan,nan,nan,0,0,1,10.01,10.002291000000001,0.3349219347867439,nan,18.72265625,0.07710417892878163,0.9515209125475285,0.16329154612664737,0.3758304519855779,0.22623091720368438,proxy +3proxy-1.0.2,http-ka-1k,2,0.15661531136,15611.59,3.9,4.96,6.11,10.69,0,0,0,10.02,10.016570999999999,51.18273513867501,64.11610005183039,130.859375,0.4119823788546256,0.9524714828897338,0.4261777561923264,0.4434213405254315,0.16633689501223545,proxy +3proxy-devel-c37,http-ka-1k,2,0.16542334975999998,16486.6,3.65,4.78,6.0,9.59,0,0,0,10.11,10.10252,48.892734984113524,60.71598013368325,134.05859375,0.42265486725663715,0.9601139601139601,0.43596597812879706,0.48050373818274733,0.17488801099519924,proxy +3proxy-bp,http-ka-1k,2,0.34577842176,34467.02,1.85,2.99,4.52,8.71,0,0,0,10.1,10.081084,23.367565734359836,29.014567611124356,30.375,0.5151357896557689,0.9582542694497154,0.5722051524462302,0.8030074497697938,0.325982801550111,proxy +nginx,http-ka-1k,2,0.42479910912,41545.77,1.5,1.62,1.75,2.05,0,0,0,10.03,10.011763,18.88892850228019,24.105941165160544,35.765625,0.4431314623338257,0.9516129032258065,0.49335812964930925,0.6860996554451991,0.3156229879588505,proxy +nginx-halfclose,http-ka-1k,2,0.42773512192,41836.37,1.5,1.62,1.74,1.98,0,0,0,10.01,10.005189000000001,18.72186685080714,23.90613320086645,35.43359375,0.4647608773822366,0.9515209125475285,0.5164693772516726,0.7117163634588405,0.3155562424351966,proxy +haproxy,http-ka-1k,2,0.49006247936,48852.98,1.25,1.39,1.58,1.97,0,0,0,10.11,10.094949,16.504018039827432,20.491844813293145,34.55078125,0.4675,0.9601139601139601,0.49839783090953904,0.73262624562195,0.31458686611969355,proxy +haproxy-splice-auto,http-ka-1k,2,0.49316626432,49160.66,1.24,1.38,1.57,1.94,0,0,0,10.1,10.098778,16.383926851000382,20.3420280397737,40.4765625,0.4757110051227698,0.9600760456273765,0.49864898059444857,0.7382774099713023,0.3202980855086939,proxy +envoy,http-ka-1k,2,0.24880611328,24279.51,2.6,2.88,3.14,3.74,0,0,0,10.09,10.089362,32.44293274625442,41.147228781038834,18.69140625,0.42813123074134496,0.9591254752851711,0.474730127576055,0.5738141568056037,0.23957188408086041,proxy +squid,http-ka-1k,2,0.22573744128,21408.81,2.92,3.11,3.3,3.73,0,0,0,10.1,10.096299,35.793796342263555,46.71060238177824,26.37890625,0.4320430480819302,0.9600760456273765,0.36469693127060615,0.47858621569741805,0.1511305360357156,proxy +tinyproxy,http-ka-1k,2,0.044207964159999995,4408.54,13.99,16.5,19.16,23.31,44145,0,0,10.02,9.867917000000002,181.3247941250593,226.9587080115065,134.91796875,0.3267882187938289,0.9524714828897338,0.4139512430605841,0.327300592368376,0.08840251907229704,proxy +direct,http-ka-1k,2,1.45752064,142556.28,0.425,0.515,0.59,0.733,0,0,0,0.83,0.0,0.45556816265737404,0.5764553413796313,0.0,0.808859357696567,0.267741935483871,0.9551767676767676,2.5091499536492337,0.956536309509035,origin +3proxy-0.9.9.2,http-ka-1k,2,0.01501560832,1497.62,42.2,43.08,44.43,49.25,0,0,0,3.51,2.695004,187.00541064725908,233.54847295229223,131.20703125,0.10213270142180095,0.3388030888030888,0.13469139556096077,0.17292585598389923,0.062641930927163,none +3proxy-1.0.2,http-ka-1m,2,26.37109919744,3139.79,4.72,6.08,8.12,11.78,0,0,0,10.02,10.015407000000002,0.30396912695918876,318.61108461318327,57.125,0.33590237636480413,0.9533777354900095,0.2926128948055338,0.5899127887134081,0.10075201251928038,proxy +3proxy-devel-c37,http-ka-1m,2,44.32406249472,5287.63,2.78,3.81,5.02,7.85,0,0,0,10.02,10.008182,0.18084984879161037,189.2708726860597,58.49609375,0.4215861657722123,0.9515669515669516,0.4298957126303592,0.7983871940095592,0.1682609380619077,proxy +3proxy-bp,http-ka-1m,2,46.042049413120004,5484.22,2.71,3.78,5.04,8.28,0,0,0,10.01,9.990845,0.17392796589367424,182.35144095893904,43.20703125,0.4478719250292854,0.9506172839506173,0.4204438149197356,0.8467601397159805,0.15204643442130356,proxy +nginx,http-ka-1m,2,13.82979469312,1652.91,8.58,11.39,13.95,20.59,0,0,0,10.01,10.011186,0.5790396876957105,604.9800556025625,46.234375,0.3193392980041294,0.9524262607040913,0.20913734392735528,0.5623185119985703,0.06084647897402813,proxy +nginx-halfclose,http-ka-1m,2,13.14259992576,1568.77,10.06,11.71,13.78,20.87,0,0,0,10.02,10.013544,0.6099249802383722,637.9321321703699,46.73046875,0.3269530380592032,0.9524714828897338,0.22056338028169015,0.594720782240775,0.05893093256311487,proxy +haproxy,http-ka-1m,2,5.3838086143999995,641.58,24.72,25.76,26.77,28.71,0,0,0,10.1,10.100745,1.500796291010147,1558.641975308642,37.6484375,0.6118038237738986,0.9600760456273765,0.17820552623408878,1.1787413431258014,0.03991664038764653,client +haproxy-splice-auto,http-ka-1m,2,17.26576852992,2057.31,7.71,8.07,8.44,9.27,0,0,0,10.1,10.092073,0.4679780101301659,486.11445348221594,46.26953125,0.5310250923944758,0.9600760456273765,0.22418058132343846,0.9466141235234149,0.08457380567976346,client +envoy,http-ka-1m,2,24.56721293312,2927.51,5.38,5.84,6.32,7.37,0,0,0,10.01,10.010495,0.3259629011154175,341.6498856616267,39.84375,0.3470907992752164,0.9524262607040913,0.28239026969857217,0.5165703861085706,0.08743753412519496,proxy +squid,http-ka-1m,2,2.92326211584,347.35,45.87,47.77,48.59,51.54,0,0,0,10.11,10.100771,2.7667720784168925,2881.9840364880274,34.4609375,0.5727318803852002,0.9601139601139601,0.05221767851525637,0.9265658094545296,0.020908592265210895,client +tinyproxy,http-ka-1m,2,1.2437789081600001,147.42,112.71,117.93,122.69,135.91,1475,0,0,10.01,9.998111,6.438443317749081,6786.440677966101,41.0703125,0.22920892494929007,0.9515209125475285,0.1689419795221843,0.4510169332224783,0.012358482714428002,proxy +direct,http-ka-1m,2,156.85220564992002,18690.75,0.706,0.91,1.14,1.64,0,0,0,0.39,0.0,0.0019891336478643842,2.065896811102871,0.0,0.8577300753596712,0.12460063897763578,0.8563304399880275,3.0620117983979656,0.8884747504497116,client +3proxy-0.9.9.2,http-ka-1m,2,19.49915152384,2321.87,2.77,27.04,35.55,42.75,0,0,0,8.31,6.902775,0.3409379116764153,357.2810524958081,54.734375,0.21675343114055845,0.7623853211009174,0.17737714451875544,0.44719147594385955,0.07128939260808756,none +3proxy-1.0.2,http-ka-50k-2000,2,4.1482505420799995,10081.85,53.37,72.14,92.75,256.3,0,452,0,10.42,10.388850999999999,2.0095218250294486,102.82624141469961,228.46484375,0.4591215133055466,0.9904942965779467,0.5055871811090027,0.3777049789573471,0.12833951797530782,proxy +3proxy-devel-c37,http-ka-50k-2000,2,4.2293683814400005,10278.99,57.28,77.37,100.14,190.9,0,537,0,10.36,10.33054,1.9596306711826623,100.30595251926727,229.078125,0.4778395552025417,0.9857278782112274,0.5059071729957806,0.4177787938570866,0.12645649252784666,proxy +3proxy-bp,http-ka-50k-2000,2,6.7104669696000006,16309.1,119.96,120.59,132.65,568.03,0,0,0,10.17,10.135759,1.2124342518721873,61.991783193338776,184.52734375,0.515348383953224,0.9676498572787822,0.5436893203883495,0.5794942342694007,0.16634170498325848,proxy +nginx,http-ka-50k-2000,2,5.90776107008,14351.39,39.17,53.95,60.3,70.42,0,453,0,10.13,10.091726,1.371754866838286,70.19124168514412,72.2734375,0.4355737096175269,0.9638439581351094,0.45309941520467834,0.5071912421936361,0.1511496288190055,proxy +nginx-halfclose,http-ka-50k-2000,2,5.9039023103999995,14342.16,43.95,55.07,60.59,65.25,0,452,0,10.14,10.099353,1.3740064746177003,70.26150584126721,73.328125,0.44576333089846604,0.9638783269961977,0.45535296867695185,0.5042832271025114,0.15398013986261205,proxy +haproxy,http-ka-50k-2000,2,4.2576379904,10339.08,188.33,191.47,197.24,571.57,0,0,0,10.16,10.121096,1.9090397112969166,97.74305889596522,159.1015625,0.5308151093439364,0.9657794676806084,0.43685932388222465,0.7039804483101133,0.096963556807932,proxy +haproxy-splice-auto,http-ka-50k-2000,2,4.19833053184,10197.66,190.65,196.53,205.95,599.4,0,0,0,10.15,10.112545,1.9341021242653929,98.99058857950943,165.5390625,0.5313131313131313,0.9657469077069457,0.4295464553060326,0.7421822890834275,0.09316996503920198,proxy +envoy,http-ka-50k-2000,2,4.44327788544,10793.11,180.41,191.49,199.17,323.94,0,0,0,10.17,10.130946,1.8310806143051586,93.54046521895091,255.125,0.2895436873337426,0.9676498572787822,0.3423166623477585,0.3510999627484701,0.10648340430420383,proxy +squid,http-ka-50k-2000,2,1.78962563072,4294.86,207.59,280.42,295.01,507.41,0,588,0,10.16,10.128656999999999,4.541732002759679,235.38678961147278,148.25390625,0.37186858316221766,0.966698382492864,0.06026006977481763,0.6051850396878711,0.034221951701101,proxy +tinyproxy,http-ka-50k-2000,2,0.77921779712,1893.72,547.5,573.05,754.5,1450.0,19051,104,0,10.27,10.167743000000002,10.543907018508113,539.0793134218676,148.25390625,0.28473602827479566,0.9771646051379639,0.2970013037809648,0.3301887535723174,0.045635605051595425,proxy +direct,http-ka-50k-2000,2,40.716289966080005,98975.11,19.31,20.3,20.96,681.14,0,562,0,0.79,0.0,0.015522042910257973,0.7947702108052531,0.0,0.8168921868179834,0.25732899022801303,0.9531200506810263,2.7181046156719617,0.9513217895583405,origin +3proxy-0.9.9.2,http-ka-50k-2000,2,4.13591928832,10051.56,61.68,82.3,107.26,531.78,0,464,0,10.4,10.358458,2.0116446719586647,102.98559191959203,246.59765625,0.4885028949545079,0.9885931558935361,0.5025402201524132,0.5110126386586744,0.12360242889890169,proxy +3proxy-1.0.2,http-ka-2k-50k-2000,2,3.7870370816,9203.79,68.56,90.78,114.31,201.53,0,459,0,10.41,10.385055,2.1990806587194736,112.55392533166106,239.67578125,0.35757009345794394,0.9904852521408183,0.5131770076779415,0.34251779195657367,0.1282917688824732,proxy +3proxy-devel-c37,http-ka-2k-50k-2000,2,3.84693174272,9349.43,62.33,85.51,110.65,612.1,0,484,0,10.35,10.307395,2.152364677556137,110.09935536029616,231.74609375,0.35908658420551853,0.9838403041825095,0.5047720042417816,0.37674054892232833,0.13116389492176142,proxy +3proxy-bp,http-ka-2k-50k-2000,2,5.762386493439999,14004.72,143.32,144.13,147.23,561.0,0,0,0,10.19,10.154942,1.4146916402223935,72.40249820592436,183.60546875,0.4224569205113952,0.9686311787072244,0.5498100464330942,0.5147393589204948,0.17869618474974983,proxy +nginx,http-ka-2k-50k-2000,2,5.46492645376,13275.78,42.42,51.76,58.15,68.01,0,431,0,10.13,10.100973,1.4829110818910023,75.99057806850405,72.1953125,0.4143266475644699,0.9629277566539924,0.4571229374854752,0.477526426796157,0.15394681603987861,proxy +nginx-halfclose,http-ka-2k-50k-2000,2,5.39739815936,13111.66,46.16,56.98,61.36,68.24,0,413,0,10.15,10.102565,1.5044285709992598,77.00828502928591,76.4375,0.40593677717810334,0.9639126305792972,0.44423350735643097,0.46720786617630716,0.1520707900944337,proxy +haproxy,http-ka-2k-50k-2000,2,3.97712293888,9657.94,201.26,206.99,213.58,782.66,0,0,0,10.16,10.113529999999999,2.0436883960868784,104.62146799571629,159.47265625,0.501432664756447,0.9657794676806084,0.3984466933396093,0.706977280713754,0.10456893033810188,proxy +haproxy-splice-auto,http-ka-2k-50k-2000,2,3.98567931904,9681.05,200.91,204.87,214.0,760.37,0,0,0,10.17,10.108741,2.0413082309792188,104.54036162536106,165.5,0.5046516043288399,0.9648956356736242,0.41192723923555147,0.7031985548677113,0.10645707960061365,proxy +envoy,http-ka-2k-50k-2000,2,4.613398855680001,11206.25,172.3,182.44,203.8,352.21,0,0,0,10.13,10.121795,1.7566224498500458,89.90379495189748,324.7578125,0.25005370569280344,0.9647619047619047,0.24476744186046512,0.3549403222382469,0.10460056787729788,proxy +squid,http-ka-2k-50k-2000,2,1.32682612736,3149.15,306.1,353.54,413.3,430.92,0,446,0,10.2,10.150153,6.150014558603876,321.63466086462967,175.1875,0.2936643835616438,0.9686609686609686,0.22780269058295965,0.4500584166814633,0.08745901658665296,proxy +tinyproxy,http-ka-2k-50k-2000,2,0.7751912652799999,1884.05,546.45,567.8,602.65,1350.0,18947,197,0,10.26,10.162116,10.588354600506575,541.5105293714045,175.1875,0.32136929460580915,0.9762131303520457,0.34780463739516526,0.32445053968862353,0.05990101414169185,proxy +direct,http-ka-2k-50k-2000,2,38.39700762624,93277.86,20.27,21.43,22.36,593.46,0,484,0,0.59,0.0,0.012292624586647255,0.6292964146103429,0.0,0.8373807458803122,0.15567282321899736,0.954401519949335,2.6940211300331898,0.9518163193064345,origin +3proxy-0.9.9.2,http-ka-2k-50k-2000,2,3.6420819353600002,8850.23,69.64,93.11,118.89,299.38,0,465,0,10.4,10.371661,2.2844076952864087,116.97090348775743,247.1171875,0.41795948165723673,0.9885931558935361,0.5185023944275141,0.4519546247442393,0.16064303866937285,proxy +3proxy-1.0.2,http-close-1k,2,0.04848615424,4758.92,12.86,14.66,17.27,21.56,0,0,0,10.04,9.894923,165.6555386975562,210.65883340327318,161.2421875,0.36977082575481995,0.9534662867996201,0.42392566782810687,0.29011859649083016,0.08647036761458707,proxy +3proxy-devel-c37,http-close-1k,2,0.05838471168,5730.63,10.65,11.9,14.45,19.35,0,0,0,10.02,10.010449,137.29621624124462,174.53405330081867,136.34375,0.41898470097357443,0.9533777354900095,0.4604880232818446,0.3529867762104718,0.09409710212464208,proxy +3proxy-bp,http-close-1k,2,0.09563013120000001,9391.1,6.55,8.42,10.34,14.46,0,0,0,10.02,10.000307999999999,83.82295307360197,106.50736622802356,30.65234375,0.45792704947634527,0.9524714828897338,0.5260482846251588,0.5527940602254988,0.13306683522329943,proxy +nginx,http-close-1k,2,0.14059307008000002,13808.18,4.5,4.68,4.88,5.37,0,0,0,10.01,9.992965,56.95871066364297,72.41868271790716,33.0703125,0.5460597337171644,0.9515209125475285,0.39580702197524625,0.7839480193151944,0.15114465477680658,proxy +nginx-halfclose,http-close-1k,2,0.14059307008000002,13806.87,4.5,4.69,4.9,5.37,0,0,0,10.02,9.997152999999999,57.01561247249776,72.46586438324462,34.42578125,0.5459092533047517,0.9524714828897338,0.3902190524707081,0.7707432010006317,0.166359039772556,proxy +haproxy,http-close-1k,2,0.1639972864,16105.81,3.82,4.02,4.22,4.71,0,0,0,10.1,10.077321,49.26910790640984,62.08850993723528,35.4140625,0.5467072297780959,0.9591642924976258,0.4674479166666667,0.8287057014242623,0.18251637251612093,proxy +haproxy-splice-auto,http-close-1k,2,0.16752050176,16451.47,3.75,3.93,4.11,4.51,0,0,0,10.11,10.077556,48.280657680857225,60.84716588225381,41.58984375,0.5480579917666011,0.9601139601139601,0.4579398198989677,0.8325119402561185,0.19009273056550913,proxy +envoy,http-close-1k,2,0.15359541248,14770.75,4.11,4.55,5.0,6.24,0,0,0,10.01,9.985672,52.13697382428489,67.66668243978611,20.12890625,0.46100427350427353,0.9515209125475285,0.20534417659018298,0.620210159931432,0.11402427257818494,proxy +squid,http-close-1k,2,0.07725907968000001,7358.16,8.55,8.8,9.08,9.94,0,0,0,10.02,9.976443,103.75479533540307,135.99348534201954,23.92578125,0.4784217016029593,0.9515669515669516,0.2482585678461967,0.5395642461880237,0.14924206383049077,proxy +tinyproxy,http-close-1k,2,0.044627394560000005,4451.28,13.83,16.19,18.9,22.93,44592,0,0,10.01,9.869909999999999,179.44135163959703,224.46965959546128,133.06640625,0.3647858086431402,0.9524262607040913,0.4490719782707107,0.33017006478411065,0.08839459999947427,proxy +direct,http-close-1k,2,0.51581550592,50649.44,0.783,1.12,1.48,2.17,0,0,0,4.54,0.0,7.041277275141284,8.875005131473232,0.0,0.7741477272727273,0.5194508009153318,0.9286157666045934,2.268408366771108,0.8685786384278467,origin +3proxy-0.9.9.2,http-close-1k,2,0.04714397696,4627.54,13.22,15.08,17.72,22.23,0,0,0,10.06,9.916289,170.711096495496,217.05359454561147,197.21484375,0.37220982142857145,0.9562737642585551,0.41912276630308654,0.33192059920809996,0.08457323468099993,proxy diff --git a/bench/data/results-full7/arm-connect.csv b/bench/data/results-full7/arm-connect.csv new file mode 100644 index 0000000..2c5b990 --- /dev/null +++ b/bench/data/results-full7/arm-connect.csv @@ -0,0 +1,127 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,connect-stream1-down,0,95.4294031933681,nan,nan,nan,nan,nan,0,0,0,0.03,0.0,0.00025146710225986774,nan,0.0,0.24956282787909068,0.005825242718446602,0.344008636200072,0.9409653272416023,0.93217776234359,origin +3proxy-0.9.9.2,connect-stream1-down,0,24.809151634180107,nan,nan,nan,nan,nan,0,0,1,10.0,10.001126000000001,0.32242418547623675,nan,19.0859375,0.1487300340403247,0.9505703422053232,0.11007911936704506,0.3833606873521067,0.21855228070081636,proxy +3proxy-1.0.2,connect-stream1-down,0,25.062856682572008,nan,nan,nan,nan,nan,0,0,0,10.0,10.000615,0.31915742994084867,nan,19.9140625,0.06666666666666667,0.9505703422053232,0.10178384050367262,0.36628937528403577,0.2290349852606322,proxy +3proxy-devel-c37,connect-stream1-down,0,63.63780696941246,nan,nan,nan,nan,nan,0,0,0,10.0,9.903528,0.125697230672723,nan,23.80078125,0.11843991970174936,0.9505703422053232,0.19249649368863955,0.5270693731480708,0.49517191514983805,proxy +3proxy-bp,connect-stream1-down,0,66.47003037053169,nan,nan,nan,nan,nan,0,0,0,9.98,9.7087,0.12010056692935897,nan,36.48046875,0.1770374449339207,0.997002997002997,0.20337738619676946,0.5405263842309267,0.5291087799766591,proxy +squid,connect-stream1-down,0,15.336463286638471,nan,nan,nan,nan,nan,0,0,0,10.01,10.004439999999999,0.5220968529205918,nan,22.671875,0.10526315789473684,0.9515209125475285,0.12716207559256887,0.2920639609094458,0.14733497738611562,proxy +tinyproxy,connect-stream1-down,0,1.5440641679811022,nan,nan,nan,nan,nan,0,0,0,9.99,9.929364000000001,5.175368463854655,nan,22.671875,0.14351978171896315,0.9487179487179487,0.06858877086494689,0.437631156325052,0.018058083872661827,proxy +direct,connect-stream16,0,211.70998275280905,nan,nan,nan,nan,nan,0,0,5663,1.35,0.0,0.005099423310324572,nan,0.0,0.8247641509433963,0.4090909090909091,0.9966799468791501,2.9272914853820087,2.986254090463427,origin +3proxy-0.9.9.2,connect-stream16,0,23.861900319153918,nan,nan,nan,nan,nan,0,0,2369,10.04,10.024547,0.3353991168032069,nan,74.44140625,0.1552564400092829,0.9534662867996201,0.22294372294372294,0.23292620084198512,0.39495497381397815,proxy +3proxy-1.0.2,connect-stream16,0,23.87813376249446,nan,nan,nan,nan,nan,0,0,2273,10.05,10.022922,0.33615708891537044,nan,84.83984375,0.1651376146788991,0.95260663507109,0.2225465158701204,0.2349065392249375,0.40366996576623165,proxy +3proxy-devel-c37,connect-stream16,0,55.7282765843782,nan,nan,nan,nan,nan,0,0,1329,10.04,10.01737,0.14399982158433577,nan,135.359375,0.2014167650531287,0.9516587677725118,0.25911078717201164,0.49720534150637774,0.6247957350605424,proxy +3proxy-bp,connect-stream16,0,48.06442006175804,nan,nan,nan,nan,nan,0,0,4138,10.03,10.018604,0.16671058775388548,nan,102.5,0.2949839914621131,0.9516129032258065,0.3663563829787234,0.4583024021938074,0.6041059361159115,proxy +squid,connect-stream16,0,20.21751439231258,nan,nan,nan,nan,nan,0,0,2,10.05,10.020283000000001,0.3975620905874736,nan,131.6328125,0.24174934197205913,0.95260663507109,0.559538731511657,0.19403694361851256,0.5034311217149849,proxy +tinyproxy,connect-stream16,0,1.498971382009919,nan,nan,nan,nan,nan,0,0,761,10.05,10.033155999999998,5.340257350540639,nan,131.6328125,0.016420752022846263,0.9535104364326376,0.23702031602708803,0.019968581813380543,0.4216488618020299,proxy +direct,connect-ka-1k,0,1.4646509568,143257.39,0.419,0.489,0.557,0.682,0,0,0,1.25,0.0,0.6827565266367769,0.8639308855291576,0.0,0.8122329660445244,0.36231884057971014,0.9579380139152435,2.5266084729133613,0.9571941280400373,origin +3proxy-0.9.9.2,connect-ka-1k,0,0.20963131391999998,20506.54,2.9,3.89,4.95,7.39,0,0,0,10.08,10.073778,38.467535451680675,48.81994255907552,130.73828125,0.43875520173692784,0.9572649572649573,0.4849846299361551,0.605083951461312,0.20812218150496284,proxy +3proxy-1.0.2,connect-ka-1k,0,0.20686307328,20233.97,2.93,3.93,5.01,7.49,0,0,0,10.09,10.092583,39.020980748333585,49.4343708508689,130.77734375,0.4429289303661163,0.9591254752851711,0.48078300310336597,0.601246874545019,0.2156954318644532,proxy +3proxy-devel-c37,connect-ka-1k,0,0.20426260480000002,19979.47,2.97,3.99,5.09,7.71,0,0,0,10.08,10.081244,39.47859182494867,50.04170141784821,132.3046875,0.4453376205787781,0.9581749049429658,0.4823585129055174,0.6002574265419977,0.20910502204091092,proxy +3proxy-bp,connect-ka-1k,0,0.35550920704,34773.68,1.83,2.72,3.86,6.74,0,0,0,10.04,10.030408999999999,22.592945107878123,28.756455165421222,29.03125,0.5288296860133207,0.9534662867996201,0.5751382543880741,1.0415474806550291,0.36304489063363726,client +squid,connect-ka-1k,0,0.43671093248000004,42717.09,1.5,1.64,1.76,1.96,0,0,0,10.05,10.024339000000001,18.410347445030375,23.436844118168334,32.0703125,0.530448717948718,0.9535104364326376,0.5609526055175666,0.9465584940608129,0.31937430032080744,client +tinyproxy,connect-ka-1k,0,0.17758683136,17369.87,3.49,4.36,5.27,7.63,0,0,0,10.1,10.091007999999999,45.49886913416686,57.629652453254366,133.33984375,0.4296970758185957,0.9591642924976258,0.4597457627118644,0.5108336453739523,0.1890773031007725,proxy +direct,connect-ka-50k-2000,0,40.88808865792,99354.79,19.02,20.22,21.34,646.29,0,484,0,0.89,0.0,0.017413384273272603,0.8919435449845212,0.0,0.8241999123191582,0.278125,0.9525766677205185,2.749029410728506,0.9502945187641879,origin +3proxy-0.9.9.2,connect-ka-50k-2000,0,4.8205135872,11710.11,130.78,180.68,232.98,947.46,0,0,0,10.25,10.212255,1.701063559238504,86.73650718432143,434.796875,0.45364126770060686,0.9724857685009488,0.4870603848706038,0.47837472558020994,0.13203897173581636,proxy +3proxy-1.0.2,connect-ka-50k-2000,0,4.79987761152,11660.09,136.61,186.6,235.58,357.21,0,0,0,10.25,10.227587000000002,1.7083768928439962,87.03404941835781,341.4375,0.4507162346521146,0.9743346007604563,0.48655854254610087,0.48898878883682223,0.13402613564296445,proxy +3proxy-devel-c37,connect-ka-50k-2000,0,4.87227129856,11836.05,137.54,186.11,234.15,352.23,0,0,0,10.22,10.2107,1.6780674759257386,85.50512445095168,340.0390625,0.4531196726900784,0.9714828897338403,0.480396575033799,0.5021107523211648,0.13676732006648926,proxy +3proxy-bp,connect-ka-50k-2000,0,9.448928051200001,22909.83,76.42,94.75,95.16,98.25,0,0,0,10.12,10.110752,0.8568167686462402,43.743813405836256,148.6875,0.5258129399932954,0.9610636277302944,0.5584386281588448,0.7244248841287477,0.209865657532939,proxy +squid,connect-ka-50k-2000,0,6.53363511296,15871.93,120.46,122.77,125.92,134.58,0,0,0,10.21,10.187187999999999,1.2501463364242829,63.71294851794072,367.109375,0.23941476391044114,0.9686907020872866,0.26089517078916374,0.37375093199004783,0.11589415790991618,proxy +tinyproxy,connect-ka-50k-2000,0,1.07130912768,2600.1,639.57,762.14,884.31,1640.0,0,85,0,10.22,10.185351,7.631784130977901,389.28884317982704,367.109375,0.358442114273486,0.969639468690702,0.2512051419389395,0.48781833737374025,0.037989842620096526,proxy +direct,connect-ka-2k-50k-2000,0,38.740605009919996,94186.95,19.95,21.15,22.07,613.35,0,523,0,0.53,0.0,0.010944589014328241,0.5602211287927235,0.0,0.843525571273123,0.14058355437665782,0.952803294266709,2.7454804775081203,0.9497799167990597,origin +3proxy-0.9.9.2,connect-ka-2k-50k-2000,0,4.42700398592,10753.98,147.71,195.97,244.4,371.11,0,0,0,10.25,10.230656,1.852268492660034,94.43175117924528,435.7734375,0.4165183339266643,0.9743346007604563,0.484196368527236,0.4556949876563002,0.14067842337512187,proxy +3proxy-1.0.2,connect-ka-2k-50k-2000,0,4.4212158464,10740.19,158.02,203.92,249.97,369.03,0,0,0,10.25,10.229733,1.854693433860936,94.49268949241292,346.2265625,0.4180298719772404,0.9743346007604563,0.4790162454873646,0.45952449230549797,0.14163174892467628,proxy +3proxy-devel-c37,connect-ka-2k-50k-2000,0,4.48102662144,10885.51,147.6,193.78,238.97,358.34,0,0,0,10.25,10.232550999999999,1.8299378005848335,93.229280360911,343.00390625,0.4195841478585392,0.9743346007604563,0.4775510204081633,0.4661715996670399,0.14064288173667566,proxy +3proxy-bp,connect-ka-2k-50k-2000,0,8.76173328384,21307.0,94.97,95.55,96.86,108.86,0,0,0,10.11,10.095965,0.9231050224865185,47.00095768519121,139.7421875,0.47174184346585846,0.9601139601139601,0.5538182642193519,0.6421444298033763,0.2204533096728012,proxy +squid,connect-ka-2k-50k-2000,0,6.27082002432,15233.38,125.78,127.67,128.82,131.47,0,0,0,10.2,10.186057,1.3012652202348705,66.30092821299498,374.58203125,0.2105383211678832,0.9686609686609686,0.26085626911314985,0.3757496036967364,0.1358907987896771,proxy +tinyproxy,connect-ka-2k-50k-2000,0,1.01644763136,2467.29,694.52,812.15,939.36,1690.0,0,67,0,10.23,10.202266,8.05157073271927,410.8598738905177,374.58203125,0.353718303856808,0.9715099715099715,0.25891891891891894,0.4718743539689834,0.045615042356910884,proxy +direct,connect-close-1k,0,0.49668947968,48767.85,0.794,1.14,1.52,2.23,0,0,0,4.6,0.0,7.409055658619742,9.339646392866134,0.0,0.7544343713046906,0.49891540130151846,0.9248840803709428,2.160958190181563,0.8622512257454856,origin +3proxy-0.9.9.2,connect-close-1k,0,0.04253024256,4176.41,5.53,8.96,11.55,14.0,5,0,0,10.09,9.947504,189.7943560658592,239.37179730499145,131.73046875,0.5053581500282008,0.9600380589914367,0.43836534167038854,1.168166471783454,0.07794926969728164,client +3proxy-1.0.2,connect-close-1k,0,0.04194304,4122.38,5.38,8.86,11.61,13.98,7,0,0,10.09,9.947406,192.45147705078125,242.4548250672818,131.59375,0.5029118917903438,0.9591254752851711,0.43869817209094963,1.1538180982289086,0.07696069839477601,client +3proxy-devel-c37,connect-close-1k,0,0.047647293439999995,4680.73,5.09,8.3,10.55,13.2,6,0,0,10.11,10.087175,169.74731230399976,213.84605622184148,134.04296875,0.544677689020992,0.959203036053131,0.4646864686468647,1.2948479740201464,0.08833697355751272,client +3proxy-bp,connect-close-1k,0,0.06140461056,6025.69,3.83,6.31,8.19,10.97,4,0,0,10.1,10.082651,131.58621032381316,165.96555803864862,28.9296875,0.6311667971808927,0.9591642924976258,0.5012208657047724,1.7952906666090818,0.1168842002236186,client +squid,connect-close-1k,0,0.05402263552,5307.69,5.19,7.94,9.37,10.97,0,0,0,10.09,10.031991000000001,149.4188486419109,188.3341110592627,32.6015625,0.5894875659382065,0.9573055028462998,0.4713489409141583,1.501121861730741,0.09316626942432545,client +tinyproxy,connect-close-1k,0,0.04328521728,4248.56,6.41,9.77,12.03,14.81,2,0,0,10.09,9.758813,186.48398939029192,235.17620734663436,126.69921875,0.6222089314194578,0.9518867924528301,0.44609833107803337,1.9605224663700653,0.08551838654771352,client +3proxy-0.9.9.2,connect-stream1-down,1,23.9659799983282,nan,nan,nan,nan,nan,0,0,0,10.01,10.001626,0.3341014211747651,nan,18.921875,0.06848502816483842,0.9515209125475285,0.1562195518025333,0.37669558013560767,0.2261519062963471,proxy +3proxy-1.0.2,connect-stream1-down,1,25.503312739609466,nan,nan,nan,nan,nan,0,0,0,10.01,9.999473,0.31396169020712483,nan,19.34765625,0.19876416065911431,0.9980059820538385,0.09772472957851548,0.425575682890825,0.2285917257461763,proxy +3proxy-devel-c37,connect-stream1-down,1,65.49380598984412,nan,nan,nan,nan,nan,0,0,0,10.0,9.846863,0.12213558175488982,nan,25.57421875,0.13947730398899588,0.949667616334283,0.19330076762037685,0.5260846313390876,0.5036451987682224,proxy +3proxy-bp,connect-stream1-down,1,59.03307286583777,nan,nan,nan,nan,nan,0,0,0,10.01,9.968159,0.1356381370866442,nan,33.19140625,0.10026540843409024,0.9497153700189753,0.1960306406685237,0.5108171014342215,0.4751189710679409,proxy +squid,connect-stream1-down,1,14.882313959977166,nan,nan,nan,nan,nan,0,0,0,10.01,10.003191999999999,0.5380269770531719,nan,22.15625,0.037477691850089236,0.9506172839506173,0.161619283065513,0.2921507221638947,0.1406703069141119,proxy +tinyproxy,connect-stream1-down,1,1.428508522048379,nan,nan,nan,nan,nan,0,0,0,9.98,9.873668,5.588356508027523,nan,22.15625,0.07610673135233474,0.9459715639810427,0.024632117722328855,0.35187519391888517,0.022797919256336563,proxy +direct,connect-stream1-down,1,85.88393578288864,nan,nan,nan,nan,nan,0,0,0,0.02,0.0,0.0001862767939109756,nan,0.0,0.23163398692810458,0.004219409282700422,0.3503623188405797,0.8711581699422377,0.9531491748203459,origin +3proxy-0.9.9.2,connect-stream16,1,24.202010205651128,nan,nan,nan,nan,nan,0,0,1969,10.06,10.039087,0.331050361599768,nan,150.59375,0.15131275909719025,0.9544592030360531,0.23137535816618912,0.22730433261994332,0.40648430234855387,proxy +3proxy-1.0.2,connect-stream16,1,24.10039795697508,nan,nan,nan,nan,nan,0,0,2166,10.04,10.022923,0.3327228469142425,nan,116.44921875,0.15475364330326163,0.9534662867996201,0.23439172315376383,0.2292525389464792,0.41153805994884296,proxy +3proxy-devel-c37,connect-stream16,1,55.00637141862068,nan,nan,nan,nan,nan,0,0,1399,10.03,10.020241,0.14569671213669985,nan,120.20703125,0.20768870135958745,0.9525166191832859,0.25511695906432746,0.5050767609717582,0.6079618623624787,proxy +3proxy-bp,connect-stream16,1,50.26566325271422,nan,nan,nan,nan,nan,0,0,4145,10.03,10.022058000000001,0.15937441220555768,nan,107.54296875,0.28808446455505277,0.9525166191832859,0.35578231292517004,0.4697833377440056,0.6115597483630255,proxy +squid,connect-stream16,1,19.64968864690941,nan,nan,nan,nan,nan,0,0,0,10.05,10.021861,0.409011895762209,nan,122.3984375,0.23515003061849357,0.95260663507109,0.5728155339805825,0.1902472036504495,0.5243674981974735,proxy +tinyproxy,connect-stream16,1,1.5265464474635042,nan,nan,nan,nan,nan,0,0,860,10.04,10.03291,5.242206480546811,nan,122.3984375,0.017619047619047618,0.9534662867996201,0.24277242401779095,0.019972163804678804,0.4207423182370818,proxy +direct,connect-stream16,1,211.17230474447868,nan,nan,nan,nan,nan,0,0,37914,1.68,0.0,0.006363570509552022,nan,0.0,0.7836549375709421,0.4009546539379475,0.9487503954444796,2.933445830724968,2.840757634238759,origin +3proxy-0.9.9.2,connect-ka-1k,1,0.20988297216,20530.26,2.89,3.88,4.95,7.39,0,0,0,10.07,10.076994000000001,38.38329482898057,48.670620248331325,132.75390625,0.4478036635248088,0.9572243346007605,0.4827175208581645,0.6021152345747222,0.25557095724941165,proxy +3proxy-1.0.2,connect-ka-1k,1,0.20820525056,20362.33,2.92,3.92,4.98,7.44,0,0,0,10.08,10.071150999999999,38.73101172189766,49.152988677257966,132.69140625,0.4464700625558534,0.9572649572649573,0.4813307802776448,0.6051245940933976,0.20623161538451776,proxy +3proxy-devel-c37,connect-ka-1k,1,0.20694695936000002,20237.27,2.93,3.93,5.01,7.5,0,0,0,10.08,10.077549,38.96650632093636,49.422666764727516,133.7734375,0.4460521614862451,0.9581749049429658,0.48328195399573154,0.5993677541554078,0.22429109413969528,proxy +3proxy-bp,connect-ka-1k,1,0.36146511872000003,35354.46,1.81,2.66,3.76,6.46,0,0,0,10.05,10.03286,22.242810118084968,28.3178360101437,27.58984375,0.5351923076923077,0.9535104364326376,0.5760019550342131,1.0853034142182862,0.3486879359775507,client +squid,connect-ka-1k,1,0.40500199424,39611.61,1.59,1.7,1.8,1.98,0,0,0,10.04,10.03491,19.83200111167926,25.255129633775464,30.52734375,0.5517847722876736,0.9534662867996201,0.5926357492426008,0.9799029281818158,0.37631536854776804,client +tinyproxy,connect-ka-1k,1,0.17809014784,17417.82,3.5,4.36,5.27,7.61,0,0,0,10.05,10.047533,45.14567536449747,57.38332058148431,132.83984375,0.4267583289264939,0.9553231939163498,0.4607403914171186,0.506110740228867,0.20810631959041764,proxy +direct,connect-ka-1k,1,1.46557370368,143346.27,0.423,0.48,0.534,0.645,0,0,0,0.84,0.0,0.45852351083581355,0.5802283060234605,0.0,0.8066799380667994,0.27450980392156865,0.9573324905183312,2.496762330193406,0.9567305988248448,origin +3proxy-0.9.9.2,connect-ka-50k-2000,1,4.8502931456,11782.45,135.13,185.52,234.2,355.08,0,0,0,10.25,10.227598,1.6906194644005643,86.13590144372175,434.21875,0.4493174061433447,0.9743346007604563,0.4858857523894199,0.4851499543448589,0.1340134162779713,proxy +3proxy-1.0.2,connect-ka-50k-2000,1,4.80784678912,11679.48,136.32,183.98,231.69,346.8,2,0,0,10.23,10.210108,1.7022173041204485,86.76476824562147,341.28125,0.45082665757627405,0.9724334600760456,0.4834260289210234,0.48710841555321,0.13211991468754933,proxy +3proxy-devel-c37,connect-ka-50k-2000,1,4.832425410560001,11739.12,136.96,184.44,232.05,351.13,0,0,0,10.2,10.188036,1.6885930576741972,86.04980765337113,340.30078125,0.45557816208884366,0.9705042816365367,0.47808496291301417,0.49754257734976787,0.13589031233801319,proxy +3proxy-bp,connect-ka-50k-2000,1,9.363028705280001,22750.16,76.68,94.77,95.14,98.28,0,0,0,10.11,10.096994,0.8638230485653658,44.007800393501995,140.04296875,0.5275328564298786,0.9601139601139601,0.5636978579481398,0.7075378077385205,0.21379386432407954,proxy +squid,connect-ka-50k-2000,1,6.61424963584,16067.75,120.91,123.17,126.79,128.67,0,0,0,10.18,10.15746,1.2312810142318924,62.74306775388446,367.99609375,0.24500548847420417,0.9667616334283001,0.2609849601887349,0.36434753157266253,0.11688665248467467,proxy +tinyproxy,connect-ka-50k-2000,1,1.07021860864,2595.37,613.3,735.06,851.3,1600.0,0,49,0,10.22,10.178583999999999,7.639560678532587,390.2848850530818,367.99609375,0.3600085360648741,0.969639468690702,0.2520064205457464,0.485985969259313,0.03800044534489892,proxy +direct,connect-ka-50k-2000,1,40.11499454464,97418.71,19.25,20.61,22.09,919.08,0,394,0,0.82,0.0,0.016352987391535168,0.8375620000163426,0.0,0.8319107025607354,0.24773413897280966,0.9525015832805573,2.7970728671142133,0.9486813710391778,origin +3proxy-0.9.9.2,connect-ka-2k-50k-2000,1,4.42784284672,10756.35,152.91,200.16,247.11,367.4,0,3,0,10.25,10.233879,1.8519175778955863,94.36046618673245,436.12890625,0.41872446260437024,0.9752616555661275,0.48138178555406014,0.4575519754138585,0.14066215314112102,proxy +3proxy-1.0.2,connect-ka-2k-50k-2000,1,4.44613001216,10800.83,154.11,201.41,248.23,367.9,0,0,0,10.24,10.219972,1.8425012263688165,93.88380046025067,343.96484375,0.4155960028551035,0.973384030418251,0.47854561878952123,0.4565594298137697,0.142517041852416,proxy +3proxy-devel-c37,connect-ka-2k-50k-2000,1,4.43228880896,10767.08,153.28,197.85,243.25,366.92,0,2,0,10.23,10.211622,1.8464500741593841,94.07502092088686,343.65234375,0.41938920454545453,0.9724334600760456,0.475391245180313,0.4632985615858626,0.1435442386552631,proxy +3proxy-bp,connect-ka-2k-50k-2000,1,8.933531975680001,21632.94,94.8,95.45,95.97,101.71,0,0,0,10.12,10.101526999999999,0.9062485052989079,46.33763284294198,143.3046875,0.4703982777179763,0.9610636277302944,0.5473034734917733,0.6506125172016121,0.21758752619953797,proxy +squid,connect-ka-2k-50k-2000,1,6.275014328319999,15243.64,126.1,129.08,134.58,138.68,0,0,0,10.18,10.171068,1.2978456420800526,66.12021148075499,375.34765625,0.2171945701357466,0.967680608365019,0.2567650676506765,0.37385085565061993,0.1368191154483921,proxy +tinyproxy,connect-ka-2k-50k-2000,1,1.01896421376,2472.04,685.25,795.41,918.06,1670.0,0,80,0,10.21,10.188286,8.015983181450412,409.2676474125145,375.34765625,0.3522630230572161,0.970532319391635,0.2580906148867314,0.4717417151511266,0.04464671087016455,proxy +direct,connect-ka-2k-50k-2000,1,38.05341024256,92520.95,20.01,21.39,22.93,605.61,0,523,0,0.65,0.0,0.013665003916479934,0.6987827205008874,0.0,0.8413251961639059,0.16539440203562342,0.9537242472266244,2.7118626291696644,0.9509766748442162,origin +3proxy-0.9.9.2,connect-close-1k,1,0.04160749568,4084.68,5.72,9.31,11.86,14.38,5,0,0,10.1,9.942900999999999,194.1957781391759,244.84848484848484,131.671875,0.5020731247644177,0.9600760456273765,0.43827022182388525,1.1596766368842404,0.07886486609675457,client +3proxy-1.0.2,connect-close-1k,1,0.04185915392,4112.32,6.29,9.89,12.07,14.55,1,0,0,10.08,9.920853,192.646034256012,243.39007605939878,133.7890625,0.5021539614159956,0.9572649572649573,0.4384082271406215,1.148249034426548,0.07696599864739197,client +3proxy-devel-c37,connect-close-1k,1,0.04798283776,4711.81,4.76,7.8,10.13,12.92,8,0,0,10.09,10.072065,168.22681560382978,212.15306980656013,134.28125,0.5446428571428571,0.9582146248812915,0.4655248133509003,1.2956326456017875,0.0864938153044664,client +3proxy-bp,connect-close-1k,1,0.061069066240000004,6000.08,3.98,6.44,8.33,11.06,4,0,0,10.09,10.076992,132.17821226015195,166.61712738201393,30.484375,0.6298828125,0.9582146248812915,0.4975402504472272,1.7877808911448785,0.11589253315479825,client +squid,connect-close-1k,1,0.05528092672,5428.48,4.95,7.65,9.16,10.27,1,0,0,10.1,10.049688,146.16252800763468,184.40078872416564,31.6484375,0.596629213483146,0.957345971563981,0.47211066488174924,1.529055213104942,0.0940290080994465,client +tinyproxy,connect-close-1k,1,0.043536875520000004,4278.93,6.43,9.72,12.0,14.91,1,0,0,10.08,9.757551000000001,185.22229497832367,233.19838056680163,129.40234375,0.6248999199359487,0.9509433962264151,0.44746906636670414,1.9802612313450403,0.0855084295333489,client +direct,connect-close-1k,1,0.5217714176,51237.02,0.766,1.1,1.45,2.1,0,0,0,4.62,0.0,7.083561642760249,8.92807105353171,0.0,0.7748021911138162,0.5202702702702703,0.9277295285359801,2.2736648296825566,0.8716663479844435,origin +3proxy-1.0.2,connect-stream1-down,2,25.630866171536738,nan,nan,nan,nan,nan,0,0,0,10.01,10.001537,0.31239999205529057,nan,20.0625,0.09359886201991466,0.9515209125475285,0.16075496257728605,0.37958073921479807,0.23946030862324538,proxy +3proxy-devel-c37,connect-stream1-down,2,59.61633732824817,nan,nan,nan,nan,nan,0,0,0,10.01,9.885950999999999,0.13431040477271328,nan,24.609375,0.10890233362143474,0.9506172839506173,0.2857993450431676,0.4946192735183446,0.5587095185768338,proxy +3proxy-bp,connect-stream1-down,2,59.57776005231409,nan,nan,nan,nan,nan,0,0,0,10.01,9.933894,0.13439738572265425,nan,34.4375,0.12868480725623582,0.9506172839506173,0.2526115859449193,0.5041195557687052,0.5244806183575299,proxy +squid,connect-stream1-down,2,15.592732406100058,nan,nan,nan,nan,nan,0,0,0,10.01,10.002137000000001,0.5135134867154774,nan,22.67578125,0.16773715415019763,0.9506172839506173,0.05378209576682859,0.2815508685820165,0.13966035156490672,proxy +tinyproxy,connect-stream1-down,2,1.485032713147802,nan,nan,nan,nan,nan,0,0,0,10.0,9.980116,5.386468886790454,nan,22.67578125,0.07852123434158265,0.9505703422053232,0.031092964824120602,0.35388452637199735,0.014254587051252368,proxy +direct,connect-stream1-down,2,58.09542404646445,nan,nan,nan,nan,nan,0,0,0,0.01,0.0,0.00013768686711801946,nan,0.0,0.17191601049868765,0.0018726591760299626,0.31759112519809823,0.6421160735704475,0.9492749724994991,origin +3proxy-0.9.9.2,connect-stream1-down,2,24.403242794589435,nan,nan,nan,nan,nan,0,0,1,10.01,10.00052,0.32814106652091857,nan,19.51953125,0.07898571844943165,0.9506172839506173,0.10125260960334029,0.36818167936479507,0.22039219986912975,proxy +3proxy-1.0.2,connect-stream16,2,24.458941270992312,nan,nan,nan,nan,nan,0,0,1994,10.04,10.023452,0.3278707040044772,nan,147.84765625,0.16621376811594202,0.952561669829222,0.22857142857142856,0.22918724816411978,0.41303972592335436,proxy +3proxy-devel-c37,connect-stream16,2,54.7961097103034,nan,nan,nan,nan,nan,0,0,1287,10.03,10.01887,0.14627096813665755,nan,131.71484375,0.20023640661938535,0.9525166191832859,0.24879495736002966,0.49716939395934545,0.622772195865557,proxy +3proxy-bp,connect-stream16,2,46.351971611169816,nan,nan,nan,nan,nan,0,0,4232,10.03,10.015389,0.17295443987035108,nan,115.65625,0.29141759180187876,0.9516129032258065,0.3781947589776771,0.43467887796974164,0.588557346866748,proxy +squid,connect-stream16,2,20.032479632667183,nan,nan,nan,nan,nan,0,0,0,10.04,10.019187,0.4007970044200672,nan,112.71484375,0.25140336808340014,0.952561669829222,0.5706635622817229,0.19406203717120835,0.529216998381628,proxy +tinyproxy,connect-stream16,2,1.539482351394383,nan,nan,nan,nan,nan,0,0,406,10.06,10.034099999999999,5.207035887678087,nan,112.71484375,0.012189292543021032,0.9535545023696682,0.24316334072431633,0.01901938203913265,0.4226716264985279,proxy +direct,connect-stream16,2,205.6166216087328,nan,nan,nan,nan,nan,0,0,5326,1.38,0.0,0.005367937091805259,nan,0.0,0.8279494382022472,0.3719676549865229,0.9913707268503154,2.9269882151242146,2.948672373701367,origin +3proxy-0.9.9.2,connect-stream16,2,24.13012913796039,nan,nan,nan,nan,nan,0,0,2025,10.06,10.038202,0.33210321141793014,nan,133.1875,0.15251499769266266,0.9544592030360531,0.21070110701107012,0.23589313108839058,0.40200739931374246,proxy +3proxy-1.0.2,connect-ka-1k,2,0.2046820352,20019.3,2.96,3.99,5.1,7.68,0,0,0,10.08,10.080424,39.39769307120901,49.94574346320218,132.84375,0.4441446303291959,0.9590865842055185,0.480296154764748,0.6050756067399772,0.2433398368737028,proxy +3proxy-devel-c37,connect-ka-1k,2,0.20896022528,20435.9,2.9,3.89,4.94,7.37,0,0,0,10.08,10.081488,38.59107631222401,48.921352131815866,132.28125,0.4441060551773558,0.9581749049429658,0.48297213622291024,0.6029490792471448,0.21088410590087,proxy +3proxy-bp,connect-ka-1k,2,0.35911630848000003,35124.87,1.82,2.71,3.87,6.66,0,0,0,10.05,10.037359,22.388289838548967,28.4897861990373,29.28125,0.5402542372881356,0.9544159544159544,0.5764127764127764,1.1138076022557126,0.3306287746004086,client +squid,connect-ka-1k,2,0.43167776768,42223.82,1.5,1.62,1.72,1.91,0,0,0,10.04,10.02858,18.606471311151864,23.713249187514172,33.16015625,0.5359699355762347,0.9534662867996201,0.5778141820734847,0.9787060868580857,0.3155472326651132,client +tinyproxy,connect-ka-1k,2,0.17867735040000002,17477.81,3.48,4.33,5.24,7.63,0,0,0,10.07,10.064975,45.086856179394076,57.18211965656658,132.84765625,0.42821912982208915,0.9572243346007605,0.4608654528257271,0.5079650911404708,0.20532144931065777,proxy +direct,connect-ka-1k,2,1.4527391334400002,142088.88,0.427,0.514,0.583,0.7020000000000001,0,0,0,0.73,0.0,0.4019992210281571,0.508667555789682,0.0,0.8048452220726783,0.24333333333333335,0.956700379266751,2.515857164015704,0.9562691308373252,origin +3proxy-0.9.9.2,connect-ka-1k,2,0.20770193408,20317.71,2.92,3.92,4.99,7.43,0,0,0,10.09,10.079519,38.86338389555356,49.25242723185739,130.75,0.44438464298528885,0.9582146248812915,0.4862428842504744,0.6039950784768858,0.24892278006551274,proxy +3proxy-1.0.2,connect-ka-50k-2000,2,4.81749368832,11702.87,119.08,171.63,220.74,337.27,1,0,0,10.22,10.203230000000001,1.697148046051973,86.50680119518204,342.12890625,0.4550193374810829,0.9705603038936372,0.48939929328621906,0.4820683231435726,0.13583716538700036,proxy +3proxy-devel-c37,connect-ka-50k-2000,2,4.84215619584,11762.76,135.35,185.53,233.59,358.74,0,0,0,10.22,10.202957,1.688503978253361,86.01535146781578,339.7421875,0.45639288738357325,0.9705603038936372,0.4819304152637486,0.500254742179588,0.13298217616320282,proxy +3proxy-bp,connect-ka-50k-2000,2,9.448928051200001,22907.12,76.08,94.71,95.14,98.15,0,0,0,10.12,10.100482,0.8568167686462402,43.768408032281364,146.71875,0.5279627163781625,0.9601518026565465,0.560063105702051,0.7181135211405967,0.21094940606106521,proxy +squid,connect-ka-50k-2000,2,6.66483294208,16190.67,119.9,122.92,126.87,129.96,0,0,0,10.18,10.177434,1.221936104141625,62.26299694189603,368.234375,0.23834886817576564,0.967680608365019,0.2503725782414307,0.37285359543878605,0.11399704727191552,proxy +tinyproxy,connect-ka-50k-2000,2,1.07768446976,2615.89,650.33,761.15,879.24,1600.0,0,71,0,10.22,10.172157000000002,7.5866361902949135,387.1065489943563,368.234375,0.3607540702656384,0.969639468690702,0.2566300562550228,0.48605358403992843,0.038017018679288056,proxy +direct,connect-ka-50k-2000,2,40.45859192832,98306.12,18.93,20.38,21.47,648.88,0,500,0,0.89,0.0,0.01759823973264917,0.9010586933434036,0.0,0.8208889862053864,0.27899686520376177,0.9489375198223914,2.7395338769561906,0.9491420300997876,origin +3proxy-0.9.9.2,connect-ka-50k-2000,2,4.7968577126400005,11652.82,135.73,186.49,235.78,357.97,0,0,0,10.25,10.230551,1.7094524147323615,87.11171546339183,433.4375,0.44867634500426984,0.9752616555661275,0.4836266429048786,0.4869629883768589,0.13301921725146615,proxy +3proxy-1.0.2,connect-ka-2k-50k-2000,2,4.4153438208,10725.82,156.08,202.35,248.21,366.78,0,1,0,10.22,10.208542,1.8517244255099983,94.37621202327085,343.96875,0.4186500888099467,0.9714828897338403,0.477051774813475,0.457424663110013,0.14061927373675875,proxy +3proxy-devel-c37,connect-ka-2k-50k-2000,2,4.47221858304,10864.27,149.1,193.35,237.61,351.11,0,0,0,10.23,10.219975,1.829964222016382,93.23903097030569,341.97265625,0.4178545972915182,0.9724334600760456,0.47794616602578605,0.46802206827805004,0.14150795335543428,proxy +3proxy-bp,connect-ka-2k-50k-2000,2,8.76173328384,21358.12,94.86,95.61,96.65,114.64,0,0,0,10.12,10.099170999999998,0.9240180838341807,46.9213649851632,140.37890625,0.47369356558833986,0.9610636277302944,0.5483870967741935,0.64095433730073,0.220449369143172,proxy +squid,connect-ka-2k-50k-2000,2,6.17611264,15003.46,126.3,129.32,133.86,139.81,0,0,0,10.17,10.161091,1.3173334869747453,67.130928413479,381.57421875,0.20924960326456585,0.9667300380228137,0.2603911980440098,0.3680043166713748,0.13493129027354347,proxy +tinyproxy,connect-ka-2k-50k-2000,2,1.01854478336,2471.97,670.58,778.91,890.88,1650.0,1,91,0,10.23,10.182705000000002,8.034992799238951,409.92146177271997,381.57421875,0.3527535615564533,0.9696682464454977,0.2615591397849462,0.46399179131693835,0.04465644847103672,proxy +direct,connect-ka-2k-50k-2000,2,36.9367187456,89826.42,21.31,22.27,23.21,725.68,0,511,0,0.97,0.0,0.021008904590163118,1.0736608847629812,0.0,0.8437022484173761,0.23891625615763548,0.9476854787571338,2.724321900837763,0.9488234548452247,origin +3proxy-0.9.9.2,connect-ka-2k-50k-2000,2,4.43094663168,10763.85,144.54,194.74,243.17,364.05,0,0,0,10.24,10.222351999999999,1.8488148652997858,94.28229444802504,435.4921875,0.41850142045454547,0.973384030418251,0.4881348414282546,0.45555464714933636,0.13965444554407522,proxy +3proxy-1.0.2,connect-close-1k,2,0.04185915392,4109.48,6.18,9.77,12.04,14.3,1,0,0,10.1,9.948122,193.02826845096442,243.49083895853423,131.62109375,0.5016930022573364,0.9600760456273765,0.43846671149966376,1.1530119871823354,0.07792121657289715,client +3proxy-devel-c37,connect-close-1k,2,0.04747952128,4658.69,5.27,8.44,10.68,13.38,4,0,0,10.1,10.080138000000002,170.1786324329174,214.72001360602067,132.953125,0.5439346089541148,0.9582542694497154,0.46547933157431837,1.2904637547218756,0.08739065421153389,client +3proxy-bp,connect-close-1k,2,0.0612368384,6009.73,4.17,6.7,8.52,11.31,0,0,0,10.09,10.065294,131.81608017176796,166.26843536293978,30.625,0.6303077522399688,0.9563981042654028,0.5002222222222222,1.787091768399936,0.11772387488586802,client +squid,connect-close-1k,2,0.05519704064,5423.25,4.98,7.75,9.16,10.25,0,0,0,10.12,10.068928,146.67453012205547,184.75919231752292,31.25390625,0.5940315315315315,0.9601518026565465,0.47224080267558527,1.5226228433491389,0.09404835214295411,client +tinyproxy,connect-close-1k,2,0.04370464768,4294.36,6.3,9.63,11.91,14.62,1,0,0,10.08,9.770798,184.5112688939539,232.47768629350307,131.46484375,0.6238495398159264,0.9518413597733711,0.445293192541002,1.971273090377357,0.08454798623470668,client +direct,connect-close-1k,2,0.51556384768,50622.93,0.772,1.1,1.44,2.04,0,0,0,4.55,0.0,7.060231271800257,8.89907664745379,0.0,0.7706403544099879,0.5170454545454546,0.9238828967642527,2.2665310648973818,0.8641185679248727,origin +3proxy-0.9.9.2,connect-close-1k,2,0.04219469824,4145.43,6.19,9.75,11.96,14.29,2,0,0,10.11,9.94664,191.68284967926812,241.6636787378989,131.80859375,0.5026335590669676,0.9601139601139601,0.438953488372093,1.159662328066675,0.07699378460884522,client diff --git a/bench/data/results-full7/arm-mix.csv b/bench/data/results-full7/arm-mix.csv new file mode 100644 index 0000000..fd4c194 --- /dev/null +++ b/bench/data/results-full7/arm-mix.csv @@ -0,0 +1,103 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,mix-http,0,19.794953065599998,54160.7,32.768,36.864,49.152,86.016,0,0,0,9.31,0.0,0.37625752257747247,17.189585806682704,0.0,0.8408886894075404,0.723950233281493,0.9368225456797771,2.735290714090793,2.7593180108064534,origin +3proxy-0.9.9.2,mix-http,0,1.795016592,4900.7,11.776,19.456,51.2,6553.6,0,0,0,10.05,10.080311,4.479067233045387,205.0727447099394,3030.53515625,0.32574568288854006,1.0,0.3416083916083916,0.7993437623235738,0.6463634259854706,proxy +3proxy-1.0.2,mix-http,0,1.9585518584000001,5372.8,10.24,17.408,34.816,6029.312,0,0,0,10.13,10.05231,4.13775104562225,188.54228707564027,2546.92578125,0.30965535385424886,1.0,0.336062655749377,0.7604533255416934,0.6479541330450379,proxy +3proxy-devel-c37,mix-http,0,2.0530599224,5639.8,9.728,16.384,32.768,5767.168,0,0,0,10.59,10.481345000000001,4.126523491869806,187.77261605021454,1675.72265625,0.3233593160673875,1.0,0.36785833611760776,0.7794015411532348,0.6811850226895875,proxy +3proxy-bp,mix-http,0,3.1274260791999997,8638.1,163.84,212.992,311.296,1966.08,0,0,0,10.62,10.557866,2.716610971720645,122.94370289762794,759.02734375,0.3866632860040568,1.0,0.43061889250814334,0.9563450161108079,0.7914821158717757,client +nginx,mix-http,0,3.3809199328000004,9217.2,3.968,5.632,11.264,3276.8,0,0,0,10.12,10.064848,2.3946145312276235,109.79473158876883,197.22265625,0.41494347945960847,0.9970443349753695,0.37331536388140163,1.06221603299338,0.6993015944641544,client +nginx-halfclose,mix-http,0,3.3641017991999997,9175.2,3.968,5.632,11.264,3276.8,0,0,0,10.18,10.126061,2.42085420897093,110.95125991803994,191.22265625,0.4129655172413793,1.0,0.37759197324414717,1.0671590561598732,0.7032098682175341,client +haproxy,mix-http,0,2.711764836,7463.6,245.76,253.952,311.296,1835.008,0,0,0,10.19,10.114469,3.0061603763638445,136.52928881504903,312.8671875,0.49709148598625064,1.0,0.27419910437478473,1.2540066439927422,0.5278212942265451,client +haproxy-splice-auto,mix-http,0,3.3801693231999996,9264.3,204.8,212.992,229.376,1835.008,0,0,0,10.21,10.156621,2.416446993923775,110.20800276329567,305.88671875,0.46344029458179903,1.0,0.2920568851890392,1.16210144538938,0.5817266786336159,client +envoy,mix-http,0,2.5666260024,7082.8,262.144,278.528,311.296,376.832,0,0,0,10.2,10.117404,3.1792711491155115,144.01084316936806,634.34765625,0.3419185282522996,1.0,0.2815198618307427,0.8893134505860811,0.5431089724819883,proxy +squid,mix-http,0,1.053104052,3017.8,253.952,458.752,1048.576,4980.736,0,0,0,10.11,10.056495000000002,7.680152768038158,335.0122605871827,874.953125,0.3503033500395674,1.0,0.14845844504021447,0.9452762197066337,0.2540467060727925,client +tinyproxy,mix-http,0,0.738449252,1859.5,688.128,1048.576,3014.656,5242.88,11770,0,0,10.45,10.216966999999997,11.321021691548818,561.9790266200591,970.015625,0.28761283851554664,0.9952380952380953,0.2701600251019768,0.636487735831774,0.3970107641963103,proxy +direct,mix-connect,0,19.797876293599998,54188.2,32.768,36.864,51.2,86.016,0,0,0,9.36,0.0,0.37822238552024,17.27313326517581,0.0,0.8393296089385475,0.7422680412371134,0.9364197530864198,2.716183113272279,2.751536707683601,origin +3proxy-0.9.9.2,mix-connect,0,2.1952757712,5860.7,21.504,180.224,344.064,4980.736,0,0,0,10.41,10.296287,3.7936008356014783,177.62383333048953,3373.12109375,0.3408400809716599,1.0,0.35764235764235763,0.8582793349833621,0.6335607988122682,proxy +3proxy-1.0.2,mix-connect,0,2.3292030911999997,6172.8,17.408,163.84,327.68,4718.592,0,0,0,10.48,10.341428,3.599514371106464,169.77708657335407,2602.703125,0.3428063943161634,1.0,0.36938435940099834,0.8752493517474875,0.6586017343792605,proxy +3proxy-devel-c37,mix-connect,0,2.2355511632,5962,20.48,188.416,376.832,4718.592,0,0,0,10.4,10.245539999999998,3.7216772923642836,174.43810801744382,1595.6640625,0.3339340885684861,1.0,0.3572860962566845,0.8562610231276709,0.6326364939422954,proxy +3proxy-bp,mix-connect,0,3.5665425832,9748.6,126.976,196.608,294.912,1376.256,0,0,0,10.36,10.317496,2.323819162861019,106.27166977822456,493.29296875,0.42221644120707597,1.0,0.42819060313228924,1.1099038575293911,0.7886546587723522,client +squid,mix-connect,0,3.070350588,8161,10.24,81.92,155.648,3276.8,391,0,0,10.52,10.485902,2.7410550550457202,128.90577135155004,3035.5234375,0.3382722250125565,1.0,0.33475549721037084,0.8469648643487819,0.605885745928542,proxy +tinyproxy,mix-connect,0,0.7939468272000001,2354.5,491.52,655.36,819.2,4456.448,104,0,0,10.54,10.402631,10.620358582119414,447.6534296028881,1131.78125,0.3404408241494969,1.0,0.22893830253679925,0.6128237483957836,0.3224601248624998,proxy +direct,mix-socks,0,19.0042182768,51945,34.816,38.912,53.248,90.112,0,0,0,9.38,0.0,0.39485970381432345,18.0575608817018,0.0,0.8415069103878734,0.7534136546184739,0.9416511483550589,2.7189082606842825,2.778317110046126,origin +3proxy-0.9.9.2,mix-socks,0,2.4171226472,6414.2,15.872,139.264,311.296,4456.448,0,0,0,10.44,10.352677,3.4553480394033684,162.76386766861026,2148.42578125,0.3439180537772087,1.0,0.37192282102461743,0.871345561793146,0.6565198407527402,proxy +3proxy-1.0.2,mix-socks,0,2.3995909591999998,6363.7,16.384,139.264,294.912,4456.448,0,0,0,10.6,10.479523,3.5339356349413604,166.56976287379985,2181.83984375,0.3415554996224516,1.0,0.366918280275681,0.8393286162672983,0.6517361618414326,proxy +3proxy-devel-c37,mix-socks,0,2.3492179064000003,6235,20.48,172.032,360.448,4456.448,0,0,0,10.34,10.179675,3.5211718663749756,165.83801122694467,1519.0078125,0.34146974811737213,1.0,0.3615876219307097,0.8633440995280395,0.6424400107320242,proxy +3proxy-bp,mix-socks,0,3.6632268216,10013.5,147.456,196.608,253.952,1114.112,0,0,0,10.55,10.485116999999999,2.303979636268778,105.35776701453038,525.9453125,0.4247720364741641,1.0,0.4106090373280943,1.0325319757250313,0.7452378069006819,client +direct,mix-relay,0,18.979607004,51913.6,34.816,38.912,53.248,90.112,0,0,0,9.34,0.0,0.3936857068971585,17.991431917647784,0.0,0.8364569388665775,0.7400950871632329,0.9339913633559531,2.71287147463709,2.746431595126848,origin +3proxy-0.9.9.2,mix-relay,0,2.4256846304,6652.8,8.704,14.848,28.672,4456.448,0,0,0,10.14,10.067421,3.344210495600294,152.4170274170274,1936.73046875,0.349059104161145,1.0,0.37874564459930316,0.8783405384565225,0.6969932695601385,proxy +3proxy-1.0.2,mix-relay,0,2.3861763328000003,6531.1,8.704,14.848,26.624,4718.592,0,0,0,10.58,10.507377,3.54709745614991,161.99415106184256,1952.1015625,0.3358624178047547,1.0,0.38018433179723504,0.8326902323025452,0.6910360799309808,proxy +3proxy-devel-c37,mix-relay,0,2.3053333936,6302.4,13.312,19.456,36.864,4718.592,0,0,0,10.13,10.060789999999999,3.515326686586023,160.73241939578574,1319.7734375,0.34185984545696774,1.0,0.3749131341209173,0.8732273310199703,0.6912089667681078,proxy +3proxy-bp,mix-relay,0,3.536019876,9700.5,102.4,139.264,221.184,2228.224,0,0,0,10.6,10.543208,2.398176565000733,109.27271790113912,479.93359375,0.4107097751957565,1.0,0.41313628899835797,1.040947822082047,0.7744741509467784,client +nginx,mix-relay,0,3.2302702871999998,8898.3,3.712,5.632,12.8,3276.8,427,0,0,10.16,10.106793,2.516198112649377,114.17911286425498,790.9609375,0.41715076071922547,1.0,0.4692467173462336,1.0780617378788107,0.8555093662715194,client +nginx-halfclose,mix-relay,0,3.237894164,8906.2,3.84,5.632,12.288,3276.8,0,0,0,10.15,10.092082,2.5078027843778528,113.96555208730996,794.3203125,0.41832779623477295,1.0,0.4720583130857341,1.0820033083005072,0.8649135323425757,client +haproxy,mix-relay,0,2.3789442951999997,7373.2,12.8,94.208,655.36,3538.944,0,0,0,10.15,10.083764,3.413278745695617,137.66071719199263,473.5859375,0.43914473684210525,1.0,0.38959260527216705,1.2019323808483866,0.7135933173658121,client +haproxy-splice-auto,mix-relay,0,3.1009686735999997,8856.2,11.776,65.536,262.144,3014.656,0,0,0,10.17,10.112971,2.6236962886034876,114.83480499537048,362.44140625,0.43028977583378897,1.0,0.417261297995243,1.1829834807484232,0.7466094250757741,client +envoy,mix-relay,0,2.8113772008,7740.9,245.76,262.144,278.528,393.216,0,0,0,10.63,10.569713,3.0248520182848884,137.32253355552973,643.56640625,0.36067642604745076,1.0,0.39935275080906146,0.932577068296679,0.7072938377474999,client +3proxy-0.9.9.2,mix-http,1,1.4366104064,3927.4,13.824,23.552,55.296,8388.608,0,0,0,10.6,10.504797,5.902783358816132,269.89866069155164,2957.95703125,0.29313315284272706,1.0,0.3127297026394921,0.7068348078678484,0.6115537521869744,proxy +3proxy-1.0.2,mix-http,1,1.5446761984000001,4233.7,8.704,15.36,34.816,7864.32,0,0,0,10.59,10.48782,5.484644619225331,250.1358150081489,2409.98046875,0.28413011335633315,1.0,0.317188025563404,0.6774381843738209,0.6117991675651127,proxy +3proxy-devel-c37,mix-http,1,1.959934276,5376.7,10.752,17.408,29.696,6029.312,0,0,0,10.12,10.068814,4.130750759930074,188.21953986646085,1665.54296875,0.3301047120418848,0.9990128331688055,0.36253041362530414,0.806279821700092,0.6776624749941053,proxy +3proxy-bp,mix-http,1,3.1317099808,8643.1,131.072,180.224,278.528,2097.152,0,0,0,10.15,10.082014000000001,2.59283268558787,117.43471671043955,688.828125,0.4069643806485912,1.0,0.42589437819420783,1.0251499742078065,0.7937756262998508,client +nginx,mix-http,1,3.3485291576,9122.7,3.968,5.632,11.264,3407.872,0,0,0,10.18,10.121412,2.4321126132397395,111.58977057230864,191.53515625,0.4142581888246628,1.0,0.3705072220356063,1.0701808632270566,0.7061969740710399,client +nginx-halfclose,mix-http,1,3.3728170856,9200.3,3.968,5.632,11.264,3276.8,0,0,0,10.17,10.114952,2.4122268695613727,110.53987369977067,187.6328125,0.4167124793842771,1.0,0.37190635451505016,1.0701845091081714,0.7008803280335233,client +haproxy,mix-http,1,2.7296350472,7532.6,245.76,262.144,294.912,2228.224,0,0,0,10.19,10.127232,2.9864798257049574,135.2786554443353,311.0234375,0.4996068152031455,1.0,0.26987951807228916,1.2489098289809548,0.5265292488607348,client +haproxy-splice-auto,mix-http,1,3.4109134264,9336.2,196.608,204.8,221.184,1835.008,0,0,0,10.2,10.135572,2.392321053018445,109.25215826567555,307.9765625,0.46540880503144655,1.0,0.292239010989011,1.155083573434992,0.5689696927229234,client +envoy,mix-http,1,2.6278125624,7254.4,262.144,278.528,311.296,360.448,0,0,0,10.18,10.124412,3.0991555929552397,140.32862814292017,634.78515625,0.3419320873914188,1.0,0.27722087798133427,0.88534382919611,0.5389199717240971,proxy +squid,mix-http,1,1.0567174664,3022.1,253.952,458.752,1048.576,5242.88,0,0,0,10.12,10.06629,7.6614613247392045,334.8664835710268,868.60546875,0.3518567289965762,1.0,0.1433860652978795,0.9462727944616347,0.25384429770579214,client +tinyproxy,mix-http,1,0.7412268904,1838.5,655.36,1015.808,3145.728,5767.168,11858,0,0,10.43,10.152458,11.257012000060055,567.3103073157465,979.54296875,0.2982412682685162,0.9961795606494747,0.2565579014715291,0.6342658685417152,0.39163049944493766,proxy +direct,mix-http,1,19.806612056,54190.4,32.768,36.864,49.152,86.016,0,0,0,9.4,0.0,0.37967119155655765,17.34624582951962,0.0,0.8732230249359124,0.7730263157894737,0.9809184993531694,2.8219591182555575,2.8907518532030543,origin +3proxy-0.9.9.2,mix-connect,1,2.0762769432,5478.3,30.72,188.416,344.064,5505.024,1,0,0,10.24,10.17454,3.9455237543476858,186.91929978277932,3263.07421875,0.33624454148471616,1.0,0.34645402103834405,0.850073215770465,0.6237232231766127,proxy +3proxy-1.0.2,mix-connect,1,2.2088609624,5901.7,22.528,163.84,344.064,4980.736,0,0,0,10.28,10.193897,3.7231859044058404,174.18709863259738,2597.65625,0.3397804495556717,1.0,0.36774193548387096,0.8842359523919442,0.6641765295365998,proxy +3proxy-devel-c37,mix-connect,1,2.2840790368,6159.3,18.432,172.032,344.064,4718.592,0,0,0,10.23,10.097927000000002,3.583063400234084,166.09030246943647,1626.05078125,0.34729448491155046,1.0,0.36441256830601093,0.87725549539056,0.6530300823924595,proxy +3proxy-bp,mix-connect,1,3.6363378512,9933.8,163.84,196.608,262.144,753.664,0,0,0,10.29,10.233101,2.263816052538523,103.58573758279812,518.99609375,0.42738373603533386,1.0,0.424689701442469,1.090105705089416,0.7680079628990171,client +squid,mix-connect,1,2.8925076344000002,7663.7,11.776,90.112,155.648,3538.944,359,0,0,10.24,10.193774000000001,2.832144642445961,133.61692133042786,2809.4453125,0.33928109645720195,1.0,0.3247718823927002,0.8941963049815845,0.592013088372156,proxy +tinyproxy,mix-connect,1,0.8332096008,2426.2,458.752,655.36,819.2,4718.592,108,0,0,10.42,10.283408999999999,10.004685486096477,429.4781963564422,1134.80078125,0.3394338701805759,1.0,0.2297254654465131,0.6425109978658229,0.3195625094808054,proxy +direct,mix-connect,1,19.6014615104,53614.5,32.768,36.864,51.2,86.016,0,0,0,9.4,0.0,0.38364486219612215,17.532570480000746,0.0,0.8375224416517055,0.7513988808952837,0.939938080495356,2.6906460265571477,2.7634768824772706,origin +3proxy-0.9.9.2,mix-socks,1,2.3120251632,6132.2,18.432,147.456,294.912,4456.448,0,0,0,10.54,10.375653,3.647019130332275,171.87958644532142,2096.6484375,0.3444639718804921,1.0,0.3611663353214049,0.8269598485754991,0.6453871958787567,proxy +3proxy-1.0.2,mix-socks,1,2.379709576,6302.4,10.752,147.456,311.296,4718.592,0,0,0,10.47,10.392183,3.5197572361241782,166.12718964204112,2166.7890625,0.3398157625383828,1.0,0.36548731642189586,0.8693321716331912,0.6554947127507372,proxy +3proxy-devel-c37,mix-socks,1,2.2757974175999998,6065.3,24.576,188.416,327.68,4718.592,0,0,0,10.12,9.989423,3.5574343908597283,166.85077407547854,1524.16796875,0.3439894319682959,1.0,0.3641658102089757,0.8452636823853658,0.6384274506234452,proxy +3proxy-bp,mix-socks,1,3.6201790191999996,9841.3,131.072,188.416,262.144,1572.864,0,0,0,10.47,10.426471,2.3136977358238378,106.38838364850172,513.84375,0.4270753512132823,1.0,0.4174884944115713,1.1060751993378264,0.7583241605539505,client +direct,mix-socks,1,19.715206486400003,53948.5,32.768,36.864,51.2,90.112,0,0,0,9.4,0.0,0.3814314602886593,17.424024764358602,0.0,0.834410519277914,0.749003984063745,0.9397031539888683,2.669097602681207,2.771550019982696,origin +3proxy-0.9.9.2,mix-relay,1,2.4001726224,6590.9,8.192,14.336,27.648,4718.592,0,0,0,10.57,10.489823,3.523079932286124,160.37263499673793,1932.4765625,0.33316391359593395,1.0,0.3796542553191489,0.8327215957235962,0.6940008648694758,proxy +3proxy-1.0.2,mix-relay,1,2.4347965224,6674.2,9.216,15.36,26.624,4456.448,0,0,0,10.12,10.068608000000001,3.3251238555325773,151.62865961463547,1961.44921875,0.3465954606141522,1.0,0.3818308388444135,0.883357600842931,0.6992584524351481,proxy +3proxy-devel-c37,mix-relay,1,2.3166008351999996,6347.6,9.216,15.872,31.744,4718.592,0,0,0,10.61,10.480274,3.6639890096850465,167.14978889659085,1333.15234375,0.32978453738910013,1.0,0.3718076285240464,0.8193293212247995,0.6847209627984052,proxy +3proxy-bp,mix-relay,1,3.5476596151999997,9757.1,81.92,131.072,237.568,1966.08,0,0,0,10.59,10.516441,2.38805322914904,108.53634789025428,473.01171875,0.4187404773996953,1.0,0.421087098886706,1.0513213043807768,0.7846749619157158,client +nginx,mix-relay,1,3.1918924336,8793,3.84,5.632,12.8,3407.872,422,0,0,10.65,10.573307,2.669262883145048,121.11907198908223,795.125,0.40879004500926663,1.0,0.474291364535267,1.050562195360699,0.8785374492236764,client +nginx-halfclose,mix-relay,1,3.2131712048,8837,3.84,5.632,12.288,3276.8,0,0,0,10.18,10.11993,2.534567715481228,115.19746520312323,795.546875,0.4161785216178522,1.0,0.46786454733932276,1.0841046833485004,0.8666428138837291,client +haproxy,mix-relay,1,2.412097336,7484.2,12.288,94.208,655.36,3538.944,0,0,0,10.14,10.089014,3.3630483641477724,135.48542262366053,476.48828125,0.4407478691229035,1.0,0.39517499150526675,1.1979583886986387,0.7225756124709565,client +haproxy-splice-auto,mix-relay,1,3.1184081384,8904.8,11.776,69.632,253.952,2883.584,0,0,0,10.15,10.092444,2.60389263996926,113.98346958943492,357.5625,0.4304180418041804,1.0,0.41442667574004766,1.1690317027476989,0.7458864571028996,client +envoy,mix-relay,1,2.8808986624,7930.6,237.568,253.952,278.528,376.832,0,0,0,10.16,10.095164,2.821341863246512,128.11136610092552,650.33203125,0.3727103796124237,1.0,0.40398245021937224,0.9542924550350504,0.7111107738012868,client +direct,mix-relay,1,19.831302429599997,54241.9,32.768,36.864,51.2,90.112,0,0,0,9.36,0.0,0.37758488261585316,17.25603269796965,0.0,0.841953385127636,0.7476038338658147,0.9405756731662024,2.744530306038961,2.7800961952086976,origin +3proxy-1.0.2,mix-http,2,1.7292579432000001,4717,8.704,16.384,32.768,7077.888,0,0,0,10.12,10.052152999999999,4.681776962098733,214.5431418274327,2457.37890625,0.29505623855610774,1.0,0.31903580290677064,0.7203670538178837,0.6237910360723,proxy +3proxy-devel-c37,mix-http,2,2.0858580976,5718,10.24,16.384,27.648,5505.024,0,0,0,10.57,10.478461000000001,4.053967050649093,184.85484435117175,1731.5390625,0.3284854563691073,1.0,0.3701986754966887,0.7832130644895936,0.6826170703932517,proxy +3proxy-bp,mix-http,2,3.2586669904,9025.7,155.648,188.416,294.912,2097.152,0,0,0,10.13,10.08315,2.4869064632484092,112.2350621004465,720.6875,0.40613432046536224,1.0,0.4308833445718139,1.011178073547805,0.7834628337367792,client +nginx,mix-http,2,3.3640167184000003,9176.2,3.968,5.632,11.264,3276.8,0,0,0,10.2,10.138488,2.425671654771405,111.15712386390881,186.8515625,0.4125585238226384,1.0,0.37341349365397464,1.0762018363351136,0.7058220756244481,client +nginx-halfclose,mix-http,2,3.3667076471999997,9186.1,3.968,5.632,11.264,3407.872,0,0,0,10.16,10.112491,2.414228038707144,110.60188763457833,187.828125,0.4126896551724138,1.0,0.3752921535893155,1.07319572445853,0.7051760434635442,client +haproxy,mix-http,2,2.754074164,7601,245.76,262.144,294.912,2359.296,0,0,0,10.44,10.38841,3.032598072039428,137.35034863833707,310.1640625,0.4815650865312265,0.9867674858223062,0.26352242744063326,1.1890212117575958,0.5078018655624237,client +haproxy-splice-auto,mix-http,2,3.4293112048000003,9379.4,204.8,212.992,221.184,1769.472,0,0,0,10.17,10.112972000000001,2.3724880928310204,108.42911060408981,305.4921875,0.46498819826907944,1.0,0.2907702984038862,1.1531031520122303,0.578242784429069,client +envoy,mix-http,2,2.6040239591999996,7200.5,262.144,278.528,311.296,376.832,0,0,0,10.16,10.106104,3.121323047464225,141.1013124088605,637.578125,0.33920126116657906,1.0,0.2761375477596388,0.8772818481384317,0.5382150776885462,proxy +squid,mix-http,2,1.0522354416,3022.7,253.952,458.752,1048.576,4980.736,0,0,0,10.16,10.093575,7.72450696741481,336.12333344361,873.453125,0.349281045751634,1.0,0.14986648865153537,0.9412495459064327,0.25530505286149013,client +tinyproxy,mix-http,2,0.7354217,1787.9,655.36,1015.808,3276.8,5242.88,11484,0,0,10.47,10.335671000000001,11.389383805237186,585.6032216566922,976.109375,0.30679563492063494,1.0,0.2577253902516725,0.6574909438869527,0.38664976511506366,proxy +direct,mix-http,2,19.596606322400003,53620.1,32.768,36.864,51.2,86.016,0,0,0,9.37,0.0,0.3825152108827975,17.474790237243123,0.0,0.8378619153674833,0.745425616547335,0.9411035337879727,2.6903581994066634,2.778575869671257,origin +3proxy-0.9.9.2,mix-http,2,1.8275739504000001,4996,11.264,17.408,47.104,6291.456,0,0,0,10.58,10.503946,4.631276342140623,211.76941553242594,3084.54296875,0.32117150657731447,1.0,0.34505862646566166,0.77267352845817,0.6503119271199794,proxy +3proxy-1.0.2,mix-connect,2,2.3943122296,6405.1,26.624,180.224,344.064,4194.304,1,0,0,10.56,10.462959999999999,3.5283618801092396,164.86862031818396,2635.85546875,0.3404095904095904,1.0,0.37794502617801046,0.8279442315906722,0.6618110451769758,proxy +3proxy-devel-c37,mix-connect,2,2.2500152752,5974.8,23.552,172.032,327.68,4456.448,0,0,0,10.29,10.181175999999999,3.6586418282285975,172.22333801968267,1658.609375,0.3322016192217289,1.0,0.36348238482384826,0.8652243662793135,0.6520089497175865,proxy +3proxy-bp,mix-connect,2,3.5939432384,9830.2,139.264,196.608,262.144,1245.184,0,0,0,10.62,10.558292000000002,2.3639772351503145,108.03442452849383,494.02734375,0.41847005535983894,1.0,0.4194489465153971,1.0687112139812793,0.76755663455309,client +squid,mix-connect,2,2.97596288,7889.8,10.752,90.112,172.032,3407.872,382,0,0,10.19,10.137189,2.739281479209848,129.15409769575908,2849.55078125,0.3404035178479048,1.0,0.3297187394103694,0.8801320814366269,0.6028761458216674,proxy +tinyproxy,mix-connect,2,0.8115327783999999,2403.5,524.288,688.128,851.968,4194.304,108,0,0,10.25,10.114322999999999,10.104336162695656,426.46141044310383,1135.79296875,0.34323922734026746,1.0,0.23081861958266453,0.6454844808783421,0.3223551643131312,proxy +direct,mix-connect,2,19.465438996,53259.3,32.768,36.864,51.2,90.112,0,0,0,9.39,0.0,0.38591474877826587,17.630723648264247,0.0,0.8359305431878896,0.7518014411529224,0.9373456790123457,2.7059476994869294,2.760764768813294,origin +3proxy-0.9.9.2,mix-connect,2,2.1540967712,5714.2,23.552,172.032,327.68,5242.88,0,0,0,10.45,10.329432,3.8809769884863745,182.8777431661475,3323.21875,0.33560434014635376,1.0,0.34711570523507834,0.8542102488272424,0.6228335976667793,proxy +3proxy-1.0.2,mix-socks,2,2.299892452,6158.8,18.432,172.032,344.064,4718.592,0,0,0,10.26,10.189953,3.568862532185918,166.5908943300643,2153.5859375,0.3410630536737884,1.0,0.36511156186612576,0.8712238900797621,0.6528570266722853,proxy +3proxy-devel-c37,mix-socks,2,2.1896672064000002,5827.8,24.576,188.416,344.064,4980.736,0,0,0,10.56,10.383941,3.8581205286849203,181.2004530011325,1523.375,0.33091000250689395,1.0,0.35625,0.8040553651860252,0.631461857951412,proxy +3proxy-bp,mix-socks,2,3.582116968,9778.6,172.032,196.608,262.144,589.824,0,0,0,10.42,10.355898,2.32711552259954,106.55922115640276,558.43359375,0.42449189606380244,1.0,0.4177762982689747,1.0930884032426589,0.7624778787644839,client +direct,mix-socks,2,19.4974239536,53335.3,32.768,36.864,51.2,90.112,0,0,0,9.4,0.0,0.38569197745795075,17.624350102089984,0.0,0.8368444643657552,0.749003984063745,0.9425465838509317,2.6736489501349374,2.7752753268356543,origin +3proxy-0.9.9.2,mix-socks,2,2.3401734712,6225.7,18.432,163.84,327.68,4456.448,0,0,0,10.24,10.145945000000001,3.500595191261307,164.47949628154265,2137.203125,0.3480749219562955,1.0,0.36174565291510397,0.8663580037804722,0.6458394104811912,proxy +3proxy-1.0.2,mix-relay,2,2.2216054936,6120.5,6.912,11.776,22.528,5242.88,0,0,0,10.58,10.492111000000001,3.8098573416311257,172.86169430602075,1898.265625,0.32214934409687185,1.0,0.365053050397878,0.816528479616323,0.6703211279731562,proxy +3proxy-devel-c37,mix-relay,2,2.2110263376,6061.3,7.168,12.288,22.528,4980.736,0,0,0,10.11,10.041028,3.6580296952858875,166.79590186923596,1402.1875,0.3380021141649049,1.0,0.3660745384883316,0.8561866408180382,0.6814313918595083,proxy +3proxy-bp,mix-relay,2,3.7559689871999997,10277.5,94.208,139.264,212.992,1900.544,0,0,0,10.6,10.54067,2.2577396216260217,103.13792264655801,486.58203125,0.41492837396330734,1.0,0.4190817323347444,1.0258411290428886,0.7601434901358008,client +nginx,mix-relay,2,3.0551027824,8390.4,3.968,5.888,13.312,3538.944,401,0,0,10.63,10.561795,2.783539738495968,126.6924103737605,793.91015625,0.4069459172852598,1.0,0.4777887462981244,1.0581050831383405,0.8853698324171728,client +nginx-halfclose,mix-relay,2,3.2754094472,9002.7,3.712,5.632,12.288,3276.8,0,0,0,10.16,10.102978,2.4815218161345483,112.85503237917514,793.0078125,0.42037861915367486,1.0,0.4719140083217753,1.0870828888887567,0.8650135954588063,client +haproxy,mix-relay,2,2.4626223056,7640.4,11.776,94.208,655.36,3407.872,0,0,0,10.19,10.134818000000001,3.3102924396739044,133.36998062928643,469.51171875,0.43568691844553914,1.0,0.39296584376056815,1.1850973682278296,0.6997341260040926,client +haproxy-splice-auto,mix-relay,2,3.1763111511999997,9080.6,11.264,65.536,253.952,2883.584,0,0,0,10.15,10.095672,2.5564246112766034,111.77675483998854,358.36328125,0.4294696555494806,1.0,0.4162125340599455,1.145115289188715,0.7407549051474221,client +envoy,mix-relay,2,2.8763688232,7916.8,237.568,253.952,278.528,376.832,0,0,0,10.14,10.09261,2.820222474451412,128.08205335489086,640.5703125,0.37666844634276564,1.0,0.40414683888511216,0.9742565850733453,0.7156304238698215,client +direct,mix-relay,2,19.288662537599997,52770.8,32.768,36.864,51.2,90.112,0,0,0,9.36,0.0,0.3882073205129388,17.73708187103474,0.0,0.8395697961012771,0.75,0.9429457364341085,2.7046637680946635,2.787423171984882,origin +3proxy-0.9.9.2,mix-relay,2,2.1607165024,5950.2,7.936,13.824,28.672,5242.88,0,0,0,10.09,10.051599,3.7357978203221407,169.57413196195085,1863.3359375,0.3358859255347241,1.0,0.3639196675900277,0.8513250784514268,0.6686620348573004,proxy diff --git a/bench/data/results-full7/arm-mixshaped.csv b/bench/data/results-full7/arm-mixshaped.csv new file mode 100644 index 0000000..77b2496 --- /dev/null +++ b/bench/data/results-full7/arm-mixshaped.csv @@ -0,0 +1,103 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,mix-http,0,0.7362589008,2435.65,294.912,753.664,1769.472,6553.6,0,105,0,5.52,0.0,2.9989450689164423,113.31677375649211,0.0,0.7050435448368265,0.2552011095700416,0.43637688198154445,1.5653186778564858,0.43065188172710034,client +3proxy-0.9.9.2,mix-http,0,0.6255984012000001,2201.95,327.68,884.736,2097.152,6553.6,0,79,0,19.85,15.055052000000002,12.691848292402575,450.73684688571495,3344.12890625,0.70410933258448,0.9254079254079254,0.29435483870967744,1.4302234482813658,0.3872168710182725,client +3proxy-1.0.2,mix-http,0,0.6615873872000001,2324.25,294.912,819.2,1966.08,6553.6,0,69,0,19.25,13.696358,11.638674117697871,414.11207916532214,2601.80078125,0.7055690525135488,0.9020618556701031,0.2839506172839506,1.403270569852389,0.36351158643100684,client +3proxy-devel-c37,mix-http,0,0.6856539556,2357.8,311.296,819.2,1835.008,6291.456,0,95,0,18.37,11.152652999999999,10.716776210486431,389.5580626007295,1874.125,0.7021612095352936,0.8415025194686212,0.27766649974962443,1.4211123993991825,0.361208887119422,client +3proxy-bp,mix-http,0,0.7316850136,2467.05,278.528,753.664,1769.472,6291.456,0,92,0,16.71,8.271594,9.13507845010207,338.66358606432783,1076.4140625,0.7189653544793732,0.772181146025878,0.2699014404852161,1.4745804984526951,0.3505292775241538,client +nginx,mix-http,0,0.752459304,2511.3,294.912,753.664,1769.472,6029.312,0,83,0,14.96,5.392079,7.952589552936142,297.85370127025845,667.2734375,0.7073903652925158,0.6824817518248175,0.20964260014391942,1.4519459628142817,0.23952218224324773,client +nginx-halfclose,mix-http,0,0.7605605532,2534.35,278.528,753.664,1769.472,6029.312,0,83,0,14.84,5.156835999999999,7.804769751763665,292.7772407126088,661.3203125,0.6985369490261858,0.668769716088328,0.20498220640569395,1.487748867918161,0.23548774154618357,client +haproxy,mix-http,0,0.7482370872,2499.35,294.912,753.664,1769.472,6029.312,0,84,0,15.38,5.913978999999999,8.221992875308521,307.6799967991678,493.27734375,0.7165547886924458,0.7048579285059579,0.21726263871763254,1.5080817414004317,0.2565922320733651,client +haproxy-splice-auto,mix-http,0,0.7554093544,2517.8,278.528,753.664,1769.472,6029.312,0,85,0,15.09,5.466586,7.990369678165055,299.66637540710144,471.60546875,0.6984245362170225,0.6824966078697422,0.2078747860112497,1.471125023282701,0.2487062099100477,client +envoy,mix-http,0,0.7441060532,2544.05,278.528,753.664,1703.936,6029.312,134,78,0,16.32,7.293208000000001,8.772943012527021,320.7484129635817,770.85546875,0.704325795251947,0.7448653582838887,0.20138226882745472,1.4720017524488584,0.2231948299772586,client +squid,mix-http,0,0.8488766472,2498.05,278.528,557.056,1441.792,8388.608,0,9,0,20.89,19.924101,9.843597450303378,418.1261383879426,865.95703125,0.6915557210688018,0.9830588235294118,0.1966547192353644,1.6672577854887112,0.2282740343098693,client +tinyproxy,mix-http,0,0.6172787987999999,1600.65,753.664,1703.936,3145.728,6029.312,24108,1,0,20.55,19.826784,13.316511138856242,641.9267172711086,973.66796875,0.6808614305203664,0.9903614457831326,0.2896886166411434,1.5113926313434722,0.33326750575117164,client +direct,mix-connect,0,0.7584371463999999,2504.6,294.912,720.896,1638.4,6553.6,0,95,0,5.52,0.0,2.911249812170328,110.19723708376587,0.0,0.689082723691615,0.2534435261707989,0.42315889178309257,1.4985026437534075,0.4050219141627897,client +3proxy-0.9.9.2,mix-connect,0,0.7097245744,2410.35,278.528,786.432,1835.008,6553.6,1,88,0,18.44,11.567352000000001,10.392763990503864,382.51706183749246,3415.16796875,0.7193612397240858,0.8540991199629459,0.2709483191169092,1.4989784268836566,0.34016647561324015,client +3proxy-1.0.2,mix-connect,0,0.7129993836,2422.8,278.528,786.432,1835.008,6553.6,1,90,0,18.1,10.825855,10.154286478404188,373.534753178141,2613.4609375,0.7109572377655095,0.8337171810225702,0.2706673306772908,1.4675564429132388,0.33977943586879783,client +3proxy-devel-c37,mix-connect,0,0.7152364276000001,2420.4,278.528,786.432,1835.008,6291.456,2,95,0,17.94,10.390341,10.033046029379838,370.5999008428359,1871.88671875,0.7124483665039429,0.827490774907749,0.27113993514592166,1.49029838358974,0.3396087995633466,client +3proxy-bp,mix-connect,0,0.7411243728,2492.65,278.528,753.664,1769.472,6291.456,0,91,0,16.22,7.234392999999999,8.75426613685373,325.35654825186043,695.40625,0.7157944365865158,0.7430142006413193,0.2519350811485643,1.5094167001049121,0.31749656777947005,client +squid,mix-connect,0,0.7382015352000001,2477.05,278.528,753.664,1769.472,6291.456,224,92,0,16.68,7.642479,9.038182233246594,336.6908217436063,3018.75390625,0.7152286657237152,0.7633867276887872,0.24764501735250372,1.4957555490189827,0.304695743796385,client +tinyproxy,mix-connect,0,0.7855654827999999,2085.85,237.568,442.368,786.432,12582.912,457,13,0,20.64,20.29977,10.509626734836981,494.7623271088525,1134.57421875,0.6948475698840947,1.0,0.25256937307297017,1.5128123086270504,0.29954741098299037,client +direct,mix-socks,0,0.7544266572,2496.75,294.912,753.664,1703.936,6291.456,0,98,0,5.42,0.0,2.873705454744104,108.5411034344648,0.0,0.690924496328375,0.2501153668666359,0.4189837008628955,1.4895270038494217,0.40004308241189657,client +3proxy-0.9.9.2,mix-socks,0,0.7179858324,2422.75,294.912,786.432,1835.008,6291.456,0,98,0,17.69,10.188332,9.855347669392259,365.08100299246723,2155.875,0.7238358251595086,0.8250932835820896,0.26634566649771924,1.5538996069871183,0.33501836979347294,client +3proxy-1.0.2,mix-socks,0,0.7238240288,2442.2,278.528,753.664,1769.472,6291.456,0,98,0,18.0,10.419142999999998,9.947169081878371,368.5201867168946,2153.9765625,0.7110841348398543,0.8245533669262483,0.2731102850061958,1.476207187633362,0.3310325248622737,client +3proxy-devel-c37,mix-socks,0,0.7327120304,2467.8,278.528,753.664,1769.472,6291.456,0,94,0,17.51,9.803128000000001,9.5590077812376,354.7694302617716,1777.109375,0.7103675777568331,0.814797580269893,0.2596056622851365,1.4578585541633946,0.32262031231368593,client +3proxy-bp,mix-socks,0,0.733708304,2464.4,294.912,753.664,1769.472,6291.456,0,92,0,16.34,7.568868,8.908172313666496,331.52085700373317,715.5546875,0.715819209039548,0.7481684981684982,0.25590649092265605,1.508979774924683,0.32023632824742054,client +direct,mix-relay,0,0.7652198544,2544.15,278.528,720.896,1638.4,6291.456,0,103,0,5.51,0.0,2.8802180018292005,108.28764027278265,0.0,0.6835265519820494,0.25391705069124426,0.4199144486692015,1.4429133799001035,0.39616363463573256,client +3proxy-0.9.9.2,mix-relay,0,0.7148843008,2434.5,278.528,786.432,1769.472,6291.456,1,89,0,17.77,10.25295,9.94286766690177,364.9620045183816,2056.7421875,0.7155513666352498,0.8242115027829313,0.266767143933685,1.460908274359018,0.33484515952335414,client +3proxy-1.0.2,mix-relay,0,0.7244515956,2436.8,278.528,786.432,1835.008,6291.456,0,91,0,17.42,9.641850999999999,9.618309963454514,357.4359816152331,2052.32421875,0.7157177983733687,0.8083526682134571,0.26165413533834586,1.4672790858382243,0.3216773159294547,client +3proxy-devel-c37,mix-relay,0,0.7239831212000001,2440.2,278.528,753.664,1835.008,6291.456,0,99,0,17.85,10.080638,9.862108370932004,365.7487091222031,1673.83203125,0.7056704839305504,0.8117326057298773,0.26727317432997294,1.4666794356956931,0.3317297976730696,client +3proxy-bp,mix-relay,0,0.7355662712000001,2471.8,294.912,786.432,1769.472,6029.312,0,87,0,16.35,7.409874,8.891109144157289,330.730641637673,688.0703125,0.7177931292008962,0.7438580527752502,0.2596603494954467,1.5041738462717296,0.3200225872908037,client +nginx,mix-relay,0,0.740254922,2488.05,294.912,786.432,1769.472,6029.312,215,83,0,15.22,5.458894,8.224193881145178,305.8620204577882,1088.16015625,0.7061793026082079,0.6911898274296094,0.24471224790949336,1.4933641416476109,0.30094699247995516,client +nginx-halfclose,mix-relay,0,0.739516336,2480,294.912,786.432,1769.472,6029.312,0,84,0,15.28,5.431409,8.264861372852756,308.06451612903226,1093.109375,0.7096955503512881,0.6945454545454546,0.24096981692231567,1.5066481916062364,0.2943038245349649,client +haproxy,mix-relay,0,0.706679706,2390.25,311.296,819.2,1835.008,6291.456,0,88,0,16.15,7.069224999999999,9.141340758977448,337.83077083987024,528.75390625,0.7133507853403142,0.734424738517508,0.25421657296504524,1.5182485038517974,0.3107948700470038,client +haproxy-splice-auto,mix-relay,0,0.7278204924,2451.1,294.912,786.432,1835.008,6291.456,0,84,0,15.7,6.177826,8.628501210912043,320.2643710986904,528.75,0.7105656150830689,0.710085933966531,0.23933941335962533,1.518956723021718,0.29736593508706427,client +envoy,mix-relay,0,0.7360672764,2476.5,294.912,786.432,1769.472,6291.456,0,87,0,16.02,6.327386999999999,8.705725964806659,323.4403391883707,825.80859375,0.7053554767680538,0.7262012692656392,0.23394383394383395,1.4982243363437737,0.280596433599516,client +3proxy-0.9.9.2,mix-http,1,0.6504435348,2270.65,327.68,851.968,1966.08,6291.456,0,75,0,19.2,13.358466000000002,11.807327752687195,422.7864267940898,3347.859375,0.7075815649247452,0.8852005532503457,0.2867886688393081,1.445390403007286,0.3745322759977796,client +3proxy-1.0.2,mix-http,1,0.6654444404,2313.2,294.912,819.2,1966.08,6553.6,0,82,0,18.88,12.898283,11.34880621357431,408.09268545737507,2603.90234375,0.7107843137254902,0.8893075836081017,0.2783687943262411,1.4389981687032107,0.3580252570304989,client +3proxy-devel-c37,mix-http,1,0.686418468,2342.45,311.296,819.2,1835.008,6553.6,0,88,0,18.35,11.17987,10.693185486961578,391.6839206813379,1862.44140625,0.7138836772983115,0.8452326116996776,0.28187075685189844,1.4681996352442808,0.3555084077314052,client +3proxy-bp,mix-http,1,0.722315564,2442.95,294.912,786.432,1835.008,6291.456,0,89,0,16.88,8.223403,9.347714955232503,345.4839435927874,1087.8828125,0.7151726084093688,0.7686703096539163,0.26853007237334664,1.499036454610436,0.3470182128349186,client +nginx,mix-http,1,0.7517845616000001,2511.7,278.528,786.432,1769.472,6029.312,0,83,0,14.94,5.313325,7.949085822248681,297.40812995182546,657.0859375,0.7089228447462743,0.6825034262220192,0.21188878235858102,1.4802718535929738,0.2403123883081322,client +nginx-halfclose,mix-http,1,0.7599839432000001,2536.6,278.528,753.664,1769.472,6029.312,0,82,0,14.92,5.160769999999999,7.852797487893032,294.0944571473626,659.72265625,0.7121484707887511,0.6815897670169027,0.2108173076923077,1.4754504250277125,0.2390031724661305,client +haproxy,mix-http,1,0.7565696132,2521.05,278.528,753.664,1769.472,6291.456,0,86,0,15.22,5.742167,8.046847102740605,301.85835267051425,513.0078125,0.7028389988793425,0.6886877828054299,0.2091662603607996,1.4966920953730694,0.24847032911018488,client +haproxy-splice-auto,mix-http,1,0.756854692,2525.85,294.912,753.664,1769.472,6029.312,0,81,0,15.21,5.555257,8.038531126659118,301.0867628719045,482.484375,0.6998045238760123,0.684826654660063,0.21362754607177498,1.4921728504376097,0.24946065172498746,client +envoy,mix-http,1,0.7457574664,2544.9,278.528,753.664,1703.936,5767.168,144,86,0,16.14,7.032433,8.656969981360149,317.10479783095604,774.8125,0.7149355572403336,0.7434362045140488,0.20053217223028544,1.5207734691278438,0.2268101167449909,client +squid,mix-http,1,0.865229272,2512.4,278.528,524.288,1376.256,8388.608,0,11,0,20.78,19.806430000000002,9.606702256832568,413.5487979621079,845.73828125,0.7003593040847201,0.9971209213051824,0.1944716242661448,1.7144205078007073,0.23047200843574112,client +tinyproxy,mix-http,1,0.6102282412000001,1627.4,786.432,1638.4,3014.656,5767.168,24582,0,0,20.54,20.343176999999997,13.463814758627725,631.0679611650486,967.68359375,0.6728917420484388,0.9837164750957854,0.2990083905415713,1.525699232691789,0.34707995161355454,client +direct,mix-http,1,0.7588584092,2507.85,294.912,720.896,1703.936,6291.456,0,90,0,5.55,0.0,2.925446925389359,110.65255098989174,0.0,0.6885890949971895,0.2549379880569591,0.4200619490111985,1.4810776500871867,0.40194085792412043,client +3proxy-0.9.9.2,mix-connect,1,0.7147974387999999,2426.25,278.528,786.432,1835.008,6291.456,1,91,0,18.32,11.405188000000003,10.2518554239677,377.537351880474,3432.74609375,0.7173667357317762,0.8544776119402985,0.2714177407126611,1.4779451602235958,0.34376104852031764,client +3proxy-1.0.2,mix-connect,1,0.73288832,2468.3,278.528,753.664,1835.008,6291.456,0,90,0,17.5,9.854951,9.551250591631751,354.49499655633434,2616.48828125,0.7097411764705882,0.8131970260223048,0.2651877993445929,1.4144520597645265,0.3303843047214037,client +3proxy-devel-c37,mix-connect,1,0.7265444212000001,2454.65,278.528,753.664,1835.008,6291.456,0,93,0,17.68,10.078306000000001,9.733747577773018,360.13280915812845,1875.9765625,0.7104029990627929,0.8181397501156872,0.26629889669007023,1.4419333642379495,0.33354216620238225,client +3proxy-bp,mix-connect,1,0.7373509,2473.5,278.528,753.664,1769.472,6291.456,0,93,0,16.31,7.330786,8.847890468432329,329.6947645037396,696.32421875,0.7036486862872529,0.737008585630366,0.24828263002944062,1.4924172357074688,0.3092424212191661,client +squid,mix-connect,1,0.7322890536000001,2463,278.528,753.664,1769.472,6291.456,223,91,0,16.76,7.871696999999999,9.154854858259212,340.235485180674,3006.73828125,0.7070829450139795,0.7645985401459854,0.24630905511811024,1.4840167277771912,0.30717149921977555,client +tinyproxy,mix-connect,1,0.7710700476,2029.4,237.568,442.368,786.432,9437.184,532,12,0,20.81,20.446489,10.79538756032468,512.7131171774909,1137.015625,0.6938082298136646,1.0,0.25287356321839083,1.5279214693394618,0.2999898086397138,client +direct,mix-connect,1,0.7542214427999999,2512.2,278.528,753.664,1703.936,6291.456,0,108,0,5.4,0.0,2.86388039032825,107.47551946501075,0.0,0.6833286530000936,0.2480477721635278,0.41569282136894825,1.4660135301278523,0.3954170460602512,client +3proxy-0.9.9.2,mix-socks,1,0.718483122,2423.35,278.528,786.432,1835.008,6291.456,1,97,0,17.98,10.763968,10.009977659572634,370.97406482761465,2158.734375,0.7191360935584269,0.8366682177757097,0.26959798994974876,1.4963155022412995,0.33546085240527823,client +3proxy-1.0.2,mix-socks,1,0.7256213016,2444.2,278.528,753.664,1835.008,6291.456,0,88,0,17.91,10.519508,9.872918537814877,366.37754684559366,2158.83203125,0.7134557721139431,0.8268698060941828,0.26743314171457133,1.4790652241541142,0.3326148892717579,client +3proxy-devel-c37,mix-socks,1,0.7199444472000001,2433.5,278.528,786.432,1835.008,6291.456,0,99,0,17.76,10.219822999999998,9.86742800452007,364.90651325251696,1780.14453125,0.7131893121091529,0.8252788104089219,0.26297139964565935,1.4569951909524976,0.33276398751342584,client +3proxy-bp,mix-socks,1,0.7364442472,2475.05,294.912,753.664,1769.472,6291.456,0,94,0,16.31,7.402963,8.858783302068815,329.4882931657946,720.078125,0.7061281337047354,0.7366757000903342,0.249079754601227,1.5175299922977,0.3084418016686119,client +direct,mix-socks,1,0.7562262832000001,2513.5,294.912,720.896,1638.4,6291.456,0,101,0,5.47,0.0,2.893313877879774,108.81241296996221,0.0,0.7025990217704038,0.2572906867356538,0.42953831278704374,1.5341952020688219,0.4055971199505873,client +3proxy-0.9.9.2,mix-relay,1,0.7148872132,2421.7,278.528,786.432,1835.008,6291.456,0,89,0,17.83,10.246046,9.976398889659142,368.12982615518024,2053.53125,0.7103809791257137,0.820902394106814,0.26756352765321373,1.468055876717906,0.3329389989735912,client +3proxy-1.0.2,mix-relay,1,0.723440834,2437.1,278.528,786.432,1835.008,6291.456,0,94,0,17.59,9.857503000000001,9.72574351532941,360.87973411021295,2049.015625,0.7126447515875981,0.8094799815922687,0.2617801047120419,1.4758876376058863,0.32488594274645155,client +3proxy-devel-c37,mix-relay,1,0.7282643776000001,2448,278.528,753.664,1835.008,6553.6,1,106,0,17.55,9.757595,9.639356552265342,358.45588235294116,1677.54296875,0.7065834807710215,0.8061552595314653,0.2640853809878382,1.4491827502810162,0.3266950920749648,client +3proxy-bp,mix-relay,1,0.7378662887999999,2479.05,294.912,786.432,1769.472,6291.456,1,84,0,16.06,7.126734,8.706184436813642,323.91440269458053,685.75,0.7044147653496569,0.7270258035310095,0.2468011811023622,1.4850609430921955,0.3061358365593123,client +nginx,mix-relay,1,0.7364392684,2467.05,294.912,786.432,1769.472,6291.456,208,86,0,15.44,5.727575,8.38629913559346,312.9243428386129,1090.05078125,0.7106589509053575,0.7043795620437956,0.24671134276495407,1.4861138408754873,0.3051947996298732,client +nginx-halfclose,mix-relay,1,0.7399392072000001,2486.35,294.912,786.432,1769.472,6029.312,0,83,0,15.27,5.473079,8.254732200383394,307.0766384459147,1092.58203125,0.701151560178306,0.6893905191873589,0.23996082272282077,1.4584316133221502,0.2928313417340941,client +haproxy,mix-relay,1,0.7394853956,2482.15,294.912,786.432,1769.472,6029.312,0,84,0,15.88,6.587451,8.589757198444934,319.8839715569164,529.5078125,0.70894126449682,0.7182270465852555,0.2422756253065228,1.5047227116854998,0.29787412102165545,client +haproxy-splice-auto,mix-relay,1,0.7455876548,2497.9,294.912,786.432,1769.472,6029.312,0,84,0,15.48,6.122493,8.304858536936173,309.8602826374154,542.30078125,0.704930302179811,0.704597177969959,0.23549655850540807,1.4708535791281865,0.2896954746144291,client +envoy,mix-relay,1,0.7432067852,2496.7,294.912,753.664,1769.472,6029.312,0,87,0,15.96,6.0975,8.589803170704421,319.6219009092001,832.60546875,0.7090175471521066,0.7281021897810219,0.2360872762932091,1.462366963708641,0.2811113537301132,client +direct,mix-relay,1,0.75448703,2506.4,278.528,753.664,1703.936,6291.456,0,110,0,5.51,0.0,2.9211900435187066,109.91860836259177,0.0,0.6923076923076923,0.2527522935779816,0.41919312485079974,1.5094707408876507,0.40337497379729953,client +3proxy-1.0.2,mix-http,2,0.6644139464,2322.65,294.912,819.2,1966.08,6553.6,0,70,0,19.1,13.819991000000002,11.498855557436565,411.1682776139324,2600.703125,0.7068413117225782,0.905642484589853,0.28678678678678676,1.4096498688717343,0.36758240862695085,client +3proxy-devel-c37,mix-http,2,0.682356428,2335.35,311.296,819.2,1835.008,6291.456,0,83,0,17.82,10.436525,10.446153516707254,381.5273941807438,1871.31640625,0.7167812142038946,0.8346604215456674,0.2733485193621868,1.4738552862961285,0.35190345436827253,client +3proxy-bp,mix-http,2,0.704479374,2390.7,294.912,786.432,1835.008,6553.6,0,83,0,17.26,8.877046,9.800144979120425,360.9821391224328,1078.6796875,0.7077290251514595,0.7788808664259927,0.2733284349742836,1.4439253352218377,0.3628574802553842,client +nginx,mix-http,2,0.7245615776000001,2440.85,294.912,786.432,1769.472,6291.456,0,88,0,14.98,5.3726020000000005,8.269828521473066,306.86031505418197,653.67578125,0.7072643548538671,0.6815286624203821,0.20760998810939357,1.4946451677952444,0.2351375378490053,client +nginx-halfclose,mix-http,2,0.7589123668,2536.6,278.528,753.664,1769.472,6029.312,0,77,0,14.96,5.242106,7.884968359695994,294.8829141370338,657.0078125,0.7008491182233834,0.676005422503389,0.2058753283974206,1.4606168941106419,0.23821732906459125,client +haproxy,mix-http,2,0.7532168456,2522.15,278.528,753.664,1769.472,6029.312,0,84,0,15.24,5.831907,8.09328686102875,302.12318854945187,504.33203125,0.7070773882641973,0.6962083142987665,0.2145848731214585,1.4839069313971496,0.25378410548946717,client +haproxy-splice-auto,mix-http,2,0.7511478052,2517.15,294.912,786.432,1769.472,6029.312,0,82,0,14.94,5.370447,7.955824351252461,296.7641976044336,478.68359375,0.7033398821218074,0.677858439201452,0.21070559610705597,1.5121139650037598,0.2492655428653015,client +envoy,mix-http,2,0.7408992287999999,2528.15,278.528,753.664,1703.936,6029.312,147,83,0,16.12,7.0894639999999995,8.70293792914797,318.81019717975596,776.3515625,0.706726709822685,0.7354014598540146,0.1974187380497132,1.487892210240636,0.22557922336822048,client +squid,mix-http,2,0.8709057124,2500.95,278.528,524.288,1310.72,8388.608,0,8,0,20.86,19.936334000000002,9.580830486237147,417.0415242207961,832.8828125,0.690618575967109,0.9839622641509433,0.19338605319913732,1.6805866363177304,0.226342580606777,client +tinyproxy,mix-http,2,0.6264828724,1623.2,753.664,1638.4,3014.656,6029.312,24686,0,0,20.55,19.921706,13.120869479655386,633.0088713652045,967.375,0.6877501220107369,0.9927536231884058,0.2941777323799796,1.539450379367364,0.33574606908828336,client +direct,mix-http,2,0.7495328832,2482.1,278.528,753.664,1703.936,6291.456,0,104,0,5.61,0.0,2.9938646459640745,113.0091454816486,0.0,0.695057536313903,0.25828729281767954,0.4247787610619469,1.5221996077281235,0.41039845355164406,client +3proxy-0.9.9.2,mix-http,2,0.6510248016,2287.8,311.296,819.2,1966.08,6291.456,9,74,0,18.9,13.298618,11.612460817806115,413.0605822187254,3362.22265625,0.7164634146341463,0.8919301557338367,0.2858241476544476,1.470723923062737,0.3747365076113245,client +3proxy-1.0.2,mix-connect,2,0.7279274676,2447.8,278.528,753.664,1835.008,6553.6,0,95,0,17.46,9.774725,9.594362502937924,356.6467848680448,2612.0859375,0.7121868525145979,0.8098330241187384,0.2671164417791104,1.4529123980465461,0.3280482665757728,client +3proxy-devel-c37,mix-connect,2,0.7224764288,2435.1,278.528,786.432,1835.008,6291.456,0,93,0,17.48,9.747572,9.677824384683925,358.9174982546918,1870.78125,0.7210275927687916,0.8134015821312238,0.26059535822401614,1.487376666666473,0.3246802558482597,client +3proxy-bp,mix-connect,2,0.7467722327999999,2491,278.528,753.664,1769.472,6291.456,0,87,0,16.14,7.272994000000001,8.645206284375924,323.9662786029707,695.61328125,0.7077727952167414,0.7329700272479565,0.2482775590551181,1.4990153206404226,0.304700136458751,client +squid,mix-connect,2,0.7402260424,2480.3,278.528,753.664,1769.472,6291.456,225,85,0,16.8,7.727947,9.078307996584478,338.66870943031086,2998.65625,0.7111297539149888,0.7601809954751131,0.24663237815331865,1.4966573454324952,0.3013001030355562,client +tinyproxy,mix-connect,2,0.7838043952,2072.1,204.8,425.984,819.2,9437.184,471,4,0,20.77,20.453,10.599583328287007,501.18237536798415,1139.19921875,0.6945578231292517,1.0,0.25012800819252434,1.5270123175524044,0.297196397383991,client +direct,mix-connect,2,0.7622742388,2519.85,278.528,720.896,1703.936,6553.6,0,107,0,5.53,0.0,2.9018427849302784,109.7287536956565,0.0,0.6950334558477053,0.255663430420712,0.42343637670740475,1.4934382474574106,0.40372290634476765,client +3proxy-0.9.9.2,mix-connect,2,0.7051283972000001,2395.35,278.528,786.432,1835.008,6553.6,1,97,0,18.31,11.546672999999998,10.386760807085532,382.1988435927944,3422.5390625,0.7212695405021317,0.8536130536130536,0.2720883534136546,1.5179167514662006,0.34384013871289176,client +3proxy-1.0.2,mix-socks,2,0.709015186,2394.55,278.528,786.432,1835.008,6553.6,0,93,0,18.33,11.153065,10.341104315923635,382.74414816980226,2149.30078125,0.7143921057531186,0.8408256880733945,0.2704978944760961,1.4978564991217975,0.3372560389359021,client +3proxy-devel-c37,mix-socks,2,0.7228647588,2442.55,278.528,753.664,1769.472,6291.456,1,96,0,17.72,10.075783999999999,9.805430287909616,362.7356655953819,1771.7421875,0.7151761261686655,0.8188539741219963,0.2645064054257724,1.4904578328317712,0.3308011621334329,client +3proxy-bp,mix-socks,2,0.7384359544,2471.4,294.912,753.664,1769.472,6291.456,0,92,0,16.32,7.420427,8.840306273147526,330.1772274823986,715.05078125,0.7137062541269692,0.7428311333636778,0.25384234010907286,1.5190829277683466,0.31560822816161327,client +direct,mix-socks,2,0.7396931396,2451.85,294.912,753.664,1703.936,6291.456,0,104,0,5.53,0.0,2.990429249075058,112.77198849848074,0.0,0.6901898139447472,0.25578168362627196,0.42087622695714627,1.4953581631049646,0.4057570185046716,client +3proxy-0.9.9.2,mix-socks,2,0.720381358,2431.4,278.528,753.664,1835.008,6553.6,0,93,0,18.12,11.121337999999998,10.061337539498073,372.6248252035864,2156.30078125,0.7088976674191121,0.847124824684432,0.2675449708639473,1.449215262859275,0.33453879578568185,client +3proxy-1.0.2,mix-relay,2,0.7219665852,2437.3,278.528,786.432,1835.008,6291.456,0,93,0,17.76,10.192502000000001,9.839790574285432,364.3375866737784,2066.86328125,0.7050970873786407,0.8237476808905381,0.26703269278762165,1.4050772526353654,0.3308643022744778,client +3proxy-devel-c37,mix-relay,2,0.7149214536,2420.5,278.528,786.432,1835.008,6291.456,0,98,0,17.89,10.310918,10.009491202097562,369.5517455071266,1678.55859375,0.7031004164738547,0.8187643020594966,0.2675709001233046,1.4425666421102743,0.33624003664483465,client +3proxy-bp,mix-relay,2,0.7432316832,2494.55,294.912,786.432,1769.472,6029.312,0,86,0,16.16,7.260035,8.697153453105106,323.9061153314225,691.14453125,0.7061456681898722,0.7348794906775807,0.25141312361759643,1.476407551375908,0.30812577811841807,client +nginx,mix-relay,2,0.7422073496,2489.1,294.912,786.432,1769.472,6029.312,213,83,0,15.33,5.468714,8.261842197203702,307.9426298662167,1092.51953125,0.7031874361118855,0.6930379746835443,0.24490297224269222,1.4793326799643562,0.30129883983519795,client +nginx-halfclose,mix-relay,2,0.7373285772,2475.7,294.912,786.432,1769.472,6029.312,0,88,0,15.49,5.885072,8.40330917801839,312.8408126994385,1093.18359375,0.7090499013250634,0.7098991750687442,0.24506126531632907,1.4627528197847388,0.30246028827296245,client +haproxy,mix-relay,2,0.7354159724,2470.4,294.912,786.432,1769.472,6029.312,0,86,0,15.85,6.6920139999999995,8.620971311392204,320.7982512953368,534.01953125,0.7062009712364588,0.7175192394748755,0.24191176470588235,1.5123096417361548,0.29943898550111264,client +haproxy-splice-auto,mix-relay,2,0.7425846787999999,2491.7,294.912,786.432,1769.472,6029.312,0,84,0,15.5,6.149540999999999,8.34921615945411,311.03262832604247,528.90625,0.7034231200897868,0.7026291931097008,0.23728813559322035,1.4993016073751264,0.29238875738994224,client +envoy,mix-relay,2,0.7392540447999999,2475.3,294.912,753.664,1769.472,6291.456,0,83,0,16.0,6.349571,8.657375695159672,323.19314830525593,830.52734375,0.7043558850787767,0.7239819004524887,0.23489278752436646,1.4896191877389107,0.28191741753386257,client +direct,mix-relay,2,0.7643070156,2524.65,278.528,753.664,1703.936,6553.6,0,97,0,5.58,0.0,2.920292440659889,110.51036777375081,0.0,0.6939468225532718,0.25561154374713696,0.4213295074127212,1.4967451146347415,0.3992879134334774,client +3proxy-0.9.9.2,mix-relay,2,0.7024832127999999,2407.9,294.912,819.2,1835.008,6291.456,1,86,0,18.24,11.04407,10.38601331257321,378.7532704846547,2051.75,0.7111673224658047,0.8386206896551724,0.2734277902063137,1.4687514333234342,0.34151772776454636,client diff --git a/bench/data/results-full7/arm-relay.csv b/bench/data/results-full7/arm-relay.csv new file mode 100644 index 0000000..4a4249d --- /dev/null +++ b/bench/data/results-full7/arm-relay.csv @@ -0,0 +1,181 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,relay-stream1-down,0,91.06329488335001,nan,nan,nan,nan,nan,0,0,0,0.17,0.0,0.001493300362805454,nan,0.0,0.23823109843081314,0.030685920577617327,0.32832764505119455,0.8980538301601215,0.8932108156954979,none +3proxy-0.9.9.2,relay-stream1-down,0,24.408393500137734,nan,nan,nan,nan,nan,0,0,1,10.01,10.002485,0.32804662851343197,nan,20.4375,0.10980392156862745,0.9515209125475285,0.12432432432432433,0.3862345927175019,0.22524146482059537,proxy +3proxy-1.0.2,relay-stream1-down,0,24.196753581025,nan,nan,nan,nan,nan,0,0,0,10.0,9.997884,0.33058593885408,nan,18.58203125,0.08706467661691543,0.998003992015968,0.10144390966308775,0.3836247536476159,0.23357243304641553,proxy +3proxy-devel-c37,relay-stream1-down,0,58.786955565985494,nan,nan,nan,nan,nan,0,0,0,10.01,9.982659,0.13620541370291814,nan,23.4296875,0.11669085631349782,0.9506172839506173,0.20548885077186965,0.49753470059260185,0.4999145179863428,proxy +3proxy-bp,relay-stream1-down,0,61.28411123932518,nan,nan,nan,nan,nan,0,0,0,10.0,9.873379,0.13053124326333476,nan,34.73828125,0.1688602632315878,0.998003992015968,0.1944547134935305,0.5584672310515388,0.5070701486251032,proxy +nginx,relay-stream1-down,0,19.265401776729735,nan,nan,nan,nan,nan,0,0,0,10.0,9.99807,0.4151983658089936,nan,35.4140625,0.14247669773635152,0.9505703422053232,0.12208915502328677,0.40041420623925267,0.1833744942849387,proxy +nginx-halfclose,relay-stream1-down,0,19.4580101705419,nan,nan,nan,nan,nan,0,0,0,10.0,9.987888,0.4110908799147579,nan,34.0078125,0.14025207830517564,0.9487666034155597,0.15771175726927938,0.41659239758082744,0.18320655058268687,proxy +haproxy,relay-stream1-down,0,9.24269856126927,nan,nan,nan,nan,nan,0,0,0,10.01,10.000542000000001,0.8663177273871306,nan,34.16015625,0.10357250075052536,0.999001996007984,0.07120636017974422,0.3466659635325392,0.09581245739603621,proxy +haproxy-splice-auto,relay-stream1-down,0,27.38020247538261,nan,nan,nan,nan,nan,0,0,0,10.0,9.995488,0.29215389772078904,nan,42.51953125,0.13706826217024748,0.9505703422053232,0.10057061340941512,0.41193507482705954,0.24996414082552781,proxy +envoy,relay-stream1-down,0,32.75521572386923,nan,nan,nan,nan,nan,0,0,1,9.99,9.998531999999999,0.24395737613608356,nan,23.671875,0.08557717941882165,0.950523311132255,0.09634105404498154,0.340594889351067,0.2622999960325136,proxy +direct,relay-stream16,0,207.61323805296783,nan,nan,nan,nan,nan,0,0,10188,1.42,0.0,0.005469713014621761,nan,0.0,0.7784052405692342,0.3631713554987212,0.9497153700189753,2.8982749517674073,2.846791093325424,origin +3proxy-0.9.9.2,relay-stream16,0,24.31194032026222,nan,nan,nan,nan,nan,0,0,2328,10.04,10.044715,0.32946141942618856,nan,88.69921875,0.15406032482598608,0.9543726235741445,0.22210144927536232,0.2377601618493094,0.3970040496372848,proxy +3proxy-1.0.2,relay-stream16,0,24.520274777033926,nan,nan,nan,nan,nan,0,0,2127,10.04,10.042140999999999,0.3267392714131849,nan,106.37109375,0.14877764842840513,0.9543726235741445,0.21839501648955661,0.23774682498920977,0.4046377371909128,proxy +3proxy-devel-c37,relay-stream16,0,56.51960668514104,nan,nan,nan,nan,nan,0,0,1340,10.02,10.017083,0.14168152404548284,nan,110.1875,0.2028746465598492,0.9515669515669516,0.2562316715542522,0.5030373009544186,0.6418738395485586,proxy +3proxy-bp,relay-stream16,0,48.62170463591743,nan,nan,nan,nan,nan,0,0,4045,10.01,10.008482,0.16464496830386785,nan,145.1796875,0.3111801242236025,0.9515209125475285,0.3780248528449967,0.45274689296293097,0.6135050624372277,proxy +nginx,relay-stream16,0,19.56442988908947,nan,nan,nan,nan,nan,0,0,7543,10.02,10.020422,0.4090280966255658,nan,65.58984375,0.16763783056925147,0.9524714828897338,0.31666666666666665,0.19685596897940325,0.4511155296691545,proxy +nginx-halfclose,relay-stream16,0,18.931140584588455,nan,nan,nan,nan,nan,0,0,8679,10.03,10.019355,0.42325274837766935,nan,56.859375,0.18714096332302255,0.9516129032258065,0.32438408085912823,0.1930066171530596,0.432008160943572,proxy +haproxy,relay-stream16,0,10.488936114929269,nan,nan,nan,nan,nan,0,0,0,10.01,10.007584,0.7632139356593031,nan,47.73828125,0.17725387469984719,0.9515209125475285,0.639649816436035,0.11886959074868245,0.9211033240024775,origin +haproxy-splice-auto,relay-stream16,0,28.031697807411927,nan,nan,nan,nan,nan,0,0,1,10.02,10.008051,0.28586264958689195,nan,82.67578125,0.32944152558863593,0.9515669515669516,0.6844117647058824,0.2929294861684027,0.8566994867994318,proxy +envoy,relay-stream16,0,19.263234272028026,nan,nan,nan,nan,nan,0,0,9772,10.02,10.027893,0.41534839342326163,nan,107.484375,0.1556094335463963,0.9533777354900095,0.1736270963498849,0.19402365133022748,0.28880515081150687,proxy +direct,relay-ka-1k,0,1.4597855641600002,142781.7,0.418,0.487,0.556,0.705,0,0,0,1.12,0.0,0.6137887796661303,0.7766290140278616,0.0,0.8045212765957447,0.32941176470588235,0.9515418502202643,2.5064381405332927,0.9477463218679387,origin +3proxy-0.9.9.2,relay-ka-1k,0,0.21281898496,20818.95,2.86,3.88,5.01,9.33,0,0,0,10.1,10.105596,37.96653762594846,48.03370920107101,130.2578125,0.45087598763311576,0.9609895337773549,0.48169418521177315,0.5251928992782469,0.22432491114532424,proxy +3proxy-1.0.2,relay-ka-1k,0,0.2113929216,20676.94,2.88,3.89,4.99,7.96,0,0,0,10.1,10.104263,38.22266109406002,48.36284584223178,130.2890625,0.44714038128249567,0.9609895337773549,0.48902525371725275,0.5318620389282438,0.2252250166718163,proxy +3proxy-devel-c37,relay-ka-1k,0,0.21021851647999998,20560.31,2.89,3.92,5.0,7.71,0,0,0,10.09,10.100124000000001,38.398139874457556,48.58903977655783,15.78125,0.451037557880295,0.9600380589914367,0.4867612293144208,0.5271118423247974,0.23577005889313704,proxy +3proxy-bp,relay-ka-1k,0,0.38327549952,37486.1,1.68,2.47,3.53,6.31,0,0,0,10.1,10.089673,21.081441443867643,26.67807748792883,27.53515625,0.5272472402312949,0.9591642924976258,0.577639751552795,0.8725899905550899,0.32415088594988123,proxy +nginx,relay-ka-1k,0,0.53343158272,52177.54,1.18,1.33,1.49,1.74,0,0,0,10.1,10.095152,15.147209617397582,19.16479446232315,32.76953125,0.5037774725274725,0.9600760456273765,0.5640962671905697,0.7744120066129896,0.35825099400468374,proxy +nginx-halfclose,relay-ka-1k,0,0.55356424192,54140.3,1.14,1.26,1.39,1.62,0,0,0,10.1,10.080586,14.596318526599672,18.47157754587718,34.80859375,0.5073203949608444,0.9600760456273765,0.5728108369617804,0.7783755395919136,0.3765475230561466,proxy +haproxy,relay-ka-1k,0,0.53804531712,52623.07,1.18,1.3,1.43,1.68,0,0,0,10.01,10.000808,14.883504688535332,19.00306972664815,33.703125,0.5068166325835037,0.9515209125475285,0.5712212817412333,0.7821085311566677,0.38198446308388656,proxy +haproxy-splice-auto,relay-ka-1k,0,0.48544874495999996,47479.54,1.32,1.45,1.56,1.76,0,0,0,10.1,10.097038999999999,16.644393633494253,21.06259762305458,39.7421875,0.5215017064846417,0.9600760456273765,0.5829542734019632,0.820019659206104,0.4314146328776175,proxy +envoy,relay-ka-1k,0,0.38814089216000003,37963.36,1.61,1.87,2.16,2.56,0,0,0,10.08,10.069365000000001,20.77596090204236,26.29025695596382,16.74609375,0.5271661931818182,0.9581749049429658,0.5915835563123327,0.8838485985251453,0.35833083844836305,proxy +direct,relay-ka-50k-2000,0,40.544491274239995,98484.69,19.81,20.59,21.3,607.6,0,431,0,1.06,0.0,0.02091529510788999,1.0708704054860894,0.0,0.8289415898111551,0.30994152046783624,0.9528331750553973,2.7691193732471544,0.9506605942408897,origin +3proxy-0.9.9.2,relay-ka-50k-2000,0,5.34916366336,12994.43,35.89,51.08,67.15,149.76,0,389,0,10.38,10.329284000000001,1.5523922098102274,79.4452608376194,196.94140625,0.46978900255754474,0.9848197343453511,0.5169020111253744,0.4300740573608747,0.1425868506513374,proxy +3proxy-1.0.2,relay-ka-50k-2000,0,5.15614179328,12525.55,44.89,63.07,83.81,489.01,0,451,0,10.36,10.32842,1.607403429207814,82.32087660609143,197.125,0.4761151534324581,0.9847908745247148,0.5192266836626301,0.42241769225283454,0.14640045767622517,proxy +3proxy-devel-c37,relay-ka-50k-2000,0,5.20085307392,12634.32,44.27,62.9,84.55,569.42,0,456,0,10.34,10.30237,1.5905083036243528,81.42950520156559,110.171875,0.47284089088287135,0.9838249286393911,0.5222929936305732,0.4376737652645821,0.14733109085953067,proxy +3proxy-bp,relay-ka-50k-2000,0,9.53482739712,23229.15,82.81,94.77,95.31,352.74,0,0,0,10.13,10.091112,0.8499367280049366,43.32948372471021,143.203125,0.5319286871961102,0.9620132953466287,0.5686936936936937,0.6421818924160457,0.21759946527151056,proxy +nginx,relay-ka-50k-2000,0,7.47324309504,18203.38,34.28,58.04,65.5,75.14,0,538,0,10.17,10.130912,1.088683975153956,55.611148476845095,114.26953125,0.49903627124583844,0.9658119658119658,0.49382716049382713,0.5926841962404329,0.1833948342509675,proxy +nginx-halfclose,relay-ka-50k-2000,0,7.55914244096,18355.15,32.31,55.42,63.81,147.31,0,560,0,10.2,10.154851,1.0794875296679407,55.27676316616628,113.62109375,0.4984087694483734,0.9695817490494296,0.49634202103337904,0.6033137511150529,0.17301732273541878,proxy +haproxy,relay-ka-50k-2000,0,5.8299986739200005,14072.31,137.49,140.28,146.56,947.89,0,0,0,10.14,10.093328,1.3914239871594378,71.69573855802476,165.65625,0.522077922077922,0.9620493358633776,0.3321501014198783,0.8331028420422667,0.09589273099429078,proxy +haproxy-splice-auto,relay-ka-50k-2000,0,10.47972020224,25358.05,78.38,80.44,83.51,1120.0,0,0,0,10.14,10.110869000000001,0.7740664677541764,39.78139846916157,141.5703125,0.5181229773462783,0.9638783269961977,0.5427609427609428,0.6402155693115381,0.19676530976588053,proxy +envoy,relay-ka-50k-2000,0,6.03979776,14672.22,133.62,140.18,148.01,267.64,0,0,0,10.13,10.110002,1.341766781277127,68.69473227363967,242.078125,0.4358203677510608,0.9647619047619047,0.49539222297145424,0.4634115955645819,0.15113970846445987,proxy +direct,relay-ka-2k-50k-2000,0,38.39700762624,93292.99,19.98,21.31,22.14,667.37,0,630,0,0.78,0.0,0.016251266402686204,0.832247676908648,0.0,0.8423354471900284,0.2025974025974026,0.9540412044374009,2.730148478708448,0.9509748870273768,origin +3proxy-0.9.9.2,relay-ka-2k-50k-2000,0,4.82403680256,11718.87,50.17,68.9,89.63,351.77,0,443,0,10.34,10.306963,1.7147464537605202,87.82211350625965,193.7109375,0.4146043917741373,0.9828897338403042,0.5244416350611041,0.37968185833666807,0.14923385185356916,proxy +3proxy-1.0.2,relay-ka-2k-50k-2000,0,4.71808868352,11461.37,51.74,70.62,91.49,311.34,0,442,0,10.34,10.305024,1.75325233476293,89.69776883306152,198.51171875,0.41281512605042014,0.9828897338403042,0.5215179139283442,0.38156078687485045,0.1492146208300258,proxy +3proxy-devel-c37,relay-ka-2k-50k-2000,0,4.85893341184,11803.57,48.47,68.63,91.23,876.36,0,478,0,10.33,10.300013,1.7007847812572832,87.06352350209441,131.6328125,0.4181373405556526,0.9828734538534729,0.5224420336098703,0.3949321855443892,0.1559655842894796,proxy +3proxy-bp,relay-ka-2k-50k-2000,0,8.76173328384,21384.39,95.27,95.96,98.62,421.55,0,0,0,10.13,10.087242,0.924931145181843,47.11847062654077,138.72265625,0.48216783216783216,0.9629277566539924,0.561618917689859,0.5994417484857378,0.22623282960729021,proxy +nginx,relay-ka-2k-50k-2000,0,6.62884581376,16103.19,51.41,62.94,66.97,71.91,0,451,0,10.18,10.144977,1.228569833845717,62.83485173937733,119.48828125,0.4694663487988263,0.9667616334283001,0.4703923900118906,0.5556925127616125,0.1672669037067101,proxy +nginx-halfclose,relay-ka-2k-50k-2000,0,6.75048062976,16398.53,37.51,54.49,61.14,67.07,0,500,0,10.21,10.170985,1.2099879175996386,61.89529329033197,106.73828125,0.48501805054151625,0.9696106362773029,0.4913214533672761,0.5708948441138336,0.17015066477432195,proxy +haproxy,relay-ka-2k-50k-2000,0,5.4457165414399995,13146.98,147.31,151.26,155.01,1020.0,0,0,0,10.12,10.091072,1.4866730463093827,76.58775806744566,164.8671875,0.5180974038279326,0.9619771863117871,0.2840563691627521,0.8268233556416192,0.10551009677618714,proxy +haproxy-splice-auto,relay-ka-2k-50k-2000,0,9.8784247808,23937.13,81.9,85.34,89.45,1280.0,0,279,0,10.14,10.096864,0.821183557095735,42.10806074523793,139.7265625,0.44637404580152673,0.9629629629629629,0.5288868013151714,0.6906624162382647,0.20806105758913687,proxy +envoy,relay-ka-2k-50k-2000,0,5.6614715392,13753.17,142.7,145.7,152.25,260.6,0,0,0,10.16,10.120612,1.4356691442713736,73.50228247737418,203.19921875,0.39629352302508425,0.9648622981956315,0.44565217391304346,0.4509348388415532,0.16251122497914586,proxy +direct,relay-close-1k,0,0.49694113792,48797.27,0.79,1.13,1.5,2.19,0,0,0,4.58,0.0,7.373106632580394,9.293303140243655,0.0,0.7533490937746257,0.49782608695652175,0.9243360098826436,2.1535146822945315,0.8618664188220424,origin +3proxy-0.9.9.2,relay-close-1k,0,0.05419040768,5320.52,11.54,13.65,16.1,19.44,0,0,0,10.02,9.890177999999999,147.92285836517996,188.02424424386857,142.390625,0.3422562141491396,0.9533777354900095,0.4483457123565159,0.30453289757451846,0.09414954009725672,proxy +3proxy-1.0.2,relay-close-1k,0,0.05335154688,5240.72,11.72,13.82,16.29,19.84,0,0,0,10.02,9.885726,150.2486894715507,190.97354578028512,150.03515625,0.34218063776971547,0.9533777354900095,0.4467222347375535,0.3006963804769606,0.09317317307061321,proxy +3proxy-devel-c37,relay-close-1k,0,0.0633339904,6218.54,9.9,10.92,13.06,17.68,0,0,0,10.02,10.010657,126.56710795219371,160.80627818523215,18.1171875,0.40779636881452475,0.9524714828897338,0.4794098216251927,0.3567393481416174,0.10072748335342992,proxy +3proxy-bp,relay-close-1k,0,0.10250878976000001,10064.64,6.05,7.87,9.76,14.07,0,0,0,10.0,9.980534,78.04208808561785,99.19552429794368,29.87109375,0.4596534220199545,0.9514747859181731,0.5363092695429303,0.5137802892128659,0.14254850920156326,proxy +nginx,relay-close-1k,0,0.0897581056,8816.89,7.09,7.33,7.62,8.59,0,0,0,10.01,9.989663,89.21756922641647,113.42519149707655,35.6953125,0.48150105708245244,0.9506172839506173,0.5349918623575912,0.5470426927080233,0.16344638419482116,proxy +nginx-halfclose,relay-close-1k,0,0.09034530816,8874.37,7.06,7.29,7.54,8.23,0,0,0,10.02,9.997107,88.72624559322772,112.7514966017014,34.65234375,0.48085704250087813,0.9515669515669516,0.5407424702311464,0.5412999687589294,0.16343905243901233,proxy +haproxy,relay-close-1k,0,0.10393485312,10203.64,6.12,6.35,6.59,7.24,0,0,0,10.02,9.989959,77.12523527353207,98.12562430225043,34.1015625,0.49003576903423607,0.9506641366223909,0.5480396380870315,0.5486884462193306,0.14153689292615274,proxy +haproxy-splice-auto,relay-close-1k,0,0.10376708096,10186.91,6.12,6.37,6.62,7.31,0,0,0,10.01,9.995038000000001,77.17283676011773,98.11705433195127,40.76953125,0.489093387866394,0.9515209125475285,0.5485050548505055,0.5431432019888321,0.1425193695405514,proxy +envoy,relay-close-1k,0,0.09504292864,9331.58,6.53,7.11,7.74,9.56,0,0,0,10.0,9.979254000000001,84.17249041537953,106.93471635566486,18.55859375,0.36320305052430885,0.9505703422053232,0.5075170842824601,0.4204562561895927,0.14346050975580996,proxy +3proxy-0.9.9.2,relay-stream1-down,1,24.230440851103314,nan,nan,nan,nan,nan,0,0,0,10.01,10.001672000000001,0.33045116917909945,nan,20.0703125,0.07592319054652881,0.9506172839506173,0.1785938480853735,0.3746743676106903,0.22790446936006697,proxy +3proxy-1.0.2,relay-stream1-down,1,24.34703548765349,nan,nan,nan,nan,nan,0,0,1,10.0,9.997748,0.32857703788841275,nan,19.0390625,0.11821438412785891,0.9505703422053232,0.1641503372952136,0.4024103633080367,0.22521549488873793,proxy +3proxy-devel-c37,relay-stream1-down,1,67.05223271118597,nan,nan,nan,nan,nan,0,0,0,10.0,9.818923999999999,0.11929540592193114,nan,23.0625,0.15583377730420883,0.9505703422053232,0.21426168853010427,0.5346484427335827,0.5169824277060543,proxy +3proxy-bp,relay-stream1-down,1,59.37231027176527,nan,nan,nan,nan,nan,0,0,0,10.0,9.967221,0.1347306855607749,nan,35.30078125,0.10179464548396587,0.9505703422053232,0.19183815835367982,0.5118928314513979,0.4771099950837431,proxy +nginx,relay-stream1-down,1,20.206292276582385,nan,nan,nan,nan,nan,0,0,0,10.01,9.993825,0.39628179796184304,nan,35.2421875,0.20707795313247251,0.9506172839506173,0.25161290322580643,0.4698946503679264,0.19572687129567445,proxy +nginx-halfclose,relay-stream1-down,1,19.5078255085202,nan,nan,nan,nan,nan,0,0,0,10.0,9.993786,0.41004361593922484,nan,36.6328125,0.19892996108949415,0.949667616334283,0.06247781327653532,0.46137607792961666,0.16725603827606883,proxy +haproxy,relay-stream1-down,1,9.114116364194846,nan,nan,nan,nan,nan,0,0,0,10.0,9.949677,0.8776581498981928,nan,34.16015625,0.08034880099657428,0.998003992015968,0.23895299746692936,0.34369809367977516,0.10483035908240416,proxy +haproxy-splice-auto,relay-stream1-down,1,27.30891429343911,nan,nan,nan,nan,nan,0,0,0,10.0,10.000762,0.29291101138143655,nan,42.49609375,0.11211846479298881,0.999000999000999,0.258133824432167,0.40764068213321814,0.2915307348720038,proxy +envoy,relay-stream1-down,1,36.863291882679434,nan,nan,nan,nan,nan,0,0,0,10.0,10.004963,0.21699321184683557,nan,23.76953125,0.18457300275482094,0.9505703422053232,0.1451870802686281,0.46330010631315804,0.27660059296299544,proxy +direct,relay-stream1-down,1,60.05407477961163,nan,nan,nan,nan,nan,0,0,0,0.05,0.0,0.0006659934505083078,nan,0.0,0.20223226149348925,0.01020408163265306,0.3328899235118058,0.6892597157555734,0.9967813123098389,origin +3proxy-0.9.9.2,relay-stream16,1,23.2950180171129,nan,nan,nan,nan,nan,0,0,2211,10.04,10.030557,0.34297704397745993,nan,97.7890625,0.14689397477814106,0.9534662867996201,0.22210065645514224,0.23011687217555962,0.39599464851036914,proxy +3proxy-1.0.2,relay-stream16,1,23.367333782838376,nan,nan,nan,nan,nan,0,0,2234,10.04,10.027190000000001,0.3429939375069965,nan,92.1953125,0.1591328413284133,0.9534662867996201,0.22406938923021322,0.23301049563039203,0.4065895606923602,proxy +3proxy-devel-c37,relay-stream16,1,54.77276970984427,nan,nan,nan,nan,nan,0,0,1340,10.03,10.016364000000001,0.14633110520350687,nan,103.01171875,0.20517038777908342,0.9516129032258065,0.2526547052361772,0.501180704608855,0.6240698037663622,proxy +3proxy-bp,relay-stream16,1,46.094185651703775,nan,nan,nan,nan,nan,0,0,4257,10.03,10.019635999999998,0.17382583791643286,nan,92.6171875,0.2962962962962963,0.9525166191832859,0.38323160938001927,0.44871485271542305,0.591511314508326,proxy +nginx,relay-stream16,1,18.737686678350485,nan,nan,nan,nan,nan,0,0,8365,10.02,10.01709,0.42720925654464526,nan,59.4375,0.1804294885986274,0.9515669515669516,0.3231170524942941,0.1883111165259456,0.416038602549027,proxy +nginx-halfclose,relay-stream16,1,18.599112401540037,nan,nan,nan,nan,nan,0,0,6551,10.03,10.019054,0.43074565526105807,nan,67.82421875,0.17022711940634136,0.9525166191832859,0.3005683717820127,0.19114881567921854,0.41220345713445344,proxy +haproxy,relay-stream16,1,8.799748802225519,nan,nan,nan,nan,nan,0,0,0,10.03,10.007527999999999,0.9116154862695373,nan,39.43359375,0.2309941520467836,0.9516129032258065,0.5995047972763851,0.1179534267688806,0.9147146782737092,origin +haproxy-splice-auto,relay-stream16,1,27.061406066560362,nan,nan,nan,nan,nan,0,0,3,10.02,10.008336,0.29611272239722736,nan,99.52734375,0.31202046035805625,0.9515669515669516,0.6961953435547984,0.2834172783231491,0.7835685378204146,proxy +envoy,relay-stream16,1,19.95168885624787,nan,nan,nan,nan,nan,0,0,8749,10.04,10.026406,0.4018736187075365,nan,127.07421875,0.1556094335463963,0.9534662867996201,0.18220617202889033,0.1977512852702436,0.297248724126108,proxy +direct,relay-stream16,1,206.62565280777292,nan,nan,nan,nan,nan,0,0,5859,0.69,0.0,0.0026703213682038283,nan,0.0,0.7889014722536807,0.1875,0.9496994621955077,2.9380060546704607,2.1985929135473263,origin +3proxy-0.9.9.2,relay-ka-1k,1,0.21533556736,21057.88,2.82,3.81,4.85,7.44,0,0,0,10.1,10.095469999999999,37.52283052474921,47.49074870811057,130.484375,0.44848380427291523,0.9600760456273765,0.4883116883116883,0.5300657764409642,0.21395692940769662,proxy +3proxy-1.0.2,relay-ka-1k,1,0.21038628863999997,20581.55,2.9,3.9,4.99,7.97,0,0,0,10.02,10.006307999999999,38.101342306182715,48.65400302994989,130.34765625,0.448358824540299,0.9515669515669516,0.4789272030651341,0.5232981696190254,0.20622638181677452,proxy +3proxy-devel-c37,relay-ka-1k,1,0.21239955456,20771.54,2.87,3.86,4.93,7.8,0,0,0,10.01,10.008434,37.702527279725764,48.156486933764384,15.7734375,0.4452757960675135,0.9524262607040913,0.48735523516899076,0.5347324207594878,0.23473400562567817,proxy +3proxy-bp,relay-ka-1k,1,0.38335938560000005,37498.75,1.7,2.45,3.45,6.07,0,0,0,10.0,9.994998,20.868146967314004,26.65387280771896,28.77734375,0.5332061730535808,0.949667616334283,0.5813559322033899,0.88281994389692,0.34870443684844005,proxy +nginx,relay-ka-1k,1,0.53594816512,52421.46,1.18,1.31,1.44,1.68,0,0,0,10.11,10.095054,15.091011643241803,19.095972846319917,32.84375,0.5057451552049391,0.9610266159695817,0.5740107474352711,0.7802450610610915,0.39457007953779094,proxy +nginx-halfclose,relay-ka-1k,1,0.53385101312,52216.67,1.18,1.32,1.47,1.77,0,0,0,10.11,10.081349,15.150294372827132,19.171291985793143,35.28125,0.5043044077134986,0.9601139601139601,0.5778529980657641,0.783111394780693,0.3821579028091824,proxy +haproxy,relay-ka-1k,1,0.5297405951999999,51816.93,1.2,1.32,1.45,1.71,0,0,0,10.09,10.096038,15.237646639016727,19.280230216267242,33.703125,0.5087928973877411,0.9591254752851711,0.5732298739088264,0.7819326056833916,0.38862712957417284,proxy +haproxy-splice-auto,relay-ka-1k,1,0.51187286016,50066.63,1.25,1.38,1.5,1.73,0,0,0,10.1,10.096313,15.78516977335812,19.974764554879183,39.78125,0.5161345108695652,0.9591642924976258,0.5745349118144479,0.8017778060774324,0.3808737177223672,proxy +envoy,relay-ka-1k,1,0.38545653760000004,37700.09,1.62,1.88,2.17,2.56,0,0,0,10.1,10.089558,20.96215581219396,26.524989954644894,16.765625,0.5297440423654016,0.9600760456273765,0.594881699661999,0.8772161932209736,0.3944617416658318,proxy +direct,relay-ka-1k,1,1.45324244992,142142.64,0.435,0.504,0.5640000000000001,0.685,0,0,0,0.75,0.0,0.41286985529016823,0.5224212763378686,0.0,0.8091193562807332,0.24671052631578946,0.9545311019892643,2.515553929835529,0.9537098846688294,origin +3proxy-0.9.9.2,relay-ka-50k-2000,1,5.173673984,12568.16,45.41,64.33,86.38,531.11,0,492,0,10.34,10.292974,1.5988637911050871,81.8932061903027,196.44140625,0.47839798170923997,0.9819563152896487,0.520442930153322,0.4299869896544357,0.14823309910511182,proxy +3proxy-1.0.2,relay-ka-50k-2000,1,5.0998542336,12388.87,48.36,66.81,88.23,266.89,0,485,0,10.34,10.298856,1.6220071439494408,83.10961788866204,199.59375,0.4802641924830948,0.9819563152896487,0.5223214285714286,0.4270632762556521,0.15105884588204177,proxy +3proxy-devel-c37,relay-ka-50k-2000,1,5.2292065689600005,12703.15,44.89,63.55,84.33,273.84,0,465,0,10.3,10.270715999999998,1.5757648682138017,80.66158159349695,99.9765625,0.47878404053198226,0.9790874524714829,0.5236981934112647,0.4386898652369639,0.14732003007234534,proxy +3proxy-bp,relay-ka-50k-2000,1,9.448928051200001,22995.39,92.05,94.87,95.49,350.26,0,0,0,10.1,10.07224,0.8551234548742122,43.71007668738207,144.91796875,0.5340890688259109,0.9609895337773549,0.5678233438485805,0.6401314929282186,0.21948302106160653,proxy +nginx,relay-ka-50k-2000,1,7.16194185216,17398.11,38.05,63.52,69.36,72.81,0,477,0,10.18,10.145741000000001,1.1371217706192094,58.174087958306664,120.0859375,0.49921397379912663,0.967680608365019,0.49046196276717996,0.5784397214792065,0.16630952946050578,proxy +nginx-halfclose,relay-ka-50k-2000,1,7.210008576,17515.03,39.98,64.95,69.67,231.13,0,463,0,10.21,10.166889,1.1328696649805483,57.95439709830678,121.28515625,0.5016513123587694,0.9686907020872866,0.49175824175824173,0.5785383000049252,0.17773164851005047,proxy +haproxy,relay-ka-50k-2000,1,5.90004355072,14254.26,135.94,138.34,143.48,867.63,0,0,0,10.12,10.0891,1.3721932610161869,70.65608221798658,165.265625,0.5207703927492447,0.9628924833491912,0.3340086097746265,0.8725146906822367,0.09412550286292784,proxy +haproxy-splice-auto,relay-ka-50k-2000,1,10.39382085632,25192.42,79.72,81.81,85.4,1310.0,0,59,0,10.14,10.104326,0.780463711289335,40.02700046185001,141.734375,0.5290840570211371,0.9638783269961977,0.5468784963078989,0.7106980435114424,0.19859459176579958,proxy +envoy,relay-ka-50k-2000,1,6.03946221568,14671.37,133.81,138.93,156.0,286.0,0,0,0,10.16,10.123514,1.3458151917728067,68.81091221867783,240.9609375,0.4524584546856262,0.9657794676806084,0.5076957394601829,0.47481204923562453,0.15111291357484732,proxy +direct,relay-ka-50k-2000,1,41.2316860416,100147.21,19.0,20.16,21.05,696.71,0,558,0,1.14,0.0,0.02211891114711761,1.1348116411765408,0.0,0.8244844229925405,0.3333333333333333,0.9534515516149462,2.7582801820959757,0.9510119586772509,origin +3proxy-0.9.9.2,relay-ka-2k-50k-2000,1,4.75449524224,11549.99,53.35,73.91,96.77,443.32,0,491,0,10.33,10.299656,1.7381445514091118,89.03176874148897,199.28515625,0.41582608695652173,0.9819391634980988,0.5235169491525423,0.3813902077907312,0.15770736703978158,proxy +3proxy-1.0.2,relay-ka-2k-50k-2000,1,4.623549071359999,11231.77,45.77,65.32,86.41,169.1,0,553,0,10.34,10.295484,1.789101807362633,91.5489840187702,197.44140625,0.4153605015673981,0.9828897338403042,0.518542199488491,0.3815788357356873,0.1473798174855235,proxy +3proxy-devel-c37,relay-ka-2k-50k-2000,1,4.6734612889600005,11352.88,52.08,72.71,95.96,432.5,0,453,0,10.36,10.3124,1.7734179203706113,90.8015250449187,107.7734375,0.4138776940599264,0.9838556505223172,0.5236386661038412,0.38909963622467525,0.1501826807808919,proxy +3proxy-bp,relay-ka-2k-50k-2000,1,8.504035246079999,20628.0,95.65,96.56,100.79,365.84,0,0,0,10.11,10.086972000000001,0.9510779019558069,48.71350101185314,143.0859375,0.4789446094705574,0.9628571428571429,0.5565177757520511,0.5947402252949772,0.21963795304975858,proxy +nginx,relay-ka-2k-50k-2000,1,6.73630388224,16364.13,38.04,54.11,60.5,65.98,0,501,0,10.16,10.138284,1.2065963979785936,61.78056952442339,109.72265625,0.47932093191258807,0.966698382492864,0.4942449355432781,0.5632970331844686,0.1739261105872193,proxy +nginx-halfclose,relay-ka-2k-50k-2000,1,6.67406041088,16212.95,44.59,53.88,61.16,66.18,0,495,0,10.2,10.168606,1.2226440124362123,62.54292161287158,111.1640625,0.4750727802037846,0.9695817490494296,0.4917165209387943,0.5594455111240078,0.1776887667266503,proxy +haproxy,relay-ka-2k-50k-2000,1,5.455195668479999,13158.42,147.57,150.78,153.99,905.27,0,0,0,10.13,10.09111,1.4855562462818215,76.52155520807366,165.38671875,0.5127238454288408,0.9620132953466287,0.28283107547691455,0.7970634580639258,0.10260821417810312,proxy +haproxy-splice-auto,relay-ka-2k-50k-2000,1,9.53482739712,23259.88,83.8,88.54,92.7,1270.0,0,287,0,10.14,10.106949,0.8507757573514371,43.36984555373541,140.3125,0.44694656488549617,0.9647954329210275,0.5167464114832536,0.6936716978028741,0.20816630486480037,proxy +envoy,relay-ka-2k-50k-2000,1,5.82932758528,14160.95,138.52,141.39,150.37,272.34,0,0,0,10.18,10.143905,1.3970736557274503,71.45263630748498,244.1015625,0.38315988647114474,0.967680608365019,0.4289385762014906,0.46055108417093243,0.15969928509135345,proxy +direct,relay-ka-2k-50k-2000,1,37.96751089664,92223.39,21.1,21.86,22.62,235.53,0,115,0,0.88,0.0,0.018542168906371517,0.949423764508382,0.0,0.8505923650724002,0.2216624685138539,0.9540412044374009,2.781541734755686,0.950661932559255,origin +3proxy-0.9.9.2,relay-close-1k,1,0.0541065216,5314.94,11.56,13.66,16.1,19.42,0,0,0,10.03,9.900928,148.30005261325095,188.22955372893443,145.99609375,0.34186401833460656,0.9543292102759277,0.44952681388012616,0.30163844590658945,0.0941107596417067,proxy +3proxy-1.0.2,relay-close-1k,1,0.05377097728,5276.51,11.62,13.74,16.18,19.6,0,0,0,10.01,9.886057999999998,148.92792366968115,189.42189421894219,143.0703125,0.34374404875261855,0.9524262607040913,0.4487034949267193,0.3035468301242527,0.09409112127810136,proxy +3proxy-devel-c37,relay-close-1k,1,0.06341787648,6231.01,9.9,10.93,13.05,17.59,0,0,0,10.02,10.012862,126.39969114273315,160.44835868694955,18.37890625,0.4085409252669039,0.9533777354900095,0.4806800618238022,0.3615871347723506,0.10360564694674027,proxy +3proxy-bp,relay-close-1k,1,0.1035993088,10175.4,5.96,7.76,9.6,13.73,0,0,0,10.08,10.061923,77.83835716093118,98.08214379542868,29.875,0.4634826564406484,0.9590865842055185,0.5391508427565607,0.5156685104629104,0.14355979474668176,proxy +nginx,relay-close-1k,1,0.09000976384,8837.81,7.08,7.32,7.58,8.26,0,0,0,10.02,9.997375000000002,89.05700512945594,113.19987346920331,33.046875,0.4820485744456177,0.9515669515669516,0.5350510677808727,0.5432815290014451,0.16252270329546123,proxy +nginx-halfclose,relay-close-1k,1,0.08925478912000001,8764.63,7.16,7.39,7.64,8.42,0,0,0,10.02,9.987357999999999,89.81030686457353,114.23099285201272,35.20703125,0.4783221713077194,0.9506641366223909,0.5363975734951003,0.536659451429317,0.16156847055929527,proxy +haproxy,relay-close-1k,1,0.10334765056,10144.2,6.13,6.42,6.73,7.44,0,0,0,10.01,9.990694,77.48603820800781,98.60126083530339,34.265625,0.4880423641954219,0.9515209125475285,0.5489306545690213,0.546031232409427,0.14349768814028382,proxy +haproxy-splice-auto,relay-close-1k,1,0.10284433408,10095.43,6.15,6.45,6.79,7.54,0,0,0,10.01,9.993217,77.86525209809594,99.06281235464685,40.36328125,0.48515358361774746,0.9506172839506173,0.546314205888674,0.5402725777257715,0.14053819079770594,proxy +envoy,relay-close-1k,1,0.09453961216,9279.28,6.58,7.17,7.8,9.47,0,0,0,10.0,9.982384,84.62061370064332,107.53150673147232,18.50390625,0.36439710916698365,0.9505703422053232,0.5086520947176685,0.42128250242907633,0.14249772917074732,proxy +direct,relay-close-1k,1,0.5325927219200001,52296.72,0.761,1.08,1.42,2.07,0,0,0,4.56,0.0,6.8495115495550465,8.633551191657263,0.0,0.7845995893223819,0.5247410817031071,0.9313877677739832,2.332488747021207,0.8752256761057282,origin +3proxy-1.0.2,relay-stream1-down,2,25.149136891867638,nan,nan,nan,nan,nan,0,0,0,10.01,10.000838,0.31838178704219994,nan,21.16796875,0.07149213883120736,0.9506172839506173,0.23388042203985931,0.3813283386647907,0.2441563840462299,proxy +3proxy-devel-c37,relay-stream1-down,2,64.31270355129475,nan,nan,nan,nan,nan,0,0,0,9.99,9.910217,0.12425399879228875,nan,24.05859375,0.12924025791982058,0.9496197718631179,0.18800420904945633,0.5353111427398131,0.49654876153399236,proxy +3proxy-bp,relay-stream1-down,2,64.11262175038475,nan,nan,nan,nan,nan,0,0,0,9.99,9.813201,0.12464088413565948,nan,34.23828125,0.17257749232058084,0.998001998001998,0.19845075617853192,0.5424381503342838,0.5218125953783823,proxy +nginx,relay-stream1-down,2,19.46656902561896,nan,nan,nan,nan,nan,0,0,0,10.0,9.997924000000001,0.4109137514205387,nan,35.66015625,0.1386645126548196,0.9514747859181731,0.06579412805093739,0.4061173041144934,0.17674281573034883,proxy +nginx-halfclose,relay-stream1-down,2,20.0908475736004,nan,nan,nan,nan,nan,0,0,0,9.99,9.984944,0.3977479288351998,nan,33.01953125,0.1898422090729783,0.9496197718631179,0.2406933788007957,0.42904094572351575,0.19384426714286743,proxy +haproxy,relay-stream1-down,2,9.863112061755155,nan,nan,nan,nan,nan,0,0,0,10.0,9.999177,0.8110078908135171,nan,33.8203125,0.19757200666507974,0.9505703422053232,0.03295956506965681,0.3653431040480585,0.0874482126015442,proxy +haproxy-splice-auto,relay-stream1-down,2,28.72996096204015,nan,nan,nan,nan,nan,0,0,0,10.01,10.000374,0.27871027746060406,nan,42.81640625,0.1886932804363997,0.9506172839506173,0.13287671232876713,0.46703511840446327,0.2498978191351027,proxy +envoy,relay-stream1-down,2,33.79796836038228,nan,nan,nan,nan,nan,0,0,0,10.01,10.001816,0.23691199278381575,nan,24.4765625,0.10384934921074494,0.999001996007984,0.10546601261387527,0.35465050770199663,0.2744998038885261,proxy +direct,relay-stream1-down,2,84.7553587409385,nan,nan,nan,nan,nan,0,0,0,0.04,0.0,0.0003775157212767773,nan,0.0,0.21800433839479394,0.008695652173913044,0.3528343023255814,0.8152221742584312,0.9581916528543236,origin +3proxy-0.9.9.2,relay-stream1-down,2,23.766520613267257,nan,nan,nan,nan,nan,0,0,1,10.02,10.002419,0.33723237755472274,nan,20.90234375,0.07373408350607048,0.9515669515669516,0.1502607561929596,0.37763163811487654,0.22240641327817318,proxy +3proxy-1.0.2,relay-stream16,2,23.77283728367894,nan,nan,nan,nan,nan,0,0,2215,10.03,10.024256,0.3369164702938774,nan,100.63671875,0.1533457249070632,0.9534220532319392,0.23071402942231792,0.23299815393528675,0.40840806469907603,proxy +3proxy-devel-c37,relay-stream16,2,55.658658170313245,nan,nan,nan,nan,nan,0,0,1330,10.03,10.016751000000001,0.14400772921155763,nan,103.29296875,0.2045614860098754,0.9516129032258065,0.24972375690607734,0.4991688376373839,0.6171892764044187,proxy +3proxy-bp,relay-stream16,2,48.465138084516816,nan,nan,nan,nan,nan,0,0,4020,10.02,10.009337,0.16524085449958606,nan,124.91015625,0.303522463615271,0.9524714828897338,0.35144312393887944,0.46327997312438873,0.6005364474836362,proxy +nginx,relay-stream16,2,18.809350746606917,nan,nan,nan,nan,nan,0,0,7123,10.04,10.01864,0.42633465480272054,nan,63.3671875,0.17304678755316769,0.952561669829222,0.3046072257209148,0.19023099916465888,0.41894178657934417,proxy +nginx-halfclose,relay-stream16,2,18.49658583233678,nan,nan,nan,nan,nan,0,0,11297,10.03,10.017477,0.43325271281613764,nan,54.35546875,0.21419382504288165,0.9516129032258065,0.34545454545454546,0.19109264642638965,0.42540598673727276,proxy +haproxy,relay-stream16,2,8.74694894129022,nan,nan,nan,nan,nan,0,0,0,10.03,10.006176,0.9170450853668584,nan,39.32421875,0.20946519524617996,0.9507109004739337,0.61749776052553,0.1150719288572657,0.9173759080650107,origin +haproxy-splice-auto,relay-stream16,2,29.557333720439537,nan,nan,nan,nan,nan,0,0,2,10.02,10.004311999999999,0.27113603241410683,nan,151.6640625,0.32613307618129217,0.9515669515669516,0.700759789596727,0.30152866062923417,0.8893404479326967,proxy +envoy,relay-stream16,2,19.87327123969175,nan,nan,nan,nan,nan,0,0,8105,10.03,10.025072,0.4031570007135462,nan,143.81640625,0.15697930427124615,0.9525166191832859,0.17658664912857613,0.19590435654510005,0.2973448035778755,proxy +direct,relay-stream16,2,209.0346910702736,nan,nan,nan,nan,nan,0,0,6414,1.47,0.0,0.00562398765651217,nan,0.0,0.8215718668869483,0.4362017804154303,0.996349153667441,2.926923704987395,2.985886621606191,origin +3proxy-0.9.9.2,relay-stream16,2,24.205101395691884,nan,nan,nan,nan,nan,0,0,2204,10.04,10.022477,0.33037083513939564,nan,95.15625,0.1571759259259259,0.952561669829222,0.22542311847317248,0.23108909127965385,0.39889155909876717,proxy +3proxy-1.0.2,relay-ka-1k,2,0.21290287104,20827.66,2.85,3.85,4.91,7.74,0,0,0,10.11,10.104831,37.98915421145465,48.06069623833542,130.3515625,0.4522052514158229,0.9610266159695817,0.48725887115979993,0.5290995465826303,0.22148591696370243,proxy +3proxy-devel-c37,relay-ka-1k,2,0.21248344064,20782.53,2.85,3.85,4.91,7.69,0,0,0,10.11,10.100121,38.06414267219577,48.16510483413767,15.59375,0.4513243894048848,0.9601139601139601,0.484688995215311,0.5309673407738857,0.20721527132026085,proxy +3proxy-bp,relay-ka-1k,2,0.37698404352,36870.85,1.71,2.52,3.62,6.54,0,0,0,10.09,10.087330999999999,21.412046845881314,27.096122756983494,27.58984375,0.5297598329272537,0.9591254752851711,0.5885019083969466,0.8677207349492897,0.3564500972945886,proxy +nginx,relay-ka-1k,2,0.5355287347200001,52380.17,1.18,1.31,1.44,1.66,0,0,0,10.1,10.079557,15.087892537128953,19.09197796672325,35.27734375,0.5129032258064516,0.9582542694497154,0.5749636098981077,0.7962758893309678,0.3744062860976933,proxy +nginx-halfclose,relay-ka-1k,2,0.49937383424000004,48839.57,1.29,1.41,1.52,1.72,0,0,0,10.09,10.093199,16.164242990994563,20.455121382595916,32.85546875,0.518848526387937,0.9600380589914367,0.5820537428023033,0.8143288947041489,0.4162994385355238,proxy +haproxy,relay-ka-1k,2,0.52118421504,50979.04,1.22,1.35,1.47,1.68,0,0,0,10.11,10.100842,15.518505293525166,19.63510936231535,33.7109375,0.5068610634648371,0.9601139601139601,0.5787951807228916,0.7782511167847125,0.3726759997099588,proxy +haproxy-splice-auto,relay-ka-1k,2,0.51875151872,50740.55,1.23,1.35,1.47,1.68,0,0,0,10.1,10.101369,15.5758580137502,19.708586113837573,39.70703125,0.5146059782608695,0.9600760456273765,0.5741010689990281,0.791356649524836,0.3581666824920396,proxy +envoy,relay-ka-1k,2,0.38872809472000003,38021.06,1.61,1.87,2.16,2.54,0,0,0,10.1,10.075553,20.785737150848348,26.302768301257846,16.77734375,0.5298362964266854,0.9582542694497154,0.595370147094285,0.8808549210241945,0.4076194414037617,proxy +direct,relay-ka-1k,2,1.4633926655999998,143131.87,0.425,0.492,0.553,0.671,0,0,0,0.85,0.0,0.4646736422730367,0.5880139241697243,0.0,0.8097147950089126,0.275974025974026,0.9542586750788643,2.520733454886444,0.9552868934176335,origin +3proxy-0.9.9.2,relay-ka-1k,2,0.21441282048,20968.19,2.83,3.83,4.9,7.63,0,0,0,10.1,10.104429,37.68431375470706,47.69325211314162,130.4921875,0.44841338650945034,0.9609895337773549,0.4901821622900402,0.5338349869102916,0.2366503803908838,proxy +3proxy-1.0.2,relay-ka-50k-2000,2,5.05430409216,12278.27,50.4,68.59,90.47,400.26,0,433,0,10.33,10.305931,1.6350421045735517,83.77124691838588,196.53515625,0.48272087568412825,0.9828734538534729,0.5222808870116157,0.4196640700961726,0.14640564422667843,proxy +3proxy-devel-c37,relay-ka-50k-2000,2,5.22073407488,12682.53,44.6,63.3,84.51,235.1,0,465,0,10.3,10.259183,1.5783221060133004,80.882006501971,101.14453125,0.4770700636942675,0.9790874524714829,0.5230507754408328,0.44056757626332455,0.1473112206909147,proxy +3proxy-bp,relay-ka-50k-2000,2,9.448928051200001,22958.57,91.93,94.88,95.58,361.19,0,0,0,10.12,10.069213,0.8568167686462402,43.84463748023309,138.14453125,0.5360258481421648,0.9619771863117871,0.5747906766236706,0.6432260076101385,0.22430593515929412,proxy +nginx,relay-ka-50k-2000,2,7.47324309504,18109.81,34.53,56.87,64.76,70.57,0,540,0,10.17,10.136419,1.088683975153956,55.88556921403019,110.73828125,0.49982462293931956,0.9667300380228137,0.5072853620264515,0.5925781493270742,0.18243140102334304,proxy +nginx-halfclose,relay-ka-50k-2000,2,7.38734374912,18029.59,33.18,55.78,63.07,113.63,0,546,0,10.19,10.164200999999998,1.1035089575967123,56.19495624072838,113.14453125,0.4998249299719888,0.9695528068506185,0.501244625480878,0.5879906768240136,0.1805556890415924,proxy +haproxy,relay-ka-50k-2000,2,5.86439196672,14154.25,137.04,140.42,144.7,1000.0,0,0,0,10.12,10.080346,1.3805352790100343,71.1578621703148,164.9609375,0.5213756412692381,0.9610636277302944,0.3364415322580645,0.8912711384645584,0.09500987190657288,proxy +haproxy-splice-auto,relay-ka-50k-2000,2,10.39382085632,25214.36,78.98,81.09,84.97,1290.0,0,40,0,10.14,10.109635,0.780463711289335,40.00378734081333,143.9296875,0.5339694028623129,0.9629629629629629,0.5561235830184486,0.730794306464967,0.20531593537525736,proxy +envoy,relay-ka-50k-2000,2,6.31293083648,15335.76,128.61,131.92,142.47,233.46,0,0,0,10.17,10.137135,1.2887833259609285,65.91569013792389,262.46484375,0.42210695761044537,0.9667300380228137,0.4683954619124797,0.47474827874751935,0.14734754656136917,proxy +direct,relay-ka-50k-2000,2,40.63039062016001,98638.24,19.38,20.61,21.57,787.27,0,337,0,0.89,0.0,0.017523828570988918,0.8980999635714509,0.0,0.8251042352424841,0.278125,0.9525015832805573,2.762275395507126,0.9500841490651455,origin +3proxy-0.9.9.2,relay-ka-50k-2000,2,5.04247615488,12249.55,50.57,69.33,92.62,577.45,0,502,0,10.34,10.301437,1.6404638804279787,83.8577823914877,200.453125,0.4783634933123525,0.9838249286393911,0.521711501800466,0.4157844649969466,0.14542071150329375,proxy +3proxy-1.0.2,relay-ka-2k-50k-2000,2,4.75290140672,11545.99,52.77,73.37,95.73,223.84,0,529,0,10.33,10.300832,1.738727419911499,89.00185241028734,197.6328125,0.41551874455100263,0.9819391634980988,0.5243825205826472,0.38143053080435724,0.1596243299093221,proxy +3proxy-devel-c37,relay-ka-2k-50k-2000,2,4.796689940479999,11652.48,50.12,69.66,90.75,164.08,0,582,0,10.31,10.278303000000001,1.719519106372473,88.02711679174884,112.0625,0.4189118720667478,0.9800380228136882,0.5252589304586768,0.3919662567373362,0.15778043454028037,proxy +3proxy-bp,relay-ka-2k-50k-2000,2,8.84763262976,21528.85,95.16,95.72,97.94,276.06,0,0,0,10.13,10.088842,0.9159512311509511,46.80302533277274,149.05859375,0.47692849594927794,0.9629277566539924,0.5619759800589168,0.5956036387604057,0.22531628495725725,proxy +nginx,relay-ka-2k-50k-2000,2,6.70644043776,16291.73,36.81,53.61,59.27,66.45,0,502,0,10.17,10.132827,1.213162194685424,62.11218058337812,104.54296875,0.4755718206770357,0.9667300380228137,0.4887705487381338,0.5708672599574965,0.18820522911688814,proxy +nginx-halfclose,relay-ka-2k-50k-2000,2,6.87647752192,16704.65,35.2,53.12,58.6,66.34,0,516,0,10.21,10.169288000000002,1.187817450717034,60.77308603469006,106.5859375,0.4826275787187839,0.9696106362773029,0.49242424242424243,0.5689811738721802,0.17583286309135318,proxy +haproxy,relay-ka-2k-50k-2000,2,5.49613207552,13245.15,147.26,150.08,152.55,899.72,0,0,0,10.13,10.090878,1.4744914948633698,76.02707854880593,165.10546875,0.5138223368964246,0.9620132953466287,0.2845303867403315,0.7506077128667584,0.1073779578470078,proxy +haproxy-splice-auto,relay-ka-2k-50k-2000,2,9.706626088959998,23518.3,84.54,87.53,91.62,1280.0,0,239,0,10.14,10.118178,0.8357177793452172,42.909010892287384,137.5078125,0.4493192133131619,0.9638783269961977,0.5160210425633668,0.6822157946466273,0.2033958201775314,proxy +envoy,relay-ka-2k-50k-2000,2,5.87294834688,14266.86,138.78,142.81,149.49,256.14,0,0,0,10.16,10.12185,1.3839726692501892,70.80336734124992,224.6171875,0.37216018482864843,0.9657794676806084,0.40930599369085174,0.45763347089450446,0.15775242894700559,proxy +direct,relay-ka-2k-50k-2000,2,38.2252089344,92941.97,20.2,21.33,22.16,604.65,0,525,0,0.78,0.0,0.016324305802248838,0.8348898320051806,0.0,0.8406270411495754,0.19746835443037974,0.953709575142676,2.708271456484466,0.9501216618040832,origin +3proxy-0.9.9.2,relay-ka-2k-50k-2000,2,4.726561177600001,11482.0,53.66,74.33,97.83,403.52,0,512,0,10.35,10.306973,1.7518021430126343,89.73936566840653,199.546875,0.4126179657462426,0.9838403041825095,0.5217943292424884,0.3776830045530714,0.15394179359907847,proxy +3proxy-1.0.2,relay-close-1k,2,0.05402263552,5302.01,11.59,13.7,16.13,19.61,0,0,0,10.03,9.891677,148.53033219805414,188.8284353408513,149.1171875,0.3435594512195122,0.9534220532319392,0.449920868189012,0.3026026457968741,0.09505241146398567,proxy +3proxy-devel-c37,relay-close-1k,2,0.06325010432,6214.01,9.92,10.9,13.04,17.75,0,0,0,10.02,10.007741,126.73496883807195,160.98195781051683,16.515625,0.40804700017803097,0.9524714828897338,0.4798672566371681,0.3587051808965675,0.10169140254233419,proxy +3proxy-bp,relay-close-1k,2,0.10368319488,10178.02,6.0,7.79,9.63,13.68,0,0,0,10.01,9.984805,77.235274330312,98.25573976461811,29.89453125,0.4620076681770652,0.9506172839506173,0.5358749196830156,0.5147178281121387,0.14161088522855264,proxy +nginx,relay-close-1k,2,0.09000976384,8838.5,7.06,7.32,7.65,8.55,0,0,0,10.02,10.000154,89.05700512945594,113.21905967164213,35.34765625,0.48200559049615654,0.9524714828897338,0.5345387111729254,0.5280903815805829,0.16163924381131123,proxy +nginx-halfclose,relay-close-1k,2,0.08959033344,8798.64,7.09,7.39,7.72,8.42,0,0,0,10.02,9.999108,89.47393867406952,113.70728884147933,34.27734375,0.47671568627450983,0.9524714828897338,0.5320037105751392,0.5223344548673629,0.15677165452433792,proxy +haproxy,relay-close-1k,2,0.10385096704,10200.02,6.12,6.37,6.63,7.28,0,0,0,10.02,9.98556,77.18753352496465,98.1477309459208,34.81640625,0.4887179487179487,0.9506641366223909,0.5480665370490386,0.5517926392469896,0.14158436598292173,proxy +haproxy-splice-auto,relay-close-1k,2,0.10427039744,10234.99,6.09,6.34,6.6,7.31,0,0,0,10.02,10.003036999999999,76.87704465318282,97.72082272740572,40.49609375,0.4891951676025183,0.9515669515669516,0.5493079584775087,0.538306509647076,0.141521303186237,proxy +envoy,relay-close-1k,2,0.09445572608,9273.09,6.58,7.17,7.82,9.49,0,0,0,10.01,9.986737,84.78046098780251,107.74794945211083,18.55859375,0.3622663105684853,0.9515209125475285,0.5061671996345363,0.4186655361260011,0.1416268702294228,proxy +direct,relay-close-1k,2,0.53083111424,52126.39,0.765,1.09,1.43,2.03,0,0,0,4.61,0.0,6.947595762694078,8.756284676121934,0.0,0.7852886788576124,0.5280641466208477,0.9319453076444997,2.3318200001129594,0.8751981530674782,origin +3proxy-0.9.9.2,relay-close-1k,2,0.0536870912,5272.51,11.64,13.73,16.2,19.72,0,0,0,10.03,9.898742,149.45864677429196,189.78240302743615,151.609375,0.344558599695586,0.9543292102759277,0.4457749661093538,0.3016300427880453,0.09315003331078169,proxy diff --git a/bench/data/results-full7/arm-socks.csv b/bench/data/results-full7/arm-socks.csv new file mode 100644 index 0000000..6e98a78 --- /dev/null +++ b/bench/data/results-full7/arm-socks.csv @@ -0,0 +1,91 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,socks-stream1-down,0,76.17524455761875,nan,nan,nan,nan,nan,0,0,0,0.04,0.0,0.0004200381550025257,nan,0.0,0.17608566329565734,0.00963855421686747,0.36300620211601603,0.6822863028228271,0.9764620345792366,origin +3proxy-0.9.9.2,socks-stream1-down,0,24.600204557112285,nan,nan,nan,nan,nan,0,0,1,10.01,10.000777000000001,0.32548805691361615,nan,19.07421875,0.09991386735572783,0.9515209125475285,0.16392914653784219,0.36146613729923316,0.23272816347954356,proxy +3proxy-1.0.2,socks-stream1-down,0,25.278597547660166,nan,nan,nan,nan,nan,0,0,0,10.02,9.997076999999999,0.31706739056894295,nan,21.171875,0.08241758241758242,0.9506641366223909,0.09286723163841808,0.373856214451332,0.2289770330541677,proxy +3proxy-devel-c37,socks-stream1-down,0,59.2903937651139,nan,nan,nan,nan,nan,0,0,0,10.01,9.999086,0.1350485749967507,nan,21.4296875,0.09052757793764989,0.9506172839506173,0.20602327173169063,0.5145140518832102,0.49466004691006393,proxy +3proxy-bp,socks-stream1-down,0,69.3329485514616,nan,nan,nan,nan,nan,0,0,0,9.98,9.606905,0.11514203837678177,nan,34.41015625,0.1925531914893617,0.997002997002997,0.20634341961356178,0.5424914478960079,0.5390760797722219,proxy +direct,socks-stream16,0,212.83494802611528,nan,nan,nan,nan,nan,0,0,5323,1.35,0.0,0.005073133001051354,nan,0.0,0.7880508859609269,0.3524804177545692,0.9494470774091627,2.9566559763729625,2.844931598655843,origin +3proxy-0.9.9.2,socks-stream16,0,24.224386442539615,nan,nan,nan,nan,nan,0,0,2225,10.04,10.027296,0.3301159775973228,nan,104.94140625,0.1505926098071113,0.952561669829222,0.22629310344827586,0.23016968043081587,0.3989708427101227,proxy +3proxy-1.0.2,socks-stream16,0,24.221372112338003,nan,nan,nan,nan,nan,0,0,2201,10.04,10.029337,0.3308645819385172,nan,123.44921875,0.15143784786641928,0.9534662867996201,0.22974910394265233,0.229145809040048,0.4159812412029362,proxy +3proxy-devel-c37,socks-stream16,0,55.98045101207075,nan,nan,nan,nan,nan,0,0,1332,10.03,10.01725,0.14320356002357476,nan,93.875,0.2029773156899811,0.9525166191832859,0.25555151073898796,0.49821902243117044,0.6258423962351909,proxy +3proxy-bp,socks-stream16,0,46.8282506018191,nan,nan,nan,nan,nan,0,0,4357,10.03,10.011978000000001,0.17126250436071558,nan,79.0546875,0.3004863607528019,0.9516129032258065,0.3771186440677966,0.45821956039760675,0.5877506892663881,proxy +direct,socks-ka-1k,0,1.4650703872000002,143293.28,0.423,0.491,0.554,0.671,0,0,0,0.72,0.0,0.39315517195104493,0.49748390605016435,0.0,0.8064732142857143,0.2408026755852843,0.9554783706978213,2.5178673963346365,0.9563267787544214,origin +3proxy-0.9.9.2,socks-ka-1k,0,0.20854079488,20401.14,2.91,3.91,4.96,7.42,0,0,0,10.09,10.081109000000001,38.707054917695345,49.0446262352295,130.50390625,0.445813247634351,0.9591254752851711,0.4851063829787234,0.6040832468032363,0.2556224500603844,proxy +3proxy-1.0.2,socks-ka-1k,0,0.2059403264,20141.98,2.94,3.96,5.04,7.57,0,0,0,10.09,10.078520000000001,39.1958201732752,49.68656591472032,130.53515625,0.44241547640571327,0.9591254752851711,0.48614728865735257,0.5974086823184264,0.23661608776988535,proxy +3proxy-devel-c37,socks-ka-1k,0,0.20627587072,20176.18,2.94,3.95,5.04,7.59,0,0,0,10.08,10.0809,39.093278199979665,49.554598548758186,17.78125,0.4446431765337149,0.9581749049429658,0.48220218319886093,0.5992921742544624,0.23755228461725852,proxy +3proxy-bp,socks-ka-1k,0,0.36180066304,35390.82,1.8,2.66,3.79,6.58,0,0,0,10.04,10.03085,22.200069874145026,28.268392052189533,27.53125,0.5362400906002265,0.9534662867996201,0.5799130854659584,1.0597755635543085,0.3696721235369336,client +direct,socks-ka-50k-2000,0,41.31758538752,100329.32,18.57,19.94,21.42,633.17,0,480,0,0.77,0.0,0.014908906080123047,0.7635873930729732,0.0,0.8285274047985912,0.2532894736842105,0.954401519949335,2.7780335660396807,0.9507916391536722,origin +3proxy-0.9.9.2,socks-ka-50k-2000,0,4.85213863936,11787.02,138.24,185.01,231.69,341.66,1,0,0,10.24,10.211145,1.6883276857646694,86.06560821657604,332.625,0.4475607683154853,0.9724596391263058,0.48201117318435754,0.4585684254621734,0.13588295133319628,proxy +3proxy-1.0.2,socks-ka-50k-2000,0,4.86262439936,11812.65,142.92,189.5,236.06,349.39,2,0,0,10.23,10.213477000000001,1.6830417749471145,85.75739793779864,333.10546875,0.44548711823920834,0.9715099715099715,0.4831209479096803,0.4613171402854979,0.13396016876896225,proxy +3proxy-devel-c37,socks-ka-50k-2000,0,4.933256478720001,11984.15,137.47,184.08,230.53,344.52,0,0,0,10.21,10.197180000000001,1.6557014692492327,84.34949274643931,226.12109375,0.45383703201761816,0.970532319391635,0.4804696319710996,0.47944513503387076,0.13776812156713228,proxy +3proxy-bp,socks-ka-50k-2000,0,9.53482739712,23078.74,73.63,94.44,94.89,97.96,1,0,0,10.1,10.094743,0.8474196399654352,43.43432171501065,147.52734375,0.5228485657104737,0.9600760456273765,0.5593834995466909,0.6896188370258504,0.21090016920067536,proxy +direct,socks-ka-2k-50k-2000,0,38.31110828032,93170.79,20.02,21.16,22.11,638.43,0,521,0,1.01,0.0,0.021090488797346037,1.0788385288487832,0.0,0.8401048492791612,0.24396135265700483,0.9465189873417722,2.7313040536928317,0.9502941121561223,origin +3proxy-0.9.9.2,socks-ka-2k-50k-2000,0,4.48027164672,10883.65,145.72,192.54,238.91,354.96,0,0,0,10.21,10.19491,1.8231037410376176,92.91024742699584,335.3359375,0.4157820240622788,0.9714557564224549,0.48744165370082243,0.4271538166779388,0.1425630124311103,proxy +3proxy-1.0.2,socks-ka-2k-50k-2000,0,4.46601101312,10849.03,160.44,205.67,250.82,367.39,0,2,0,10.24,10.219756,1.8342991040402712,93.51598173515981,336.30078125,0.4135551229870819,0.9724596391263058,0.4748299319727891,0.4242743093486272,0.1405524942539414,proxy +3proxy-devel-c37,socks-ka-2k-50k-2000,0,4.54754828288,11047.06,149.9,194.81,239.16,350.41,0,1,0,10.2,10.191941,1.7943734716835602,91.44045612651055,228.5078125,0.4172865745660645,0.9695817490494296,0.47902018598321616,0.4384719429421911,0.1443958968579848,proxy +3proxy-bp,socks-ka-2k-50k-2000,0,8.84763262976,21589.16,94.51,95.33,96.04,101.7,0,0,0,10.08,10.063186,0.9114302477790313,46.343549143471904,148.875,0.46950784593437944,0.9572649572649573,0.5512995896032832,0.6173114494070214,0.21569096082785574,proxy +direct,socks-close-1k,0,0.49710891007999997,48815.95,0.795,1.14,1.51,2.21,0,0,0,4.54,0.0,7.306246028492026,9.208345925509756,0.0,0.7559194948697711,0.49455337690631807,0.9279529993815708,2.1678847328422073,0.8750003871067759,origin +3proxy-0.9.9.2,socks-close-1k,0,0.0402653184,3955.82,6.21,9.95,12.38,14.77,5,0,0,10.1,9.978327,200.6689707438151,252.85399559383137,131.73046875,0.4559721011333915,0.9591642924976258,0.41993204983012455,0.5885703270779252,0.07218119131318858,proxy +3proxy-1.0.2,socks-close-1k,0,0.04001366016,3927.83,5.99,9.71,12.33,14.91,5,0,0,10.1,9.967514,201.9310397422039,254.74815244533005,131.6875,0.45419647530971907,0.9582542694497154,0.4221218961625282,0.5876816498726468,0.07124674741573449,proxy +3proxy-devel-c37,socks-close-1k,0,0.04513071104,4433.87,5.53,8.97,11.28,13.94,4,0,0,10.1,10.092279,179.03551293128484,225.56223060946468,18.49609375,0.4776380153738644,0.9600760456273765,0.45202464788732394,0.6620892039111685,0.08173243230940151,proxy +3proxy-bp,socks-close-1k,0,0.05813305344,5709.19,4.08,6.71,8.65,11.48,7,0,0,10.09,10.085494,138.85387954601822,175.07330869467145,28.95703125,0.5207499089916272,0.9591254752851711,0.48980486735365053,0.9102901969048062,0.10735811782528597,client +3proxy-0.9.9.2,socks-stream1-down,1,24.58395436428838,nan,nan,nan,nan,nan,0,0,1,10.01,9.997739,0.32570460752147334,nan,20.15234375,0.062257968424188265,0.9497153700189753,0.22453222453222454,0.35839970291801815,0.24120451058205042,proxy +3proxy-1.0.2,socks-stream1-down,1,25.039539577518376,nan,nan,nan,nan,nan,0,0,0,10.0,10.000725,0.3194581146392936,nan,18.9765625,0.06415206415206415,0.9505703422053232,0.13689482470784642,0.3651956338855878,0.23082455693166654,proxy +3proxy-devel-c37,socks-stream1-down,1,60.97125764509834,nan,nan,nan,nan,nan,0,0,0,10.01,9.986331,0.13132594467340147,nan,21.18359375,0.09796437659033079,0.9980059820538385,0.1925814911952042,0.5144511692043015,0.5020147149245122,proxy +3proxy-bp,socks-stream1-down,1,65.59734853337989,nan,nan,nan,nan,nan,0,0,0,9.99,9.701586,0.12182174249009828,nan,35.46484375,0.1429349305744623,0.9496197718631179,0.21552878179384202,0.5068278862930709,0.5081264448169375,proxy +direct,socks-stream1-down,1,96.3331975916996,nan,nan,nan,nan,nan,0,0,0,0.04,0.0,0.00033214459367830355,nan,0.0,0.23803856224708403,0.00641025641025641,0.31485284052019163,0.9456509337704277,0.8629006416785011,client +3proxy-0.9.9.2,socks-stream16,1,23.7791956494524,nan,nan,nan,nan,nan,0,0,2235,10.03,10.024102000000001,0.3363359857789349,nan,109.1796875,0.15094775774387426,0.9525166191832859,0.21832785688207376,0.22346427706591648,0.3950571854990009,proxy +3proxy-1.0.2,socks-stream16,1,25.21985035827545,nan,nan,nan,nan,nan,0,0,1885,10.04,10.027474,0.31789407736514247,nan,173.8125,0.14447788840009262,0.9534662867996201,0.2422554820744866,0.2254213722898697,0.4379160822347463,proxy +3proxy-devel-c37,socks-stream16,1,55.75557092363134,nan,nan,nan,nan,nan,0,0,1335,10.03,10.015839000000001,0.1437707177531817,nan,92.1640625,0.20202973802218552,0.9525166191832859,0.24702823179791977,0.4915844862929991,0.6079317227942949,proxy +3proxy-bp,socks-stream16,1,48.97588099283573,nan,nan,nan,nan,nan,0,0,4180,10.04,10.019023,0.16380634081893417,nan,84.30859375,0.2938906752411576,0.952561669829222,0.36333333333333334,0.46219821940818195,0.5945821142815553,proxy +direct,socks-stream16,1,214.02162662056335,nan,nan,nan,nan,nan,0,0,5557,1.84,0.0,0.006876116021134694,nan,0.0,0.8245323229931328,0.4946236559139785,0.9960172585462994,2.938631391705606,2.9855918630198035,origin +3proxy-0.9.9.2,socks-ka-1k,1,0.21038628863999997,20576.45,2.88,3.87,4.92,7.37,0,0,0,10.06,10.071743,38.253443473073666,48.53619468514194,130.50390625,0.44701691896705253,0.9562737642585551,0.485586011342155,0.6041134184461084,0.27065388643957,proxy +3proxy-1.0.2,socks-ka-1k,1,0.21005074431999998,20546.01,2.89,3.88,4.91,7.33,0,0,0,10.08,10.080136,38.390723280251606,48.68718483741958,130.53515625,0.44798717491984325,0.9581749049429658,0.4856396866840731,0.6050961670112269,0.21388855062202686,proxy +3proxy-devel-c37,socks-ka-1k,1,0.20661141504,20210.14,2.94,3.94,5.0,7.5,0,0,0,10.08,10.074169,39.02978931942753,49.50276243093923,17.27734375,0.4435296223375694,0.9572649572649573,0.4847984916332783,0.5916561498882063,0.2326997576386884,proxy +3proxy-bp,socks-ka-1k,1,0.35550920704,34773.64,1.83,2.73,3.91,6.8,0,0,0,10.04,10.03404,22.592945107878123,28.758102538103053,27.59765625,0.5360687022900763,0.9543726235741445,0.5756776205325018,1.0749519192550578,0.42762138306289843,client +direct,socks-ka-1k,1,1.45533960192,142348.89,0.41100000000000003,0.508,0.593,0.725,0,0,0,1.09,0.0,0.5991728658036847,0.7581527503903791,0.0,0.8077777777777778,0.3303030303030303,0.9579380139152435,2.5119972159220896,0.9572517170881402,origin +3proxy-0.9.9.2,socks-ka-50k-2000,1,4.714397696,11452.53,141.24,190.36,239.16,364.39,0,2,0,10.23,10.206721,1.7359587645615546,88.48409362187971,331.88671875,0.4426931642967278,0.9724334600760456,0.47952562094428286,0.4546707194480736,0.13022761767258434,proxy +3proxy-1.0.2,socks-ka-50k-2000,1,4.88854519808,11875.47,141.62,187.63,233.44,346.96,1,1,0,10.22,10.207822,1.6724812124497004,85.31098441530256,332.2109375,0.44543125533731853,0.972407231208373,0.480743394536498,0.45937081909615923,0.1349451515500026,proxy +3proxy-devel-c37,socks-ka-50k-2000,1,4.91891195904,11949.26,134.99,183.53,230.69,350.67,0,0,0,10.21,10.181519,1.6605298220450582,84.6158308677888,224.765625,0.4552364864864865,0.9696106362773029,0.478809738503156,0.47349454962813325,0.13774560224685742,proxy +3proxy-bp,socks-ka-50k-2000,1,9.448928051200001,22958.0,74.22,94.6,95.15,98.23,0,0,0,10.11,10.092089000000001,0.8559701117602262,43.60860094463735,142.734375,0.524039261354184,0.9601139601139601,0.5638369736545823,0.6819970467437292,0.2185052629695395,proxy +direct,socks-ka-50k-2000,1,41.14578669568,100025.16,18.88,20.03,20.92,687.83,0,564,0,0.87,0.0,0.016915462211178837,0.8659990842308535,0.0,0.8271767810026385,0.2779552715654952,0.9534515516149462,2.7709840492395417,0.9516455791822052,origin +3proxy-0.9.9.2,socks-ka-2k-50k-2000,1,4.485304811520001,10895.9,153.24,197.57,242.24,353.75,2,1,0,10.2,10.177842,1.8192743509966052,92.72221515190081,335.0390625,0.4144830028328612,0.9695817490494296,0.4793965323125422,0.4243054989384308,0.1406290027133899,proxy +3proxy-1.0.2,socks-ka-2k-50k-2000,1,4.4650882662399995,10846.82,156.94,201.33,245.75,355.75,1,0,0,10.21,10.186167999999999,1.8293031431779918,93.24371221392171,335.59765625,0.4178999295278365,0.970532319391635,0.477818017202354,0.42903602185362333,0.14157733199719225,proxy +3proxy-devel-c37,socks-ka-2k-50k-2000,1,4.5406696243199995,11030.49,153.75,196.18,238.51,347.4,0,0,0,10.2,10.182877000000001,1.7970917673232,91.70517684714005,227.8359375,0.4195087471284679,0.9695817490494296,0.47539863325740317,0.44048910925360163,0.14064647301362743,proxy +3proxy-bp,socks-ka-2k-50k-2000,1,9.0194313216,21827.79,94.33,95.29,96.02,101.2,1,0,0,10.12,10.103684000000001,0.897617567153204,45.949038339296415,142.84375,0.47314123087869087,0.9610636277302944,0.5499312872194229,0.6250540929479244,0.2261473977383773,proxy +direct,socks-ka-2k-50k-2000,1,38.56880631808,93620.04,20.01,21.11,22.11,629.4,0,524,0,0.61,0.0,0.01265271203820583,0.6480750577158648,0.0,0.8409832499456167,0.15885416666666666,0.9514901712111604,2.7124536625858395,0.9508293640503693,origin +3proxy-0.9.9.2,socks-close-1k,1,0.040097546240000004,3940.39,6.0,9.74,12.33,14.87,5,0,0,10.09,9.970858,201.30907641295107,253.766253363849,133.78125,0.45210526315789473,0.9591254752851711,0.4226150011330161,0.5867337815802791,0.07219220108789565,proxy +3proxy-1.0.2,socks-close-1k,1,0.03934257152,3860.56,6.5,10.42,12.75,15.56,1,0,0,10.1,9.963652,205.3754924456956,259.22028591227576,133.796875,0.45195168913005423,0.9591642924976258,0.4179580674567001,0.5838968555306037,0.07315675953301745,proxy +3proxy-devel-c37,socks-close-1k,1,0.044962938880000004,4415.81,5.35,8.66,11.08,13.99,5,0,0,10.09,10.092591,179.5256315772213,226.26362290891151,18.65234375,0.47610712410292316,0.9600380589914367,0.45103661226290254,0.6630294438626937,0.08171289699979159,proxy +3proxy-bp,socks-close-1k,1,0.057126420479999995,5611.47,4.28,7.03,8.97,11.9,5,0,0,10.07,10.065184,141.02056338048368,177.91519434628975,30.44140625,0.5189620758483033,0.9572243346007605,0.488264970388243,0.9016400569256348,0.10353653789314683,client +direct,socks-close-1k,1,0.52873396224,51916.03,0.766,1.09,1.44,2.02,0,0,0,4.56,0.0,6.899500052058544,8.696597456245245,0.0,0.784016393442623,0.5223367697594502,0.9311200744647844,2.3262795560825165,0.8774125209593303,origin +3proxy-1.0.2,socks-stream1-down,2,25.012751625917243,nan,nan,nan,nan,nan,0,0,0,10.0,9.997076,0.31980091677600003,nan,18.7109375,0.05567258501354198,0.9505703422053232,0.0887154009936125,0.3596932411547041,0.22241331306656814,proxy +3proxy-devel-c37,socks-stream1-down,2,64.51528524173817,nan,nan,nan,nan,nan,0,0,0,9.99,9.867056000000002,0.12386387127509206,nan,23.57421875,0.1381798002219756,0.950523311132255,0.21515151515151515,0.5098681718587948,0.5129938699596495,proxy +3proxy-bp,socks-stream1-down,2,69.69903686699624,nan,nan,nan,nan,nan,0,0,0,9.99,9.584434,0.1146519740049814,nan,36.078125,0.16834755624515127,0.9496197718631179,0.23029315960912053,0.5051329838717414,0.5338915282367083,proxy +direct,socks-stream1-down,2,96.1360481981245,nan,nan,nan,nan,nan,0,0,0,0.03,0.0,0.00024960749507615867,nan,0.0,0.23733650416171226,0.004942339373970346,0.31642098045937606,0.9465240590286392,0.8694000984891221,client +3proxy-0.9.9.2,socks-stream1-down,2,24.26490496404148,nan,nan,nan,nan,nan,0,0,1,10.0,10.001938999999998,0.3296531899069725,nan,21.0,0.1307171853856563,0.9514747859181731,0.07733428367783321,0.39000856303779935,0.21095705763570763,proxy +3proxy-1.0.2,socks-stream16,2,23.76646281517831,nan,nan,nan,nan,nan,0,0,2284,10.03,10.018595000000001,0.3372877248396157,nan,89.2578125,0.14895104895104896,0.9516129032258065,0.22792534099066764,0.2282710544069849,0.40916108336511114,proxy +3proxy-devel-c37,socks-stream16,2,55.21768139563317,nan,nan,nan,nan,nan,0,0,1327,10.03,10.018747,0.14515447634486286,nan,115.3671875,0.20965485074626866,0.9525166191832859,0.25742574257425743,0.4888243519876297,0.6373124696105733,proxy +3proxy-bp,socks-stream16,2,47.18538597281001,nan,nan,nan,nan,nan,0,0,4248,10.04,10.020933,0.16998455717793548,nan,80.50390625,0.3007820756711055,0.952561669829222,0.3712871287128713,0.45275172877757064,0.5927971994694454,proxy +direct,socks-stream16,2,214.61792688362758,nan,nan,nan,nan,nan,0,0,6618,0.97,0.0,0.0036141545370430056,nan,0.0,0.822084426424994,0.3050314465408805,0.9960172585462994,2.9369700708625266,2.983068713271928,origin +3proxy-0.9.9.2,socks-stream16,2,24.071841735866002,nan,nan,nan,nan,nan,0,0,2144,10.05,10.026799,0.33280271118941335,nan,132.4609375,0.14474907063197026,0.9535104364326376,0.23186344238975817,0.22160120882024087,0.40168042681862054,proxy +3proxy-1.0.2,socks-ka-1k,2,0.20988297216,20531.81,2.89,3.88,4.92,7.36,0,0,0,10.08,10.076768000000001,38.42141130845324,48.717539764241906,130.734375,0.44304707150556955,0.9581749049429658,0.48614728865735257,0.6040369538526799,0.2223263133327563,proxy +3proxy-devel-c37,socks-ka-1k,2,0.20988297216,20531.12,2.89,3.88,4.92,7.33,0,0,0,10.09,10.070878,38.45952778792591,48.801485809359825,17.84765625,0.44325098460436807,0.9573055028462998,0.48361823361823364,0.6031066556408118,0.23562424214582758,proxy +3proxy-bp,socks-ka-1k,2,0.36557553664,35755.41,1.78,2.6,3.68,6.36,0,0,0,10.04,10.03714,21.97083555924449,27.969066880613315,27.78515625,0.5385187941942687,0.9534662867996201,0.5745049504950495,1.0340969071210453,0.32969119347735737,client +direct,socks-ka-1k,2,1.46137939968,142939.39,0.425,0.484,0.54,0.65,0,0,0,0.78,0.0,0.4269938389282331,0.5402840647371137,0.0,0.8110393946138438,0.26,0.9567277321541378,2.5271692337010605,0.9568385791403744,origin +3proxy-0.9.9.2,socks-ka-1k,2,0.21055406080000003,20595.39,2.88,3.86,4.91,7.3,0,0,0,10.07,10.072965,38.26095763430652,48.53128991060026,130.50390625,0.4457357411049526,0.9572243346007605,0.4847836424155968,0.6031391849135452,0.22997744343065946,proxy +3proxy-1.0.2,socks-ka-50k-2000,2,4.876130058239999,11845.37,136.75,183.54,230.3,345.9,0,0,0,10.22,10.20183,1.6767395254734165,85.50798604429347,333.078125,0.44849821822501273,0.9714828897338403,0.48408635655464055,0.4593866526472986,0.1320462388124106,proxy +3proxy-devel-c37,socks-ka-50k-2000,2,4.95749955584,12043.04,134.76,183.33,230.92,350.8,1,0,0,10.22,10.197012,1.6492185037855553,84.0218687055535,224.6328125,0.4534864089144015,0.9705603038936372,0.48094170403587444,0.4698870630701501,0.13398047195947616,proxy +3proxy-bp,socks-ka-50k-2000,2,9.448928051200001,22914.7,73.93,94.63,94.98,98.14,1,0,0,10.08,10.067744,0.853430141102184,43.64996882145084,141.12109375,0.5247672872340425,0.9572649572649573,0.5639574371745528,0.6830241580159829,0.21943500217626719,proxy +direct,socks-ka-50k-2000,2,40.97398800384,99540.11,18.98,20.14,21.11,633.95,0,496,0,1.26,0.0,0.024600973669088113,1.2599848801814377,0.0,0.8270032930845225,0.358974358974359,0.9519291587602783,2.7648676269118435,0.9479894554658091,origin +3proxy-0.9.9.2,socks-ka-50k-2000,2,4.8859447296,11869.12,139.73,186.99,233.94,351.18,0,0,0,10.24,10.221209,1.6766460640398317,85.4358563609665,332.5234375,0.447108843537415,0.973384030418251,0.48337424681990626,0.4593111093451732,0.13586714833998398,proxy +3proxy-1.0.2,socks-ka-2k-50k-2000,2,4.50921234432,10953.96,155.47,199.68,244.24,359.51,0,0,0,10.23,10.209901,1.8149511211883653,92.46956097296417,335.79296875,0.41550168111838615,0.9715099715099715,0.47774011299435026,0.4279092894429781,0.14340723960087343,proxy +3proxy-devel-c37,socks-ka-2k-50k-2000,2,4.5524975616,11059.12,148.7,193.85,237.5,350.65,3,0,0,10.21,10.197602,1.7941799835098238,91.45221823132664,227.22265625,0.41662226957911563,0.9714557564224549,0.47762888939359527,0.4413722512109882,0.14820768528712072,proxy +3proxy-bp,socks-ka-2k-50k-2000,2,8.84763262976,21507.13,94.6,95.42,96.47,113.68,1,0,0,10.1,10.092243999999999,0.9132386411277992,46.507344476677254,144.76953125,0.47068287450840185,0.9609895337773549,0.5501485035412383,0.6249248036588676,0.2204064270038735,proxy +direct,socks-ka-2k-50k-2000,2,38.91240370176,94460.48,19.25,20.93,22.15,692.88,0,683,0,0.49,0.0,0.010073908643743586,0.5164401883214956,0.0,0.8441048034934497,0.13031914893617022,0.9537828426717315,2.736607631374865,0.9515568280033838,origin +3proxy-0.9.9.2,socks-ka-2k-50k-2000,2,4.50141093888,10934.96,149.67,195.62,241.77,360.23,2,0,0,10.24,10.222467,1.8198738376101824,92.77463193657984,336.98828125,0.4157820240622788,0.973384030418251,0.4837334529952883,0.4271728363039723,0.1435492230052046,proxy +3proxy-1.0.2,socks-close-1k,2,0.04001366016,3925.4,6.18,10.01,12.45,15.08,4,0,0,10.08,9.964736,201.53117629716982,254.47476711014616,133.57421875,0.4519685039370079,0.9590865842055185,0.42062230297524417,0.5821438347100654,0.07220707738174129,proxy +3proxy-devel-c37,socks-close-1k,2,0.04513071104,4433.35,5.28,8.62,11.01,13.84,6,0,0,10.09,10.086852,178.85825004719447,225.41441401188507,16.74609375,0.4752058875065709,0.9591254752851711,0.452863436123348,0.6610734251679449,0.08170487895106843,proxy +3proxy-bp,socks-close-1k,2,0.05779750912,5678.65,4.36,7.05,8.98,11.8,0,0,0,10.08,10.077083,139.52158359034834,175.775119450354,29.1640625,0.5206896551724138,0.9581749049429658,0.4891471168603376,0.9062242420735878,0.10450040100430351,client +direct,socks-close-1k,2,0.5309150003199999,52130.62,0.765,1.09,1.42,2.04,0,0,0,4.56,0.0,6.871156395658872,8.661231870294253,0.0,0.7850102669404517,0.5217391304347826,0.9316133043207958,2.3285869569136888,0.8802013478806242,origin +3proxy-0.9.9.2,socks-close-1k,2,0.04001366016,3924.99,6.16,9.93,12.41,15.06,5,0,0,10.1,9.977915,201.9310397422039,254.86386232304625,131.62109375,0.45365512416928994,0.9600760456273765,0.41717931191615404,0.5857749200153916,0.07218139889034782,proxy diff --git a/bench/data/results-full7/arm-socks8-dante.csv b/bench/data/results-full7/arm-socks8-dante.csv new file mode 100644 index 0000000..ffb9adc --- /dev/null +++ b/bench/data/results-full7/arm-socks8-dante.csv @@ -0,0 +1,37 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +3proxy-bp,socks-stream1-down,0,54.95798518703387,nan,nan,nan,nan,nan,0,0,0,10.01,9.993529,0.14569523951370048,nan,30.90625,0.08743658609370338,0.9506172839506173,0.1853555005305978,0.5069158833069751,0.47970922709920055,proxy +dante,socks-stream1-down,0,10.755941861630104,nan,nan,nan,nan,nan,0,0,0,10.01,10.014462,0.7444363790873445,nan,13.26171875,0.017312206572769953,0.9515209125475285,0.05566801619433198,0.23402890534835158,0.11497876234460526,proxy +3proxy-bp,socks-stream16,0,44.85364033390902,nan,nan,nan,nan,nan,0,0,4243,10.04,10.023199,0.1788190827216997,nan,108.609375,0.28963876270819816,0.952561669829222,0.364088947892466,0.4812483481390654,0.5946620905582705,proxy +dante,socks-stream16,0,15.811853329382707,nan,nan,nan,nan,nan,0,0,1,10.03,10.025917,0.5072910594144856,nan,123.98046875,0.13795439151049899,0.9534220532319392,0.48177399756986633,0.1626791975615335,0.5275027490734411,proxy +3proxy-bp,socks-ka-1k,0,0.34384904192000004,33632.84,1.91,2.84,4.07,7.07,0,0,0,10.06,10.040764000000001,23.405619963520063,29.75987977718547,29.02734375,0.5341772151898734,0.9544592030360531,0.5673880964092474,1.0978000360669382,0.3334424809956902,client +dante,socks-ka-1k,0,0.28059893760000004,27446.17,1.23,4.13,4.25,4.46,0,0,0,10.08,10.093356,28.73852648542601,36.443702072735555,42.5625,0.4736641947138239,0.9581749049429658,0.5043457267020763,0.8614987819440435,0.31052558332728447,proxy +3proxy-bp,socks-ka-50k-2000,0,8.67583393792,21075.79,94.94,95.64,97.08,118.93,0,0,0,10.1,10.095554000000002,0.9313225746154785,47.476461546416466,143.05078125,0.5037440435670524,0.9609895337773549,0.5467889908256881,0.6543105946993625,0.20327122665405828,proxy +dante,socks-ka-50k-2000,0,5.892493803520001,14314.31,184.84,188.03,191.02,199.88,0,0,0,10.2,10.196748999999999,1.384812656930663,70.58188536671442,785.1796875,0.4534053300818673,0.9695817490494296,0.4860180263461983,0.5306994172269507,0.16052484871987505,proxy +3proxy-bp,socks-ka-2k-50k-2000,0,8.1604378624,19877.51,95.82,96.67,100.72,120.87,0,0,0,10.12,10.107762999999998,0.9921036268535411,50.447899582757984,146.3203125,0.43484791588434096,0.9619771863117871,0.5286519492719587,0.5992455852093844,0.22334728215129124,proxy +dante,socks-ka-2k-50k-2000,0,5.84669200384,14203.17,185.11,188.19,191.16,199.78,0,0,0,10.18,10.171887,1.3929244083066405,71.19727520054832,782.421875,0.40569259962049337,0.9667616334283001,0.4985156428408312,0.5458227149016238,0.17290750139081254,proxy +3proxy-bp,socks-close-1k,0,0.05595201536,5493.93,4.09,6.79,8.89,11.87,8,0,0,10.08,10.078088000000001,144.1234948931784,181.69036932893528,29.0234375,0.5051143760461224,0.9581749049429658,0.4704411095952706,0.8941815686882505,0.10551339904505572,proxy +dante,socks-close-1k,0,0.03623878656,3561.9,6.84,11.28,14.6,19.49,1,0,0,10.1,10.099393000000001,222.96552304868342,280.7661301531704,58.53125,0.3834942267650956,0.9609895337773549,0.35838009270553794,0.5421806142150116,0.06650908130427907,proxy +dante,socks-stream1-down,1,11.2936958870653,nan,nan,nan,nan,nan,0,0,0,10.01,10.008063,0.7089896604789634,nan,13.44921875,0.032843560933448576,0.9515209125475285,0.10387547649301143,0.23593302423963355,0.11971520464136326,proxy +3proxy-bp,socks-stream1-down,1,61.03543774843403,nan,nan,nan,nan,nan,0,0,0,10.01,9.717065,0.13118743280519407,nan,34.75390625,0.19036926147704591,0.9506172839506173,0.22332015810276679,0.5832849272618086,0.5218081282560422,proxy +dante,socks-stream16,1,15.277981933652228,nan,nan,nan,nan,nan,0,0,0,10.05,10.029684,0.5260712793672943,nan,100.12109375,0.1431474373447731,0.9535104364326376,0.4986884290294375,0.17118687403026758,0.5166235126931561,proxy +3proxy-bp,socks-stream16,1,44.22535831987954,nan,nan,nan,nan,nan,0,0,4371,10.03,10.013959,0.18130578737501923,nan,73.66796875,0.30192674147787424,0.9516129032258065,0.3517959046659953,0.4555756586234994,0.582007752487401,proxy +dante,socks-ka-1k,1,0.28848422912,28212.88,1.19,4.1,4.21,4.38,0,0,0,10.07,10.069407,27.925270038415057,35.46074316139392,40.046875,0.46503563860527836,0.9581351094196003,0.5017064846416383,0.8533464366250856,0.2709403272752939,proxy +3proxy-bp,socks-ka-1k,1,0.35332816895999997,34560.58,1.83,2.72,3.9,6.9,0,0,0,10.05,10.040239,22.75504957237135,28.941934703539555,27.5859375,0.5268920476373415,0.9544159544159544,0.5679442508710801,1.0491695703001873,0.35042702607264375,client +dante,socks-ka-50k-2000,1,5.835954585600001,14177.04,181.81,187.99,190.95,202.99,1,0,0,10.19,10.187209,1.3968580256115692,71.18755370503622,782.33984375,0.4421553090332805,0.9686311787072244,0.48022206800832756,0.5200974832985292,0.1557799285387799,proxy +3proxy-bp,socks-ka-50k-2000,1,8.933531975680001,21690.49,94.2,95.21,95.89,99.92,0,0,0,10.1,10.076718000000001,0.9044575003477242,46.216430169719544,144.8828125,0.4941586748038361,0.9591642924976258,0.5393465255407272,0.6715851335669595,0.20617344426214845,proxy +dante,socks-ka-2k-50k-2000,1,5.69452265472,13833.46,185.58,188.35,191.29,206.28,0,0,0,10.22,10.208106,1.4357656463484583,73.2763565446828,787.03515625,0.4037386779726344,0.969639468690702,0.4955017301038062,0.5686355978781013,0.17373619902521278,proxy +3proxy-bp,socks-ka-2k-50k-2000,1,8.074538516479999,19579.43,95.9,96.57,101.74,120.62,0,0,0,10.12,10.108378,1.0026579207562387,51.19902863502985,141.765625,0.43322659634582783,0.9610636277302944,0.5235614492067251,0.6030420999415438,0.21186705673910358,proxy +dante,socks-close-1k,1,0.036154900479999995,3549.21,6.94,11.44,14.66,19.43,2,0,0,10.1,10.087703,223.48284444786833,282.004746614547,58.53125,0.3811881188118812,0.9591642924976258,0.3587487781036168,0.5421210358070141,0.06652521660649778,proxy +3proxy-bp,socks-close-1k,1,0.05469372416,5367.61,4.35,7.18,9.28,12.4,4,0,0,10.09,10.078190000000001,147.58548853587521,186.12115398804693,29.015625,0.5041922861934042,0.9582146248812915,0.4690346083788707,0.8912023606099028,0.10450568660088848,proxy +3proxy-bp,socks-stream1-down,2,57.36229887120687,nan,nan,nan,nan,nan,0,0,0,10.0,9.973225,0.13944875045923041,nan,34.98046875,0.10020570085218924,0.9505703422053232,0.1883139739528335,0.5222844706307754,0.48277207263414984,proxy +dante,socks-stream1-down,2,11.753604475365163,nan,nan,nan,nan,nan,0,0,0,10.01,10.008835999999999,0.6812506289556256,nan,13.6484375,0.17946927374301677,0.9515209125475285,0.1586410635155096,0.1988582845703688,0.10644563824153462,proxy +3proxy-bp,socks-stream16,2,43.675061631469575,nan,nan,nan,nan,nan,0,0,4421,10.01,10.013479,0.18323653504279785,nan,89.21875,0.2858690940615518,0.9515209125475285,0.3598800399866711,0.4755141671297322,0.5926556223721916,proxy +dante,socks-stream16,2,15.453823538696986,nan,nan,nan,nan,nan,0,0,0,10.04,10.023786,0.519573219924098,nan,116.46484375,0.14173228346456693,0.9534662867996201,0.5097706032285472,0.16362116338270416,0.4874334579230881,proxy +3proxy-bp,socks-ka-1k,2,0.35139878912,34366.01,1.85,2.74,3.91,6.77,0,0,0,10.04,10.037360000000001,22.85722162024051,29.07406066748715,27.49609375,0.5297757153905646,0.9543726235741445,0.5695233390960731,1.0691578110266728,0.31936298095471594,client +dante,socks-ka-1k,2,0.28890365951999997,28256.75,1.19,4.1,4.22,4.38,0,0,0,10.07,10.067013,27.88472812488658,35.44364390225016,39.55859375,0.47195284274576915,0.956315289648623,0.5075024201355276,0.8541140983970574,0.29068704547344687,proxy +3proxy-bp,socks-ka-50k-2000,2,8.84763262976,21420.74,94.41,95.37,97.0,112.25,0,0,0,10.11,10.092648,0.9141428378021831,46.72508457656259,144.76953125,0.5007789510126364,0.9610266159695817,0.5369685767097967,0.6809496892893266,0.20709911542400056,proxy +dante,socks-ka-50k-2000,2,6.01396084736,14609.44,180.74,187.97,191.06,206.98,0,0,0,10.19,10.186513999999999,1.3555126491351457,69.10770357610325,784.625,0.4472708002119767,0.9686311787072244,0.4841910916224325,0.5449257182858768,0.15672388946545585,proxy +3proxy-bp,socks-ka-2k-50k-2000,2,8.24633720832,20074.01,95.69,96.37,98.99,118.24,0,0,0,10.13,10.120194,0.9827393417557081,49.99876607191333,146.94140625,0.4375821287779238,0.9629277566539924,0.5272598536700496,0.6077319369455954,0.21756435670252475,proxy +dante,socks-ka-2k-50k-2000,2,5.82790152192,14157.47,185.43,188.18,191.09,197.4,0,0,0,10.19,10.17821,1.398788220655164,71.30860741777467,789.33203125,0.40357890729107176,0.9686311787072244,0.4997716894977169,0.536449313060721,0.17579235852888758,proxy +3proxy-bp,socks-close-1k,2,0.05519704064,5419.44,4.33,7.12,9.19,12.18,4,0,0,10.1,10.089447,146.38465950916606,184.5389267508359,29.03125,0.5039149888143176,0.9591642924976258,0.46954140999315536,0.892010453570365,0.10449202988381376,proxy +dante,socks-close-1k,2,0.03623878656,3554.32,6.76,11.11,14.43,19.38,3,0,0,10.12,10.096798,223.40703893590853,281.8627450980392,58.18359375,0.3843968945275516,0.9610636277302944,0.35881778212017584,0.5461040851901602,0.06558136489931111,proxy diff --git a/bench/data/results-full7/intel-base.csv b/bench/data/results-full7/intel-base.csv new file mode 100644 index 0000000..e8ad5c0 --- /dev/null +++ b/bench/data/results-full7/intel-base.csv @@ -0,0 +1,271 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,stream1,0,42.65864082282753,nan,nan,nan,nan,nan,0,0,0,6.26,0.0,0.1173781851744329,nan,0.0,0.2733866933466733,0.6507276507276507,0.34583901773533426,0.7110640539100583,0.7534543449353868,none +3proxy-0.9.9.2,stream1,0,17.299364644856016,nan,nan,nan,nan,nan,0,0,0,10.01,6.724027,0.461008694111473,nan,6.17578125,0.12016148183329375,0.9515209125475285,0.25746753246753246,0.31017560880223993,0.4639858065460021,proxy +3proxy-1.0.2,stream1,0,17.38584577362481,nan,nan,nan,nan,nan,0,0,0,10.01,7.002098,0.46049998949489573,nan,11.4921875,0.12874251497005987,0.999001996007984,0.2638414217361586,0.3216956614530931,0.46818599140079237,proxy +3proxy-devel-c37,stream1,0,32.09364068317709,nan,nan,nan,nan,nan,0,0,0,10.01,5.257929,0.2494618124316081,nan,8.23828125,0.18921498449057506,0.9506172839506173,0.3597285067873303,0.5280460945405007,0.7394051438187699,proxy +3proxy-bp,stream1,0,28.80410319202098,nan,nan,nan,nan,nan,0,0,0,9.93,5.247447,0.27574920359942234,nan,13.1875,0.19402241594022415,0.9900299102691924,0.354631507775524,0.5355004145807614,0.7517518669007485,proxy +nginx,stream1,0,9.289936689965094,nan,nan,nan,nan,nan,0,0,0,9.99,6.479329,0.8600308204191679,nan,32.94140625,0.07863205192211682,0.998001998001998,0.2577962577962578,0.16783576575913303,0.4591976119761054,proxy +nginx-halfclose,stream1,0,9.345413648168748,nan,nan,nan,nan,nan,0,0,0,9.99,6.50547,0.8549563800330631,nan,32.15625,0.07093549154963104,0.950523311132255,0.25627649168568634,0.15796075683283373,0.450739344439433,proxy +haproxy,stream1,0,8.70032519847398,nan,nan,nan,nan,nan,0,0,0,9.99,6.593871999999999,0.9181190311050713,nan,31.3203125,0.06825208085612366,0.950523311132255,0.25873434410019774,0.160811952271678,0.42788705516364073,proxy +haproxy-splice-auto,stream1,0,31.496194524762448,nan,nan,nan,nan,nan,0,0,0,9.95,5.310834,0.2526457735745249,nan,44.26171875,0.19072532699167657,0.9449192782526116,0.3521669341894061,0.5642381290437706,0.7473366654458613,proxy +envoy,stream1,0,17.6926155115721,nan,nan,nan,nan,nan,0,0,1,9.97,7.672467,0.45071052680063345,nan,32.3203125,0.12097779995011225,0.997,0.18545697131420946,0.2987061226808447,0.35641718881381046,proxy +direct,stream16,0,118.78711152502342,nan,nan,nan,nan,nan,0,0,5173,8.36,0.0,0.056254245219886534,nan,0.0,0.8734466142531068,0.8368368368368369,0.978021978021978,2.814626956893005,2.54817391511956,origin +3proxy-0.9.9.2,stream16,0,18.36738755627939,nan,nan,nan,nan,nan,0,0,752,10.03,6.979857,0.43404154863182987,nan,93.28125,0.1429913125146748,0.9543292102759277,0.26662341874797274,0.3469370168479818,0.47849331759669883,proxy +3proxy-1.0.2,stream16,0,18.80587904699052,nan,nan,nan,nan,nan,0,0,782,10.05,7.095741,0.4259461315860193,nan,89.15625,0.14527503526093088,0.9535104364326376,0.26871961102106967,0.35642768212757636,0.4767157775954924,proxy +3proxy-devel-c37,stream16,0,30.44962183019276,nan,nan,nan,nan,nan,0,0,711,10.04,5.171083,0.26319104279050987,nan,91.45703125,0.188423058599333,0.952561669829222,0.35301668806161746,0.5561117945090465,0.7637518301271479,proxy +3proxy-bp,stream16,0,31.623597122647052,nan,nan,nan,nan,nan,0,0,1278,10.02,5.297035999999999,0.25316774805644787,nan,103.25390625,0.21428571428571427,0.9515669515669516,0.3989158163265306,0.579826424561117,0.8452747830436128,proxy +nginx,stream16,0,9.07389277429834,nan,nan,nan,nan,nan,0,0,665,10.08,6.646204,0.8825575165255112,nan,108.02734375,0.0804079696394687,0.9563567362428842,0.28206806282722513,0.1815722272609085,0.45781778487614744,proxy +nginx-halfclose,stream16,0,9.083375976059685,nan,nan,nan,nan,nan,0,0,704,10.09,6.647265,0.8809259014065467,nan,105.72265625,0.07827324478178369,0.9573055028462998,0.27906219472484534,0.18060759173631144,0.4544249644802307,proxy +haproxy,stream16,0,8.0062967964041,nan,nan,nan,nan,nan,0,0,3,10.01,6.285575,0.9995842943615677,nan,50.1640625,0.08912064470253614,0.9506172839506173,0.35848400556328236,0.17109202586789563,0.6115774443762809,proxy +haproxy-splice-auto,stream16,0,26.55380021752728,nan,nan,nan,nan,nan,0,0,4,10.01,5.019807,0.30142022377653255,nan,103.8515625,0.2199524940617577,0.9506172839506173,0.5860916081578067,0.527433069136312,1.154178491232018,origin +envoy,stream16,0,13.918529054396332,nan,nan,nan,nan,nan,0,0,7577,10.02,8.067065999999999,0.5747557136325531,nan,151.75390625,0.11668639053254438,0.9524714828897338,0.16402786573780875,0.28229783789667234,0.30578913067655505,proxy +direct,stream1-down,0,43.609480634875936,nan,nan,nan,nan,nan,0,0,0,6.48,0.0,0.11886049224401773,nan,0.0,0.2658388241256969,0.6778242677824268,0.3631210403467823,0.7272806962699088,0.7583428318358719,none +3proxy-0.9.9.2,stream1-down,0,18.114649010500234,nan,nan,nan,nan,nan,0,0,0,9.99,6.77132,0.4411407466817201,nan,9.16015625,0.1973811833171678,0.9514285714285714,0.16256313131313133,0.4719331643436426,0.31948248270956636,proxy +3proxy-1.0.2,stream1-down,0,19.18272463682328,nan,nan,nan,nan,nan,0,0,0,10.01,6.815037,0.41741495003176926,nan,5.7109375,0.20271252119157182,0.9506172839506173,0.16260677000949067,0.4767037482272027,0.3251655232939652,proxy +3proxy-devel-c37,stream1-down,0,25.37349651641682,nan,nan,nan,nan,nan,0,0,0,10.01,5.208435,0.31557167697417626,nan,9.3046875,0.24583835946924004,0.9506172839506173,0.18676047329708986,0.6508457980110811,0.4049108482681737,proxy +3proxy-bp,stream1-down,0,29.436416209641255,nan,nan,nan,nan,nan,0,0,0,9.99,5.211023,0.27147098699658606,nan,9.78515625,0.2697768762677485,0.9970059880239521,0.22457200402819738,0.6873892610501695,0.4971849436868914,proxy +nginx,stream1-down,0,9.11199114014623,nan,nan,nan,nan,nan,0,0,0,10.02,6.608334,0.8796259631233603,nan,36.76953125,0.199317738791423,0.9515669515669516,0.09347275031685678,0.46148186445042083,0.17400010881274416,proxy +nginx-halfclose,stream1-down,0,9.89771403842631,nan,nan,nan,nan,nan,0,0,0,10.01,6.55374,0.8089896321880098,nan,33.40625,0.20424335378323108,0.999001996007984,0.09836612204068022,0.46055029875075015,0.16770587225749173,proxy +haproxy,stream1-down,0,8.372608450191604,nan,nan,nan,nan,nan,0,0,0,9.99,6.462617000000001,0.9544386316267719,nan,31.1328125,0.19994866529774127,0.996011964107677,0.09727755644090305,0.4375455135014839,0.16667177497697952,proxy +haproxy-splice-auto,stream1-down,0,27.015788996388874,nan,nan,nan,nan,nan,0,0,0,10.0,5.320064,0.29611697087693284,nan,42.125,0.25664388762338647,0.998003992015968,0.22680067001675042,0.6593982680151872,0.49316716757663204,proxy +envoy,stream1-down,0,17.88387664466333,nan,nan,nan,nan,nan,0,0,0,9.99,7.622625,0.44683565513207035,nan,31.9296875,0.13112426035502958,0.9514285714285714,0.15177439797211661,0.33017460383033115,0.29950153341985714,proxy +direct,http-ka-1k,0,1.2062818304,117983.4,0.514,0.583,0.723,0.93,0,0,0,7.76,0.0,5.146392694932198,6.512460115377966,0.0,0.5699949824385349,0.7570731707317073,0.9585311807534029,1.6295280696606627,0.8308813008601282,origin +3proxy-0.9.9.2,http-ka-1k,0,0.0155189248,1547.03,40.98,41.01,41.04,42.03,0,0,0,0.53,0.8095279999999999,27.32148041596284,33.922171018945214,9.890625,0.01573088092933204,0.05480868665977249,0.012728459530026109,0.057083021332042044,0.0323240449881755,none +3proxy-1.0.2,http-ka-1k,0,0.1765801984,17603.11,3.48,3.97,4.52,6.71,0,0,0,10.08,7.598621,45.66763472387173,56.69737774627924,9.94140625,0.1765684410646388,0.96,0.27432778489116516,0.39194594234022306,0.21390311884930027,proxy +3proxy-devel-c37,http-ka-1k,0,0.21340618752,21272.82,2.8,3.32,3.95,6.74,0,0,0,10.11,7.123163,37.89955714963517,47.05499057503898,7.51953125,0.2028605482717521,0.9601139601139601,0.31129653401797175,0.45665176162869003,0.2576372261567283,proxy +3proxy-bp,http-ka-1k,0,0.33789313024,33677.54,0.313,16.96,27.78,36.19,0,0,0,10.11,6.853513,23.936562410295895,29.722181390562987,5.43359375,0.22308438409311349,0.9601139601139601,0.4184922680412371,0.58123841271583,0.3555459268726699,proxy +nginx,http-ka-1k,0,0.35953573888,35165.57,1.7,1.82,2.3,2.81,0,0,0,10.01,6.793145,22.27316823897938,28.449219138565603,31.6484375,0.22483940042826553,0.9515209125475285,0.41486359360301034,0.5651100030314863,0.3146804972611208,proxy +nginx-halfclose,http-ka-1k,0,0.32304529408,31595.96,1.91,2.26,2.6,2.85,0,0,0,10.0,6.833974,24.764329171806025,31.612356637962648,31.65234375,0.21147892355322695,0.9523809523809523,0.3913863564916693,0.5280128931172969,0.3051528941418723,proxy +haproxy,http-ka-1k,0,0.34997272576,34884.7,1.71,1.99,2.31,2.83,0,0,0,10.01,6.980485000000001,22.881783094982172,28.6738145912764,29.5859375,0.21811680572109654,0.9515209125475285,0.38454347148644435,0.5603407546357633,0.3355767254941038,proxy +haproxy-splice-auto,http-ka-1k,0,0.348127232,34705.35,1.75,1.98,2.32,2.8,0,0,0,10.09,7.044639,23.18692494587726,28.78761077096018,35.7265625,0.2195238095238095,0.9600380589914367,0.38386995936230073,0.5555974378050772,0.3289284098720963,proxy +envoy,http-ka-1k,0,0.1077936128,10522.25,5.83,6.36,7.08,10.04,0,0,0,10.01,8.964251,74.29011600954523,94.96613096028689,25.96875,0.08504049547403525,0.9506172839506173,0.15226986128625472,0.20645351044065074,0.118839820270548,proxy +squid,http-ka-1k,0,0.09848225792,9124.21,6.65,7.45,8.62,10.93,0,0,0,10.02,8.915154,81.39537180911945,109.70482613646317,33.52734375,0.09566872917658258,0.9524714828897338,0.12277918781725888,0.2264424258850257,0.10172695993829342,proxy +tinyproxy,http-ka-1k,0,0.03707764736,3696.27,16.42,19.15,22.04,27.14,37007,0,0,10.06,6.9072119999999995,217.05800052142249,271.8404626151809,7.75390625,0.1531702683448112,0.9562737642585551,0.154505076142132,0.292074500979894,0.07129719510124613,proxy +direct,http-ka-1m,0,60.9885356032,7273.23,1.43,1.86,2.21,2.74,0,0,0,5.9,0.0,0.0773915942286102,80.93389484080714,0.0,0.9457788347205708,0.5711519845111326,0.48732394366197185,3.539831811888859,0.4962483519787225,client +3proxy-0.9.9.2,http-ka-1m,0,14.08749273088,1677.69,4.49,24.92,41.46,44.61,0,0,0,8.56,5.571839,0.48610495357978645,509.4934825308017,14.28125,0.28039819862526666,0.8214971209213052,0.12149826880705068,0.8829028883384019,0.09028002906387983,none +3proxy-1.0.2,http-ka-1m,0,18.21066133504,2170.8,7.05,8.23,11.5,15.87,0,0,0,10.02,6.959531,0.4401817074361837,461.00759144237406,15.65234375,0.355864342910975,0.9524714828897338,0.1607587064676617,1.1074580156562621,0.13786916995640636,client +3proxy-devel-c37,http-ka-1m,0,28.60448219136,3414.0,4.45,5.4,6.98,9.31,0,0,0,10.01,5.990891,0.2799561252823105,292.89559925093636,16.77734375,0.4962121212121212,0.9515209125475285,0.24122943185346166,1.6970834962344608,0.16256272621142637,client +3proxy-bp,http-ka-1m,0,28.60448219136,3410.42,4.44,5.84,7.23,10.51,0,0,0,10.0,5.986879,0.27967644883347703,292.8343436118188,19.015625,0.5070921985815603,0.9514747859181731,0.24042354406726876,1.7172785257286394,0.20439963073782982,client +nginx,http-ka-1m,0,5.911200399359999,704.42,22.12,23.24,24.96,32.2,0,0,0,10.02,6.24969,1.3560697419204202,1420.672054444917,44.74609375,0.2543421365691173,0.9506641366223909,0.06192733017377567,0.55751960541004,0.04563393241888484,proxy +nginx-halfclose,http-ka-1m,0,5.92177004544,705.7,22.06,23.51,25.58,31.16,0,0,0,10.01,6.224417,1.3522983733835596,1417.244796828543,43.6171875,0.2544674767691208,0.9515209125475285,0.06184916377406122,0.5613258620823016,0.04276927684916809,proxy +haproxy,http-ka-1m,0,7.3014444032,873.19,18.77,20.64,22.81,26.56,0,0,0,10.1,5.292126,1.1066303533666273,1145.254564009525,45.078125,0.33798528292311597,0.9600760456273765,0.0683111954459203,0.8219445905060362,0.04847801962830637,proxy +haproxy-splice-auto,http-ka-1m,0,24.0518168576,2865.93,5.3,5.86,6.68,8.36,0,0,0,10.01,5.846613,0.33294782042503357,349.0723950341749,51.47265625,0.46715151515151515,0.9506172839506173,0.18310301507537688,1.4926381593984304,0.15019694270024309,client +envoy,http-ka-1m,0,11.33871366144,1351.74,11.48,12.79,14.34,16.78,0,0,0,10.02,7.988493,0.7069584998217495,740.5217648363018,45.328125,0.21765962497032992,0.9524714828897338,0.10902255639097744,0.7078491491348671,0.07701281028304488,proxy +squid,http-ka-1m,0,2.0602421248,244.27,63.6,69.35,74.46,83.97,0,0,0,10.1,7.283883,3.9218691350582766,4094.041345764086,42.91015625,0.21683857040057566,0.9609895337773549,0.027549081697276757,0.45473692652831976,0.014260731561718674,proxy +tinyproxy,http-ka-1m,0,1.17801222144,139.82,113.87,119.28,125.07,136.76,1399,0,0,10.02,6.1215139999999995,6.8046832232362195,7162.258756254468,8.640625,0.24075434729365663,0.9515669515669516,0.03476874003189793,0.4423776313013025,0.011403316196898123,proxy +direct,http-ka-50k-2000,0,33.67254360064,81791.29,23.03,25.97,30.76,141.59,0,0,0,8.7,0.0,0.20669659181517,10.55712496723651,0.0,0.8498678837376892,0.8761329305135952,0.9556119213696893,2.750398014912689,0.7621834184597773,origin +3proxy-0.9.9.2,http-ka-50k-2000,0,4.0995127296,9963.34,47.54,58.07,66.53,108.93,0,202,0,10.5,7.145713,2.049024007011587,104.71935213627478,155.08984375,0.1961155850307911,0.9971509971509972,0.23263124803520904,0.48710727751299254,0.14451632324592495,proxy +3proxy-1.0.2,http-ka-50k-2000,0,3.8507905024,9358.93,53.73,60.76,70.18,112.1,0,161,0,10.48,7.39596,2.1772153002804706,111.33538723042601,124.72265625,0.1867612293144208,0.9961977186311787,0.23185673892554196,0.45951242230065414,0.14736453371584995,proxy +3proxy-devel-c37,http-ka-50k-2000,0,4.51592323072,10975.43,44.96,52.19,61.86,111.31,0,165,0,10.42,7.014406,1.8459126902985332,94.30034932758964,81.39453125,0.21940828402366863,0.9914367269267365,0.25,0.544178608136502,0.16637172081124582,proxy +3proxy-bp,http-ka-50k-2000,0,5.636725145600001,13699.26,141.05,158.8,165.78,786.36,0,0,0,10.31,6.437089,1.4632609870002884,74.78818477251625,161.98046875,0.24899882214369848,0.9791073124406457,0.28763693270735524,0.5984239781039316,0.18349814914105142,proxy +nginx,http-ka-50k-2000,0,3.59133085696,8724.2,126.24,132.7,157.72,186.51,0,138,0,10.16,6.9930699999999995,2.2632278460916333,115.70831482683613,113.3203125,0.19650448748228624,0.9657794676806084,0.173404927353127,0.4233711097476587,0.11594033416721783,proxy +nginx-halfclose,http-ka-50k-2000,0,3.5014049791999997,8505.71,133.42,144.72,163.01,185.75,0,140,0,10.2,6.954351,2.3304930587790484,118.94766302826756,117.5078125,0.1878845243729295,0.9695817490494296,0.17374762206721622,0.405249061084241,0.11216677437379438,proxy +haproxy,http-ka-50k-2000,0,2.86043144192,6917.19,275.94,293.61,327.34,755.67,0,0,0,10.16,6.093551,2.8415293864006275,145.97701149425288,177.375,0.2393629664844307,0.9657794676806084,0.15827564505978603,0.4889951995790218,0.09598188214252691,proxy +haproxy-splice-auto,http-ka-50k-2000,0,3.00110839808,7180.83,263.68,281.64,294.33,756.33,0,0,0,10.12,6.079101,2.6976699692618653,139.99363665287942,186.2734375,0.24453941120607786,0.9628924833491912,0.163278073193619,0.4994601680211157,0.09506458801123431,proxy +envoy,http-ka-50k-2000,0,2.4213716992,5881.59,328.96,356.06,381.08,537.95,0,0,0,10.2,8.110259000000001,3.369990655584185,171.93136230320601,363.86328125,0.10454870207192189,0.9686609686609686,0.11523809523809524,0.2673321281682394,0.07320551181425411,proxy +squid,http-ka-50k-2000,0,0.9210691583999999,2184.55,476.97,516.14,578.65,644.82,0,268,0,10.31,8.361904,8.95481074876907,467.9981842941443,194.0859375,0.12488015340364333,0.9809705042816366,0.05354879594423321,0.259730999121622,0.03137574655714551,proxy +tinyproxy,http-ka-50k-2000,0,0.66236448768,1609.76,633.23,681.14,869.32,1720.0,16222,67,0,10.28,6.625122,12.416124585430914,633.7073110590557,31.625,0.201634222542658,0.979047619047619,0.0979087452471483,0.3548570284741804,0.0399263993942528,proxy +direct,http-ka-2k-50k-2000,0,25.254407700479998,61255.95,31.12,34.78,40.57,46.16,0,0,0,8.67,0.0,0.2746451265957891,14.068440447658748,0.0,0.7404819277108434,0.857566765578635,0.954746835443038,2.3141085152111485,0.7856676425235058,origin +3proxy-0.9.9.2,http-ka-2k-50k-2000,0,3.54947170304,8626.58,68.42,78.77,89.54,364.81,0,204,0,10.48,6.7903080000000005,2.3620416505417956,120.40441176470588,156.24609375,0.1810874704491726,0.9971455756422455,0.26350710900473934,0.4366931464723868,0.17017765442018976,proxy +3proxy-1.0.2,http-ka-2k-50k-2000,0,3.79014086656,9211.55,68.19,76.74,88.22,126.1,0,213,0,10.46,7.291064,2.2078335066197545,112.73252430323541,179.0546875,0.1841172299692744,0.9952426260704091,0.2734449005367856,0.45381717379716724,0.17682671852709753,proxy +3proxy-devel-c37,http-ka-2k-50k-2000,0,4.1972400128,10200.88,51.1,57.52,66.02,122.01,0,230,0,10.39,6.792644,1.980348985202546,101.24929349626771,79.80078125,0.20684769775678866,0.9876425855513308,0.28332280480101074,0.49950584977324985,0.1863502323190708,proxy +3proxy-bp,http-ka-2k-50k-2000,0,5.422480097279999,13178.72,157.37,159.24,168.25,935.63,0,0,0,10.26,6.3674029999999995,1.5136985019303733,77.34056987788331,161.50390625,0.2399432087079981,0.9752851711026616,0.34992175273865417,0.5879222072242163,0.2290302940358794,proxy +nginx,http-ka-2k-50k-2000,0,3.27340261376,7951.98,139.66,148.33,152.97,167.38,0,126,0,10.22,6.994725,2.4977068099205253,127.66223221535195,119.37890625,0.18710134656272148,0.969639468690702,0.19834710743801653,0.39862583239501376,0.142598604683917,proxy +nginx-halfclose,http-ka-2k-50k-2000,0,3.49855285248,8498.84,132.35,137.57,145.04,161.0,0,135,0,10.17,6.999016,2.325532968362241,118.92928560569737,116.765625,0.19574468085106383,0.9667300380228137,0.20748730964467005,0.42429574027087014,0.1435519691004419,proxy +haproxy,http-ka-2k-50k-2000,0,2.8986834944,6984.67,270.82,284.96,306.77,690.54,0,0,0,10.17,5.988569,2.806791433324139,144.6410285584253,179.43359375,0.24279247081248512,0.9658119658119658,0.18726474278544541,0.4927772717408581,0.11788490653490355,proxy +haproxy-splice-auto,http-ka-2k-50k-2000,0,2.93693554688,7105.65,271.24,282.7,295.34,706.72,0,0,0,10.18,5.974853,2.772958367660342,142.33183731107476,186.85546875,0.23718712753277713,0.967680608365019,0.19467918622848202,0.4890177272398265,0.12359044078347606,proxy +envoy,http-ka-2k-50k-2000,0,2.2914321612800004,5565.89,340.85,358.91,383.97,546.26,0,0,0,10.2,8.125176,3.561091677897111,182.14285714285714,359.9609375,0.10190023752969121,0.9705042816365367,0.12706480304955528,0.25592145765484686,0.08743441964808887,proxy +squid,http-ka-2k-50k-2000,0,0.7189037056,1733.85,603.1,651.19,720.75,774.57,0,222,0,10.33,8.099122,11.495280850030994,591.231684981685,207.75390625,0.11420345489443379,0.9819391634980988,0.10750636132315522,0.23402342745563456,0.05228644302888436,proxy +tinyproxy,http-ka-2k-50k-2000,0,0.62151196672,1510.54,683.59,735.21,810.81,1740.0,15212,205,0,10.32,6.717229,13.283734573238627,678.4117801735472,30.0234375,0.1930835734870317,0.98005698005698,0.11492063492063492,0.3367996579522196,0.05226920666886526,proxy +direct,http-close-1k,0,0.5169060249599999,50760.75,0.8130000000000001,1.89,2.77,4.01,0,0,0,8.58,0.0,13.279009468947786,16.73509591472513,0.0,0.7354028085735402,0.8827160493827161,0.9005134788189987,2.01294870134438,0.5805326465490447,origin +3proxy-0.9.9.2,http-close-1k,0,0.04722786304,4638.12,12.94,15.82,19.17,23.38,0,0,0,10.1,6.885663,171.08544574961147,217.3585555340349,143.23828125,0.15036703765095905,0.9609895337773549,0.16470588235294117,0.300644181050757,0.08267753776560345,proxy +3proxy-1.0.2,http-close-1k,0,0.04898947072,4811.42,12.41,15.07,18.75,22.88,0,0,0,10.02,6.992992,163.62699743819562,207.86225495280573,52.3359375,0.14539426947667536,0.9524714828897338,0.16751592356687897,0.29208785106109564,0.0846199728612601,proxy +3proxy-devel-c37,http-close-1k,0,0.0603979776,5929.62,10.07,11.75,13.85,19.55,0,0,0,10.01,6.366975,132.58722093370227,168.57243899563832,9.140625,0.17847831239630244,0.9524262607040913,0.2032546266751755,0.36627375577644744,0.10362783000243737,proxy +3proxy-bp,http-close-1k,0,0.07306477568000001,7172.19,8.12,10.72,13.62,20.73,0,0,0,10.01,6.184381,109.6013766616138,139.4033924741665,7.0390625,0.1981042654028436,0.9515209125475285,0.22532529355760075,0.4186188787613249,0.11503913899692264,proxy +nginx,http-close-1k,0,0.13992198144,13738.84,4.47,4.64,5.01,5.99,0,0,0,10.0,5.421762,57.17471920900779,72.73362038868846,31.84375,0.3176526490852934,0.9505703422053232,0.22777061855670103,0.6859087594812794,0.16914490201466065,proxy +nginx-halfclose,http-close-1k,0,0.13103005696,12863.29,4.75,5.19,5.65,6.71,0,0,0,10.02,5.378476,61.176803139504635,77.8095297260359,31.30078125,0.30028530670470754,0.9515669515669516,0.1769825918762089,0.6507966630366921,0.15492323027174965,proxy +haproxy,http-close-1k,0,0.16089350144,15796.0,3.83,4.0,4.51,5.8,0,0,0,10.02,5.707294,49.82177607085831,63.30913433288474,29.26953125,0.3281807372175981,0.9533777354900095,0.2034007058068656,0.7554675188840374,0.20537084131939454,proxy +haproxy-splice-auto,http-close-1k,0,0.15720251391999998,15438.42,3.84,4.24,4.78,5.8,0,0,0,10.1,5.772915,51.39866913395478,64.7751468664221,35.72265625,0.3333333333333333,0.9600760456273765,0.20663018989378823,0.7610496561836757,0.17490415446353944,proxy +envoy,http-close-1k,0,0.06484393984,6231.58,9.95,10.85,11.82,14.46,0,0,0,10.0,7.953665000000001,123.37313278217981,160.274389755261,28.94921875,0.1591123701605288,0.9505703422053232,0.08783570300157978,0.3434617274330547,0.07320638630000226,proxy +squid,http-close-1k,0,0.04387241984,4082.87,14.85,15.76,17.57,23.32,0,0,0,10.11,7.884148,184.35272158445864,245.16222901207624,18.94140625,0.13211140204713165,0.9601139601139601,0.0768985322271857,0.2540415435859487,0.07606189691222688,proxy +tinyproxy,http-close-1k,0,0.03766484992,3751.21,16.16,18.58,21.46,26.75,37575,0,0,10.06,6.9254929999999995,213.67402278500833,267.7169545200522,7.6875,0.14635887672536887,0.9553656220322887,0.14666666666666667,0.2825717171524247,0.06845633724479949,proxy +3proxy-0.9.9.2,stream1,1,19.108039019095386,nan,nan,nan,nan,nan,0,0,0,10.01,6.727242,0.41733967560405316,nan,8.49609375,0.1092778574844572,0.9506172839506173,0.2691309987029831,0.28638809628104056,0.47346205086873133,proxy +3proxy-1.0.2,stream1,1,18.432115072951373,nan,nan,nan,nan,nan,0,0,0,10.0,6.9599079999999995,0.43393211985269026,nan,9.46875,0.12630792227204785,0.999000999000999,0.2635711847046774,0.320663595211113,0.47314891260003994,proxy +3proxy-devel-c37,stream1,1,34.06670241202806,nan,nan,nan,nan,nan,0,0,0,10.0,5.383496,0.23478455442017768,nan,11.56640625,0.19984992496248125,0.999000999000999,0.38085539714867617,0.5543742791950376,0.7736019918875908,proxy +3proxy-bp,stream1,1,30.44056650456466,nan,nan,nan,nan,nan,0,0,0,9.96,5.293896999999999,0.2617107721307439,nan,13.078125,0.18806193806193805,0.9940119760479041,0.35690121786197565,0.5205227522144518,0.7465191372571452,proxy +nginx,stream1,1,9.710732762036175,nan,nan,nan,nan,nan,0,0,0,10.0,6.5112250000000005,0.8236151837088295,nan,32.44140625,0.07861242825056151,0.998003992015968,0.26664378860672616,0.1678364093759511,0.4720206899538093,proxy +nginx-halfclose,stream1,1,9.439613476455548,nan,nan,nan,nan,nan,0,0,0,9.99,6.395765,0.8463267860042807,nan,33.140625,0.07641196013289037,0.9514285714285714,0.28231404958677686,0.16841294747801439,0.4735155667230333,proxy +haproxy,stream1,1,9.496397863624335,nan,nan,nan,nan,nan,0,0,0,10.0,6.384722,0.8422731622801691,nan,29.37890625,0.07480610457843383,0.999000999000999,0.2982395581636175,0.15785677624654623,0.4982033244330157,proxy +haproxy-splice-auto,stream1,1,31.193901750211253,nan,nan,nan,nan,nan,0,0,0,9.94,5.401806,0.25483444215405426,nan,44.26953125,0.18709830992620805,0.9430740037950665,0.3453957996768982,0.5433012112411322,0.7112154781286815,proxy +envoy,stream1,1,17.553795028255408,nan,nan,nan,nan,nan,0,0,0,10.0,7.645869,0.4556195263838377,nan,32.72265625,0.11789772727272728,0.9505703422053232,0.17580340264650285,0.3016398555961134,0.32603805412080283,proxy +direct,stream1,1,46.974961472179864,nan,nan,nan,nan,nan,0,0,0,6.35,0.0,0.10812537444413135,nan,0.0,0.2770422183362478,0.6642259414225942,0.3507640067911715,0.7203342972271652,0.7697339766475437,none +3proxy-0.9.9.2,stream16,1,18.555996920692323,nan,nan,nan,nan,nan,0,0,664,10.02,6.92682,0.4293832395506858,nan,91.76953125,0.13185255198487714,0.9533777354900095,0.261703511053316,0.3344681913988237,0.47091848099468675,proxy +3proxy-1.0.2,stream16,1,18.59016296791776,nan,nan,nan,nan,nan,0,0,768,10.04,7.051431,0.43057403650224846,nan,91.89453125,0.1362781954887218,0.9534662867996201,0.26312378483473753,0.3316830803645738,0.4672106146319552,proxy +3proxy-devel-c37,stream16,1,30.385584388021638,nan,nan,nan,nan,nan,0,0,753,10.02,5.146593,0.26328008900312366,nan,96.953125,0.18718742557751847,0.9515669515669516,0.3476863753213368,0.5512575634591844,0.7569069429268312,proxy +3proxy-bp,stream16,1,29.92532108582211,nan,nan,nan,nan,nan,0,0,1288,10.03,5.3368020000000005,0.26732024896487966,nan,104.328125,0.19933475885008314,0.9525166191832859,0.378060413354531,0.5264023630293184,0.7962468276179829,proxy +nginx,stream16,1,10.022587855061582,nan,nan,nan,nan,nan,0,0,659,10.09,6.645957,0.7998315859392858,nan,110.6640625,0.07858499525166192,0.9573055028462998,0.2828216851730895,0.1843905628794057,0.46253101551775616,proxy +nginx-halfclose,stream16,1,9.54485468547081,nan,nan,nan,nan,nan,0,0,690,10.06,6.619219,0.8375532964968135,nan,107.53125,0.07343155893536121,0.9562737642585551,0.28332239001969795,0.1748094210614166,0.4566023705044488,proxy +haproxy,stream16,1,8.870406077757307,nan,nan,nan,nan,nan,0,0,11,10.02,6.296742,0.9033456999400302,nan,56.46484375,0.08252080856123663,0.9506641366223909,0.3479020979020979,0.17676676381120515,0.6001508273955392,proxy +haproxy-splice-auto,stream16,1,29.406099572703443,nan,nan,nan,nan,nan,0,0,5,10.02,5.007129,0.2725114007369192,nan,115.125,0.22440758293838864,0.9506641366223909,0.605112680793811,0.5417555534315157,1.1928293609721357,origin +envoy,stream16,1,14.67511052533997,nan,nan,nan,nan,nan,0,0,7396,10.04,8.07631,0.5458654924515057,nan,153.1328125,0.11516587677725118,0.9534662867996201,0.16255534471853259,0.2785075671509435,0.30582409163523716,proxy +direct,stream16,1,138.45755227392587,nan,nan,nan,nan,nan,0,0,4781,8.46,0.0,0.048869605243656467,nan,0.0,0.9278737791134485,0.8571428571428571,0.982787156570672,2.9621209198999563,2.5273302733870926,origin +3proxy-0.9.9.2,stream1-down,1,19.465571431214002,nan,nan,nan,nan,nan,0,0,1,9.99,6.6339120000000005,0.410527159439332,nan,7.18359375,0.20358266763495522,0.9514285714285714,0.1324376199616123,0.4833835247275551,0.2671836687541128,proxy +3proxy-1.0.2,stream1-down,1,19.95457699837657,nan,nan,nan,nan,nan,0,0,0,9.99,6.689307,0.40046684759085915,nan,6.9609375,0.21236012207527977,0.998001998001998,0.1603459747172322,0.47456589532599514,0.3094956855147718,proxy +3proxy-devel-c37,stream1-down,1,31.143523462084133,nan,nan,nan,nan,nan,0,0,0,9.96,5.253895,0.2558208502292628,nan,12.90234375,0.2753220510229856,0.995004995004995,0.24523889074507182,0.7291492484588366,0.5459860027868013,proxy +3proxy-bp,stream1-down,1,32.18815364036048,nan,nan,nan,nan,nan,0,0,0,10.01,5.215737,0.24876056344013742,nan,10.0546875,0.27629911280101394,0.9980059820538385,0.2542713567839196,0.722331676355259,0.5539871909192353,proxy +nginx,stream1-down,1,9.74244911819768,nan,nan,nan,nan,nan,0,0,0,10.02,6.430186,0.8227045899541008,nan,32.70703125,0.20482809070958302,0.9506641366223909,0.09724421919543871,0.46722149732750134,0.16735680702989836,proxy +nginx-halfclose,stream1-down,1,9.69589529742518,nan,nan,nan,nan,nan,0,0,0,10.0,6.421913999999999,0.8250045450490392,nan,34.89453125,0.20939183987682833,0.998003992015968,0.08662207357859532,0.45057680648053894,0.14974559731417142,proxy +haproxy,stream1-down,1,9.489535444386185,nan,nan,nan,nan,nan,0,0,0,10.01,6.425814,0.8437861346143753,nan,33.3203125,0.20891501347048738,0.9515209125475285,0.08615774469433006,0.46815569239630184,0.1454213376219807,proxy +haproxy-splice-auto,stream1-down,1,32.820177472663666,nan,nan,nan,nan,nan,0,0,0,10.0,5.262926,0.24372648495676147,nan,44.1328125,0.27525955938212204,0.9970089730807578,0.25091636121292904,0.7052951595328574,0.53583788839536,proxy +envoy,stream1-down,1,17.623027371315064,nan,nan,nan,nan,nan,0,0,0,10.0,7.62484,0.4539036750226077,nan,32.41796875,0.1366120218579235,0.9514747859181731,0.14925844114862732,0.3406427562910187,0.2880998209024951,proxy +direct,stream1-down,1,45.92109262680008,nan,nan,nan,nan,nan,0,0,0,6.44,0.0,0.11218058372280723,nan,0.0,0.2504234212436487,0.6407960199004975,0.34466327827191867,0.7241317780329034,0.7130799602671765,none +3proxy-0.9.9.2,http-ka-1k,1,0.0155189248,1546.68,40.99,41.01,41.04,42.03,0,0,0,0.51,0.798887,26.29048115498311,32.64835797964279,9.84765625,0.014275344785869828,0.05268595041322314,0.013381201044386422,0.05708167477162861,0.0313696794571686,none +3proxy-1.0.2,http-ka-1k,1,0.17867735040000002,17811.11,3.42,3.94,4.52,7.25,0,0,0,10.1,7.551864,45.22117650564847,56.14448588883392,9.8125,0.1669449081803005,0.9600760456273765,0.2613016992625842,0.3786562995873606,0.23482369507477363,proxy +3proxy-devel-c37,http-ka-1k,1,0.224395264,22371.08,2.69,3.08,3.66,5.31,0,0,0,10.1,7.104576000000001,36.00789007739486,44.699759240900725,7.6328125,0.19909177820267687,0.9609895337773549,0.30613556055252167,0.4557067503437526,0.2642987118861608,proxy +3proxy-bp,http-ka-1k,1,0.350224384,34913.16,0.298,16.94,27.96,35.58,0,0,0,10.1,6.896053,23.070923582522454,28.64378755952094,5.44921875,0.23078782020299662,0.9582542694497154,0.42366288492706644,0.5974215275277833,0.3788448293866692,proxy +nginx,http-ka-1k,1,0.34477178880000003,33723.75,1.75,1.96,2.53,2.88,0,0,0,10.0,6.831206,23.203754657086375,29.619361584280412,31.65234375,0.21341898643825838,0.9514747859181731,0.39553178099433606,0.5356511056098626,0.30981285337728864,proxy +nginx-halfclose,http-ka-1k,1,0.37882953727999996,37053.58,1.69,1.74,1.84,2.36,0,0,0,10.01,6.738652,21.138795188721353,26.996922728388302,31.62109375,0.2352661596958175,0.9506172839506173,0.4287511796162315,0.5878937251536369,0.35740869015826904,proxy +haproxy,http-ka-1k,1,0.37841010688,37716.42,1.62,1.72,1.99,2.52,0,0,0,10.1,7.035094999999999,21.35249522434743,26.515797902364106,31.359375,0.22198378636146876,0.9600760456273765,0.3929463171036205,0.5717970701389944,0.348788244932615,proxy +haproxy-splice-auto,http-ka-1k,1,0.3703570432,36919.71,1.62,1.82,2.08,2.65,0,0,0,10.11,7.007141,21.838385818498725,27.112407882175,35.6171875,0.22272618763428026,0.9601139601139601,0.3867835891011588,0.5707815977147347,0.3222458807937162,proxy +envoy,http-ka-1k,1,0.10091495424,9847.08,6.06,6.98,8.18,10.72,0,0,0,9.99,8.969147,79.19539834495792,101.31332082551594,25.875,0.0815450643776824,0.950523311132255,0.14664981036662453,0.19978100848913619,0.11598262748470815,proxy +squid,http-ka-1k,1,0.09521070079999999,8821.17,6.98,7.59,8.45,11.29,0,0,0,10.01,8.868362999999999,84.108193015212,113.31605103184395,21.68359375,0.09836454136051197,0.9533333333333334,0.12337456390738978,0.22261076072715297,0.11122960919599005,proxy +tinyproxy,http-ka-1k,1,0.0327155712,3261.83,19.03,21.78,24.78,30.57,32669,0,0,10.08,6.863086,246.4881310096154,308.5493893293336,7.5546875,0.13798856053384176,0.9572649572649573,0.13918017159199236,0.2625937691330597,0.06465265047995207,proxy +direct,http-ka-1k,1,0.99430170624,97248.52,0.654,0.753,0.791,0.88,0,0,0,7.27,0.0,5.849331207519985,7.4018792831885705,0.0,0.47560670502877156,0.702415458937198,0.9582806573957017,1.348631839582166,0.831095465213215,origin +3proxy-0.9.9.2,http-ka-1m,1,14.08749273088,1672.9,4.55,24.88,41.49,44.54,0,0,0,8.63,5.549388,0.4900801109104623,515.0701283199045,12.51953125,0.2756577388006637,0.8234732824427481,0.11805555555555555,0.8676888683215443,0.10172093975631519,none +3proxy-1.0.2,http-ka-1m,1,17.69526525952,2106.39,7.18,8.69,11.93,17.43,0,0,0,10.02,6.95227,0.45300253386636374,474.971558589306,16.515625,0.3519830028328612,0.9524714828897338,0.15848702719599875,1.103588382458938,0.11504052366512363,client +3proxy-devel-c37,http-ka-1m,1,27.74548873216,3301.94,4.59,5.68,7.2,10.02,0,0,0,10.03,6.046153,0.2892001679069118,303.36942713689433,17.265625,0.4895734597156398,0.9525166191832859,0.232718173287457,1.6687082919283187,0.17873414572271568,client +3proxy-bp,http-ka-1m,1,26.972394618880003,3211.76,4.74,6.24,7.88,11.69,0,0,0,10.02,6.011978,0.2971927451479966,311.66407465007774,16.96875,0.4801897983392645,0.9515669515669516,0.2269900497512438,1.621944627078797,0.19105932183223837,client +nginx,http-ka-1m,1,5.71591360512,681.12,22.86,24.5,26.7,31.56,0,0,0,10.01,6.285486000000001,1.4010008816135493,1468.3878538946751,44.8359375,0.24707287933094385,0.9515209125475285,0.057838179519595447,0.5422447807636425,0.03992448286167002,proxy +nginx-halfclose,http-ka-1m,1,5.81993234432,693.61,22.58,24.15,26.05,31.24,0,0,0,10.01,6.253646000000001,1.3759610122986152,1441.7398818954343,44.8203125,0.2517797816801139,0.9524262607040913,0.056556082148499214,0.5460636186564088,0.050365278702137146,proxy +haproxy,http-ka-1m,1,7.261934059520001,865.4,18.27,20.37,23.23,27.78,0,0,0,10.12,5.282568,1.1148545185957153,1157.8947368421052,44.7734375,0.33629667259334517,0.9601518026565465,0.07156368221941993,0.818127248482504,0.053235152136439874,proxy +haproxy-splice-auto,http-ka-1m,1,22.93512536064,2733.34,5.66,6.3,7.03,8.53,0,0,0,10.09,5.911258,0.3519492426168606,365.4605382302872,51.3515625,0.46255184191266163,0.9600380589914367,0.1759899434318039,1.4554692400572247,0.14259268702799768,client +envoy,http-ka-1m,1,12.36950581248,1471.96,10.61,11.53,12.57,15.39,0,0,0,10.01,8.019601999999999,0.6473985397153431,679.1044776119403,44.24609375,0.23337278106508877,0.9533333333333334,0.1200750469043152,0.7573856650638459,0.07986936229425375,proxy +squid,http-ka-1m,1,2.21400530944,262.98,59.18,62.02,66.1,77.34,0,0,0,10.11,7.172208,3.6531077705706765,3806.475903614458,42.9140625,0.21780528445608188,0.9610266159695817,0.028200253485424587,0.44714421786270175,0.01330850208543908,proxy +tinyproxy,http-ka-1m,1,1.12440901632,133.14,117.47,125.9,136.19,159.7,1332,0,0,10.03,6.141971,7.136193221094216,7524.381095273819,8.15625,0.23202933985330074,0.9525166191832859,0.0351213282247765,0.4262286808615097,0.011409114879337996,proxy +direct,http-ka-1m,1,60.90263625728,7258.41,1.46,1.88,2.27,2.82,0,0,0,5.82,0.0,0.07644989258479669,80.0561218173565,0.0,0.9395238095238095,0.5645004849660524,0.4863593603010348,3.5165994502832154,0.46194593644267695,client +3proxy-0.9.9.2,http-ka-50k-2000,1,3.9917191168,9701.39,48.99,58.71,66.52,114.58,0,205,0,10.48,7.132361,2.1003481844987917,107.14650853695942,159.4140625,0.20118483412322274,0.9961977186311787,0.2367758186397985,0.4966090385826088,0.1501362989226934,proxy +3proxy-1.0.2,http-ka-50k-2000,1,4.2291167232,10278.49,68.29,76.66,87.2,137.43,0,199,0,10.47,7.382676,1.9805554086627866,101.09690626086285,190.06640625,0.19389204545454544,0.9952471482889734,0.2408805031446541,0.4804610342284706,0.14640538538819334,proxy +3proxy-devel-c37,http-ka-50k-2000,1,4.71037116416,11448.01,51.1,59.21,67.68,132.97,0,153,0,10.38,6.852365,1.7629184008222103,90.01743112105524,82.88671875,0.21951795841209829,0.9866920152091255,0.24699176694110198,0.5375393681774698,0.15877507078531292,proxy +3proxy-bp,http-ka-50k-2000,1,5.892493803520001,14321.08,122.9,156.64,161.71,1040.0,0,0,0,10.19,6.386259,1.3834549974630839,70.67995644061565,161.2578125,0.25153374233128833,0.9695528068506185,0.29554655870445345,0.6107616597707677,0.18443053846774016,proxy +nginx,http-ka-50k-2000,1,3.2523472076799997,7900.79,143.34,173.73,182.7,193.65,0,122,0,10.17,6.921214,2.5015779314053193,127.64515400256043,109.75390625,0.18058851447555765,0.9658119658119658,0.16503628905017356,0.3862452892764732,0.11122938985820548,proxy +nginx-halfclose,http-ka-50k-2000,1,3.6143156428800003,8780.04,123.25,130.79,141.06,165.66,0,138,0,10.2,7.015163,2.257688814775971,115.50351606291544,110.0390625,0.19962201748169148,0.967741935483871,0.17131095630145662,0.4328953579842317,0.10934045155006755,proxy +haproxy,http-ka-50k-2000,1,2.93903269888,7113.06,267.74,286.74,306.81,686.07,0,0,0,10.18,6.035844,2.7709797182942184,142.23041886718642,178.6640625,0.24227294341417024,0.967680608365019,0.15923366834170855,0.4918694282755393,0.09697350435725574,proxy +haproxy-splice-auto,http-ka-50k-2000,1,3.13893322752,7532.19,247.74,262.73,289.78,619.56,0,0,0,10.13,6.048664,2.5817688407480994,133.4949857016723,183.51171875,0.24904852521408183,0.9638439581351094,0.16687539135879775,0.5147052887641936,0.0979205360802824,proxy +envoy,http-ka-50k-2000,1,2.58293628928,6274.1,306.27,320.88,339.65,511.81,0,0,0,10.17,8.049517,3.1499034775913617,160.91008338211793,360.625,0.11095238095238096,0.9676498572787822,0.11940298507462686,0.2825450102524802,0.08080682105289307,proxy +squid,http-ka-50k-2000,1,0.85882568704,2018.69,492.44,561.75,596.78,642.22,0,262,0,10.3,8.29546,9.594496443626074,506.1673792323947,183.96875,0.12169947191550648,0.9781576448243114,0.05228136882129278,0.2444960525497153,0.030420639894554503,proxy +tinyproxy,http-ka-50k-2000,1,0.6743601971200001,1638.82,626.66,666.56,834.88,1710.0,16516,221,0,10.3,6.652087,12.218989251131205,623.5999273475812,28.95703125,0.20604461501559126,0.9809523809523809,0.10224754669199114,0.35962901374899475,0.04180685417253297,proxy +direct,http-ka-50k-2000,1,37.36621547519999,90793.31,20.8,22.31,24.57,32.25,0,0,0,8.68,0.0,0.18583632063591618,9.53637611115811,0.0,0.8891273247496424,0.8662674650698603,0.946417247939125,2.939729565427461,0.7612634230490707,origin +3proxy-0.9.9.2,http-ka-2k-50k-2000,1,3.9349282406399997,9563.2,44.67,51.27,57.21,94.7,0,209,0,10.47,6.923961,2.1286283987322925,108.88442859074222,127.87890625,0.18730760123135212,0.9961941008563273,0.269364527347455,0.461431210236117,0.17866348611347757,proxy +3proxy-1.0.2,http-ka-2k-50k-2000,1,4.06780379136,9886.33,58.45,67.75,75.56,121.26,0,220,0,10.47,7.317996,2.0590963649206957,105.25151795407938,175.34375,0.18473895582329317,0.9961941008563273,0.2734424166142228,0.46143733337228854,0.174935316256531,proxy +3proxy-devel-c37,http-ka-2k-50k-2000,1,4.2097390387199995,10231.27,50.69,56.92,63.44,113.09,0,175,0,10.38,6.841489999999999,1.9725688275739035,100.9619593234187,75.5703125,0.20274426307073576,0.9876308277830638,0.28062992125984254,0.49947248269064337,0.20060278520664462,proxy +3proxy-bp,http-ka-2k-50k-2000,1,5.029473812479999,12223.57,159.1,162.92,195.5,893.33,0,0,0,10.25,6.354820999999999,1.6303892426386122,83.22710036782318,161.73828125,0.2269185360094451,0.97340930674264,0.3290544771446462,0.5499136302860516,0.21294905963019123,proxy +nginx,http-ka-2k-50k-2000,1,3.42817243136,8327.87,134.44,141.78,148.22,159.74,0,133,0,10.17,7.00593,2.3732761880861237,121.23162750777813,116.6328125,0.1851588430535799,0.9667300380228137,0.20095087163232964,0.4062337031237914,0.14165929418026202,proxy +nginx-halfclose,http-ka-2k-50k-2000,1,3.26920830976,7941.77,140.47,145.18,150.7,186.0,0,127,0,10.18,6.985963,2.4911229962577295,127.29932848978979,119.2578125,0.18448438978240303,0.9686013320647003,0.19441801458928004,0.39673723022675694,0.13310304853387017,proxy +haproxy,http-ka-2k-50k-2000,1,3.00807094272,7240.15,263.6,276.1,287.48,713.11,0,0,0,10.15,6.056342,2.6994044205146372,139.26047883652328,179.94921875,0.24092095893662474,0.964828897338403,0.191875,0.4937568787571568,0.12358513526494037,proxy +haproxy-splice-auto,http-ka-2k-50k-2000,1,3.0358372352,7330.25,247.84,287.21,324.73,640.74,0,0,0,10.13,6.013194,2.669444825972731,137.45844358504647,184.40234375,0.24684898929845422,0.9638439581351094,0.19436619718309858,0.5089699315357484,0.12259679561086585,proxy +envoy,http-ka-2k-50k-2000,1,2.44804747264,5946.34,320.49,346.62,383.56,539.1,0,0,0,10.29,8.177489999999999,3.362679887544225,171.71464330413016,368.10546875,0.10767768005704778,0.9781368821292775,0.13683877098511246,0.26732749559899477,0.0931608194553502,proxy +squid,http-ka-2k-50k-2000,1,0.7798049996799999,1879.32,502.67,538.71,586.34,595.97,0,279,0,10.35,8.103747,10.618039129523115,547.0401691331924,189.89453125,0.1144290492116579,0.9829059829059829,0.11104060913705584,0.23118960305372396,0.054168627413839765,proxy +tinyproxy,http-ka-2k-50k-2000,1,0.6451678412799999,1567.93,657.48,685.46,855.05,1690.0,15775,280,0,10.35,6.740012,12.83386968509256,656.1014263074485,28.23828125,0.1968390804597701,0.9819734345351043,0.11798287345385347,0.34345787875418377,0.053221941166219346,proxy +direct,http-ka-2k-50k-2000,1,18.640158064639998,45210.98,31.74,105.24,267.86,784.43,0,2,0,9.72,0.0,0.41716384448214067,21.372454600025065,0.0,0.6546134663341646,0.9355149181905679,0.8210526315789474,1.8966153625659263,0.5750227828816307,client +3proxy-0.9.9.2,http-close-1k,1,0.04831838208,4744.15,12.57,15.55,18.82,24.76,0,0,0,10.12,6.904956,167.55527920193143,212.9405576012625,173.96484375,0.15004748338081672,0.9638095238095238,0.16810207336523125,0.30539679647786405,0.08461466551073585,proxy +3proxy-1.0.2,http-close-1k,1,0.0436207616,4282.8,14.04,17.17,20.75,26.3,0,0,0,10.0,6.976185999999999,183.3989070012019,233.12196941439763,35.0859375,0.14458689458689458,0.9514747859181731,0.1717557251908397,0.29301983541295673,0.0864722757177606,proxy +3proxy-devel-c37,http-close-1k,1,0.05670699008,5565.91,10.87,12.75,14.64,21.34,0,0,0,10.02,6.363153,141.3582344732341,179.76641130985485,9.38671875,0.17600950118764846,0.9524714828897338,0.2024872448979592,0.36245253763527585,0.10456200084719587,proxy +3proxy-bp,http-close-1k,1,0.06752829440000001,6629.65,8.76,11.7,14.98,23.13,0,0,0,10.03,6.168466,118.82426575844332,151.01100588686973,6.97265625,0.20452937013446568,0.9516129032258065,0.22526248806872415,0.420487335825737,0.11408119277739419,proxy +nginx,http-close-1k,1,0.12205424640000001,11983.61,5.22,5.89,6.11,6.83,0,0,0,10.1,5.473346,66.20007282270188,83.44624739746853,31.3125,0.3089954664757814,0.9609895337773549,0.17930591259640102,0.6696766572081247,0.1473414720827219,proxy +nginx-halfclose,http-close-1k,1,0.12348030976,12122.76,4.9,5.51,6.43,7.55,0,0,0,10.02,5.435444,64.91723267928413,82.57856089138694,31.53515625,0.304564907275321,0.9515669515669516,0.17647058823529413,0.6601722148957877,0.1463550354844611,proxy +haproxy,http-close-1k,1,0.148897792,14623.51,4.02,4.68,5.29,6.16,0,0,0,10.11,5.761748,54.31913993727993,68.4532676109742,31.22265625,0.33159268929503916,0.9601139601139601,0.2012965964343598,0.7506112370746723,0.1844198877622291,proxy +haproxy-splice-auto,http-close-1k,1,0.14705229824000002,14436.92,4.17,4.67,5.31,6.3,0,0,0,10.01,5.741987,54.45681635611273,69.2350255913681,35.83984375,0.3216235461666271,0.9515209125475285,0.20243044451551007,0.7334773937446049,0.1881464262740137,proxy +envoy,http-close-1k,1,0.0620756992,5966.48,10.24,11.28,12.68,16.65,0,0,0,9.99,8.020178999999999,128.74603271484375,167.20504795219844,28.53515625,0.15867768595041323,0.950523311132255,0.08927444794952681,0.33965054091249586,0.06464533229760337,proxy +squid,http-close-1k,1,0.044459622399999996,4138.12,15.17,15.67,16.26,18.82,0,0,0,10.1,7.884879,181.7379357679835,241.66726485296581,18.75,0.1428912213740458,0.9600760456273765,0.08333333333333333,0.277790987643991,0.09316206944999827,proxy +tinyproxy,http-close-1k,1,0.0373293056,3723.73,16.31,18.54,21.53,26.38,37291,0,0,10.01,6.907453,214.52314398261936,268.42218170116917,7.74609375,0.15243757431629013,0.9524262607040913,0.15279542566709023,0.2939632638896764,0.07224745757556617,proxy +direct,http-close-1k,1,0.49777999872,48879.07,0.86,2.0,3.01,4.47,0,0,0,8.58,0.0,13.78922419070715,17.380700130253963,0.0,0.7104551045510455,0.8701825557809331,0.8907805974943784,1.949815610115938,0.5681805019822146,client +3proxy-1.0.2,stream1,2,18.729927584166912,nan,nan,nan,nan,nan,0,0,0,10.0,6.880953,0.42704862646512254,nan,8.43359375,0.141436738752175,0.999000999000999,0.28405599180607716,0.3506894357585474,0.5151821308763853,proxy +3proxy-devel-c37,stream1,2,30.48636893849952,nan,nan,nan,nan,nan,0,0,0,9.98,5.387523,0.2618287016838545,nan,12.78515625,0.18641944374843397,0.997002997002997,0.3920108327691266,0.544476709350809,0.8112787205376472,proxy +3proxy-bp,stream1,2,31.785403249878545,nan,nan,nan,nan,nan,0,0,0,9.98,5.323895,0.2511457286258642,nan,13.09375,0.2015988008993255,0.997002997002997,0.3782593972231629,0.5535065122598182,0.7707711923577647,proxy +nginx,stream1,2,9.29903375619557,nan,nan,nan,nan,nan,0,0,0,9.99,6.44721,0.8592454749804123,nan,31.55859375,0.06996668253212755,0.950523311132255,0.23592931937172776,0.14940407645193068,0.4317324056906184,proxy +nginx-halfclose,stream1,2,9.499439943061889,nan,nan,nan,nan,nan,0,0,0,10.01,6.624892,0.8424365086792915,nan,36.65625,0.07315914489311164,0.9524262607040913,0.2741565673108418,0.1741370934320443,0.47451550738046366,proxy +haproxy,stream1,2,9.292913029417784,nan,nan,nan,nan,nan,0,0,0,10.01,6.5037959999999995,0.8614415509487728,nan,32.83984375,0.07328098976921246,0.9515209125475285,0.279023746701847,0.16745181326405678,0.46477474618347536,proxy +haproxy-splice-auto,stream1,2,30.386860852665556,nan,nan,nan,nan,nan,0,0,0,9.98,5.308745,0.2626587512440192,nan,41.62890625,0.1815377313716184,0.9495718363463368,0.3502587322121604,0.5147669639583708,0.7083678592286975,proxy +envoy,stream1,2,17.702707864732723,nan,nan,nan,nan,nan,0,0,0,10.01,7.699901,0.45221600697425685,nan,31.39453125,0.11816244376035993,0.9515209125475285,0.17800882167611845,0.29877776365949804,0.33755270343598837,proxy +direct,stream1,2,45.72171027378695,nan,nan,nan,nan,nan,0,0,0,6.48,0.0,0.11336500014331577,nan,0.0,0.276,0.6792452830188679,0.3471890971039182,0.7172296069085492,0.7586373733244711,none +3proxy-0.9.9.2,stream1,2,18.142179560963168,nan,nan,nan,nan,nan,0,0,0,10.01,6.740428,0.439578894625795,nan,6.5859375,0.12014302741358761,0.9506172839506173,0.27665799739921976,0.31207078201951166,0.5084605842847514,proxy +3proxy-1.0.2,stream16,2,18.606271815585487,nan,nan,nan,nan,nan,0,0,820,10.05,7.0987540000000005,0.4306591424442688,nan,86.3671875,0.14440263405456255,0.9544159544159544,0.2699287103046014,0.3554791658036532,0.48052114200551804,proxy +3proxy-devel-c37,stream16,2,30.622886988781264,nan,nan,nan,nan,nan,0,0,699,10.02,5.194896,0.26116281037977085,nan,101.25,0.18849916487711763,0.9524714828897338,0.3507078507078507,0.5617912621160093,0.7712477337438773,proxy +3proxy-bp,stream16,2,29.457344080786292,nan,nan,nan,nan,nan,0,0,1154,10.05,5.347677,0.27202886147291255,nan,99.34375,0.19660368332934705,0.9535104364326376,0.37806821804271595,0.5340916465642044,0.7995312862901298,proxy +nginx,stream16,2,9.55105675324065,nan,nan,nan,nan,nan,0,0,571,10.07,6.641947999999999,0.8377093829562925,nan,108.42578125,0.07681331747919144,0.9572243346007605,0.2784313725490196,0.17965938703173195,0.4549399545954861,proxy +nginx-halfclose,stream16,2,9.098800768316645,nan,nan,nan,nan,nan,0,0,667,10.08,6.639348,0.8805365004350914,nan,107.36328125,0.07909738717339668,0.9563567362428842,0.2752203721841332,0.18345538231696001,0.45019934040512277,proxy +haproxy,stream16,2,8.79826703275025,nan,nan,nan,nan,nan,0,0,19,10.02,6.282488000000001,0.9105005086066744,nan,52.85546875,0.09159943046986237,0.9515669515669516,0.3765367053038286,0.1758473915991156,0.6439322067150245,proxy +haproxy-splice-auto,stream16,2,28.27170229264633,nan,nan,nan,nan,nan,0,0,3,10.01,4.966381999999999,0.2829732636412268,nan,104.59765625,0.22532544378698224,0.9515209125475285,0.5866486850977748,0.537868721959147,1.156426489671539,origin +envoy,stream16,2,15.106820426097146,nan,nan,nan,nan,nan,0,0,7832,10.05,8.079008,0.5312065444504199,nan,148.56640625,0.12154173563490187,0.95260663507109,0.16782334384858044,0.28801221383401443,0.31247288722131134,proxy +direct,stream16,2,145.79316429084,nan,nan,nan,nan,nan,0,0,3819,8.8,0.0,0.0482739054570581,nan,0.0,0.96575856035991,0.9016393442622951,0.9877280265339967,3.1228662732514088,2.5461665313699937,origin +3proxy-0.9.9.2,stream16,2,18.75349578021542,nan,nan,nan,nan,nan,0,0,724,10.02,6.976376999999999,0.425026454596693,nan,99.66015625,0.13029084890044929,0.9524714828897338,0.26508760545100585,0.33455416891956336,0.47007235881298753,proxy +3proxy-1.0.2,stream1-down,2,19.593293927773047,nan,nan,nan,nan,nan,0,0,0,10.0,6.969335,0.4082597300482673,nan,11.578125,0.2056549057515708,0.9514747859181731,0.14486728493763992,0.47196506980569136,0.29856932040342193,proxy +3proxy-devel-c37,stream1-down,2,33.08688358870258,nan,nan,nan,nan,nan,0,0,0,10.0,5.232449,0.24176168997068842,nan,12.71875,0.26612127045235806,0.9505703422053232,0.2655456852791878,0.7450685117321622,0.5847421627456215,proxy +3proxy-bp,stream1-down,2,31.29600639291404,nan,nan,nan,nan,nan,0,0,0,10.02,5.333539,0.25610743667586283,nan,12.11328125,0.2792929292929293,0.99800796812749,0.2493324432576769,0.7143493318111298,0.549106568606663,proxy +nginx,stream1-down,2,9.7025996562964,nan,nan,nan,nan,nan,0,0,0,10.0,6.455812,0.8244339839908797,nan,33.28125,0.2149077868852459,0.999000999000999,0.09940159574468085,0.4754415270530022,0.1646850832200131,proxy +nginx-halfclose,stream1-down,2,9.36015789505786,nan,nan,nan,nan,nan,0,0,0,10.01,6.352537,0.8554493336075328,nan,31.84375,0.21335379892555642,0.9980059820538385,0.10172872340425532,0.45659477701235995,0.1657372184633672,proxy +haproxy,stream1-down,2,9.61023085357569,nan,nan,nan,nan,nan,0,0,0,10.0,6.454963,0.8323581203632991,nan,29.9375,0.20358514724711907,0.998003992015968,0.10893390900033212,0.45259273922053195,0.1767132809422502,proxy +haproxy-splice-auto,stream1-down,2,29.122288168884637,nan,nan,nan,nan,nan,0,0,0,10.0,5.295282,0.2746747934825263,nan,42.9296875,0.25512418615866894,0.949667616334283,0.23735777496839444,0.6527267328960789,0.48964792859920037,proxy +envoy,stream1-down,2,18.13932009846064,nan,nan,nan,nan,nan,0,0,0,10.0,7.695813,0.4409799740621929,nan,33.7890625,0.1323529411764706,0.9514747859181731,0.14552948636651872,0.3387483464952778,0.28336491178854306,proxy +direct,stream1-down,2,44.49280424915384,nan,nan,nan,nan,nan,0,0,0,6.33,0.0,0.11380420769772082,nan,0.0,0.25121019108280257,0.6607515657620042,0.3642428285523682,0.6973568122796289,0.7497508276144182,none +3proxy-0.9.9.2,stream1-down,2,19.830019472320355,nan,nan,nan,nan,nan,0,0,0,10.0,6.593415,0.4033856700143813,nan,7.90625,0.2052835676199709,0.9514747859181731,0.1548223350253807,0.4918585950227508,0.30136508535608353,proxy +3proxy-1.0.2,http-ka-1k,2,0.17750294528,17697.82,3.38,3.92,4.65,9.72,0,0,0,10.0,7.540346,45.06967468838611,56.440415852984,9.79296875,0.1709992845218221,0.9523809523809523,0.26548956661316214,0.39099119410792477,0.2186516497855267,proxy +3proxy-devel-c37,http-ka-1k,2,0.22288531456,22218.09,2.72,3.13,3.67,5.21,0,0,0,10.11,7.122573,36.28772050759197,45.05447982352548,7.59765625,0.2038095238095238,0.9601139601139601,0.3076675257731959,0.460460503796144,0.27570095887685103,proxy +3proxy-bp,http-ka-1k,2,0.35475423232,35363.51,0.291,17.18,28.06,35.41,0,0,0,10.1,6.874465,22.77633151029351,28.27935523070074,5.28125,0.2313649564375605,0.9591642924976258,0.43669250645994834,0.5974094004431905,0.40095680909112796,proxy +nginx,http-ka-1k,2,0.35592863744,34813.29,1.75,1.92,2.15,2.6,0,0,0,10.02,6.805554,22.521368490197087,28.74164928877326,31.64453125,0.22663160411188144,0.9524714828897338,0.42316188071946986,0.575575916963682,0.3506905637140497,proxy +nginx-halfclose,http-ka-1k,2,0.33587986432,32850.29,1.79,2.15,2.46,2.9,0,0,0,10.03,6.807545999999999,23.889493989896824,30.48697084740405,31.63671875,0.2149666348903718,0.9525166191832859,0.4018957345971564,0.5375540611991114,0.3175433323081744,proxy +haproxy,http-ka-1k,2,0.31549554688,31444.78,1.95,2.26,2.59,3.04,0,0,0,10.02,7.008943,25.407648631721944,31.81962527786599,29.6171875,0.2050548402479733,0.9524714828897338,0.3578154425612053,0.5213464595765943,0.29469783829801044,proxy +haproxy-splice-auto,http-ka-1k,2,0.32698793983999996,32594.72,1.84,2.26,2.63,2.92,0,0,0,10.1,7.041201,24.71039147178842,30.680530621295933,35.67578125,0.20458343280019098,0.9609895337773549,0.36639549436795993,0.5213329909008231,0.31751321957928347,proxy +envoy,http-ka-1k,2,0.10930356224,10662.76,5.59,6.23,7.18,10.18,0,0,0,10.01,8.949786000000001,73.26385193573724,93.74063530116871,25.23828125,0.08458422682868716,0.9506172839506173,0.15459697732997482,0.20740098555349012,0.12259254287168711,proxy +squid,http-ka-1k,2,0.10208935935999999,9458.14,6.27,6.73,8.84,10.84,0,0,0,10.02,8.875576,78.51944659318508,105.78323937416862,21.75390625,0.09482964021920419,0.9524714828897338,0.12705436156763592,0.22928737486986966,0.13215240533465636,proxy +tinyproxy,http-ka-1k,2,0.03724541952,3713.6,16.44,19.04,21.74,26.87,37186,0,0,10.02,6.875208000000001,215.22109572951854,269.44900099497136,7.90234375,0.1489311163895487,0.9524714828897338,0.15133248730964466,0.28350628799039324,0.07130169737872433,proxy +direct,http-ka-1k,2,1.1166914969600001,109220.96,0.544,0.6950000000000001,0.76,0.849,0,0,0,7.75,0.0,5.552115348669199,7.025527594459351,0.0,0.5681875472649357,0.7553606237816765,0.9591642924976258,1.6225604384011665,0.8386511087295749,origin +3proxy-0.9.9.2,http-ka-1k,2,0.0155189248,1546.71,40.99,41.01,41.05,42.04,0,0,0,0.55,0.820057,28.35247967694257,35.20675969786199,9.8984375,0.016484848484848484,0.05699481865284974,0.01110022853411688,0.0608889414224813,0.03232505245050753,none +3proxy-1.0.2,http-ka-1m,2,17.609365913599998,2099.58,7.24,8.65,11.91,17.15,0,0,0,10.02,6.949788000000001,0.4552123023242485,476.4848542488944,16.32421875,0.3504838329006372,0.9524714828897338,0.16017450919289497,1.0950875110461036,0.10073584557584847,client +3proxy-devel-c37,http-ka-1m,2,26.027501813759997,3098.45,4.85,6.2,7.71,11.33,0,0,0,10.01,6.078798,0.3076745535280838,322.5598556375471,17.55078125,0.4674247808576167,0.9524262607040913,0.22482070470845025,1.5859297732928783,0.19488792688155995,client +3proxy-bp,http-ka-1m,2,27.74548873216,3307.65,4.58,6.05,7.54,10.94,0,0,0,10.02,6.006983,0.2889118327444921,302.5270976117871,16.44921875,0.4927639383155397,0.9515669515669516,0.23479887745556596,1.6687394813041212,0.20154936108627233,client +nginx,http-ka-1m,2,5.74401544192,684.57,22.49,24.83,27.47,32.01,0,0,0,10.02,6.261412,1.3955394237799201,1462.5602101882937,43.8828125,0.2518447988574149,0.9515669515669516,0.061018020866266204,0.5555995801939936,0.03801407529091768,proxy +nginx-halfclose,http-ka-1m,2,5.91782739968,705.29,22.04,23.26,25.81,31.02,0,0,0,10.02,6.226882000000001,1.354551165252548,1419.2634560906515,44.4140625,0.25529383773495123,0.9515669515669516,0.06242118537200504,0.5622327786739303,0.05891359121192945,proxy +haproxy,http-ka-1m,2,7.38734374912,875.42,19.25,20.54,22.94,26.97,0,0,0,10.09,5.286287,1.0926796253337416,1141.2736115824002,47.0234375,0.33552798176753607,0.9582146248812915,0.07232704402515723,0.8180991000641329,0.0598671414722309,proxy +haproxy-splice-auto,http-ka-1m,2,24.56721293312,2931.62,5.18,5.62,6.34,7.97,0,0,0,10.01,5.804236,0.3259629011154175,341.17246080436263,51.390625,0.4587067086461613,0.9515209125475285,0.1873822975517891,1.4917183621772074,0.18822993633444682,client +envoy,http-ka-1m,2,12.79900254208,1523.64,10.33,11.09,11.94,14.38,0,0,0,10.02,7.997545999999999,0.6262988052112144,656.9630212431157,47.1484375,0.2359363873724187,0.9524714828897338,0.1212406015037594,0.7735089418669427,0.08936740102005404,proxy +squid,http-ka-1m,2,2.0753416192,247.13,60.02,71.19,78.63,86.51,0,0,0,10.1,7.200801,3.8933349214644806,4046.474358974359,43.07421875,0.2195589645254075,0.9609895337773549,0.025965801139962,0.45571081264314034,0.01711265716490261,proxy +tinyproxy,http-ka-1m,2,1.06526932992,126.2,123.61,132.85,142.15,174.91,1263,0,0,10.01,6.130424,7.517347749607499,7925.574030087094,8.73828125,0.2310327949094469,0.9515209125475285,0.03381180223285486,0.42045675205443805,0.010456409097309513,proxy +direct,http-ka-1m,2,65.45530159104,7805.27,1.39,1.73,2.02,2.68,0,0,0,6.14,0.0,0.07504357753463303,78.56183225641354,0.0,0.9448013323816322,0.5949612403100775,0.541588492808005,3.546272378290698,0.4923549107805503,client +3proxy-0.9.9.2,http-ka-1m,2,14.00159338496,1668.05,4.67,24.88,41.4,44.41,0,0,0,8.35,5.417232,0.477088558161917,499.7306840624813,12.4140625,0.2752075919335706,0.800575263662512,0.11686670878079596,0.8685975461878286,0.0912664767383956,none +3proxy-1.0.2,http-ka-50k-2000,2,4.20093100032,10209.85,56.56,62.7,70.48,116.19,0,216,0,10.48,7.40914,1.9957480852128637,102.00406848288415,173.2578125,0.18996924532765555,0.9961977186311787,0.23273415326395458,0.47471865569298183,0.14254233411187087,proxy +3proxy-devel-c37,http-ka-50k-2000,2,4.76741369856,11586.47,39.85,48.01,54.63,119.84,0,463,0,10.37,7.087179,1.7401468646418936,88.83977143248777,91.35546875,0.22237993849065532,0.9866793529971456,0.2551310388380171,0.5603751741358365,0.1635145788050675,proxy +3proxy-bp,http-ka-50k-2000,2,5.8225328128000005,14151.08,123.71,157.47,162.54,1010.0,0,0,0,10.24,6.40027,1.4069478461316813,71.83091675610457,162.29296875,0.2547635850388144,0.9724596391263058,0.2957658779576588,0.6117117809461265,0.18442168090713634,proxy +nginx,http-ka-50k-2000,2,3.68318611456,8947.42,136.75,143.56,156.27,186.81,0,145,0,10.2,6.980891,2.2154731654050037,113.22136997857675,120.87890625,0.19919659735349715,0.9686609686609686,0.1840937896070976,0.42907710946419525,0.11879462051749916,proxy +nginx-halfclose,http-ka-50k-2000,2,3.6440952012800003,8852.52,125.79,135.76,146.72,163.07,0,140,0,10.17,6.995018,2.23265297710724,113.98278490092352,114.01171875,0.1947405828002843,0.9676498572787822,0.17446270543615677,0.42146193213722166,0.11313703475453368,proxy +haproxy,http-ka-50k-2000,2,3.1659445452800004,7592.88,254.05,259.92,272.67,638.58,0,0,0,10.13,6.075645,2.559741613946454,132.5083717036417,180.3046875,0.24654926225606855,0.9638439581351094,0.1641041732036398,0.5108706182328546,0.09886403669500622,proxy +haproxy-splice-auto,http-ka-50k-2000,2,2.92787585024,7089.67,275.47,290.28,317.88,637.06,0,0,0,10.15,6.068842,2.773341635825986,142.2784171350874,183.8359375,0.2398286937901499,0.9666666666666667,0.16175548589341693,0.4927951103208988,0.0969641303959569,proxy +envoy,http-ka-50k-2000,2,2.6148968857600003,6351.63,298.96,319.46,348.85,481.29,0,0,0,10.12,8.000789,3.096106788794831,158.07066320952174,364.0390625,0.11441484300666033,0.9628924833491912,0.11531130876747141,0.2949252441353963,0.07605196171938865,proxy +squid,http-ka-50k-2000,2,0.90127204352,2159.34,468.27,503.81,519.23,523.79,0,283,0,10.28,8.311938999999999,9.124880838287648,472.0576755292281,183.125,0.12673694298035457,0.9771863117870723,0.05413105413105413,0.2635293605291282,0.029472354256620016,proxy +tinyproxy,http-ka-50k-2000,2,0.6385408409600001,1551.93,662.04,687.44,881.54,1490.0,15641,122,0,10.35,6.646204,12.967064076201638,661.7223962662234,29.51953125,0.19500480307396734,0.9838403041825095,0.09275730622617535,0.3406146526328378,0.03898033135844341,proxy +direct,http-ka-50k-2000,2,33.5007449088,81311.99,22.12,28.04,30.93,219.49,0,0,0,8.72,0.0,0.2082341756576147,10.631799566193315,0.0,0.8700551426516423,0.8790322580645161,0.9543870763382959,2.8156925863501843,0.761366313207276,origin +3proxy-0.9.9.2,http-ka-50k-2000,2,4.21493997568,10244.03,56.19,62.76,76.36,250.38,0,212,0,10.48,7.114956,1.9891149217723798,101.40692431250363,162.828125,0.19719981015662078,0.9971455756422455,0.23212045169385195,0.48902552533322735,0.1453940669123295,proxy +3proxy-1.0.2,http-ka-2k-50k-2000,2,3.79274133504,9217.91,70.7,79.92,90.99,145.53,0,215,0,10.48,7.273267000000001,2.2105383044561298,112.74878967186659,184.16796875,0.18381831085876507,0.9952516619183286,0.272153894670451,0.4538293724983824,0.17398372505028376,proxy +3proxy-devel-c37,http-ka-2k-50k-2000,2,4.26669768704,10369.78,52.03,60.3,71.94,108.5,0,150,0,10.47,6.827206,1.9631107273997677,100.06977166505777,80.78125,0.20412029363012077,0.9952471482889734,0.2862992125984252,0.5023605335737485,0.18540413928383465,proxy +3proxy-bp,http-ka-2k-50k-2000,2,5.08567748608,12360.17,158.36,163.25,200.01,841.3,0,0,0,10.24,6.342478,1.6107981724012799,82.27014172317382,164.7421875,0.2283483199242783,0.9724596391263058,0.3318722604884158,0.5537138098746307,0.21960254804753745,proxy +nginx,http-ka-2k-50k-2000,2,3.41382791168,8292.94,138.38,146.57,164.75,201.4,0,134,0,10.19,6.992704000000001,2.3879352477343443,122.13246398350792,122.2265625,0.1881211547562707,0.9695528068506185,0.20336294416243655,0.4062135707937399,0.13594136256888345,proxy +nginx-halfclose,http-ka-2k-50k-2000,2,3.47003158528,8429.47,126.17,132.13,142.02,163.56,0,135,0,10.19,7.0248360000000005,2.349258155049965,120.11127089276032,114.8359375,0.19026234932640038,0.9686311787072244,0.19822391373295276,0.4129170052959088,0.13786376634155922,proxy +haproxy,http-ka-2k-50k-2000,2,2.96637956096,7151.03,267.05,278.62,296.99,696.67,0,0,0,10.15,6.031429,2.737343564143272,140.94481628572223,177.0859375,0.2398190045248869,0.9639126305792972,0.19130978430759613,0.49283918698674667,0.12074678604386939,proxy +haproxy-splice-auto,http-ka-2k-50k-2000,2,3.1713132544000002,7569.96,253.84,261.26,265.65,634.13,0,0,0,10.1,5.969062999999999,2.547840390346019,132.5511503077549,184.24609375,0.2501783590963139,0.9609895337773549,0.20012468827930174,0.51470175123742,0.12360040596895779,proxy +envoy,http-ka-2k-50k-2000,2,2.45417115648,5961.34,316.96,339.63,365.83,536.71,0,0,0,10.13,8.079402,3.3021331778764402,168.83333333333334,367.296875,0.10720228191110055,0.9620132953466287,0.1320215804506506,0.2711361532240894,0.08935573868593062,proxy +squid,http-ka-2k-50k-2000,2,0.7825732403200001,1833.79,431.99,469.91,495.16,513.33,0,326,0,10.27,8.069882,10.498697855603158,556.0669229519735,160.40234375,0.11586239847109413,0.9790276453765491,0.11230964467005077,0.23309367237593212,0.05419177735910882,proxy +tinyproxy,http-ka-2k-50k-2000,2,0.6304877772799999,1532.24,681.56,730.16,804.61,1670.0,15445,153,0,10.38,6.750973,13.170754928548266,672.0621560375527,33.16796875,0.19468390804597702,0.9857549857549858,0.11463956811686249,0.3358208537273696,0.052271915350061406,proxy +direct,http-ka-2k-50k-2000,2,26.80059592704,65086.08,29.11,32.12,36.08,46.19,0,0,0,8.66,0.0,0.2585017146208347,13.217903084991422,0.0,0.7320782041998551,0.8582755203171457,0.954084863837872,2.2862352011372495,0.7808039423860857,origin +3proxy-0.9.9.2,http-ka-2k-50k-2000,2,3.7882953728000004,9207.0,53.57,67.39,79.34,138.69,0,218,0,10.48,6.801622999999999,2.2131326031748233,112.97729673788837,166.40625,0.1822695035460993,0.9971455756422455,0.26445497630331755,0.4452635038788218,0.16922470500894726,proxy +3proxy-1.0.2,http-close-1k,2,0.047815065600000005,4698.48,12.71,15.37,19.15,23.92,0,0,0,10.04,6.962637,167.98052871436403,213.3220014873048,48.72265625,0.14055463379947855,0.9543726235741445,0.1636479186526851,0.28350358074781734,0.08172426970588723,proxy +3proxy-devel-c37,http-close-1k,2,0.06274678784,6164.96,9.8,11.04,12.95,18.3,0,0,0,9.99,6.382136,127.36906979810746,161.76827787223706,10.421875,0.17869008068343617,0.9514285714285714,0.2034383954154728,0.36912921010692634,0.10358642352322114,proxy +3proxy-bp,http-close-1k,2,0.07155482624,7026.52,8.26,11.02,14.03,20.98,0,0,0,10.03,6.188696,112.1377889045098,142.6073109351229,7.18359375,0.19549763033175355,0.9516129032258065,0.21968253968253967,0.41100671276734624,0.11218001246535568,proxy +nginx,http-close-1k,2,0.12977176576000002,12742.02,4.78,5.35,5.85,6.61,0,0,0,10.09,5.456031,62.201511651836206,78.40181513022938,32.625,0.29895437262357416,0.9591254752851711,0.1735483870967742,0.6411625074368622,0.15495145740210137,proxy +nginx-halfclose,http-close-1k,2,0.13958643712000002,13706.09,4.43,4.71,5.19,6.21,0,0,0,10.02,5.408043,57.42678275475135,72.99535947664805,32.48828125,0.3090302597093162,0.9524714828897338,0.17947062621045837,0.6754595137785236,0.15970683913950973,proxy +haproxy,http-close-1k,2,0.15636365312,15351.21,3.77,4.34,5.22,5.91,0,0,0,10.01,5.723675,51.2139480001425,65.1540003644979,34.859375,0.3270828388321861,0.9515209125475285,0.1912427559562138,0.747766784760389,0.1996415850792773,proxy +haproxy-splice-auto,http-close-1k,2,0.16122904576,15831.92,3.76,4.1,4.64,5.68,0,0,0,10.1,5.768357,50.11503951978733,63.1668480368244,38.14453125,0.33759469696969696,0.9600760456273765,0.21096774193548387,0.761121056045158,0.18443940105989048,proxy +envoy,http-close-1k,2,0.06476005375999999,6224.53,9.8,10.94,12.43,15.51,0,0,0,10.0,7.944899,123.5329425396697,160.41065126724413,27.51953125,0.15864022662889518,0.9505703422053232,0.08515352959797404,0.33964854549528833,0.0694008850815005,proxy +squid,http-close-1k,2,0.04202692608,3910.24,15.41,17.06,19.17,23.58,0,0,0,10.02,7.8173699999999995,190.73486328125003,255.85373949901694,20.58984375,0.1311163895486936,0.9524714828897338,0.0784438775510204,0.24831129486875625,0.07320722098045974,proxy +tinyproxy,http-close-1k,2,0.03758096384,3745.9,16.16,18.56,21.49,27.19,37832,0,0,10.1,6.965667,215.00246865408758,266.96976104884754,7.875,0.15005945303210463,0.9600760456273765,0.14974619289340102,0.2863686209154519,0.07129772513166345,proxy +direct,http-close-1k,2,0.49845108736,48944.51,0.8140000000000001,2.05,3.04,4.06,0,0,0,8.61,0.0,13.818808253547308,17.416915648319904,0.0,0.7081375216423448,0.9015706806282723,0.8774193548387097,1.951756060607503,0.5841944714234126,client +3proxy-0.9.9.2,http-close-1k,2,0.049576673280000004,4869.6,12.31,15.25,18.25,21.98,0,0,0,10.16,6.911226999999999,163.94807199132825,208.2820828208282,198.46484375,0.1522974893415443,0.9648622981956315,0.1641695887790883,0.30634906392867556,0.08366351792931571,proxy diff --git a/bench/data/results-full7/intel-connect.csv b/bench/data/results-full7/intel-connect.csv new file mode 100644 index 0000000..7507471 --- /dev/null +++ b/bench/data/results-full7/intel-connect.csv @@ -0,0 +1,127 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,connect-stream1-down,0,46.26198562750912,nan,nan,nan,nan,nan,0,0,0,6.33,0.0,0.10945203209811664,nan,0.0,0.2609582059123344,0.6628272251308901,0.35557038025350235,0.723323636221585,0.7408077991856329,none +3proxy-0.9.9.2,connect-stream1-down,0,17.713906303797383,nan,nan,nan,nan,nan,0,0,0,10.01,6.358693,0.45202596763447683,nan,9.80078125,0.20044378698224852,0.9506172839506173,0.15492063492063493,0.4814628107074179,0.3250728380164803,proxy +3proxy-1.0.2,connect-stream1-down,0,19.65687482144446,nan,nan,nan,nan,nan,0,0,0,10.01,6.887004,0.40734487531036145,nan,11.07421875,0.19877149877149877,0.9515209125475285,0.1705548549810845,0.4871894178975676,0.35086070378382983,proxy +3proxy-devel-c37,connect-stream1-down,0,33.102683455007714,nan,nan,nan,nan,nan,0,0,0,9.99,5.217993,0.241402889091837,nan,12.33203125,0.26985276369780353,0.9496197718631179,0.25877886744701045,0.7421940247107842,0.5571921075137308,proxy +3proxy-bp,connect-stream1-down,0,34.15351272034401,nan,nan,nan,nan,nan,0,0,0,10.01,5.331195,0.23444576561579042,nan,12.04296875,0.2729462780052999,0.9506172839506173,0.22523961661341854,0.7498136196403974,0.5286966621598861,proxy +squid,connect-stream1-down,0,13.788757357232626,nan,nan,nan,nan,nan,0,0,0,10.01,7.517545999999999,0.5807004521025327,nan,20.72265625,0.1470014627011214,0.9506172839506173,0.1095585900285805,0.3511092738556199,0.2014939749458741,proxy +tinyproxy,connect-stream1-down,0,1.1330752973733,nan,nan,nan,nan,nan,0,0,0,10.0,6.091314000000001,7.0596784780697694,nan,3.54296875,0.21482936410508224,0.9514747859181731,0.019943019943019943,0.47481579780614336,0.02376375665410614,proxy +direct,connect-stream16,0,142.21542206752517,nan,nan,nan,nan,nan,0,0,2227,8.84,0.0,0.04971571930815501,nan,0.0,0.966616841056303,0.9075975359342916,0.9800796812749004,3.145539352089552,2.51148399817767,origin +3proxy-0.9.9.2,connect-stream16,0,18.963135092869727,nan,nan,nan,nan,nan,0,0,738,10.03,6.921190999999999,0.4211492963590396,nan,77.59375,0.13317535545023695,0.9534220532319392,0.26990291262135924,0.3412708641121055,0.4749107461228737,proxy +3proxy-1.0.2,connect-stream16,0,19.193324101399263,nan,nan,nan,nan,nan,0,0,763,10.04,6.990646000000001,0.41705434886914905,nan,74.33203125,0.13208442020393646,0.9543726235741445,0.2710492227979275,0.3403039440411137,0.4749412158469942,proxy +3proxy-devel-c37,connect-stream16,0,30.816311029792686,nan,nan,nan,nan,nan,0,0,715,10.04,5.188586,0.26016690643648765,nan,96.48046875,0.1913022813688213,0.952561669829222,0.35022450288646567,0.5569453608675856,0.7607113382220348,proxy +3proxy-bp,connect-stream16,0,32.39409480142338,nan,nan,nan,nan,nan,0,0,1222,10.01,5.293577,0.246993011829924,nan,104.484375,0.1958262557631643,0.9506172839506173,0.39223177332059855,0.5636287011794604,0.834492445654281,proxy +squid,connect-stream16,0,12.859969294111226,nan,nan,nan,nan,nan,0,0,0,10.04,7.691039,0.6243356869299611,nan,67.99609375,0.10448473282442748,0.952561669829222,0.27560819462227915,0.23002718500956246,0.44543488880864895,proxy +tinyproxy,connect-stream16,0,1.1755686921997728,nan,nan,nan,nan,nan,0,0,61,10.06,6.208057,6.806039636816085,nan,58.359375,0.018052256532066508,0.9544592030360531,0.29467805519053875,0.02661863788372779,0.475723373486055,proxy +direct,connect-ka-1k,0,1.3074484428800002,127878.14,0.534,0.579,0.646,0.89,0,0,0,8.05,0.0,4.92562443671905,6.232854810099239,0.0,0.5822434607645876,0.7876712328767124,0.9591513616212793,1.6780289882903647,0.8540040685396668,origin +3proxy-0.9.9.2,connect-ka-1k,0,0.32833011712,32115.49,1.92,2.1,2.35,3.21,0,0,0,10.08,6.9214020000000005,24.56064667699285,31.15457366449491,9.8125,0.2318137730358875,0.9572649572649573,0.39371354504212575,0.6036305957580005,0.36668811847001537,proxy +3proxy-1.0.2,connect-ka-1k,0,0.31557943295999996,30862.66,1.97,2.18,2.53,3.69,0,0,0,10.1,6.905894,25.603696426643076,32.431356305008876,8.8671875,0.22782063645130182,0.9591642924976258,0.38652482269503546,0.5789690084566569,0.32679586548266365,proxy +3proxy-devel-c37,connect-ka-1k,0,0.30777802752,30100.55,2.0,2.29,2.68,4.02,0,0,0,10.11,6.91829,26.278679037522995,33.28416977231126,7.43359375,0.22127968977217644,0.959203036053131,0.37544311956171444,0.5741710205187933,0.3286824637027437,proxy +3proxy-bp,connect-ka-1k,0,0.42882564096,41946.02,0.23800000000000002,16.0,27.6,36.24,0,0,0,10.07,6.419092,18.78619007474753,23.85820596715765,4.48046875,0.2716170004885198,0.9554079696394687,0.4810828440965427,0.718663689533055,0.4198591693028052,proxy +squid,connect-ka-1k,0,0.3850371072,37659.66,1.62,1.71,1.92,2.44,0,0,0,10.01,7.249333,20.797995440580745,26.51206153129006,20.484375,0.2630691399662732,0.9524262607040913,0.41913875598086126,0.6748509091054125,0.4084253504376652,proxy +tinyproxy,connect-ka-1k,0,0.28236054528,27620.06,2.17,2.57,3.0,3.94,0,0,0,10.09,7.033802,28.58756343594493,36.26535167327398,5.71875,0.2157907483652216,0.9573055028462998,0.367129480142073,0.5541462532036817,0.32865080664010743,proxy +direct,connect-ka-50k-2000,0,36.24952397824,88141.15,21.01,23.19,25.7,34.45,0,0,0,8.68,0.0,0.19156113620052972,9.80386620207485,0.0,0.8777167422975878,0.8654037886340977,0.9471351693573916,2.8953468455940716,0.7636238485335609,origin +3proxy-0.9.9.2,connect-ka-50k-2000,0,5.60895885312,13625.66,112.13,134.95,148.3,223.28,2,0,0,10.23,6.810571,1.4590943193401438,74.35133367250526,387.04296875,0.23895486935866983,0.9715099715099715,0.2807017543859649,0.6330962632720661,0.17281763739198097,proxy +3proxy-1.0.2,connect-ka-50k-2000,0,5.35511957504,13008.95,121.51,139.91,158.7,230.01,0,0,0,10.18,6.669096,1.5207877034079427,77.60743445678608,254.32421875,0.22621313035204568,0.967680608365019,0.26927899686520373,0.6026854327943175,0.16813264398792566,proxy +3proxy-devel-c37,connect-ka-50k-2000,0,6.50377166848,15799.43,93.79,113.26,130.12,219.23,2,0,0,10.18,6.365114,1.2521964815384332,63.89856573455105,219.91796875,0.2589774078478002,0.967680608365019,0.31120201384518564,0.6949036792380645,0.2023442227047944,proxy +3proxy-bp,connect-ka-50k-2000,0,7.988639170560001,19388.54,94.28,100.14,135.17,145.97,3,0,0,10.11,5.400423999999999,1.0124377665981168,51.73843177793926,119.8125,0.31995277449822906,0.9610266159695817,0.38724727838258166,0.8677674550637288,0.2535908415568281,proxy +squid,connect-ka-50k-2000,0,4.37163917312,10619.77,171.52,179.08,190.9,231.32,0,0,0,10.31,7.441069,1.8867064900311699,96.13053613053613,247.70703125,0.1537731371618415,0.9791073124406457,0.18421052631578946,0.4239396444844696,0.12918669063882224,proxy +tinyproxy,connect-ka-50k-2000,0,0.958398464,2323.59,414.99,645.8,758.65,1280.0,0,38,0,10.41,6.501187,8.68949639718955,430.5923229649239,130.96875,0.2470474813208002,0.9895437262357415,0.09721342621912603,0.4685192847265285,0.053180188582357485,proxy +direct,connect-ka-2k-50k-2000,0,24.56721293312,59664.87,32.21,35.96,40.46,48.92,0,0,0,8.62,0.0,0.28069932144004983,14.357262659624613,0.0,0.7337506018295619,0.8534653465346534,0.95595690747782,2.2836353147483965,0.783193266540216,origin +3proxy-0.9.9.2,connect-ka-2k-50k-2000,0,5.03509417984,12231.53,92.22,141.44,161.23,208.06,4,0,0,10.28,6.731453999999999,1.6333358833540892,83.20248636223837,393.14453125,0.22943414170233,0.976258309591643,0.3225499524262607,0.599779112440365,0.22035092162430947,proxy +3proxy-1.0.2,connect-ka-2k-50k-2000,0,4.7278194688,11485.08,122.08,149.45,167.99,225.47,3,1,0,10.2,6.570945,1.7259542277047106,87.94695591443279,262.203125,0.2287814129919393,0.9705042816365367,0.31918936035465484,0.5864190243468469,0.21368624546548265,proxy +3proxy-devel-c37,connect-ka-2k-50k-2000,0,5.55183243264,13486.94,96.54,131.55,155.09,206.1,0,0,0,10.24,6.237678,1.4755488569572248,75.17361875816705,225.640625,0.241026859995246,0.9724596391263058,0.3490208464939987,0.6339513408488664,0.2355467794961946,proxy +3proxy-bp,connect-ka-2k-50k-2000,0,8.1604378624,19795.66,95.25,96.57,101.14,141.19,2,0,0,10.12,5.309474,0.9921036268535411,50.630631532076904,115.14453125,0.30884095757288454,0.9619771863117871,0.4509308930261912,0.8439759404872351,0.3075961908583516,proxy +squid,connect-ka-2k-50k-2000,0,4.47632900096,10874.24,172.08,177.28,182.75,194.96,0,0,0,10.22,7.282095,1.8264966668550422,93.08001967248948,258.92578125,0.15127048207076704,0.9714828897338403,0.21870047543581617,0.42399665382870655,0.16340060851991298,proxy +tinyproxy,connect-ka-2k-50k-2000,0,0.95286198272,2313.33,442.85,613.5,718.22,1370.0,2,33,0,10.39,6.463465,8.723194072947388,434.4916990758165,130.37890625,0.23984619081951453,0.9876425855513308,0.11230623220499841,0.45436097809757686,0.06079211904840198,proxy +direct,connect-close-1k,0,0.49677336576,48777.77,0.8250000000000001,1.91,2.83,4.33,0,0,0,8.55,0.0,13.768854112248292,17.354310059613578,0.0,0.7877094972067039,0.8627648839556004,0.8953451043338684,2.1699235036017384,0.5689608027992533,client +3proxy-0.9.9.2,connect-close-1k,0,0.04689231872,4605.57,3.38,6.44,9.25,12.53,28,0,0,10.08,6.838298999999999,171.9684634950805,216.7275854654913,11.33203125,0.33616018845700824,0.9581749049429658,0.1722488038277512,1.00191560671798,0.0845433350857585,client +3proxy-1.0.2,connect-close-1k,0,0.041523609600000004,4080.43,4.89,8.57,11.49,15.22,13,0,0,10.08,6.880471999999999,194.20276988636363,244.73147518694765,11.94140625,0.30473721423521094,0.9545454545454546,0.1649778340721976,0.9143683291011332,0.079500850920759,client +3proxy-devel-c37,connect-close-1k,0,0.05377097728,5276.12,3.74,6.34,8.61,12.71,15,0,0,10.09,6.470199999999999,150.1181568258824,189.3591066904382,8.484375,0.376153300212917,0.9591254752851711,0.19138755980861244,1.1349063231858076,0.09498411520534286,client +3proxy-bp,connect-close-1k,0,0.05637144576,5531.45,3.26,5.63,7.87,11.43,27,0,0,10.06,6.365813,142.76731581914993,180.3449141300061,5.1484375,0.3875119161105815,0.9553656220322887,0.20369191597708466,1.1851171266525498,0.09972324881168176,client +squid,connect-close-1k,0,0.03464495104,3398.07,7.42,12.06,14.27,18.03,2,0,0,10.07,7.377618,232.5302752109186,293.63737096868255,20.53515625,0.2591362126245847,0.9581351094196003,0.14371827411167512,0.7509299791992293,0.06838809988194505,proxy +tinyproxy,connect-close-1k,0,0.049408901119999994,4850.93,3.9,6.95,9.4,12.39,22,0,0,10.07,6.538482999999999,163.04754441784274,205.8420719118579,7.06640625,0.4623935666982025,0.9572243346007605,0.18074968233799238,1.5197530504319225,0.08737844841988686,client +3proxy-0.9.9.2,connect-stream1-down,1,19.1399223654836,nan,nan,nan,nan,nan,0,0,1,10.0,6.34019,0.4179299340051054,nan,8.38671875,0.17757009345794392,0.9505703422053232,0.1591772151898734,0.43960941412867954,0.30523728176655046,proxy +3proxy-1.0.2,connect-stream1-down,1,20.607957111827634,nan,nan,nan,nan,nan,0,0,0,10.0,6.659053,0.38815768344831447,nan,7.32421875,0.18943488943488943,0.9505703422053232,0.1475095785440613,0.4557813821008531,0.3003321200858913,proxy +3proxy-devel-c37,connect-stream1-down,1,32.26401241709248,nan,nan,nan,nan,nan,0,0,0,9.99,5.299609,0.24768024595642718,nan,12.74609375,0.2691566265060241,0.9478178368121443,0.25649968294229547,0.7050726147969323,0.5714740721395201,proxy +3proxy-bp,connect-stream1-down,1,32.02253804737681,nan,nan,nan,nan,nan,0,0,0,9.99,5.367619,0.24955111295363908,nan,13.1015625,0.2635135135135135,0.9496197718631179,0.23461906279885242,0.7279013787702074,0.5391426029549744,proxy +squid,connect-stream1-down,1,13.33006408954242,nan,nan,nan,nan,nan,0,0,0,10.01,7.50993,0.6006830261195424,nan,20.7421875,0.1442190173551699,0.9515209125475285,0.11583624246271025,0.32826772262123194,0.21584395111810922,proxy +tinyproxy,connect-stream1-down,1,1.1698765089517966,nan,nan,nan,nan,nan,0,0,1,9.95,6.008574,6.803412402396262,nan,2.21875,0.21894218942189422,0.9485224022878932,0.021870047543581617,0.47958881210245,0.025662491294288995,proxy +direct,connect-stream1-down,1,45.8309612914644,nan,nan,nan,nan,nan,0,0,0,6.19,0.0,0.10803788432672995,nan,0.0,0.2676306443429731,0.6454640250260688,0.3633633633633634,0.7263720644787327,0.7518041552062336,none +3proxy-0.9.9.2,connect-stream16,1,18.68348733200186,nan,nan,nan,nan,nan,0,0,721,10.04,6.883532,0.4275458868818374,nan,74.65234375,0.132749645054425,0.9534662867996201,0.2632434189145271,0.33268491030543446,0.4701129866797502,proxy +3proxy-1.0.2,connect-stream16,1,17.917143969047,nan,nan,nan,nan,nan,0,0,744,10.03,6.959362,0.44665301122683493,nan,77.22265625,0.14107688690336234,0.9534220532319392,0.2633279483037157,0.3393474832506608,0.4587634171421069,proxy +3proxy-devel-c37,connect-stream16,1,29.187649791219453,nan,nan,nan,nan,nan,0,0,712,10.03,5.261256,0.27417611240532097,nan,94.98828125,0.18723201524535493,0.9534220532319392,0.3472534532605204,0.5474724979334827,0.7569643775972204,proxy +3proxy-bp,connect-stream16,1,31.203875916792068,nan,nan,nan,nan,nan,0,0,1339,10.02,5.3062,0.2566405030419741,nan,101.328125,0.20198115486832569,0.9515669515669516,0.390515595162317,0.5616326512856451,0.8298640670419709,proxy +squid,connect-stream16,1,13.094691993390475,nan,nan,nan,nan,nan,0,0,0,10.03,7.730595,0.6125011177687396,nan,63.01953125,0.11150822015725519,0.9516129032258065,0.27626084163186637,0.2395286299439532,0.45967330693294667,proxy +tinyproxy,connect-stream16,1,1.2146646710246067,nan,nan,nan,nan,nan,0,0,79,10.07,6.183121,6.590152936154358,nan,73.703125,0.01900688999762414,0.9545023696682464,0.30197368421052634,0.027568386235318623,0.4882539556575725,proxy +direct,connect-stream16,1,125.55179012685882,nan,nan,nan,nan,nan,0,0,5447,8.18,0.0,0.05209638468776034,nan,0.0,0.8779994948219247,0.8270980788675429,0.9793539793539794,2.7822221908118423,2.5378767560084685,origin +3proxy-0.9.9.2,connect-ka-1k,1,0.3145728,30769.53,1.98,2.21,2.58,3.62,0,0,0,10.09,6.892318,25.660196940104164,32.55489807638947,9.8046875,0.2290909090909091,0.9563981042654028,0.39311010946555053,0.5940324466294442,0.3275531473295827,proxy +3proxy-1.0.2,connect-ka-1k,1,0.30719082496,30045.69,2.01,2.29,2.68,3.58,0,0,0,10.08,6.890251999999999,26.250784023416166,33.22467195580591,8.81640625,0.22557122022362663,0.9590865842055185,0.38919266645223544,0.5855150921971267,0.3210426742314246,proxy +3proxy-devel-c37,connect-ka-1k,1,0.3074424832,30071.15,2.02,2.31,2.67,3.56,0,0,0,10.1,6.888572,26.281338596734308,33.28719267022609,7.45703125,0.21998544748969198,0.9591642924976258,0.37395228884590587,0.5693482420609888,0.3913163526291188,proxy +3proxy-bp,connect-ka-1k,1,0.40802189312,39907.71,0.262,16.28,27.82,36.28,0,0,0,10.05,6.375361,19.704824999759072,25.020788416246333,4.5078125,0.27252800779347297,0.9544159544159544,0.461413220449365,0.7128999360918102,0.433129684003727,proxy +squid,connect-ka-1k,1,0.3510632448,34333.23,1.77,1.93,2.19,3.09,0,0,0,10.03,7.208647,22.85628051028599,29.12877940830533,20.47265625,0.2541556251505661,0.9534220532319392,0.4015898251192369,0.6491513761670585,0.388432314187512,proxy +tinyproxy,connect-ka-1k,1,0.30937186304000003,30262.96,2.01,2.21,2.57,3.52,0,0,0,10.08,7.030616,26.065718843207698,32.98245843653985,5.87109375,0.22618181818181818,0.9581749049429658,0.39575289575289574,0.5816956849697175,0.33894955342726313,proxy +direct,connect-ka-1k,1,1.30082144256,127228.77,0.487,0.5720000000000001,0.646,0.8220000000000001,0,0,0,8.09,0.0,4.975317740198983,6.29564145504803,0.0,0.6320541760722348,0.7877312560856865,0.9597591888466414,1.8239869416759056,0.8429580895025452,origin +3proxy-0.9.9.2,connect-ka-50k-2000,1,5.6660852736,13764.49,114.45,137.56,154.06,227.82,0,0,0,10.31,6.831125,1.4556787626246854,74.1710610562362,388.3359375,0.24256837098692033,0.9791073124406457,0.28616253529965485,0.646477456199755,0.18051283166426674,proxy +3proxy-1.0.2,connect-ka-50k-2000,1,5.25663731712,12769.67,111.99,141.52,160.42,230.52,0,0,0,10.26,6.69143,1.5614545012013477,79.60214444763405,257.25,0.23501427212178877,0.9752851711026616,0.2778654878433849,0.6207375295494947,0.17478698881445348,proxy +3proxy-devel-c37,connect-ka-50k-2000,1,6.13005918208,14891.49,81.93,110.71,137.18,205.3,2,0,0,10.2,6.323492,1.3311453866308705,67.83719074221868,219.8359375,0.25089179548156954,0.967741935483871,0.3023547880690738,0.6711343151580378,0.19568785297609292,proxy +3proxy-bp,connect-ka-50k-2000,1,8.33223655424,20242.45,92.42,96.45,103.99,141.4,1,0,0,10.15,5.4479750000000005,0.9745282610667122,49.653161658953714,118.0,0.3160634019399101,0.9629981024667932,0.3826929084661043,0.8697508128358374,0.25068446758043234,proxy +squid,connect-ka-50k-2000,1,4.40687132672,10705.38,172.58,178.57,192.59,218.43,0,0,0,10.24,7.376366,1.8589151787413865,94.69907150519735,244.5,0.15161596958174905,0.9724596391263058,0.18662864385297845,0.42204537030112255,0.12728449951642978,proxy +tinyproxy,connect-ka-50k-2000,1,0.94187290624,2284.93,386.28,497.03,622.27,1090.0,0,13,0,10.67,6.676939000000001,9.062793868947889,439.3839565145775,129.65625,0.23342541436464087,0.9673617407071623,0.09387262300030184,0.4455978477359472,0.05078842897249281,proxy +direct,connect-ka-50k-2000,1,34.016140984319996,82732.32,21.65,24.9,29.43,220.09,0,0,0,8.6,0.0,0.20225692277002816,10.324873340216582,0.0,0.8947869554867889,0.8884297520661157,0.9446552814674257,2.9185792419712158,0.7343026489048369,origin +3proxy-0.9.9.2,connect-ka-2k-50k-2000,1,5.122503475199999,12443.97,133.86,147.58,168.64,228.09,1,0,0,10.27,6.664873999999999,1.603903255464208,81.70896650489298,391.17578125,0.2290276453765491,0.9762357414448669,0.3285849952516619,0.6036199523478515,0.2184721033324285,proxy +3proxy-1.0.2,connect-ka-2k-50k-2000,1,5.09331111936,12373.0,101.76,131.99,151.12,197.75,1,0,0,10.23,6.618755,1.6068132906493962,81.86488692562538,255.83984375,0.22370617696160267,0.9733587059942912,0.3223559214692844,0.5893855776360309,0.21554995691749304,proxy +3proxy-devel-c37,connect-ka-2k-50k-2000,1,6.00825659392,14595.64,89.34,118.46,137.29,187.38,3,0,0,10.19,6.208114,1.3567995761448242,69.12551810220266,223.0859375,0.24798099762470308,0.9677113010446344,0.35337150127226463,0.6529893048633683,0.2441092424148409,proxy +3proxy-bp,connect-ka-2k-50k-2000,1,8.074538516479999,19701.18,95.55,96.63,101.6,142.73,1,0,0,10.15,5.2804709999999995,1.0056302268454371,51.02989899599302,120.31640625,0.30963139120095123,0.9639126305792972,0.44272641211738717,0.8497498789521943,0.31155686542654776,proxy +squid,connect-ka-2k-50k-2000,1,4.26367778816,10357.49,175.61,188.35,205.48,231.4,0,0,0,10.29,7.223452,1.9307275101462436,98.37758253104774,250.625,0.15585649798051793,0.9772079772079773,0.22102254684026676,0.429650229558828,0.1624394753123251,proxy +tinyproxy,connect-ka-2k-50k-2000,1,1.0028580864,2433.52,361.08,570.38,671.16,1090.0,0,22,0,10.27,6.381811,8.192584884560592,414.1463021211388,138.296875,0.24669709344222915,0.9753086419753086,0.11500789889415482,0.4675896114589953,0.06451611613135938,proxy +direct,connect-ka-2k-50k-2000,1,27.65958938624,67289.68,28.2,31.22,34.14,41.9,0,0,0,8.89,0.0,0.25712601516557776,13.108401615474106,0.0,0.7697478991596639,0.9062181447502549,0.9553231939163498,2.4507947382354964,0.798327254286923,origin +3proxy-0.9.9.2,connect-close-1k,1,0.04513071104,4433.22,3.66,6.78,9.5,13.52,26,0,0,10.09,6.822545,178.85825004719447,225.4547079590651,11.3359375,0.32483474976392823,0.9591254752851711,0.1699013681196309,0.963893554757284,0.08264100117729718,client +3proxy-1.0.2,connect-close-1k,1,0.0457179136,4486.86,3.59,6.99,10.02,13.37,26,0,0,10.09,6.877249,176.5609881199828,222.67831920903956,11.94921875,0.32774498229043686,0.9582146248812915,0.17223814071951607,0.9752382499458768,0.08355466233083435,client +3proxy-devel-c37,connect-close-1k,1,0.052512686079999996,5153.61,3.69,6.43,8.8,12.18,22,0,0,10.07,6.443891,153.4105489810054,193.4752536120504,7.609375,0.3792367859682389,0.9581351094196003,0.2001268633047891,1.1424490003841434,0.0968753600113836,client +3proxy-bp,connect-close-1k,1,0.05637144576,5536.56,3.23,5.48,7.69,11.43,26,0,0,10.04,6.3433399999999995,142.48348417736233,179.6803693827514,5.25,0.3891917515999052,0.9543726235741445,0.20057489619929736,1.1824707836324115,0.09969860094314828,client +squid,connect-close-1k,1,0.03674210304,3604.14,7.4,11.8,13.44,16.9,1,0,0,10.1,7.346435,219.91120081513986,277.5792887374265,20.9296875,0.2721639656816015,0.9591642924976258,0.14304,0.8003192680182505,0.07120737196295295,proxy +tinyproxy,connect-close-1k,1,0.0486539264,4774.94,4.42,7.34,9.73,12.29,15,0,0,10.08,6.554525,165.74201912715517,209.14598721885633,7.1875,0.4479413156649314,0.9572649572649573,0.1752150366358713,1.4731951262976057,0.0845301254735264,client +direct,connect-close-1k,1,0.51816431616,50878.03,0.778,1.86,2.86,4.2,0,0,0,8.59,0.0,13.262202327877104,16.716062404038322,0.0,0.750732421875,0.8774259448416751,0.8915275994865212,2.0608384478720647,0.5721390956128595,client +3proxy-1.0.2,connect-stream1-down,2,19.735428284030984,nan,nan,nan,nan,nan,0,0,0,10.01,6.827653,0.40572399622706284,nan,9.50390625,0.19637165972051973,0.9506172839506173,0.17943866288237148,0.4662408690735468,0.36320845931545054,proxy +3proxy-devel-c37,connect-stream1-down,2,32.43194417713397,nan,nan,nan,nan,nan,0,0,0,10.0,5.281178,0.2466441619009595,nan,11.3203125,0.2688588007736944,0.9505703422053232,0.25667090216010163,0.7269815549244284,0.5724442159175552,proxy +3proxy-bp,connect-stream1-down,2,31.54091800522264,nan,nan,nan,nan,nan,0,0,0,9.97,5.2319249999999995,0.25285065810112856,nan,12.89453125,0.2807506974384986,0.9940179461615155,0.26819541375872386,0.7212262254019531,0.5888914227469961,proxy +squid,connect-stream1-down,2,13.427965366936837,nan,nan,nan,nan,nan,0,0,0,10.02,7.391081,0.596940070614107,nan,22.7109375,0.13869149718206322,0.9506641366223909,0.12120253164556961,0.3159242229584438,0.22440418953400892,proxy +tinyproxy,connect-stream1-down,2,1.2234520579941774,nan,nan,nan,nan,nan,0,0,0,9.97,6.04242,6.5185588719309715,nan,2.32421875,0.21572481572481572,0.9477186311787072,0.02158730158730159,0.47572155116268516,0.025669900993600104,proxy +direct,connect-stream1-down,2,45.66977372034482,nan,nan,nan,nan,nan,0,0,0,6.32,0.0,0.11069353883865132,nan,0.0,0.2538684719535783,0.6301096709870389,0.34710743801652894,0.7022502666904819,0.7169694836980338,none +3proxy-0.9.9.2,connect-stream1-down,2,19.38869576198813,nan,nan,nan,nan,nan,0,0,0,9.95,6.31109,0.41050412646174117,nan,8.359375,0.19014778325123152,0.9485224022878932,0.15464895635673626,0.47289866361383964,0.3042668721806325,proxy +3proxy-1.0.2,connect-stream16,2,18.711155372433623,nan,nan,nan,nan,nan,0,0,761,10.05,6.953842,0.4285505932274143,nan,68.171875,0.13185255198487714,0.95260663507109,0.2668175937904269,0.3327202211827355,0.4635136334675799,proxy +3proxy-devel-c37,connect-stream16,2,31.366541189241357,nan,nan,nan,nan,nan,0,0,691,10.04,5.178926,0.255202802244711,nan,99.91796875,0.19106463878326996,0.9534662867996201,0.35194096888033366,0.5598260220083029,0.7613469815903704,proxy +3proxy-bp,connect-stream16,2,32.130136796394666,nan,nan,nan,nan,nan,0,0,1291,10.02,5.268666,0.2491186216976843,nan,100.859375,0.19975845410628018,0.9515669515669516,0.39306174411203054,0.5598382136954406,0.8337899704949295,proxy +squid,connect-stream16,2,13.169087330936264,nan,nan,nan,nan,nan,0,0,0,10.02,7.697527,0.6084957113086236,nan,65.19140625,0.10968049594659036,0.9524714828897338,0.28438899552143315,0.23951380106831263,0.458663092480262,proxy +tinyproxy,connect-stream16,2,1.215549359707145,nan,nan,nan,nan,nan,0,0,70,10.06,6.181061000000001,6.576838816141817,nan,70.98828125,0.019235336024697222,0.9553656220322887,0.30223390275952694,0.027569492861091883,0.4863199804211407,proxy +direct,connect-stream16,2,142.10231135605397,nan,nan,nan,nan,nan,0,0,3981,8.94,0.0,0.050315463611874,nan,0.0,0.9645266050462153,0.9094608341810784,0.9767287234042553,3.110159612322339,2.5057455421449846,origin +3proxy-0.9.9.2,connect-stream16,2,18.976734045843227,nan,nan,nan,nan,nan,0,0,749,10.04,6.90282,0.42129790445200394,nan,78.765625,0.13383778671080634,0.9534662867996201,0.2651072124756335,0.3364836149616842,0.47959016134913024,proxy +3proxy-1.0.2,connect-ka-1k,2,0.30475812863999996,29808.21,2.0,2.28,2.76,5.77,0,0,0,10.07,6.865955,26.434077528794216,33.50089324625984,8.8046875,0.22241045498547918,0.9572243346007605,0.3713270907329674,0.5712758160902743,0.346690481675092,proxy +3proxy-devel-c37,connect-ka-1k,2,0.30316429312,29651.42,2.02,2.35,2.77,3.79,0,0,0,10.09,6.915248,26.62582693010255,33.712895767344264,7.45703125,0.23093629343629343,0.9582146248812915,0.3837471783295711,0.583644172732661,0.3989600089176776,proxy +3proxy-bp,connect-ka-1k,2,0.39770390528,38898.98,0.265,16.88,28.27,36.56,0,0,0,10.05,6.384193,20.216044884798173,25.725563274646625,4.55078125,0.2641693018730236,0.9544159544159544,0.4412050534499514,0.6910476630091466,0.4844416090356235,proxy +squid,connect-ka-1k,2,0.38512099328,37668.23,1.63,1.69,1.88,2.46,0,0,0,10.04,7.210707,20.855783351598234,26.577932374515893,20.484375,0.2587040618955513,0.9534662867996201,0.42103590721321893,0.6719892386469629,0.36377178736234084,proxy +tinyproxy,connect-ka-1k,2,0.29997662208,29339.83,2.07,2.35,2.75,3.69,0,0,0,10.1,7.026314,26.935432314606054,34.13822940890163,5.68359375,0.2180632697416083,0.9582542694497154,0.3781865117779929,0.5551065735685059,0.308589231071883,proxy +direct,connect-ka-1k,2,1.2903356825599999,126209.87,0.481,0.519,0.613,0.769,0,0,0,8.22,0.0,5.096348251761395,6.448763320187376,0.0,0.5712490575521488,0.8074656188605108,0.9591513616212793,1.654599166221867,0.841891018533049,origin +3proxy-0.9.9.2,connect-ka-1k,2,0.30853300224,30179.37,2.0,2.28,2.69,3.86,0,0,0,10.08,6.897169,26.136588116843395,33.18671477862354,9.81640625,0.2244352683993199,0.9554502369668246,0.38273195876288657,0.5807692864137067,0.32197875297059547,proxy +3proxy-1.0.2,connect-ka-50k-2000,2,5.49336383488,13344.89,100.29,135.99,157.68,256.26,0,0,0,10.31,6.726727,1.5014479739407565,76.50013726988743,254.55859375,0.23184955962865983,0.9800380228136882,0.27652228499686127,0.6216285285039953,0.1785681348802869,proxy +3proxy-devel-c37,connect-ka-50k-2000,2,6.17451880448,14999.35,69.96,92.33,108.54,177.76,0,0,0,10.32,6.396488,1.3371082446149092,67.16082805656607,209.05859375,0.24982155603140613,0.9809885931558935,0.30345911949685533,0.6682746239646584,0.19187450001626039,proxy +3proxy-bp,connect-ka-50k-2000,2,9.19123001344,22246.25,89.15,92.6,97.16,115.0,0,0,0,10.08,5.434653999999999,0.8773580889835535,44.86760051811396,124.57421875,0.3215304182509506,0.9581749049429658,0.38796615481040425,0.9031692453392961,0.2546127703877703,client +squid,connect-ka-50k-2000,2,4.74719715328,11532.21,159.84,166.34,178.71,200.93,0,0,0,10.22,7.427429,1.722279428473057,87.73963135618685,231.17578125,0.15529131985731273,0.9714828897338403,0.1945758435824661,0.4373074327854353,0.1339531536112197,proxy +tinyproxy,connect-ka-50k-2000,2,1.05771958272,2566.15,399.55,617.8,714.77,1070.0,0,10,0,10.17,6.32141,7.692019825403729,392.54284390921725,129.203125,0.24939700916546068,0.9676498572787822,0.09756867698137038,0.47906539144284416,0.05319233560847641,proxy +direct,connect-ka-50k-2000,2,37.10851743744,90213.79,20.99,23.4,26.2,227.53,0,0,0,8.82,0.0,0.1901450256506602,9.712576024032568,0.0,0.8738026819923371,0.8741328047571854,0.9550490661601773,2.862781731277201,0.7654829527655076,origin +3proxy-0.9.9.2,connect-ka-50k-2000,2,5.29312776192,12858.47,111.13,145.19,176.99,243.35,3,0,0,10.23,6.734129,1.5461557642491859,78.80991633668705,393.84765625,0.2297650130548303,0.9724334600760456,0.26702395964691045,0.6074432359539927,0.17098438667771876,proxy +3proxy-1.0.2,connect-ka-2k-50k-2000,2,5.11361155072,12422.31,119.35,141.59,159.0,248.59,0,0,0,10.26,6.58016,1.6051277885674182,81.77579404614833,260.95703125,0.2235182099500119,0.9743589743589743,0.3186847929181157,0.5874121216506615,0.2156159923068164,proxy +3proxy-devel-c37,connect-ka-2k-50k-2000,2,5.68210751488,13803.32,82.64,121.26,149.35,190.21,0,0,0,10.18,6.202294,1.4332710140863978,73.08388134279069,223.57421875,0.23849272597185786,0.967680608365019,0.34860935524652337,0.6330400940252952,0.23746518703551717,proxy +3proxy-bp,connect-ka-2k-50k-2000,2,8.074538516479999,19587.94,95.41,96.72,101.81,141.6,0,0,0,10.09,5.272408,0.9996856146670404,51.070506655868805,115.09765625,0.31000948766603414,0.9591254752851711,0.44714420952982015,0.8450290941501744,0.3153679094679543,proxy +squid,connect-ka-2k-50k-2000,2,4.4228096819200005,10744.21,170.83,175.74,179.51,192.23,0,0,0,10.27,7.312563,1.8576426730696054,94.65437788018433,244.94140625,0.1461447212336892,0.9753086419753086,0.21905666350110795,0.40596147299704727,0.1595477543701661,proxy +tinyproxy,connect-ka-2k-50k-2000,2,1.0368319488,2515.75,402.42,669.06,771.67,1340.0,0,13,0,10.21,6.310521,7.877843665459396,401.79449844555506,135.54296875,0.24717208182912154,0.9714557564224549,0.11360050489113285,0.4686702672083783,0.06267402847399471,proxy +direct,connect-ka-2k-50k-2000,2,27.40189134848,66624.94,28.33,31.37,35.03,42.83,0,0,0,8.58,0.0,0.25049365800002527,12.799608552764074,0.0,0.7532374100719424,0.8478260869565217,0.954718176060798,2.3707023434534666,0.7846204623870378,origin +3proxy-0.9.9.2,connect-ka-2k-50k-2000,2,4.92981714944,11975.88,129.66,151.85,171.31,271.08,1,0,0,10.28,6.634926,1.6682160312850958,85.04161082708757,390.50390625,0.22325249643366618,0.976258309591643,0.31352718078381797,0.5855220982706428,0.2127683546498205,proxy +3proxy-1.0.2,connect-close-1k,2,0.04429185024,4347.91,4.6,8.14,10.83,14.43,14,0,0,10.09,6.917148,182.2457169041489,229.87720137607363,11.6953125,0.31103757976837626,0.9582146248812915,0.16698352344740178,0.9296823004554435,0.07881528498462136,client +3proxy-devel-c37,connect-close-1k,2,0.05804916736,5700.4,3.18,5.55,7.6,10.3,22,0,0,10.09,6.433623,139.05453544131595,175.2892533268476,7.671875,0.3896011396011396,0.9582146248812915,0.19572158365261813,1.1862360567177908,0.0978282108935512,client +3proxy-bp,connect-close-1k,2,0.05905580032,5802.2,2.8,4.97,7.04,10.48,28,0,0,10.08,6.36536,136.5488225763494,172.07825463484585,5.1015625,0.3911280705938469,0.9581749049429658,0.198468410976388,1.1968405937399453,0.09784397967218068,client +squid,connect-close-1k,2,0.037748736,3708.37,7.28,11.64,13.04,16.62,2,0,0,10.09,7.371855,213.83497450086804,269.42590120160213,25.87890625,0.269267364414843,0.9591254752851711,0.1447704081632653,0.7947012659237689,0.07028970968882148,proxy +tinyproxy,connect-close-1k,2,0.045885685759999996,4505.18,4.63,7.5,9.89,14.09,18,0,0,10.07,6.570728,175.56673430001717,221.51341838979323,7.44140625,0.43904174573055027,0.9572243346007605,0.17765042979942694,1.4382573583697196,0.08549495832371908,client +direct,connect-close-1k,2,0.54408511488,53425.45,0.715,1.62,2.51,4.13,0,0,0,8.69,0.0,12.777412595698909,16.10458155886419,0.0,0.7758494255683207,0.8885480572597138,0.9025328630971465,2.1664158788302132,0.5839363901347119,origin +3proxy-0.9.9.2,connect-close-1k,2,0.048234496,4737.79,3.64,6.78,9.53,12.41,22,0,0,10.07,6.834289999999999,167.01739767323372,210.58134671685488,11.5859375,0.3405507178159567,0.9581351094196003,0.17647058823529413,1.0171284556779074,0.08545556642808108,client diff --git a/bench/data/results-full7/intel-mix.csv b/bench/data/results-full7/intel-mix.csv new file mode 100644 index 0000000..7420d18 --- /dev/null +++ b/bench/data/results-full7/intel-mix.csv @@ -0,0 +1,103 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,mix-http,0,17.890787997599997,48877,31.744,38.912,61.44,237.568,0,0,0,8.54,0.0,0.38187250337528417,17.472430795670764,0.0,0.8650410429744085,0.8767967145790554,0.9423261775072093,2.551008241250829,1.8690223933816072,origin +3proxy-0.9.9.2,mix-http,0,2.185660696,5994.3,5.12,10.752,49.152,5505.024,0,0,0,10.39,6.561990999999999,3.802969058835105,173.33133143152662,2950.46484375,0.2438964241676942,1.0,0.2903752039151713,0.6392010870317111,0.5596737715660055,proxy +3proxy-1.0.2,mix-http,0,2.2117111136,6014.5,4.864,10.752,49.152,5767.168,0,0,0,10.42,6.881062999999999,3.769027495833984,173.24798403857343,2357.21484375,0.24301812836844683,1.0,0.29261179520414776,0.6352449099962051,0.5568651259270885,proxy +3proxy-devel-c37,mix-http,0,2.8310321224,7779.7,3.84,6.656,12.8,4194.304,0,0,0,10.4,6.120280999999999,2.9388575050666477,133.6812473488695,1413.12890625,0.28758331276228094,1.0,0.32746823069403713,0.7690116697774089,0.6315980751376934,proxy +3proxy-bp,mix-http,0,3.2144191591999998,8852.7,139.264,245.76,376.832,1769.472,0,0,0,10.43,5.7253799999999995,2.5958033432318897,117.81716312537418,673.453125,0.3263516804676084,1.0,0.3677900194426442,0.8628847703810314,0.6962582013529073,proxy +nginx,mix-http,0,2.6288657391999997,7209.5,18.432,180.224,253.952,4194.304,0,0,0,10.37,6.644279,3.155733621651057,143.83799153894168,221.296875,0.30507228620436166,0.9961575408261287,0.23519896473633128,0.7661121122889908,0.47180662383009603,proxy +nginx-halfclose,mix-http,0,2.6661174431999997,7313.3,12.288,147.456,237.568,4194.304,0,0,0,10.45,6.701806,3.1356458138490453,142.89035045738586,225.83984375,0.3082945926107169,1.0,0.23176661264181522,0.7720077272278106,0.47024731718097024,proxy +haproxy,mix-http,0,2.2415387024,6932.3,122.88,245.76,589.824,2752.512,0,0,0,10.42,6.170202,3.7188739998442597,150.31086363833072,497.00390625,0.34454191033138404,1.0,0.21674718196457327,0.8618767030246058,0.3892254569923375,proxy +haproxy-splice-auto,mix-http,0,2.9247613111999997,8318.7,155.648,311.296,557.056,1441.792,0,0,0,10.41,6.277035,2.847411844552575,125.13974539290994,411.0859375,0.3411850412821758,1.0,0.24606993904395252,0.8719094645854913,0.4517763981896703,proxy +envoy,mix-http,0,1.9698967055999999,5386.7,344.064,376.832,425.984,524.288,0,0,0,10.43,8.088216,4.235755091259238,193.62503944901331,602.26953125,0.17645625152327565,1.0,0.15740142210730446,0.482437622483347,0.31481689827307563,proxy +squid,mix-http,0,0.8263517784,2411.2,36.864,86.016,1376.256,7340.032,0,0,0,10.4,8.255137999999999,10.06835129720343,431.32050431320505,656.08984375,0.22388425698871997,1.0,0.12532299741602068,0.583229092100476,0.23365189426792882,proxy +tinyproxy,mix-http,0,0.606360464,1537,81.92,1966.08,4194.304,6291.456,9214,0,0,10.57,7.283462999999999,13.945500246203387,687.7033181522446,788.83984375,0.21108433734939758,0.9971698113207547,0.1820488423723438,0.48030619525752727,0.33017872329935816,proxy +direct,mix-connect,0,16.4650746664,44994,31.744,36.864,63.488,278.528,0,0,0,8.84,0.0,0.42951520981752433,19.64706405298484,0.0,0.8571082586582708,0.8956433637284701,0.9278350515463918,2.4895182928577215,1.7961192946095268,origin +3proxy-0.9.9.2,mix-connect,0,2.6926454831999997,7195.1,8.704,65.536,212.992,3407.872,20497,0,0,9.92,5.763827,2.947287360892634,137.87160706591987,3216.95703125,0.30666336388407234,0.9603097773475314,0.30834419817470665,0.775995829805116,0.5696268715602759,proxy +3proxy-1.0.2,mix-connect,0,3.2176469152,8564.8,5.12,18.432,180.224,3276.8,0,0,0,10.3,6.022286000000001,2.560877628018991,120.25966747618158,2183.95703125,0.31331006979062814,1.0,0.321323288568621,0.8479326203706187,0.5995938321090923,proxy +3proxy-devel-c37,mix-connect,0,3.08524308,8275.6,3.712,14.848,237.568,3538.944,0,0,0,10.33,5.745448999999999,2.6785571787102103,124.82478611822708,1500.8828125,0.31651261553834625,1.0,0.3200919238345371,0.8689360137987928,0.6015314557964366,proxy +3proxy-bp,mix-connect,0,4.074397215199999,11119,57.344,139.264,253.952,1966.08,0,0,0,10.49,5.1398589999999995,2.059691178045355,94.3430164583146,457.16796875,0.37226809130645944,1.0,0.3765312701482914,1.0227512074092615,0.7197667091533348,client +squid,mix-connect,0,2.6484012872,7034.3,17.408,131.072,188.416,4063.232,329,0,0,10.39,6.94608,3.1384971908044164,147.7048178212473,1804.8359375,0.24915254237288137,1.0,0.24477995502730485,0.6521710378041636,0.4529675396035327,proxy +tinyproxy,mix-connect,0,0.9619588287999999,2674.7,90.112,204.8,1900.544,6029.312,113,0,0,10.19,6.412230999999999,8.474375156127264,380.97730586607844,1074.63671875,0.28372915613946437,1.0,0.14460217893694288,0.6012124458453159,0.25373752990656023,proxy +direct,mix-socks,0,16.5230640464,45182.3,27.648,34.816,63.488,311.296,0,0,0,9.22,0.0,0.4464063069226596,20.406221020178254,0.0,0.8543046357615894,0.9210789210789211,0.9306414848583523,2.4649856399352417,1.7880242869759404,origin +3proxy-0.9.9.2,mix-socks,0,3.1345091184,8383.2,6.912,40.96,237.568,3276.8,0,0,0,10.28,5.942877,2.6236963075730064,122.62620479053345,1988.46484375,0.2992773486169948,1.0,0.31106745252128354,0.7890622428507952,0.569227648617973,proxy +3proxy-1.0.2,mix-socks,0,3.0571918896,8127.1,5.632,32.768,237.568,3407.872,0,0,0,10.39,6.0022329999999995,2.7188348982201225,127.84388035092468,1979.296875,0.2894736842105263,1.0,0.29778212654924985,0.7751097786841684,0.5597892488396026,proxy +3proxy-devel-c37,mix-socks,0,3.0406696215999998,8225.4,3.84,31.744,278.528,3538.944,0,0,0,10.55,5.897625,2.7757043843384976,128.26123957497506,1514.25390625,0.3082706766917293,1.0,0.3189517417705337,0.8343139317709245,0.5969058616875935,proxy +3proxy-bp,mix-socks,0,4.0511233168,11048.4,49.152,147.456,253.952,1966.08,0,0,0,10.65,5.309807,2.1031203776660115,96.39404800695124,471.875,0.3586800573888092,1.0,0.3624246271025071,0.9806866359473132,0.690913795548803,client +direct,mix-relay,0,16.7428066792,45864.2,27.648,34.816,61.44,311.296,0,0,0,9.1,0.0,0.4348135972354099,19.841183319451773,0.0,0.8535218133073361,0.9118236472945892,0.9313693752023309,2.4910702689475537,1.7921895642866044,origin +3proxy-0.9.9.2,mix-relay,0,3.145954436,8676.5,4.096,9.216,23.552,3407.872,0,0,0,10.47,6.070004,2.6624670415283793,120.6707773871953,1800.2265625,0.3007113073338239,1.0,0.3335492227979275,0.8229291708877394,0.6328425170806635,proxy +3proxy-1.0.2,mix-relay,0,3.1824382032,8775.1,3.2,7.936,18.432,3407.872,0,0,0,10.39,6.026994,2.6118339050989685,118.4032090802384,1794.04296875,0.29461196243203164,1.0,0.32130081300813007,0.7990381375416642,0.6009112512507905,proxy +3proxy-devel-c37,mix-relay,0,3.32932092,9158.6,2.048,4.352,10.752,3276.8,0,0,0,10.46,5.868797000000001,2.513425470561126,114.20959535300155,1327.23828125,0.3156727451946772,1.0,0.3403497409326425,0.8698556648284459,0.6486097915022422,proxy +3proxy-bp,mix-relay,0,4.1708265152,11363.4,8.192,21.504,204.8,2228.224,0,0,0,10.44,5.169081,2.0024807959674877,91.87391097734833,433.5625,0.3608875883930749,1.0,0.3727714748784441,0.9766868542412668,0.7108167299838288,client +nginx,mix-relay,0,3.376903908,9291.9,3.584,5.376,12.288,3276.8,450,0,0,10.46,5.543486,2.478009510479681,112.57116413220116,651.38671875,0.34797630799605134,1.0,0.3485436893203884,0.9218216746505568,0.6528050447718481,client +nginx-halfclose,mix-relay,0,3.5765249264000003,9796,3.456,5.376,11.776,3014.656,0,0,0,10.42,5.543054,2.330754061985726,106.36994691710902,662.1171875,0.35009910802775024,1.0,0.36390054891830803,0.9268845706295364,0.6832828497811612,client +haproxy,mix-relay,0,2.41502428,7556.7,102.4,188.416,589.824,2883.584,0,0,0,10.43,6.148199,3.455037727405374,138.02321119006973,485.08203125,0.3244902972242692,1.0,0.298454603992273,0.8539952132754344,0.5443885902649153,proxy +haproxy-splice-auto,mix-relay,0,3.3404994952,9420.9,69.632,110.592,245.76,2228.224,0,0,0,10.37,5.973726,2.4834609350848913,110.07440902673842,342.28125,0.34571850393700787,1.0,0.34599291921467656,0.9108451737249291,0.6382776491603305,client +envoy,mix-relay,0,3.2356764352,8873,212.992,229.376,253.952,344.064,0,0,0,10.44,6.389523,2.581222247422819,117.66031781809986,712.83203125,0.27266064011727337,1.0,0.3094155844155844,0.7500192162043958,0.5880021241392146,proxy +3proxy-0.9.9.2,mix-http,1,2.362792964,6465.3,5.376,11.264,45.056,4980.736,0,0,0,10.34,6.514959,3.5009415238803796,159.9307070050887,2977.421875,0.2597467097094611,1.0,0.30721311475409835,0.6801952741171778,0.5853535452213547,proxy +3proxy-1.0.2,mix-http,1,2.272501412,6205.8,5.12,11.776,90.112,5242.88,0,0,0,10.35,6.803770999999999,3.6435620925369965,166.77946437203906,2366.18359375,0.24455984174085063,1.0,0.2964169381107492,0.6332481440466552,0.5587971822310115,proxy +3proxy-devel-c37,mix-http,1,2.9038839664,7889.8,3.968,6.656,14.848,4194.304,0,0,0,10.43,6.151376000000001,2.8733930475687064,132.19599989860325,1448.65234375,0.29783571077225773,1.0,0.32769280833062153,0.7900791178266242,0.6287846239491169,proxy +3proxy-bp,mix-http,1,3.3362030736,9153.4,126.976,229.376,344.064,2228.224,0,0,0,10.37,5.695825,2.4866591802063254,113.29123604343741,674.42578125,0.32142857142857145,1.0,0.3575856443719413,0.8519379374772355,0.6819410204629708,proxy +nginx,mix-http,1,2.8243107552,7747.1,10.752,147.456,262.144,3932.16,0,0,0,10.38,6.684086,2.940186374573347,133.98562042570768,226.8515625,0.3146287674589561,0.9961612284069098,0.24199288256227758,0.78409926722304,0.4895222273951471,proxy +nginx-halfclose,mix-http,1,2.708539152,7445.2,10.24,139.264,229.376,3932.16,0,0,0,10.42,6.688738999999999,3.0776738057652415,139.95594476978457,226.7421875,0.3053435114503817,1.0,0.23533204384268214,0.7670190584822644,0.4692208546155079,proxy +haproxy,mix-http,1,2.3406531632,7189,114.688,229.376,557.056,2752.512,0,0,0,10.44,6.159306,3.5682347693844774,145.2218667408541,501.296875,0.3495121951219512,1.0,0.21930105803142033,0.882854161929775,0.3967430420501387,proxy +haproxy-splice-auto,mix-http,1,2.7949968696,7988.2,163.84,327.68,589.824,1507.328,0,0,0,10.44,6.282115999999999,2.988196548926825,130.69277183846174,423.26953125,0.33689320388349514,1.0,0.24090619017230377,0.8618974512612827,0.4381135260293862,proxy +envoy,mix-http,1,1.9668651224,5351.1,344.064,393.216,425.984,507.904,0,0,0,10.4,8.065850000000001,4.230081618330699,194.35256302442488,613.04296875,0.17153996101364521,1.0,0.15489306545690215,0.4654333975487033,0.31251340159015045,proxy +squid,mix-http,1,0.6472366816,2111.5,442.368,786.432,1638.4,5242.88,0,0,0,10.42,8.454991,12.879368918635775,493.48804167653327,911.796875,0.1885728298185385,1.0,0.0818298969072165,0.4933819879797821,0.15444018843322407,proxy +tinyproxy,mix-http,1,0.643843428,1643.1,106.496,1769.472,3538.944,5505.024,10017,0,0,10.27,6.988840999999999,12.76086645090365,625.0380378552736,784.79296875,0.23261568918584508,1.0,0.18205718041406507,0.5003731354052304,0.3379898156027552,proxy +direct,mix-http,1,16.66169168,45731,30.72,36.864,63.488,262.144,0,0,0,8.99,0.0,0.4316488468354613,19.658437383831536,0.0,0.8758470474346564,0.9026104417670683,0.9310789049919485,2.555184324393649,1.8214604091275743,origin +3proxy-0.9.9.2,mix-connect,1,2.1000662832,5564.3,8.192,90.112,212.992,3407.872,4864,0,0,8.34,5.093222,3.177042578786353,149.88408245421707,3217.51953125,0.268822512959763,0.8104956268221575,0.2680143462667101,0.6314069616604995,0.44919536260989046,none +3proxy-1.0.2,mix-connect,1,3.271001632,8737.6,5.12,16.384,221.184,3145.728,0,0,0,10.57,6.2315640000000005,2.5851408685570476,120.97143380333273,2080.21875,0.30347171643602816,1.0,0.32345442957297643,0.8446501730611903,0.6059067189247676,proxy +3proxy-devel-c37,mix-connect,1,3.3130239224,8902.9,3.072,8.704,221.184,3407.872,0,0,0,10.22,5.685501,2.4678360891753517,114.79405586943581,1494.49609375,0.3398643556895252,1.0,0.33454665784248844,0.9118487710994531,0.6267121843045024,client +3proxy-bp,mix-connect,1,4.0972031632,11177.8,65.536,155.648,253.952,1769.472,0,0,0,10.41,5.127701,2.032606065230034,93.1310275725098,449.8515625,0.3771887159533074,1.0,0.38700290979631424,1.0265930771050893,0.7218229471754188,client +squid,mix-connect,1,2.712697388,7171.7,15.36,118.784,188.416,3801.088,331,0,0,10.18,6.872053,3.0021778455739785,141.94681874590404,1809.17578125,0.2545997016409746,1.0,0.2458319712324289,0.6672339773723505,0.4477158083913803,proxy +tinyproxy,mix-connect,1,0.9999093952,2771.8,73.728,188.416,1835.008,4980.736,127,0,0,10.42,6.559928,8.33675535005114,375.92899920629196,1064.80859375,0.2918731417244797,1.0,0.14907437479701202,0.6341429560754753,0.27155913140741594,proxy +direct,mix-connect,1,14.5013552064,39703.9,22.528,32.768,69.632,622.592,0,0,0,9.49,0.0,0.5235372757884974,23.90193406693045,0.0,0.8767726161369194,0.9349753694581281,0.9064748201438849,2.487185622541359,1.6585278445984724,origin +3proxy-0.9.9.2,mix-socks,1,3.0264209288000004,8079,6.144,47.104,237.568,3538.944,0,0,0,10.26,5.8715269999999995,2.7121144722107564,126.99591533605644,2138.9921875,0.3023372706710229,1.0,0.3062438057482656,0.7939900360964343,0.5693516721404336,proxy +3proxy-1.0.2,mix-socks,1,3.1844428712,8513.8,5.12,24.576,212.992,3276.8,0,0,0,10.24,5.913204,2.572506504697631,120.27531771946722,2139.69921875,0.30904522613065327,1.0,0.31968295904887717,0.8149282740688887,0.5979822531933717,proxy +3proxy-devel-c37,mix-socks,1,3.0743888648000004,8312.3,3.712,16.384,237.568,3407.872,0,0,0,10.51,5.872717,2.7348524762975845,126.43913237010214,1513.96484375,0.310555963752143,1.0,0.32412463861227114,0.8474871731421262,0.6064864899902506,proxy +3proxy-bp,mix-socks,1,3.9986097368,10906.4,57.344,147.456,262.144,1966.08,0,0,0,10.54,5.2804,2.1087329234455234,96.6405046578156,472.25,0.37167070217917675,1.0,0.3870146403564608,1.0035704548873496,0.7268877598559257,client +direct,mix-socks,1,14.2284771776,39337.9,38.912,45.056,73.728,262.144,0,0,0,8.75,0.0,0.49197113033432366,22.243180240938127,0.0,0.7906409943943457,0.8793969849246231,0.9254019292604502,2.299289617341098,1.8006151813683662,origin +3proxy-0.9.9.2,mix-relay,1,3.0733963032,8469.8,3.84,8.704,26.624,3407.872,0,0,0,10.4,5.991007,2.7071028852794776,122.78920399537179,1784.90234375,0.30579531442663377,1.0,0.33041220382992537,0.8219928475754321,0.6186156615721347,proxy +3proxy-1.0.2,mix-relay,1,3.000337212,8223.1,3.456,8.192,18.432,3670.016,0,0,0,10.34,5.987583000000001,2.7570234328713847,125.74333280636256,1775.14453125,0.29503722084367245,1.0,0.32014388489208634,0.7960097665407944,0.6010770000619542,proxy +3proxy-devel-c37,mix-relay,1,3.4594468824,9451.7,2.432,4.864,11.264,3276.8,0,0,0,10.35,5.770493,2.3934462015082967,109.50411037167918,1323.9375,0.32771024559662615,1.0,0.3511574828822954,0.894901808476827,0.6719264318577264,proxy +3proxy-bp,mix-relay,1,4.1887785416,11429.5,8.704,22.528,196.608,2228.224,0,0,0,10.41,5.200571,1.9881690849234845,91.08009974189596,429.12890625,0.3646800195407914,1.0,0.38652482269503546,0.980730637452236,0.734422889080062,client +nginx,mix-relay,1,3.4551716071999996,9461,3.712,5.632,12.288,3145.728,458,0,0,10.42,5.554315000000001,2.4126153336723335,110.13634922312652,632.60546875,0.3566312669795011,1.0,0.35974025974025975,0.9307676100915329,0.6814564840333156,client +nginx-halfclose,mix-relay,1,3.5582701512,9740.4,3.584,5.376,11.776,3014.656,0,0,0,10.35,5.529788,2.326973402288646,106.25846987803375,662.58984375,0.35567138247704144,1.0,0.36118335500650195,0.9348422971106405,0.6863563720273916,client +haproxy,mix-relay,1,2.5267582408,7882.9,118.784,188.416,589.824,2490.368,0,0,0,10.47,6.1863600000000005,3.3149194350101596,132.8191401641528,479.59375,0.33684726648688407,1.0,0.3173940949935815,0.8879504779590411,0.5883134335139124,proxy +haproxy-splice-auto,mix-relay,1,3.1793792064,8996.4,69.632,118.784,262.144,2490.368,0,0,0,10.48,5.991773,2.6369927761756906,116.49104086078876,332.00390625,0.3392857142857143,1.0,0.33365477338476374,0.9038586002678446,0.6228804733104609,client +envoy,mix-relay,1,3.1453664511999997,8628.8,212.992,237.568,262.144,360.448,0,0,0,10.43,6.375245,2.652791059310959,120.87428147598739,713.92578125,0.27590420332355814,1.0,0.3070661022468251,0.7470979366110851,0.5872844266813874,proxy +direct,mix-relay,1,15.149289836,41616.1,25.6,34.816,69.632,475.136,0,0,0,9.31,0.0,0.4916402076024021,22.371149627187556,0.0,0.8372881355932204,0.9163385826771654,0.9095299420476497,2.4441218421037663,1.6813439568487916,origin +3proxy-1.0.2,mix-http,2,2.2247241336,6083.7,5.376,12.288,139.264,5505.024,0,0,0,10.41,6.823644000000001,3.743385471583757,171.11297401252529,2368.6875,0.24182845908085523,1.0,0.2953216374269006,0.6312380693022117,0.5567789538546479,proxy +3proxy-devel-c37,mix-http,2,2.6632122104000002,7324.7,3.968,6.912,13.824,4718.592,0,0,0,10.41,6.137676000000001,3.127050847648817,142.12186164621076,1413.9140625,0.27971512770137524,1.0,0.32206694832629185,0.7390500001726316,0.6170051786854794,proxy +3proxy-bp,mix-http,2,3.3772084648000003,9274.5,126.976,212.992,344.064,1703.936,0,0,0,10.45,5.749591000000001,2.4754172231695746,112.67453771092781,688.3203125,0.3165608207132389,1.0,0.35608020698576975,0.8498047877732389,0.6771553697787555,proxy +nginx,mix-http,2,2.690459384,7376.3,13.824,163.84,229.376,4194.304,0,0,0,10.38,6.68961,3.086461757937469,140.7209576617003,222.16796875,0.3016732283464567,0.9952061361457335,0.23401493021746186,0.7590739570782248,0.4761883775895489,proxy +nginx-halfclose,mix-http,2,2.9022388256,7961.4,9.728,131.072,221.184,3670.016,0,0,0,10.46,6.740571000000001,2.8832913150316037,131.383927449946,225.29296875,0.3189043775984348,0.9980916030534351,0.2374636040116467,0.7980352730635306,0.48285133575722117,proxy +haproxy,mix-http,2,2.3663789384,7292.3,114.688,221.184,557.056,2621.44,0,0,0,10.36,6.157841,3.502397636113105,142.0676604089245,490.9609375,0.358018636586562,1.0,0.2198192382182053,0.8989051468769703,0.3947856136668191,proxy +haproxy-splice-auto,mix-http,2,3.0591845728,8695.2,147.456,294.912,524.288,1310.72,0,0,0,10.38,6.2428170000000005,2.714448835102337,119.37620756279327,440.5703125,0.3468095470043838,1.0,0.25007994883274703,0.8898844788996795,0.4552725757305246,proxy +envoy,mix-http,2,1.9568210175999998,5335.8,360.448,376.832,425.984,491.52,0,0,0,10.33,8.03003,4.223176225966554,193.59796094306384,605.84765625,0.17306745445593305,1.0,0.15729606759831005,0.4753965938456878,0.3106222367211036,proxy +squid,mix-http,2,0.8498213104,2470.7,34.816,86.016,1376.256,7340.032,0,0,0,10.43,8.235982,9.818534670626919,422.1475695147124,643.1015625,0.22802734375,1.0,0.12467866323907455,0.5882065116730458,0.22728546966726307,proxy +tinyproxy,mix-http,2,0.63411742,1613.7,69.632,1900.544,3670.016,5767.168,9749,0,0,10.26,6.974548,12.94397495025448,635.8059118795315,793.21484375,0.22446941323345818,1.0,0.17364085667215814,0.48935452819066955,0.32103335475764255,proxy +direct,mix-http,2,12.596715800799998,34560.6,22.528,38.912,110.592,688.128,0,0,0,9.58,0.0,0.6084125514297362,27.71942616736978,0.0,0.8455264458724666,0.9419862340216323,0.9061777337297654,2.395247140730312,1.603065454960551,origin +3proxy-0.9.9.2,mix-http,2,2.0877665024,5719.4,5.12,10.752,49.152,5767.168,0,0,0,10.33,6.571869,3.958297055968705,180.6133510508095,2913.93359375,0.2483902922238732,1.0,0.2963450773789924,0.6442069180388486,0.5720881554919475,proxy +3proxy-1.0.2,mix-connect,2,2.9591691672,7879.8,5.888,43.008,278.528,3538.944,1,0,0,10.62,6.2135180000000005,2.8710761433213405,134.77499428919515,2063.07421875,0.29164643030597376,1.0,0.30820610687022904,0.8093647155618108,0.5708903645363533,proxy +3proxy-devel-c37,mix-connect,2,2.975001036,7961.9,3.584,10.752,245.76,3932.16,0,0,0,10.6,5.931452999999999,2.850419175450667,133.13405091749456,1503.26953125,0.3138065143412737,1.0,0.3274704189318836,0.8694205321916305,0.6136116068058529,proxy +3proxy-bp,mix-connect,2,4.2041294208,11486.4,61.44,139.264,245.76,1900.544,0,0,0,10.41,5.1224110000000005,1.9809095216710224,90.62891767655663,452.015625,0.3799511002444988,1.0,0.38845654993514916,1.0416632956609164,0.7394709659654568,client +squid,mix-connect,2,2.5899553224000003,6858.5,18.432,131.072,188.416,4063.232,319,0,0,10.3,6.949344,3.1815220628456045,150.17861048334183,1778.34765625,0.2483419307295505,1.0,0.237156704361874,0.657140796630687,0.4280796671653903,proxy +tinyproxy,mix-connect,2,0.956471648,2628.8,69.632,163.84,1900.544,5505.024,124,0,0,10.62,6.689240000000001,8.88264698463911,403.98660986001215,1074.53515625,0.269071411162564,1.0,0.14449395289624442,0.6011935028557711,0.2570825403471825,proxy +direct,mix-connect,2,12.9685245704,35265.2,26.624,38.912,94.208,720.896,0,0,0,9.58,0.0,0.5909693086823995,27.16559100756553,0.0,0.8166911404796867,0.9319066147859922,0.91222366710013,2.3472110454786974,1.6003528668625462,origin +3proxy-0.9.9.2,mix-connect,2,2.0282807207999998,5367.9,9.728,102.4,229.376,3670.016,159923,0,0,8.55,4.630558999999999,3.372314260967855,159.28016542782095,3190.30859375,0.4433117851815017,0.8365949119373777,0.23074391046741277,1.3128947937648046,0.4208807726793519,client +3proxy-1.0.2,mix-socks,2,3.1020253631999997,8293.5,6.4,36.864,245.76,3538.944,0,0,0,10.34,5.9676860000000005,2.6666448631054185,124.67595104599988,1970.71875,0.29908165797964753,1.0,0.3115397188623733,0.7920048162976899,0.577152786395661,proxy +3proxy-devel-c37,mix-socks,2,3.1854810144,8580.2,3.584,15.872,262.144,3538.944,0,0,0,10.39,5.780331,2.6093390487733306,121.09274842078273,1514.70703125,0.320455671124319,1.0,0.32529335071707954,0.8578686526619591,0.6159509160222161,proxy +3proxy-bp,mix-socks,2,4.0263894328,10997.3,63.488,147.456,262.144,1900.544,0,0,0,10.65,5.304715,2.116039727949288,96.84195211551926,476.76953125,0.35351842987075155,1.0,0.35752603344903755,0.9721569270380874,0.6775840773371343,client +direct,mix-socks,2,16.9746964208,46349,28.672,34.816,61.44,294.912,0,0,0,9.19,0.0,0.43311525683553326,19.82782800060411,0.0,0.8695235815178358,0.9054187192118227,0.9305289993626513,2.5604037384966616,1.7590109277706096,origin +3proxy-0.9.9.2,mix-socks,2,3.0466569472,8139,6.4,51.2,262.144,3407.872,0,0,0,10.52,6.016741999999999,2.7623720510228895,129.25420813367737,2141.76171875,0.28525954946131243,1.0,0.2946859903381642,0.7750643356425542,0.5528868578000113,proxy +3proxy-1.0.2,mix-relay,2,3.0893335952,8509.5,3.2,7.68,17.408,3538.944,0,0,0,10.37,6.013691,2.6853687840282996,121.86379928315412,1787.6875,0.3049925852694019,1.0,0.32250656167979,0.8169967679610951,0.6106760923051615,proxy +3proxy-devel-c37,mix-relay,2,3.4855927311999997,9553.2,1.92,4.096,10.752,3145.728,0,0,0,10.47,5.868810000000001,2.403034618768085,109.59678432357744,1324.15234375,0.3270130509726668,1.0,0.34827810266406756,0.8948703134482677,0.6699791163534119,proxy +3proxy-bp,mix-relay,2,4.1313796696,11279.2,7.68,18.432,204.8,2359.296,0,0,0,10.43,5.225292,2.019664293116848,92.47109724093907,425.1875,0.36131566028473244,1.0,0.3804909560723514,0.9857407451899522,0.7281662338412307,client +nginx,mix-relay,2,3.4262696592,9372.4,3.712,5.632,11.776,3014.656,455,0,0,10.41,5.504334,2.4306318032027012,111.07080363620844,645.48046875,0.3564676616915423,1.0,0.3634296849626502,0.9347523498344235,0.6868433567198923,client +nginx-halfclose,mix-relay,2,3.570399108,9787.4,3.456,5.12,11.776,3014.656,0,0,0,10.49,5.5948139999999995,2.350437513049031,107.17861740605268,656.03515625,0.3598429062346588,1.0,0.37467866323907456,0.9517229366636665,0.7090867896911406,client +haproxy,mix-relay,2,2.4544794752,7667.3,106.496,196.608,589.824,2621.44,0,0,0,10.42,6.169131,3.3962394406743823,135.90181680643772,469.4765625,0.33275862068965517,1.0,0.30875724404378624,0.8749148421307248,0.5629766265329785,proxy +haproxy-splice-auto,mix-relay,2,3.2937020544,9277.2,69.632,110.592,245.76,2490.368,0,0,0,10.46,5.993402,2.5406062423956453,112.74953649808131,344.97265625,0.3464068209500609,1.0,0.33740752653586364,0.9118741974457185,0.6229693666889169,client +envoy,mix-relay,2,3.279566112,9006.2,204.8,221.184,245.76,327.68,0,0,0,10.46,6.410708,2.551557039628296,116.1422131420577,713.1484375,0.2697176241480039,1.0,0.3101552393272963,0.7380842892608579,0.583661477220399,proxy +direct,mix-relay,2,15.639636976,42938.7,21.504,32.768,65.536,442.368,0,0,0,9.49,0.0,0.48543326239927426,22.101274607754775,0.0,0.878699660359049,0.9285714285714286,0.9297052154195011,2.5498249721389223,1.718734838059157,origin +3proxy-0.9.9.2,mix-relay,2,3.171368804,8724,3.84,9.216,31.744,3407.872,0,0,0,10.4,6.041080000000001,2.6234728643058194,119.21137093076571,1779.21875,0.30476660903926894,1.0,0.3304007820136852,0.8290154721812054,0.6241072874862796,proxy diff --git a/bench/data/results-full7/intel-mixshaped.csv b/bench/data/results-full7/intel-mixshaped.csv new file mode 100644 index 0000000..2188fee --- /dev/null +++ b/bench/data/results-full7/intel-mixshaped.csv @@ -0,0 +1,103 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,mix-http,0,3.7925668444,10727.25,65.536,163.84,376.832,1769.472,0,4,0,17.95,0.0,1.8931769154185878,83.66543149455825,0.0,0.9715498119394349,0.8650602409638555,0.8373798684876075,1.5364878862552123,0.49904901782485167,client +3proxy-0.9.9.2,mix-http,0,1.4467625652,3950.8,43.008,106.496,884.736,6553.6,0,0,0,20.76,9.008863,5.7397116843786025,262.7315986635618,2995.0703125,0.6894337419731466,1.0,0.28702555197221535,1.2484590976871885,0.364399320698309,client +3proxy-1.0.2,mix-http,0,1.4151055884000001,3850.9,34.816,110.592,786.432,7340.032,0,0,0,20.66,9.595282,5.839846911596014,268.24898075774496,2296.265625,0.692036783408335,1.0,0.27752864972595914,1.2544486377978215,0.3468213178396677,client +3proxy-devel-c37,mix-http,0,1.5230865595999998,4166.45,34.816,180.224,786.432,6291.456,0,0,0,20.64,8.238496,5.4205717645937534,247.69288002976154,1490.0703125,0.708989533405067,1.0,0.2896311066799601,1.260842953285457,0.36797298930217776,client +3proxy-bp,mix-http,0,1.9767382124000001,5398.35,180.224,376.832,622.592,3670.016,0,0,0,20.35,6.99204,4.117894797064227,188.4835181120157,743.44140625,0.7923395037416305,1.0,0.31351214574898784,1.342335206485557,0.4013130933830413,client +nginx,mix-http,0,1.5846334028,4330.85,59.392,278.528,442.368,6291.456,0,0,0,20.48,9.257755999999999,5.16964995533035,236.44319244490111,261.2734375,0.7248698044610395,0.9995119570522206,0.2169576059850374,1.2842772804688178,0.2967196991121169,client +nginx-halfclose,mix-http,0,1.6181492076,4438.65,57.344,237.568,393.216,6291.456,0,0,0,20.49,9.249326,5.0650458941027505,230.81342300023655,257.96875,0.7230739185626404,0.9932137663596704,0.20966135458167331,1.2840847968417708,0.2940918363265054,client +haproxy,mix-http,0,1.6135814112,4969.05,188.416,344.064,819.2,3801.088,0,39,0,20.63,10.489118999999999,5.114089653439359,207.5849508457351,440.1328125,0.7793190416141236,0.9951760733236855,0.24022621096631425,1.4414379711469514,0.2951664012897329,client +haproxy-splice-auto,mix-http,0,2.0185862808,5706.65,237.568,442.368,819.2,1966.08,0,3,0,20.59,9.22542,4.080083213850009,180.4035642627461,410.36328125,0.8147362330022182,0.9856390617520344,0.25469626738228834,1.4023163758668042,0.3136014673330226,client +envoy,mix-http,0,1.1995963336,3288,557.056,622.592,720.896,950.272,0,0,0,20.81,11.875276000000001,6.939000867916623,316.4537712895377,625.40625,0.5822397631968427,1.0,0.14584855125395665,1.0923209205131004,0.18605516981557174,client +squid,mix-http,0,0.6077446688,1800.4,425.984,753.664,1703.936,8388.608,0,38,0,20.28,15.800038999999998,13.347710669379055,563.2081759608976,835.13671875,0.3101328574261352,1.0,0.10644118378512808,0.5934712848768224,0.1317623923723369,proxy +tinyproxy,mix-http,0,0.5666371388,1500.9,851.968,1572.864,3276.8,6291.456,22350,0,0,20.53,12.693909000000001,14.49251988210837,683.9229795456059,791.7578125,0.4528169718803162,0.9932268988872762,0.24519467718087729,0.9638063686529155,0.3039245025794935,client +direct,mix-connect,0,3.6153283976,10193.7,65.536,172.032,393.216,1900.544,0,4,0,18.28,0.0,2.0224995341651395,89.66322336344997,0.0,0.9342673447845696,0.8738049713193117,0.820125786163522,1.4500701556394027,0.5191932367541435,client +3proxy-0.9.9.2,mix-connect,0,1.6900707687999998,4565.1,32.768,122.88,425.984,6029.312,2,0,0,20.81,8.220649000000002,4.925237542514438,227.92490854526736,3319.94921875,0.7384630237497587,1.0,0.2810327706057597,1.3106575587548626,0.3473923061346837,client +3proxy-1.0.2,mix-connect,0,1.7307813708,4641.25,31.744,110.592,507.904,5505.024,0,0,0,20.47,7.922498,4.730811261398862,220.52248855373014,2036.71484375,0.7441974822974036,1.0,0.27079158316633267,1.310631519271125,0.33620499017120886,client +3proxy-devel-c37,mix-connect,0,1.8860430572,5100.3,26.624,77.824,458.752,4980.736,0,0,0,20.38,7.284199999999999,4.32227672050201,199.79216908809286,1488.49609375,0.7816352697504685,1.0,0.2905679513184584,1.3474692448735348,0.37643805731994967,client +3proxy-bp,mix-connect,0,2.2890777611999997,6236.85,81.92,245.76,524.288,3145.728,0,0,0,20.54,6.210869000000001,3.5892183914682465,164.66645822811194,472.5859375,0.8387159722899795,1.0,0.3202793714143178,1.4282841927555807,0.41094814782379163,client +squid,mix-connect,0,1.6080350356,4344.75,55.296,188.416,294.912,6029.312,405,0,0,20.35,9.524004,5.062078760592895,234.19068991311352,1859.65625,0.7141578842712268,1.0,0.23809523809523808,1.3000750895568514,0.2913961152864117,client +tinyproxy,mix-connect,0,0.934820032,2511.5,51.2,122.88,1441.792,11534.336,312,0,0,20.6,12.030831000000001,8.814530837952775,410.1134780011945,1089.69140625,0.5735603405107661,1.0,0.2013888888888889,1.191796227460615,0.23947323186459699,client +direct,mix-socks,0,3.6719007628,10353.9,69.632,172.032,393.216,1835.008,0,6,0,17.91,0.0,1.951033119570777,86.4891490163127,0.0,0.9565980688578952,0.8719571567672834,0.8428025477707006,1.4326749639352325,0.5207522372332187,client +3proxy-0.9.9.2,mix-socks,0,1.7944482335999998,4828.4,32.768,110.592,409.6,5242.88,0,0,0,20.4,7.881349,4.547358818832855,211.25010355397234,1963.234375,0.7578325123152709,1.0,0.2866902834008097,1.3128129195510476,0.36438839512255655,client +3proxy-1.0.2,mix-socks,0,1.76257236,4740.15,32.768,118.784,376.832,5767.168,0,0,0,20.54,8.091188,4.661368909699684,216.65981034355454,1959.38671875,0.7571330522600255,1.0,0.2778894472361809,1.3145673613371134,0.34908622473349077,client +3proxy-devel-c37,mix-socks,0,1.796491708,4919.8,32.768,126.976,524.288,5242.88,0,0,0,20.61,7.672556,4.588944086570757,209.45973413553398,1504.609375,0.7391134924500731,1.0,0.28475336322869954,1.30208882254255,0.3593807481501423,client +3proxy-bp,mix-socks,0,2.1377239684,5819.8,118.784,278.528,524.288,3407.872,0,0,0,20.74,6.323697999999999,3.880762962212198,178.18481734767516,492.765625,0.8068952159597134,1.0,0.3036688150718889,1.3744089189276907,0.3840376980315564,client +direct,mix-relay,0,3.827851382,10747.2,69.632,163.84,376.832,1769.472,0,4,0,17.37,0.0,1.8151174919361068,80.81174631531934,0.0,0.962244312750908,0.8259629101283881,0.8241319010741943,1.5151292421763203,0.5108124253676186,client +3proxy-0.9.9.2,mix-relay,0,1.7917519204,4810.2,32.768,102.4,491.52,5505.024,0,0,0,20.34,7.755694,4.5408071884101435,211.42572034426843,1930.81640625,0.7588153724247226,1.0,0.2782564622402433,1.3044425883654622,0.3480937955476714,client +3proxy-1.0.2,mix-relay,0,1.7645891864,4720.65,30.72,98.304,491.52,5767.168,0,0,0,20.43,7.820682000000001,4.631106244435275,216.38969209748657,1916.5,0.7490909090909091,1.0,0.2702498107494323,1.297280755992803,0.33780392472243176,client +3proxy-devel-c37,mix-relay,0,1.7757536592,4821.9,27.648,86.016,475.136,5242.88,0,0,0,20.67,7.574277,4.656051224878141,214.33459839482362,1412.56640625,0.7482224603097302,1.0,0.279,1.3036156173816653,0.355436918246683,client +3proxy-bp,mix-relay,0,2.2193804052,6030.3,86.016,262.144,524.288,3276.8,0,0,0,20.35,5.960249,3.667690307136177,168.7312405684626,472.24609375,0.834927521940637,1.0,0.3160687215765538,1.3963002490687673,0.39122361021221325,client +nginx,mix-relay,0,2.0307971447999997,5496.75,36.864,131.072,262.144,4718.592,529,0,0,20.37,6.584405000000001,4.012217577153647,185.29130850047756,687.8984375,0.7958017147925496,1.0,0.29763104838709675,1.3434880452279363,0.37404407809510726,client +nginx-halfclose,mix-relay,0,2.1935230816,5962.95,32.768,122.88,262.144,4063.232,0,0,0,20.83,7.092056,3.7984555849407657,174.66187038294802,695.1171875,0.8063023995374385,1.0,0.31206726013847674,1.3587232676856518,0.3951868895727012,client +haproxy,mix-relay,0,1.8882960296,5426.2,204.8,327.68,622.592,2621.44,0,9,0,20.73,10.311071,4.3912606233443725,191.01765508090375,458.44140625,0.8189663531465141,1.0,0.3071782178217822,1.5221507806344918,0.3741606714000323,client +haproxy-splice-auto,mix-relay,0,2.1297471024,5841.4,253.952,393.216,589.824,1245.184,0,1,0,20.83,8.809908,3.91220158985577,178.29629883247168,418.4375,0.8451494341812554,1.0,0.31526005888125613,1.438389290566383,0.3836921333681207,client +envoy,mix-relay,0,1.8583825148,5103.6,360.448,409.6,491.52,720.896,0,0,0,20.38,8.006368,4.386610364162473,199.66298299239753,720.8515625,0.7546103509815586,1.0,0.2510702593805087,1.3263414255523684,0.3171597273081297,client +3proxy-0.9.9.2,mix-http,1,1.5365483195999998,4206.9,38.912,90.112,753.664,6291.456,0,0,0,20.32,8.77051,5.289778327385052,241.50799876393543,3032.76953125,0.7283815946053154,1.0,0.29883603238866396,1.2722538188091126,0.3784581469791765,client +3proxy-1.0.2,mix-http,1,1.359447512,3713.55,36.864,131.072,851.968,7340.032,0,0,0,20.42,9.356383000000001,6.00832318121893,274.9390744705201,2276.79296875,0.6811997219187605,1.0,0.2702431687139634,1.2506480939002742,0.3364080238519106,client +3proxy-devel-c37,mix-http,1,1.5380163992,4224.55,36.864,212.992,950.272,6291.456,0,0,0,20.39,8.096017,5.30293435378345,241.32747866636683,1510.56640625,0.7151767151767152,1.0,0.2861825516893596,1.2677805775530817,0.36432120358638664,client +3proxy-bp,mix-http,1,2.0086143008,5501.9,147.456,344.064,589.824,3538.944,0,0,0,20.47,7.086851999999999,4.076442150560635,186.0266453407005,723.9765625,0.8003329416372895,1.0,0.3245481927710843,1.3478210543649503,0.4103385005337802,client +nginx,mix-http,1,1.5908382328,4348.85,57.344,253.952,458.752,6029.312,0,0,0,20.49,9.215694000000001,5.152000895511794,235.57952102279913,266.64453125,0.7229895190518171,0.9965953307392996,0.22150323544051767,1.2877644061833837,0.3060161174396406,client +nginx-halfclose,mix-http,1,1.6568009095999998,4524.45,51.2,262.144,409.6,5767.168,0,0,0,20.54,9.336031,4.958954303075305,226.98891577981854,263.65234375,0.7320236136649569,0.9908345393150024,0.22140039447731755,1.279656678164035,0.3042659325764226,client +haproxy,mix-http,1,1.592423668,4885.6,188.416,344.064,819.2,3932.16,0,39,0,20.7,10.494652,5.19962128570925,211.84706074995907,446.484375,0.7699123661148978,1.0,0.23353884093711466,1.4068875489147645,0.2867959232356858,client +haproxy-splice-auto,mix-http,1,1.8236510436,5202.35,253.952,491.52,917.504,2097.152,0,2,0,20.59,9.024701,4.5162148914968,197.8913375685988,415.86328125,0.7813498595913625,0.9899038461538462,0.23058074001470227,1.3685043793296976,0.2897346419517138,client +envoy,mix-http,1,1.1892162072,3253.1,589.824,622.592,720.896,983.04,0,0,0,20.84,11.922498999999998,7.009658924534039,320.30985828901663,601.10546875,0.5706148104498134,1.0,0.1436544528027178,1.0817599228001442,0.1808471416260037,client +squid,mix-http,1,0.6057821852,1783.2,425.984,753.664,1703.936,8388.608,0,38,0,20.73,16.146137,13.688088231353952,581.2584118438762,825.78125,0.3061917701863354,1.0,0.10546780072904009,0.5961457683502721,0.12696931312174825,proxy +tinyproxy,mix-http,1,0.5747426852,1538.15,819.2,1835.008,3407.872,6291.456,22353,1,0,20.52,12.682466999999999,14.28117349095755,667.035074602607,799.04296875,0.4581916383276655,0.9922630560928434,0.25036891293654695,0.9725895440690138,0.30708251227285777,client +direct,mix-http,1,3.6029852008,10150.1,73.728,172.032,393.216,1900.544,0,4,0,17.47,0.0,1.9395028318318925,86.05826543580851,0.0,0.952362358453729,0.8526110297706199,0.8487780040733197,1.4213961946610139,0.5151995952200122,client +3proxy-0.9.9.2,mix-connect,1,1.6476152432,4447.05,34.816,147.456,458.752,5767.168,2,0,0,20.58,7.972580000000001,4.996312114721518,231.38934799473807,3310.51171875,0.741549916723817,1.0,0.27802690582959644,1.312922240175881,0.3424850828539742,client +3proxy-1.0.2,mix-connect,1,1.6954633224000002,4561.75,30.72,102.4,524.288,5767.168,0,0,0,20.44,7.9329469999999995,4.822280666282139,224.03682797172138,2028.36328125,0.7422629607727184,1.0,0.27450980392156865,1.3142266060283878,0.33999975506367935,client +3proxy-devel-c37,mix-connect,1,1.7868406652,4826,27.648,90.112,507.904,5242.88,0,0,0,20.53,7.606198000000001,4.595821082391158,212.70203066721922,1484.234375,0.7673214111208834,1.0,0.28900576008014023,1.3340946051973475,0.36570614623811737,client +3proxy-bp,mix-connect,1,2.0114853947999998,5459.65,155.648,311.296,557.056,3538.944,0,0,0,20.58,6.077264999999999,4.09249802224813,188.47362010385282,477.390625,0.806234121555599,1.0,0.3075386919620569,1.3846196816773055,0.3882030727460537,client +squid,mix-connect,1,1.6203784336,4383,55.296,221.184,327.68,5767.168,408,0,0,20.46,9.732886,5.050672009882026,233.40177960301165,1853.41796875,0.7193138124815144,1.0,0.24099378881987576,1.30622848257598,0.291380113836862,client +tinyproxy,mix-connect,1,0.9365021352,2520.25,55.296,118.784,1507.328,11534.336,317,1,0,20.7,12.075553999999999,8.841410701355976,410.67354429124094,1094.34765625,0.5793800138655046,1.0,0.20078837152007883,1.1952656183813548,0.23333123388659077,client +direct,mix-connect,1,3.2900844384,9338.85,59.392,212.992,458.752,2097.152,0,7,0,19.66,0.0,2.3902122110350272,105.25921285811422,0.0,0.9816208818066282,0.961839530332681,0.8153885876581461,1.6885287423068878,0.49459734461741295,client +3proxy-0.9.9.2,mix-socks,1,1.5304642164000002,4100.85,36.864,155.648,475.136,6553.6,0,0,0,20.71,7.924129000000001,5.4127368096758595,252.50862626040941,1903.48046875,0.7020447906523856,1.0,0.2543597409068261,1.2770241358966545,0.31813280993460086,client +3proxy-1.0.2,mix-socks,1,1.7060475868,4579.05,32.768,122.88,393.216,5767.168,0,0,0,20.59,8.028305,4.827532399285593,224.82829407846606,1957.015625,0.7390412964951675,1.0,0.2716417910447761,1.3038548911798769,0.3340546576352663,client +3proxy-devel-c37,mix-socks,1,1.81471178,4919.25,30.72,98.304,425.984,5242.88,0,0,0,20.3,7.490137,4.474539753084096,206.33226609747422,1499.5234375,0.7676328024532595,1.0,0.2864016206634591,1.329366387702547,0.36369370839221693,client +3proxy-bp,mix-socks,1,2.0677098148,5642.9,147.456,311.296,524.288,3407.872,0,0,0,20.4,6.075062000000001,3.9463951573829905,180.75812082439882,491.578125,0.8126909055079318,1.0,0.3005547150781644,1.3815045623920386,0.3794030893939197,client +direct,mix-socks,1,3.3952261731999998,9601.65,63.488,188.416,442.368,2097.152,0,7,0,19.0,0.0,2.2384370325576874,98.94132779261898,0.0,0.9770717963664627,0.9205426356589147,0.8077809060660354,1.6345266389254174,0.4907304638749856,client +3proxy-0.9.9.2,mix-relay,1,1.6585256308,4458,34.816,114.688,458.752,5767.168,0,0,0,20.62,7.773664,4.973091670595122,231.2696276357111,1887.21484375,0.7293761593283218,1.0,0.2704056084126189,1.2858199624868625,0.33622231496656113,client +3proxy-1.0.2,mix-relay,1,1.7430399904,4700.35,31.744,114.688,524.288,5505.024,0,0,0,20.65,7.967897000000001,4.738847097882395,219.664493069665,1895.3359375,0.7376300184699135,1.0,0.27488151658767773,1.2896681992500112,0.34551033844115886,client +3proxy-devel-c37,mix-relay,1,1.810516326,4904.15,26.624,81.92,507.904,5242.88,0,0,0,20.37,7.386196,4.500373668544317,207.68124955394921,1411.46484375,0.754631454473788,1.0,0.2825757575757576,1.3104020870936561,0.35724968409507457,client +3proxy-bp,mix-relay,1,2.2048707872,6004.95,86.016,278.528,524.288,3276.8,0,0,0,20.81,6.2375940000000005,3.775277920286103,173.27371585108952,470.0234375,0.8196990160138916,1.0,0.30680137999014295,1.3848098369764548,0.3906448433910131,client +nginx,mix-relay,1,2.0299592944000002,5498,36.864,155.648,311.296,4456.448,518,0,0,20.36,6.628211,4.011903106858673,185.15823935976718,693.765625,0.7903973183476289,1.0,0.29601613716591024,1.341411108277541,0.3719539344733997,client +nginx-halfclose,mix-relay,1,2.1437265536,5817.35,34.816,139.264,294.912,4194.304,0,0,0,20.39,6.80374,3.8045897161200326,175.2516180047616,707.80859375,0.8258603736479843,1.0,0.31098790322580644,1.376108486214097,0.3912898536302876,client +haproxy,mix-relay,1,1.927068968,5534.85,196.608,327.68,622.592,2621.44,0,8,0,20.67,10.319419,4.2904536045645045,186.72592753191142,462.48046875,0.8244148781198407,1.0,0.3117719950433705,1.5262346715282138,0.37951522505746105,client +haproxy-splice-auto,mix-relay,1,1.9506862852,5386.9,262.144,425.984,622.592,1376.256,0,2,0,20.82,8.638462,4.269266700230143,193.24657966548477,416.50390625,0.8116180166247825,1.0,0.3010329562223315,1.4045116836896339,0.3685872447867408,client +envoy,mix-relay,1,1.8337787124,5052.95,360.448,409.6,491.52,720.896,0,0,0,20.78,8.312922,4.532717030574251,205.62245816800086,719.38671875,0.7455586836229492,1.0,0.2569735867686991,1.3103279085891102,0.3238021066680405,client +direct,mix-relay,1,3.3566420972,9466.45,59.392,204.8,442.368,2097.152,0,6,0,20.0,0.0,2.3833342275821825,105.63622054730126,0.0,0.9345318208036916,0.9601536245799328,0.7905077825976015,1.556201360431178,0.5003262441896349,client +3proxy-1.0.2,mix-http,2,1.3754473007999999,3751.45,34.816,114.688,917.504,7340.032,0,0,0,20.41,9.400409,5.935523662194532,272.02814911567526,2288.41015625,0.6816245666171372,1.0,0.2712846347607053,1.2577646158808178,0.34402454663740406,client +3proxy-devel-c37,mix-http,2,1.532709484,4187.85,34.816,188.416,884.736,6291.456,0,0,0,20.51,8.217161999999998,5.352612537236705,244.87505521926525,1506.6953125,0.721221613155834,1.0,0.29345372460496616,1.264653334182259,0.3733221077704697,client +3proxy-bp,mix-http,2,1.8359566236,5043.55,221.184,409.6,655.36,3538.944,0,0,0,20.37,6.907209,4.438013346972846,201.94109307927948,709.66796875,0.7740124125701902,1.0,0.3036120232381915,1.317707332102975,0.3853284087718263,client +nginx,mix-http,2,1.5159070932,4135.4,59.392,262.144,442.368,6291.456,0,0,0,20.4,9.135387,5.38291563948993,246.65086811432994,257.66796875,0.714764769701154,1.0,0.2151803607214429,1.2762476652490322,0.2938223300438697,client +nginx-halfclose,mix-http,2,1.6160463892,4431.55,55.296,262.144,393.216,6291.456,0,0,0,20.57,9.305418,5.091438002638743,232.0858390405163,255.82421875,0.7147018838609439,0.9946808510638298,0.2176063303659743,1.2816511226402947,0.30132254494530014,client +haproxy,mix-http,2,1.7402751455999999,5268.7,172.032,311.296,753.664,3670.016,0,37,0,20.46,10.4611,4.702704638799158,194.16554368250232,454.7421875,0.8018071105873109,1.0,0.24275724275724275,1.4658673616262299,0.3031236145156672,client +haproxy-splice-auto,mix-http,2,1.9062484912,5450.3,245.76,458.752,851.968,2031.616,0,3,0,20.61,9.197791,4.324724734502127,189.07216116544043,414.12890625,0.8047793409134708,0.9875419262098706,0.23724676592628752,1.3732239364812082,0.2999093720351483,client +envoy,mix-http,2,1.2340669227999999,3385.8,557.056,622.592,688.128,950.272,0,0,0,20.55,11.697932999999999,6.660902944671325,303.47332978911925,627.81640625,0.5975718977012638,1.0,0.14742800886044793,1.1244047431612372,0.18587187031698424,client +squid,mix-http,2,0.590630202,1750.35,425.984,753.664,1703.936,8388.608,0,41,0,20.33,15.863612000000002,13.768344342133725,580.7409946582112,829.8828125,0.3047779206647542,1.0,0.1019139945314442,0.5810278739555177,0.12702511015429613,proxy +tinyproxy,mix-http,2,0.5927339627999999,1601.05,786.432,1769.472,3276.8,6029.312,24142,0,0,20.32,12.624711999999999,13.712728660939824,634.5835545423316,791.6015625,0.4649532710280374,1.0,0.25773453093812376,0.9795451166067912,0.3177804592301821,client +direct,mix-http,2,3.5715397064000003,10094.1,73.728,172.032,393.216,1835.008,0,7,0,17.21,0.0,1.9274600216999564,85.2478180323159,0.0,0.9570828037931371,0.8428011753183153,0.8415286624203822,1.4444425455359644,0.5118111159422316,client +3proxy-0.9.9.2,mix-http,2,1.4066522635999998,3853.7,43.008,98.304,819.2,6815.744,5,0,0,20.43,8.753055,5.809538157700513,265.06993279186236,2984.80078125,0.6920336467095497,1.0,0.2762694821518351,1.2652839845270891,0.35087519146473706,client +3proxy-1.0.2,mix-connect,2,1.6918213408,4556,31.744,102.4,524.288,5767.168,0,0,0,20.41,7.972148000000001,4.825568636070961,223.99034240561897,2026.49609375,0.7530766958747662,1.0,0.2739656912209889,1.3212704625696279,0.3427226603396365,client +3proxy-devel-c37,mix-connect,2,1.7726697884,4790.45,28.672,90.112,475.136,5505.024,0,0,0,20.57,7.596036,4.6415864104202615,214.6979928816708,1491.859375,0.7517827488522028,1.0,0.2832456799398948,1.3239430577992806,0.35939330989122453,client +3proxy-bp,mix-connect,2,2.1416514092,5834.2,102.4,278.528,557.056,3407.872,0,0,0,20.68,6.223701,3.8624399678050088,177.23081142230296,470.9375,0.80917288858722,1.0,0.30092016911216113,1.3955984400584132,0.3806648316668819,client +squid,mix-connect,2,1.7454086616,4704,49.152,180.224,294.912,5242.88,445,0,0,20.51,9.748043,4.700331893895536,218.00595238095238,1862.8671875,0.7350024545900835,1.0,0.24560099132589838,1.333955665583027,0.3002589001201667,client +tinyproxy,mix-connect,2,0.9506899268,2548.45,55.296,126.976,1572.864,11010.048,306,0,0,20.45,11.953600000000002,8.604277556125673,401.22427357805725,1088.33203125,0.5833417060182859,1.0,0.18889166875156368,1.197757209664616,0.22261143774540343,client +direct,mix-connect,2,3.4953713852,9874.3,63.488,188.416,425.984,2031.616,0,5,0,18.97,0.0,2.1708708928982166,96.05744204652481,0.0,0.94793364656247,0.9080899952130206,0.8024722502522704,1.562173597445972,0.490248955900716,client +3proxy-0.9.9.2,mix-connect,2,1.7326786375999998,4680.8,34.816,122.88,458.752,5505.024,0,0,0,20.32,7.9074349999999995,4.6910026034939785,217.05691334814563,3319.62890625,0.7512615019293559,1.0,0.27332824815662343,1.3221552673774788,0.3409526456723282,client +3proxy-1.0.2,mix-socks,2,1.6300696056,4395.8,34.816,139.264,442.368,6029.312,0,0,0,20.47,7.853095,5.023098382959016,232.83588880294826,1937.6640625,0.7241006487124042,1.0,0.2639899623588457,1.294188710699947,0.3250680578687764,client +3proxy-devel-c37,mix-socks,2,1.6845583456,4600.75,32.768,131.072,524.288,5767.168,0,0,0,20.39,7.425103,4.8416251187162205,221.59430527631363,1506.1640625,0.7462039045553145,1.0,0.27298120873539866,1.3084057915631513,0.3454200681596301,client +3proxy-bp,mix-socks,2,2.2076075432,6013.85,98.304,262.144,507.904,3276.8,0,0,0,20.62,6.293095000000001,3.7361713251098303,171.43759821079675,496.57421875,0.8154970760233918,1.0,0.30495394573064477,1.3899757122109944,0.38257344852712427,client +direct,mix-socks,2,3.4518155528000003,9740.1,69.632,188.416,425.984,2031.616,0,3,0,18.43,0.0,2.135687694558324,94.608884919046,0.0,0.9379904306220096,0.8772013326987149,0.8288220551378446,1.4562432303970338,0.49797742034473325,client +3proxy-0.9.9.2,mix-socks,2,1.7720844568,4769.2,34.816,118.784,393.216,5242.88,0,0,0,20.59,8.042478000000001,4.6476340156340115,215.86429589868322,1958.32421875,0.7479286480163758,1.0,0.2811094452773613,1.3048948223103067,0.35205504713084557,client +3proxy-1.0.2,mix-relay,2,1.6692918315999998,4503.35,31.744,118.784,491.52,6029.312,0,0,0,20.36,7.703045999999999,4.8787155402264535,226.0539376242131,1893.140625,0.7399564615080151,1.0,0.26531645569620255,1.294563840771863,0.3305635824466459,client +3proxy-devel-c37,mix-relay,2,1.8470411472000001,5008.35,26.624,86.016,524.288,4980.736,0,0,0,20.42,7.522524000000001,4.422207925569056,203.85955454391166,1394.54296875,0.7696458353772196,1.0,0.2851020922611545,1.3192738003223297,0.35951623564340873,client +3proxy-bp,mix-relay,2,2.238873266,6090.7,98.304,253.952,507.904,3276.8,0,0,0,20.39,5.954074,3.6429038319670575,167.38634311327104,472.43359375,0.838342172461206,1.0,0.3146038977474057,1.3929147050071566,0.39874964451323014,client +nginx,mix-relay,2,2.000385708,5439.1,38.912,155.648,311.296,4456.448,509,0,0,20.64,6.768864000000001,4.127204052189719,189.73727271055873,686.359375,0.7832684824902724,1.0,0.3014246438390402,1.3296376219249113,0.37756477241063496,client +nginx-halfclose,mix-relay,2,1.9782757644000002,5372.05,38.912,163.84,262.144,4718.592,0,0,0,20.38,6.653919,4.12076018252817,189.68550181029588,706.265625,0.7896395509158952,1.0,0.29750818021646114,1.3317264060925433,0.3703186087684284,client +haproxy,mix-relay,2,1.8749882612,5389.35,204.8,327.68,622.592,2621.44,0,9,0,20.39,10.093525,4.349893900018407,189.1693803519905,455.2421875,0.8252656434474617,1.0,0.3009538152610442,1.5207297952622119,0.36249783843814654,client +haproxy-splice-auto,mix-relay,2,2.151355236,5905.5,245.76,393.216,557.056,1245.184,0,0,0,20.9,8.860465,3.8859226315146773,176.9536872407078,419.60546875,0.8354770589364562,1.0,0.31146732429099877,1.420690737582743,0.3869220598551559,client +envoy,mix-relay,2,1.7560518528,4845.4,376.832,425.984,507.904,753.664,0,0,0,20.37,7.984914999999999,4.639954103296056,210.19936434556487,715.60546875,0.7405351833498514,1.0,0.24767178454568337,1.3041023853482874,0.3092077220898419,client +direct,mix-relay,2,3.5100279868000004,9934.5,73.728,180.224,409.6,1966.08,0,4,0,17.78,0.0,2.026194670454415,89.48613417887161,0.0,0.948367722561271,0.8576941630487217,0.8198883815322171,1.456038058367828,0.4935071187543634,client +3proxy-0.9.9.2,mix-relay,2,1.7400852932,4668.7,32.768,102.4,507.904,5505.024,0,0,0,20.46,7.837467,4.703217728453819,219.11881251740314,1917.41796875,0.7500244881966892,1.0,0.2730478589420655,1.301195973559325,0.3404352164834452,client diff --git a/bench/data/results-full7/intel-relay.csv b/bench/data/results-full7/intel-relay.csv new file mode 100644 index 0000000..f3a3639 --- /dev/null +++ b/bench/data/results-full7/intel-relay.csv @@ -0,0 +1,181 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,relay-stream1-down,0,46.08552280693825,nan,nan,nan,nan,nan,0,0,0,6.39,0.0,0.11091733966434261,nan,0.0,0.2614876872302615,0.669109947643979,0.3584528176058686,0.7143152505569662,0.7437768470810827,none +3proxy-0.9.9.2,relay-stream1-down,0,17.253188738816206,nan,nan,nan,nan,nan,0,0,0,10.0,6.696095000000001,0.46363232990696235,nan,5.53515625,0.20004837929366232,0.9505703422053232,0.14049060210258044,0.4680015191243798,0.2813707922367194,proxy +3proxy-1.0.2,relay-stream1-down,0,20.10776161341201,nan,nan,nan,nan,nan,0,0,0,10.01,6.695717,0.3982117250111454,nan,6.3828125,0.22343949044585987,0.999001996007984,0.17054521276595744,0.511563263479741,0.32548681728298845,proxy +3proxy-devel-c37,relay-stream1-down,0,32.12652002961684,nan,nan,nan,nan,nan,0,0,0,9.99,5.274052,0.24873994865521434,nan,11.140625,0.2585542168674699,0.9514285714285714,0.2376425855513308,0.701295223722602,0.5163115686598513,proxy +3proxy-bp,relay-stream1-down,0,31.197971936214053,nan,nan,nan,nan,nan,0,0,0,10.01,5.219402,0.25665578677779033,nan,9.0234375,0.2648101265822785,0.999001996007984,0.23733333333333334,0.6703399212577851,0.5031618176412916,proxy +nginx,relay-stream1-down,0,9.649326057979192,nan,nan,nan,nan,nan,0,0,0,9.99,6.371232,0.828155676411586,nan,32.12109375,0.2,0.9514285714285714,0.0989566866898514,0.44821256493949135,0.1645174009929432,proxy +nginx-halfclose,relay-stream1-down,0,9.749086291881314,nan,nan,nan,nan,nan,0,0,0,10.0,6.469037,0.8205591141183936,nan,34.859375,0.2101628021706956,0.9505703422053232,0.08866371120962635,0.4453239211587376,0.14737815699683463,proxy +haproxy,relay-stream1-down,0,9.390567092377825,nan,nan,nan,nan,nan,0,0,0,10.0,6.448917,0.8518276705465304,nan,32.62109375,0.22497420020639836,0.999000999000999,0.09723609723609723,0.46740575571242887,0.16965994828052286,proxy +haproxy-splice-auto,relay-stream1-down,0,32.446677834298534,nan,nan,nan,nan,nan,0,0,0,10.01,5.305460999999999,0.24677911531341687,nan,43.96484375,0.2823886639676113,0.999001996007984,0.25308025308025306,0.7203385524985568,0.5580534800393582,proxy +envoy,relay-stream1-down,0,18.620934483584048,nan,nan,nan,nan,nan,0,0,0,10.01,7.676879,0.43000776600383156,nan,33.49609375,0.1384214268784072,0.9524262607040913,0.15119949494949494,0.3463807150600652,0.2928952227819361,proxy +direct,relay-stream16,0,144.1715604352099,nan,nan,nan,nan,nan,0,0,3012,8.82,0.0,0.04892931214893385,nan,0.0,0.970757310672332,0.9027635619242579,0.9830508474576272,3.1547105210430106,2.516765101447633,origin +3proxy-0.9.9.2,relay-stream16,0,18.671505221577586,nan,nan,nan,nan,nan,0,0,749,10.05,6.97755,0.42787619999476845,nan,90.4140625,0.13266998341625208,0.9535104364326376,0.26729457616109126,0.3441519442057614,0.47593101066240445,proxy +3proxy-1.0.2,relay-stream16,0,17.6650707918288,nan,nan,nan,nan,nan,0,0,786,10.04,7.021755000000001,0.4527322116975879,nan,90.7109375,0.12930627654554036,0.9552806850618458,0.25665152498377675,0.32319641466451493,0.45307055636866533,proxy +3proxy-devel-c37,relay-stream16,0,29.741924427633332,nan,nan,nan,nan,nan,0,0,689,10.05,5.2057970000000005,0.2697407092165601,nan,94.56640625,0.18047619047619048,0.9517045454545454,0.3408287825248956,0.526620147780804,0.7377472673819634,proxy +3proxy-bp,relay-stream16,0,30.96937805825479,nan,nan,nan,nan,nan,0,0,1249,10.01,5.278244,0.25801105169601113,nan,102.5703125,0.19447779111644659,0.9524262607040913,0.38037591589678243,0.5322326172696766,0.8033676924797942,proxy +nginx,relay-stream16,0,9.23887319864593,nan,nan,nan,nan,nan,0,0,606,10.08,6.634277,0.8661759384925551,nan,107.68359375,0.07373929590865842,0.9581749049429658,0.277321956022317,0.17016883691235143,0.45313089404139245,proxy +nginx-halfclose,relay-stream16,0,9.206718334989503,nan,nan,nan,nan,nan,0,0,807,10.07,6.607422000000001,0.8692425516737852,nan,106.4765625,0.07394198763670946,0.956315289648623,0.285761154855643,0.1730146836325301,0.4614438671581203,proxy +haproxy,relay-stream16,0,9.1302684729293,nan,nan,nan,nan,nan,0,0,1,10.0,6.344079000000001,0.8758747424115445,nan,55.38671875,0.08442330558858502,0.9505703422053232,0.35619777158774374,0.1768303137365692,0.6165505505041627,proxy +haproxy-splice-auto,relay-stream16,0,27.859980064518545,nan,nan,nan,nan,nan,0,0,5,10.0,5.021706,0.2870103238339045,nan,91.37890625,0.21637010676156584,0.9505703422053232,0.5689365984568937,0.5084750784737041,1.1358374993906328,origin +envoy,relay-stream16,0,14.49413075316886,nan,nan,nan,nan,nan,0,0,7505,10.03,8.072345,0.5523199696021415,nan,151.171875,0.1171875,0.9525166191832859,0.16429249762583095,0.281389790164682,0.30868911191639303,proxy +direct,relay-ka-1k,0,1.19378280448,116762.32,0.523,0.584,0.728,0.9,0,0,0,7.76,0.0,5.200275943582672,6.580325336033302,0.0,0.590440251572327,0.7533980582524272,0.9594294770206022,1.687247299879933,0.8371382336744951,origin +3proxy-0.9.9.2,relay-ka-1k,0,0.30928797696,30253.2,1.98,2.25,2.74,3.74,0,0,0,10.09,6.901836,26.09865433289683,33.02166207941563,5.6640625,0.21447527141133896,0.9600380589914367,0.3908120349401488,0.5451505079749489,0.31754014371589806,proxy +3proxy-1.0.2,relay-ka-1k,0,0.31348228095999997,30658.19,1.96,2.23,2.68,3.84,0,0,0,10.1,6.922672,25.774981524493246,32.617892690362545,5.68359375,0.21494197292069633,0.9600760456273765,0.382971835545484,0.5499157758001217,0.34416549450534506,proxy +3proxy-devel-c37,relay-ka-1k,0,0.31440502783999996,30753.86,1.97,2.23,2.62,3.61,0,0,0,10.11,6.915068,25.72477945268727,32.55053220603102,6.6953125,0.2078583555663352,0.9610266159695817,0.3840696549500161,0.5423078799705032,0.31945906183564615,proxy +3proxy-bp,relay-ka-1k,0,0.44350570495999997,43378.13,0.219,16.33,27.84,36.28,0,0,0,10.1,6.430293,18.218480415553483,23.053781504932598,4.76953125,0.25866276232308444,0.9600760456273765,0.48538961038961037,0.687896124951813,0.4136195117757819,proxy +nginx,relay-ka-1k,0,0.47588573184,46548.21,1.29,1.46,1.69,1.85,0,0,0,10.1,5.870917,16.97886584823396,21.484196352791777,31.453125,0.28495532480077274,0.9600760456273765,0.5157152020525978,0.7430079088261022,0.4373227669995702,proxy +nginx-halfclose,relay-ka-1k,0,0.45558530048,44562.7,1.38,1.5,1.73,1.9,0,0,0,10.12,5.858977,17.770547011657612,22.486040657072326,33.4453125,0.27884615384615385,0.9601518026565465,0.5095785440613027,0.7173399495292919,0.4438181603957417,proxy +haproxy,relay-ka-1k,0,0.47278194687999997,46242.51,1.32,1.41,1.6,1.99,0,0,0,10.09,6.0431479999999995,17.07340995837307,21.603960226445473,30.9921875,0.2835063994204298,0.9600380589914367,0.5172855313700384,0.7401665036857163,0.4685215458788465,proxy +haproxy-splice-auto,relay-ka-1k,0,0.47429189632,46386.29,1.32,1.42,1.58,1.88,0,0,0,10.1,6.063939,17.03592252512049,21.55784225209015,41.32421875,0.2861271676300578,0.9600760456273765,0.523748804590373,0.7400874705102961,0.4667226028838534,proxy +envoy,relay-ka-1k,0,0.36498833408,35702.09,1.63,2.07,2.31,3.29,0,0,0,10.09,7.019196999999999,22.115775344838113,27.981918522421587,23.6171875,0.22640598600048273,0.9591254752851711,0.41592071611253195,0.5926956634084697,0.3877028687695426,proxy +direct,relay-ka-50k-2000,0,36.16362463232,87792.51,20.8,23.16,26.96,33.45,0,0,0,8.75,0.0,0.19356466812079423,9.90167355257336,0.0,0.8856801909307875,0.8637709772951628,0.9455351488283724,2.925182099447694,0.7578209988071816,origin +3proxy-0.9.9.2,relay-ka-50k-2000,0,5.8191773696,14136.22,33.06,39.74,46.89,78.26,0,265,0,10.4,7.126417,1.4297553539894767,73.12511425799103,106.83984375,0.22620755619320898,0.9904761904761905,0.28634500157678966,0.6250252423844336,0.1882160846488994,proxy +3proxy-1.0.2,relay-ka-50k-2000,0,6.17594486784,15002.97,26.8,30.84,35.21,56.13,0,187,0,10.39,7.2721860000000005,1.3458669366177605,68.89189475917675,77.66796875,0.24343675417661098,0.9885823025689819,0.30105129021981525,0.6716370002168796,0.21390115529530807,proxy +3proxy-devel-c37,relay-ka-50k-2000,0,7.0640467968000005,17160.39,21.26,25.34,30.0,51.44,0,183,0,10.37,6.86699,1.1743976559948714,60.045280047248745,53.19140625,0.2552220888355342,0.9857414448669202,0.32857142857142857,0.7230407135705702,0.23282060686298053,proxy +3proxy-bp,relay-ka-50k-2000,0,8.76173328384,21320.52,91.18,96.99,130.21,825.97,0,0,0,10.2,5.5296400000000006,0.9313225746154785,47.57063306252274,119.5,0.3098224852071006,0.9695817490494296,0.38764044943820225,0.8476111724438726,0.254770560901245,proxy +nginx,relay-ka-50k-2000,0,5.20613789696,12647.08,71.88,79.42,85.15,104.54,0,320,0,10.22,6.0228150000000005,1.5704539837053069,80.3092929324679,108.91015625,0.24603362538479753,0.9714828897338403,0.24455664247396655,0.5784467935533908,0.15876746635033853,proxy +nginx-halfclose,relay-ka-50k-2000,0,4.8985276416,11899.82,78.89,84.5,90.04,93.87,0,292,0,10.28,6.0700210000000006,1.67887181653502,85.87132666187748,117.7109375,0.23395690267582286,0.9771863117870723,0.22962728995578016,0.5432250044116733,0.1521150630416655,proxy +haproxy,relay-ka-50k-2000,0,4.1657827328,10034.84,189.49,194.83,214.94,1040.0,0,0,0,10.17,6.471483,1.9530543290075637,100.61437093758347,159.92578125,0.26351189046360796,0.9658119658119658,0.19893316598682145,0.5860641038390153,0.12549575478828615,proxy +haproxy-splice-auto,relay-ka-50k-2000,0,7.90273982464,19224.07,91.93,95.35,105.64,744.28,0,751,0,10.22,5.9837240000000005,1.034577903540238,52.80125648391163,132.4140625,0.2767370168366137,0.969639468690702,0.35633978763272955,0.7572829507802349,0.24238736802514876,proxy +envoy,relay-ka-50k-2000,0,5.01655535616,12186.43,156.35,169.46,192.65,368.08,0,0,0,10.2,7.111114000000001,1.6266141646339167,83.16957624285516,274.0625,0.1870092790863669,0.9714285714285714,0.21799746514575413,0.5099429989946977,0.1464057404617332,proxy +direct,relay-ka-2k-50k-2000,0,26.45699854336,64175.65,29.12,31.88,39.5,41.7,0,0,0,8.75,0.0,0.26458027687939734,13.556076453172665,0.0,0.7815206929740135,0.8595284872298625,0.9543870763382959,2.445924646682522,0.784643332616067,origin +3proxy-0.9.9.2,relay-ka-2k-50k-2000,0,5.7348718592,13931.54,32.38,41.16,46.79,74.59,0,218,0,10.41,6.876463,1.4521684537100947,74.23147956673346,111.71484375,0.2224343675417661,0.9895437262357415,0.3367120684193855,0.5889261537145896,0.24338664412222388,proxy +3proxy-1.0.2,relay-ka-2k-50k-2000,0,5.54579263488,13472.16,26.23,31.72,36.49,53.19,0,244,0,10.4,6.916156999999999,1.5002364040212672,76.73747666516635,88.4609375,0.22680658239923682,0.9895337773549001,0.34052681688352904,0.5945646632391681,0.24897304104508047,proxy +3proxy-devel-c37,relay-ka-2k-50k-2000,0,6.3615008768,15453.7,27.56,31.49,35.47,51.16,0,208,0,10.38,6.475613,1.3053523312846147,66.78505250154416,59.453125,0.2436233611442193,0.9848197343453511,0.3671451355661882,0.6450187552391337,0.26712669717101223,proxy +3proxy-bp,relay-ka-2k-50k-2000,0,8.24633720832,20035.24,95.66,97.84,138.46,826.25,0,0,0,10.19,5.363293,0.9885601078470547,50.56243890578714,112.03125,0.2995961035875505,0.9695528068506185,0.4532739987285442,0.8115388831106479,0.31375856799255314,proxy +nginx,relay-ka-2k-50k-2000,0,5.03475863552,12230.65,62.53,71.67,76.97,89.8,0,386,0,10.2,5.934535,1.6207331057404735,82.99497961740941,102.1953125,0.24667931688804554,0.9695817490494296,0.28353948620361563,0.5812861779073578,0.21391585616004338,proxy +nginx-halfclose,relay-ka-2k-50k-2000,0,5.028383293439999,12215.23,75.98,84.71,91.24,113.61,0,300,0,10.24,5.990629,1.6291518609345546,83.31570468488113,110.5390625,0.25194437897713884,0.9743101807802094,0.2793509385937003,0.5822228743498057,0.2034520706127772,proxy +haproxy,relay-ka-2k-50k-2000,0,3.75969021952,9070.84,208.26,230.43,261.77,959.87,0,0,0,10.18,6.330201,2.166135911335734,111.32374651429821,147.4921875,0.24700239808153476,0.967680608365019,0.23322884012539186,0.5422671528567296,0.1530492516681668,proxy +haproxy-splice-auto,relay-ka-2k-50k-2000,0,7.47324309504,18094.73,98.6,109.74,115.44,742.83,0,751,0,10.21,5.82205,1.0929659180257516,56.12048590117078,130.16015625,0.2696869070208729,0.9696106362773029,0.41109350237717907,0.7240038247705268,0.2994839025384074,proxy +envoy,relay-ka-2k-50k-2000,0,4.90205085696,11908.31,157.96,174.75,200.15,383.44,0,0,0,10.21,6.975783,1.6662413831147755,85.18839902546473,295.453125,0.1880362249761678,0.9714557564224549,0.2654811051127342,0.5127980183171292,0.1901373252749782,proxy +direct,relay-close-1k,0,0.47798288384,46931.32,0.8180000000000001,2.26,3.38,4.37,0,0,0,8.48,0.0,14.192976839461217,17.889880192653756,0.0,0.7586122648424138,0.8609137055837564,0.8721417069243156,2.069677131197196,0.5512668574337951,client +3proxy-0.9.9.2,relay-close-1k,0,0.05419040768,5318.25,11.66,13.22,15.68,19.11,0,0,0,10.0,6.784491,147.62760315886223,187.76521837094896,12.42578125,0.14580859653289005,0.9514747859181731,0.17277653809372012,0.3082493220329295,0.0874352497573855,proxy +3proxy-1.0.2,relay-close-1k,0,0.04924112896,4833.75,12.38,15.45,18.2,22.76,0,0,0,10.0,6.8155779999999995,162.46581199425043,206.57742521897208,20.75,0.15244623020562514,0.9523809523809523,0.18222363810130615,0.31013908822163894,0.09126738696272743,proxy +3proxy-devel-c37,relay-close-1k,0,0.06190792704,6079.64,9.93,11.33,13.06,18.68,0,0,0,10.01,6.408297,129.3533862767827,164.45152704989403,8.15234375,0.18412322274881518,0.9515209125475285,0.21303098051740657,0.38339357319497486,0.10928652677784652,proxy +3proxy-bp,relay-close-1k,0,0.06853492736,6730.68,8.85,11.56,14.56,20.71,0,0,0,9.99,6.302159,116.61207369520731,148.26798064650183,6.49609375,0.19056603773584907,0.950523311132255,0.21842021106491846,0.4014644018613562,0.11122808141284225,proxy +nginx,relay-close-1k,0,0.0805306368,7910.52,7.88,8.48,9.32,10.91,0,0,0,10.01,5.325955,99.44041570027669,126.41921673128654,32.45703125,0.22240762812872467,0.9524262607040913,0.25200900032144,0.46426705769232035,0.1302501317700467,proxy +nginx-halfclose,relay-close-1k,0,0.08304721920000001,8158.24,7.46,7.82,8.81,11.75,0,0,0,10.02,5.556794,96.5234005089962,122.68286113083722,31.8125,0.21848939718846797,0.9524714828897338,0.2488702388637831,0.4575919826217314,0.13119189382380086,proxy +haproxy,relay-close-1k,0,0.08573157376,8416.12,7.08,7.83,9.05,10.41,0,0,0,10.02,5.743843,93.50114139325464,118.91622458788764,29.38671875,0.21226527216543856,0.9524714828897338,0.2759709504262709,0.46328225325675265,0.14063831881703198,proxy +haproxy-splice-auto,relay-close-1k,0,0.090177536,8855.67,6.92,7.11,7.89,9.85,0,0,0,10.09,5.817404000000001,89.51231490734011,112.81558174377781,35.59765625,0.216945107398568,0.960952380952381,0.286300505050505,0.47948291411801475,0.1473601045206922,proxy +envoy,relay-close-1k,0,0.05007998976,4916.25,12.27,14.03,16.59,18.23,0,0,0,10.0,7.176284,159.74444160908712,203.24377057843176,24.02734375,0.13382283278067267,0.9505703422053232,0.16873607131486787,0.2873271287044627,0.08366272524213596,proxy +3proxy-0.9.9.2,relay-stream1-down,1,18.358301535576924,nan,nan,nan,nan,nan,0,0,0,10.0,6.827237,0.4357238862601872,nan,11.42578125,0.2026602176541717,0.9505703422053232,0.15621039290240812,0.48135982429958285,0.3251216426298269,proxy +3proxy-1.0.2,relay-stream1-down,1,19.388761676652454,nan,nan,nan,nan,nan,0,0,0,10.0,6.892227999999999,0.4125669612680816,nan,8.3203125,0.21913265306122448,0.998003992015968,0.16983016983016982,0.497568864220801,0.34945208983936055,proxy +3proxy-devel-c37,relay-stream1-down,1,29.549898234909215,nan,nan,nan,nan,nan,0,0,0,9.97,5.291356,0.2698873952475252,nan,12.76953125,0.27247404406178777,0.996003996003996,0.24815807099799062,0.7101926504191248,0.5599756419395577,proxy +3proxy-bp,relay-stream1-down,1,30.535642343391146,nan,nan,nan,nan,nan,0,0,0,9.99,5.2380260000000005,0.2616986951304671,nan,12.3515625,0.26390561040211896,0.9514285714285714,0.24492385786802032,0.7165251903913585,0.5315503783614988,proxy +nginx,relay-stream1-down,1,9.22270709674065,nan,nan,nan,nan,nan,0,0,0,9.99,6.4719430000000004,0.8664641372287243,nan,32.4921875,0.20619354838709678,0.999,0.09619238476953908,0.44360602940094035,0.17671365530802358,proxy +nginx-halfclose,relay-stream1-down,1,9.958840511253651,nan,nan,nan,nan,nan,0,0,0,10.0,6.489545,0.80322098555035,nan,33.3671875,0.1968810916179337,0.9505703422053232,0.09749126706891076,0.4586468983751098,0.17020527386681716,proxy +haproxy,relay-stream1-down,1,9.61431986735803,nan,nan,nan,nan,nan,0,0,0,10.02,6.497466999999999,0.833668122914372,nan,30.49609375,0.22628865979381443,0.9990029910269193,0.09371884346959122,0.4695842118630369,0.15774026641798913,proxy +haproxy-splice-auto,relay-stream1-down,1,29.52996266302119,nan,nan,nan,nan,nan,0,0,0,9.99,5.254994,0.2706112244530002,nan,41.1953125,0.27021546261089985,0.998001998001998,0.19797979797979798,0.6903992118636653,0.45029244580428174,proxy +envoy,relay-stream1-down,1,19.154133597411164,nan,nan,nan,nan,nan,0,0,0,10.01,7.694438,0.4180364296385778,nan,32.45703125,0.13658881811748053,0.9515209125475285,0.15155358275206088,0.34445489229730547,0.30130739727976913,proxy +direct,relay-stream1-down,1,42.565563728575654,nan,nan,nan,nan,nan,0,0,0,6.29,0.0,0.11820506330745972,nan,0.0,0.25388337153043034,0.6558915537017727,0.35881174899866486,0.7143357533680711,0.7497938025704708,none +3proxy-0.9.9.2,relay-stream16,1,18.538698612890133,nan,nan,nan,nan,nan,0,0,753,10.04,6.956393,0.4308331660624996,nan,93.37890625,0.13972667295004712,0.952561669829222,0.26880674448767833,0.34789428578835946,0.4813531285556605,proxy +3proxy-1.0.2,relay-stream16,1,18.052604673029933,nan,nan,nan,nan,nan,0,0,779,10.04,7.012098,0.4434538918084558,nan,91.58203125,0.13598868724958757,0.9534662867996201,0.2606158833063209,0.33458153880969743,0.4606491636944035,proxy +3proxy-devel-c37,relay-stream16,1,30.719278924969068,nan,nan,nan,nan,nan,0,0,720,10.02,5.1969389999999995,0.2603427798960795,nan,98.8046875,0.19457659372026642,0.9515669515669516,0.35439384220654263,0.5729851581396839,0.7737190133973828,proxy +3proxy-bp,relay-stream16,1,30.220746843297643,nan,nan,nan,nan,nan,0,0,1294,10.03,5.332505,0.2645807115908399,nan,104.8125,0.21370775821037602,0.9534220532319392,0.3915259636827015,0.5683003431924466,0.827114951026245,proxy +nginx,relay-stream16,1,9.385846597857537,nan,nan,nan,nan,nan,0,0,517,10.08,6.63041,0.8533922596986107,nan,110.64453125,0.07727056585829767,0.9572649572649573,0.2875816993464052,0.18245946250898923,0.4671952031067657,proxy +nginx-halfclose,relay-stream16,1,9.623661382998325,nan,nan,nan,nan,nan,0,0,685,10.06,6.641259,0.8306911519495103,nan,104.56640625,0.07798383262006657,0.9571836346336822,0.2871157619359058,0.18062656551623096,0.4664091637999482,proxy +haproxy,relay-stream16,1,8.777461469391476,nan,nan,nan,nan,nan,0,0,1,10.02,6.349126,0.9127508322363708,nan,53.78125,0.09028436018957346,0.9515669515669516,0.36752433936022255,0.17679885560134526,0.6182853886558458,proxy +haproxy-splice-auto,relay-stream16,1,29.58524300511233,nan,nan,nan,nan,nan,0,0,3,10.03,5.012560000000001,0.271026928670124,nan,122.0390625,0.23611770289511153,0.9516129032258065,0.6176273458445041,0.5682943170971413,1.224003361898087,origin +envoy,relay-stream16,1,13.009923594040899,nan,nan,nan,nan,nan,0,0,6740,10.05,8.040831,0.6162875460279106,nan,150.8125,0.11413686952403504,0.9544159544159544,0.1602908631046475,0.2718532605889931,0.29823778914830595,proxy +direct,relay-stream16,1,128.02708282882625,nan,nan,nan,nan,nan,0,0,3270,8.77,0.0,0.05476006491601616,nan,0.0,0.9635728542914171,0.8822937625754527,0.9811383189940437,3.1115683276159554,2.5353389963537123,origin +3proxy-0.9.9.2,relay-ka-1k,1,0.30500978688,29835.69,2.02,2.31,2.73,4.03,0,0,0,10.11,6.913953,26.51718190007477,33.55069938772463,5.60546875,0.2112914950327114,0.9610266159695817,0.39021249195106245,0.5470292547747188,0.3165788403245484,proxy +3proxy-1.0.2,relay-ka-1k,1,0.3112173568,30440.25,1.99,2.26,2.64,3.71,0,0,0,10.1,6.918138,25.96256225256907,32.85140431621916,5.56640625,0.2106537530266344,0.9600760456273765,0.3896229455365775,0.5432219856615743,0.3279657297445757,proxy +3proxy-devel-c37,relay-ka-1k,1,0.2994733056,29294.88,2.06,2.39,2.79,4.1,0,0,0,10.12,6.911041,27.034129081320028,34.204442521665065,6.56640625,0.20991535671100361,0.9601518026565465,0.377498388136686,0.5337052093928125,0.322258099565528,proxy +3proxy-bp,relay-ka-1k,1,0.42328915968,41401.66,0.248,15.61,27.47,37.13,0,0,0,10.09,6.402026,19.06970640614162,24.131251046325307,4.6875,0.26200341213746037,0.9591254752851711,0.4839650145772595,0.6915817894516222,0.4591660084456132,proxy +nginx,relay-ka-1k,1,0.49333403648,48248.55,1.27,1.34,1.56,1.87,0,0,0,10.09,5.859526,16.36213884124989,20.70571818470978,31.4765625,0.29376062151007526,0.960952380952381,0.5385109114249037,0.7734200811563158,0.5418207491033539,proxy +nginx-halfclose,relay-ka-1k,1,0.5024776192,49143.92,1.24,1.31,1.52,1.85,0,0,0,10.1,5.866208,16.080318189821575,20.34809342393943,31.5390625,0.29713313896987364,0.9600760456273765,0.5467139175257731,0.7829722946870576,0.4638986083837394,proxy +haproxy,relay-ka-1k,1,0.46028292095999995,45021.0,1.35,1.47,1.71,1.96,0,0,0,10.1,6.074312,17.554420622750367,22.213180553570055,28.96875,0.27158098933074687,0.9600760456273765,0.514790996784566,0.7172574804502015,0.48835758918456706,proxy +haproxy-splice-auto,relay-ka-1k,1,0.47580184576,46538.07,1.3,1.39,1.65,1.91,0,0,0,10.11,6.0637110000000005,16.998673023390666,21.50949417584171,35.078125,0.2836433921237014,0.9610266159695817,0.51744,0.7391884739577008,0.5029271668372189,proxy +envoy,relay-ka-1k,1,0.35626418175999996,34844.66,1.71,2.09,2.35,3.1,0,0,0,10.09,7.024484,22.657343660322727,28.673814754084386,23.4609375,0.22843373493975905,0.9591254752851711,0.4208506555804285,0.5917601981019539,0.35842896553706366,proxy +direct,relay-ka-1k,1,1.26634426368,123860.51,0.537,0.611,0.747,0.92,0,0,0,8.0,0.0,5.053917945979067,6.394991442702076,0.0,0.5880574452003023,0.7889546351084813,0.9594808483697372,1.6906986343910977,0.8446686236396,origin +3proxy-0.9.9.2,relay-ka-50k-2000,1,6.0456697856,14686.45,29.99,36.69,45.02,68.11,0,258,0,10.49,7.24883,1.3881009545027838,70.98581637072326,104.40625,0.23264137437365784,0.9962013295346629,0.291151284490961,0.6421628838178721,0.20050612928132175,proxy +3proxy-1.0.2,relay-ka-50k-2000,1,5.74510596096,13956.4,27.72,33.12,37.71,56.42,0,204,0,10.49,7.227739000000001,1.4607215353427019,74.67999373513875,76.11328125,0.2215583173996176,0.9952561669829222,0.28186429930247303,0.6127265363612208,0.19395252168897395,proxy +3proxy-devel-c37,relay-ka-50k-2000,1,7.47324309504,18194.09,23.63,27.99,32.26,49.82,0,243,0,10.34,6.852678,1.1068822323590861,56.47711693603448,61.38671875,0.2624760076775432,0.9819563152896487,0.3368320610687023,0.7468345186747267,0.2291277646376403,proxy +3proxy-bp,relay-ka-50k-2000,1,8.67583393792,21121.53,91.65,96.7,126.16,809.84,0,0,0,10.19,5.528262000000001,0.9396214886467056,47.89411593290124,119.7734375,0.3125295508274232,0.9686311787072244,0.3938730853391685,0.8504993412199139,0.25846913548249056,proxy +nginx,relay-ka-50k-2000,1,5.03417143296,12229.41,58.77,69.09,74.68,90.72,0,381,0,10.22,5.997541,1.6241004321922077,83.10902570524757,96.58203125,0.2450817729319744,0.9705603038936372,0.24304677623261695,0.5727041028017709,0.15781184809533483,proxy +nginx-halfclose,relay-ka-50k-2000,1,4.9400512512,12000.66,73.11,84.14,89.37,103.68,0,317,0,10.31,6.081633999999999,1.6696183056798164,85.20942841085656,109.265625,0.23423423423423423,0.9800380228136882,0.23763000315159155,0.5451530182213513,0.1530671422529024,proxy +haproxy,relay-ka-50k-2000,1,3.97435469824,9571.97,201.69,220.26,232.91,1150.0,0,0,0,10.16,6.453831,2.045111877809849,105.63526720731961,150.7265625,0.2533686236766121,0.9657794676806084,0.19435736677115986,0.5679722488339555,0.12264211907653864,proxy +haproxy-splice-auto,relay-ka-50k-2000,1,8.074538516479999,19530.52,88.46,101.44,105.78,804.67,0,807,0,10.17,5.967601999999999,1.007611764238236,51.79579114633202,123.90625,0.27943969610636277,0.9667300380228137,0.3623824451410658,0.7668191841742517,0.23483765718587174,proxy +envoy,relay-ka-50k-2000,1,5.14968256512,12509.9,146.99,166.55,191.99,384.87,0,0,0,10.22,7.1728559999999995,1.5876706761263217,81.17876007784265,300.3359375,0.189873417721519,0.9705603038936372,0.22112944162436549,0.5270868286817494,0.1492098096224014,proxy +direct,relay-ka-50k-2000,1,35.82002724864,86946.35,21.03,23.87,27.71,37.41,0,0,0,8.72,0.0,0.1947513873056828,9.987618560019058,0.0,0.8769708552317248,0.8711288711288712,0.9471853257432005,2.8772123910750556,0.7555469765954793,origin +3proxy-0.9.9.2,relay-ka-2k-50k-2000,1,5.363004866560001,13028.18,34.63,41.16,47.35,459.99,0,189,0,10.4,6.80941,1.5513690938223423,79.37174213342085,101.828125,0.2126999283838625,0.9904761904761905,0.32147395171537485,0.5603651325597528,0.2262613349183767,proxy +3proxy-1.0.2,relay-ka-2k-50k-2000,1,5.64788199424,13720.13,26.96,33.45,39.24,62.39,0,259,0,10.44,6.920395,1.4787844378685318,75.66752674455687,82.140625,0.22855100095328884,0.9914529914529915,0.346031746031746,0.5993509917158414,0.24812426597182746,proxy +3proxy-devel-c37,relay-ka-2k-50k-2000,1,6.4553694003199995,15681.85,24.16,28.27,32.66,49.56,0,176,0,10.41,6.507404,1.2900888366802328,65.97627135831263,54.1015625,0.24522445081184335,0.9886039886039886,0.37133757961783437,0.6564295669526936,0.2737896312712136,proxy +3proxy-bp,relay-ka-2k-50k-2000,1,7.64504178688,18481.3,96.67,119.67,143.2,918.51,0,0,0,10.19,5.348400000000001,1.066312026441767,54.77316706084713,116.05859375,0.28900498693896937,0.9686311787072244,0.44472600570161547,0.7772695604540797,0.31182893119623883,proxy +nginx,relay-ka-2k-50k-2000,1,4.84601495552,11772.13,74.76,83.02,91.8,114.46,0,316,0,10.22,5.967975,1.687159465054246,86.26583720910602,109.24609375,0.24769558024107777,0.972407231208373,0.27889207258834764,0.5784399838907438,0.19671413030241064,proxy +nginx-halfclose,relay-ka-2k-50k-2000,1,4.64259121152,11278.04,64.67,78.7,84.08,89.91,0,353,0,10.32,6.007,1.778317242214603,90.97640960541626,100.640625,0.24314744801512286,0.9809885931558935,0.27710843373493976,0.5593978877731933,0.19773929096334525,proxy +haproxy,relay-ka-2k-50k-2000,1,3.7889664614400003,9111.14,202.49,225.81,249.69,1160.0,0,0,0,10.17,6.372453,2.147287415393987,110.85918594257559,153.546875,0.24268585131894485,0.9667300380228137,0.22872340425531915,0.536533752667742,0.15204375436119325,proxy +haproxy-splice-auto,relay-ka-2k-50k-2000,1,7.3014444032,17812.31,98.41,106.44,116.86,714.85,0,739,0,10.19,5.834748,1.1164914159213795,56.85781083478872,125.9140625,0.2684547828150961,0.9695528068506185,0.41330390920554855,0.7201233760506224,0.2899264123428985,proxy +envoy,relay-ka-2k-50k-2000,1,4.9564090368,12040.5,158.4,169.74,192.01,384.9,0,0,0,10.28,7.082566,1.6592657988755604,84.84858489398054,297.27734375,0.1899761336515513,0.9771863117870723,0.2748890298034242,0.5194160604801534,0.2034426449625169,proxy +direct,relay-ka-2k-50k-2000,1,24.56721293312,59602.69,31.97,35.57,40.17,63.58,0,0,0,8.7,0.0,0.28330441955086233,14.497607894697374,0.0,0.7308897998553171,0.8504398826979472,0.946417247939125,2.256268054640356,0.7715081044740868,origin +3proxy-0.9.9.2,relay-close-1k,1,0.05402263552,5307.29,11.63,13.3,15.78,19.78,0,0,0,10.01,6.773419,148.23416005010188,188.39161365603945,14.078125,0.15281058101086442,0.9524262607040913,0.17438518045352921,0.3120584862651951,0.09031897380166654,proxy +3proxy-1.0.2,relay-close-1k,1,0.051254394880000005,5035.63,12.07,14.58,17.04,21.14,0,0,0,10.01,6.817902999999999,156.24026034740692,198.3356449375867,13.2734375,0.1450580706328514,0.9524262607040913,0.17373286579534586,0.3015964692013489,0.08742133809783245,proxy +3proxy-devel-c37,relay-close-1k,1,0.062411243520000007,6127.51,9.54,11.64,13.83,19.71,0,0,0,10.01,6.397772,128.31021380680863,163.135593220339,10.9140625,0.17208639924044625,0.9524262607040913,0.2007031000319591,0.360585263523695,0.10267493294796382,proxy +3proxy-bp,relay-close-1k,1,0.0725614592,7122.63,8.35,10.86,13.69,19.82,0,0,0,10.0,6.302203,110.25136605852602,140.1698859017129,6.296875,0.18884424485937132,0.9505703422053232,0.22264752791068582,0.4052750739885211,0.11313279579472053,proxy +nginx,relay-close-1k,1,0.08489271295999999,8332.0,7.29,7.8,8.78,10.67,0,0,0,10.03,5.313092999999999,94.51930230785264,120.24216268057305,31.8828125,0.22727272727272727,0.9516129032258065,0.2570048309178744,0.47469881214484194,0.13404011211288658,proxy +nginx-halfclose,relay-close-1k,1,0.08363442176000001,8212.62,7.32,8.02,9.02,10.6,0,0,0,10.01,5.537657,95.7500492199254,121.6740205909881,32.1171875,0.21228783169973703,0.9524262607040913,0.24387096774193548,0.4518695745106286,0.12642812791477334,proxy +haproxy,relay-close-1k,1,0.08757706752,8597.3,7.11,7.36,8.12,10.85,0,0,0,10.01,5.758019,91.4394627128981,116.28447294440186,29.1328125,0.2045077105575326,0.9524262607040913,0.2722380500158278,0.4423926526873393,0.13880895001271082,proxy +haproxy-splice-auto,relay-close-1k,1,0.08237613056,8089.11,7.54,8.31,9.25,10.64,0,0,0,9.99,5.761597,97.01839532483133,123.3927446548338,35.6796875,0.19696969696969696,0.9496197718631179,0.25602027883396705,0.42240957673211216,0.13120558844355976,proxy +envoy,relay-close-1k,1,0.05402263552,5307.1,11.68,12.38,13.25,16.65,0,0,0,9.99,7.157542,147.93798790214964,187.9091114287864,24.1953125,0.13955135773317592,0.9496197718631179,0.17568427753023552,0.29875560774369614,0.086521843405939,proxy +direct,relay-close-1k,1,0.46120566784,45288.33,0.96,2.46,3.63,4.58,0,0,0,8.39,0.0,14.553160266730519,18.34300768482384,0.0,0.6823876197494473,0.8509127789046653,0.8610397946084724,1.853238869102974,0.5498374830274468,client +3proxy-1.0.2,relay-stream1-down,2,19.745119552287235,nan,nan,nan,nan,nan,0,0,0,10.01,6.786671999999999,0.4055257920276359,nan,6.94921875,0.200872304337291,0.9506172839506173,0.16835443037974684,0.48054958962142386,0.34516555012234584,proxy +3proxy-devel-c37,relay-stream1-down,2,33.3770401329459,nan,nan,nan,nan,nan,0,0,0,9.96,5.224653,0.2387016778535349,nan,12.91796875,0.2752822483785731,0.9467680608365019,0.27527018436109346,0.7774032392550587,0.639923813978375,proxy +3proxy-bp,relay-stream1-down,2,31.78590574854353,nan,nan,nan,nan,nan,0,0,0,9.82,5.189223,0.24712749548720833,nan,13.203125,0.28575031525851197,0.9800399201596807,0.2897196261682243,0.7732899117243275,0.6728755738979696,proxy +nginx,relay-stream1-down,2,9.28659415193919,nan,nan,nan,nan,nan,0,0,0,10.01,6.474259,0.8622682796216792,nan,36.04296875,0.205078125,0.9515209125475285,0.09375989863794743,0.4396265486578297,0.16641990979263988,proxy +nginx-halfclose,relay-stream1-down,2,9.078485226175351,nan,nan,nan,nan,nan,0,0,1,10.0,6.376659,0.8811043586656504,nan,32.53515625,0.21199407699901282,0.9505703422053232,0.09430379746835443,0.4614926897110213,0.1539766609794236,proxy +haproxy,relay-stream1-down,2,9.09280788524101,nan,nan,nan,nan,nan,0,0,0,9.98,6.461757,0.8779631873378496,nan,30.90234375,0.22716627634660422,0.998998998998999,0.09015302727877578,0.4546164871415012,0.15576525493230176,proxy +haproxy-splice-auto,relay-stream1-down,2,31.519447414494923,nan,nan,nan,nan,nan,0,0,0,10.0,5.370067000000001,0.2537835892853579,nan,44.19140625,0.275512788047607,0.998003992015968,0.2524174724908303,0.706341233816518,0.5590617001442515,proxy +envoy,relay-stream1-down,2,18.470400875427906,nan,nan,nan,nan,nan,0,0,0,10.01,7.6667380000000005,0.4335129324490111,nan,33.28125,0.13282911841172299,0.9515209125475285,0.15101522842639595,0.3358852597143875,0.3080828633268731,proxy +direct,relay-stream1-down,2,46.45044406364044,nan,nan,nan,nan,nan,0,0,0,6.41,0.0,0.11038549937659836,nan,0.0,0.259720457433291,0.6712041884816754,0.35857238158772514,0.7083702818315417,0.7428044265739066,none +3proxy-0.9.9.2,relay-stream1-down,2,19.68887259056022,nan,nan,nan,nan,nan,0,0,1,10.0,6.7065719999999995,0.4062770001943681,nan,8.578125,0.20208131655372702,0.9514747859181731,0.15343245808288516,0.4786606816126939,0.31287316172060986,proxy +3proxy-1.0.2,relay-stream16,2,18.760516487940244,nan,nan,nan,nan,nan,0,0,677,10.07,7.032341,0.42820200049987456,nan,94.4765625,0.13123669898321116,0.9535984848484849,0.2654781199351702,0.3327074999581284,0.4663709706384227,proxy +3proxy-devel-c37,relay-stream16,2,30.218911345283633,nan,nan,nan,nan,nan,0,0,718,10.02,5.1999889999999995,0.2648085920450766,nan,91.53515625,0.18575851393188855,0.9524714828897338,0.34712864934231635,0.541787609078868,0.745495241823194,proxy +3proxy-bp,relay-stream16,2,31.650363411212016,nan,nan,nan,nan,nan,0,0,1291,10.0,5.287618,0.2526666069861403,nan,105.55078125,0.2077144226161955,0.9505703422053232,0.39246968730057435,0.5645417898293831,0.8315571462519832,proxy +nginx,relay-stream16,2,9.441491411399214,nan,nan,nan,nan,nan,0,0,438,10.09,6.642548,0.8478225381650752,nan,112.7734375,0.07202281911100547,0.9582146248812915,0.28103504749426794,0.17103861363373826,0.45576202014858547,proxy +nginx-halfclose,relay-stream16,2,9.701761722828984,nan,nan,nan,nan,nan,0,0,707,10.08,6.607215,0.8258268209591513,nan,107.484375,0.07239819004524888,0.9563567362428842,0.2815565729234794,0.17677860809478413,0.4587053711863393,proxy +haproxy,relay-stream16,2,9.158458969492068,nan,nan,nan,nan,nan,0,0,0,10.0,6.282291,0.873138229008114,nan,37.21875,0.09037001897533206,0.9505703422053232,0.3834849545136459,0.17864317898159118,0.6446354152767234,proxy +haproxy-splice-auto,relay-stream16,2,30.01123197891332,nan,nan,nan,nan,nan,0,0,11,10.03,4.961291999999999,0.2671877093600843,nan,100.95703125,0.22507122507122507,0.9507109004739337,0.5963611859838275,0.5426905682642973,1.1747537664047878,origin +envoy,relay-stream16,2,15.054114477813464,nan,nan,nan,nan,nan,0,0,7613,10.03,8.089846,0.5318295535940779,nan,146.54296875,0.1177167219327333,0.9534220532319392,0.16850741558851373,0.2823484498488731,0.31442327558383243,proxy +direct,relay-stream16,2,149.5872616070508,nan,nan,nan,nan,nan,0,0,1980,8.87,0.0,0.047423408357583095,nan,0.0,0.9820448877805487,0.922037422037422,0.9752921535893155,3.2094375009128484,2.4851378522260887,origin +3proxy-0.9.9.2,relay-stream16,2,19.56968427890754,nan,nan,nan,nan,nan,0,0,744,10.03,6.941142,0.40752621315218024,nan,89.84375,0.12989788648777012,0.9534220532319392,0.27337431252022,0.3431065168912479,0.4853008878199672,proxy +3proxy-1.0.2,relay-ka-1k,2,0.30047993856,29387.69,2.01,2.38,2.89,4.26,0,0,0,10.1,6.912141,26.890314337529663,34.02884702854043,5.6015625,0.20911722141823444,0.9600760456273765,0.3790660225442834,0.5327707327956382,0.2966090843479766,proxy +3proxy-devel-c37,relay-ka-1k,2,0.31398559744,30713.5,1.98,2.23,2.62,3.65,0,0,0,10.1,6.894594,25.733664428808776,32.558904215572184,6.71875,0.21133896260554885,0.9600760456273765,0.3795667636598771,0.5403542639038271,0.2994700952805786,proxy +3proxy-bp,relay-ka-1k,2,0.42345693184,41417.83,0.25,16.69,27.96,36.23,0,0,0,10.1,6.421943,19.081043176907936,24.14546567279786,4.79296875,0.2654246310186305,0.9600760456273765,0.4663838120104439,0.6716534682208559,0.3993004837281229,proxy +nginx,relay-ka-1k,2,0.47966060544,46919.21,1.32,1.39,1.52,1.85,0,0,0,10.1,5.876384,16.845244133793503,21.313817473531827,31.51171875,0.2826086956521739,0.9600760456273765,0.517109050207867,0.7373016879669908,0.4848312999163947,proxy +nginx-halfclose,relay-ka-1k,2,0.50365202432,49260.53,1.24,1.31,1.49,1.83,0,0,0,10.11,5.843492,16.058706427160537,20.32197567393179,31.48046875,0.2902521823472357,0.9601139601139601,0.5339961513790892,0.765837360932875,0.46579604223767157,proxy +haproxy,relay-ka-1k,2,0.46456111104000003,45435.57,1.33,1.44,1.72,1.95,0,0,0,10.1,6.085995,17.39276019448018,22.01073513676076,28.9765625,0.27801932367149756,0.9609895337773549,0.5148704828909498,0.727796388289715,0.4506025930556299,proxy +haproxy-splice-auto,relay-ka-1k,2,0.48008003584,46956.14,1.28,1.35,1.69,1.93,0,0,0,10.1,6.0761650000000005,16.830526988822516,21.29629043923072,35.1484375,0.27764365041042977,0.9609895337773549,0.514102564102564,0.7287637572485111,0.4943954263803887,proxy +envoy,relay-ka-1k,2,0.37186699264,36373.59,1.63,2.02,2.24,2.96,0,0,0,10.1,7.009379999999999,21.72819895263507,27.49399079359635,23.00390625,0.22645145748012527,0.9582542694497154,0.4155761251196936,0.5917544398020642,0.3878992929244641,proxy +direct,relay-ka-1k,2,1.24889595904,122153.84,0.503,0.663,0.713,0.95,0,0,0,7.85,0.0,5.028441284114093,6.362643098680136,0.0,0.5798994974874372,0.7636186770428015,0.9582410629547612,1.6709938122243149,0.8306129369415213,origin +3proxy-0.9.9.2,relay-ka-1k,2,0.31423725568,30732.14,1.97,2.23,2.65,3.62,0,0,0,10.11,6.914485999999999,25.738513985230075,32.57360474782037,5.71875,0.21137623523740662,0.9610266159695817,0.3830200907323396,0.5375334302298217,0.3498823702275717,proxy +3proxy-1.0.2,relay-ka-50k-2000,2,6.00615944192,14590.52,32.19,38.32,46.07,74.96,0,258,0,10.41,7.164886,1.3865765770177045,70.952439373492,109.0703125,0.23018147086914995,0.9895437262357415,0.2914684427529337,0.6364926373673585,0.20630608230818814,proxy +3proxy-devel-c37,relay-ka-50k-2000,2,7.38734374912,17997.48,20.35,24.4,30.4,43.34,0,194,0,10.34,6.853066,1.1197529559911685,57.06874189364462,54.796875,0.25653320546631503,0.9828897338403042,0.32812001276731567,0.7278086540531776,0.23768119752720668,proxy +3proxy-bp,relay-ka-50k-2000,2,8.84763262976,21596.56,92.89,96.5,106.66,914.17,0,0,0,10.14,5.481513,0.9168554278253351,46.69626245694181,114.64453125,0.313517338995046,0.9647954329210275,0.3842318479277033,0.8429288545686536,0.24717418093278395,proxy +nginx,relay-ka-50k-2000,2,5.09758930944,12383.28,70.15,76.72,78.32,92.64,0,352,0,10.19,6.013733,1.5991872834682215,81.76726420696185,107.109375,0.23939322114245082,0.9704761904761905,0.23646723646723647,0.5603688313769247,0.15688010904123936,proxy +nginx-halfclose,relay-ka-50k-2000,2,5.19959478272,12631.21,77.43,82.1,84.62,95.24,0,289,0,10.27,6.093278,1.5801231333073351,80.76756714246392,114.7578125,0.24249586386197117,0.9753086419753086,0.24073487488121634,0.564199808420584,0.15871852820975563,proxy +haproxy,relay-ka-50k-2000,2,3.8983539097600004,9391.56,202.4,227.95,251.9,977.25,0,0,0,10.15,6.405816000000001,2.082930433707057,107.30974985727275,150.33984375,0.257321171387422,0.964828897338403,0.20219092331768387,0.5708264972681182,0.12549093049850635,proxy +haproxy-splice-auto,relay-ka-50k-2000,2,8.074538516479999,19602.65,90.48,94.58,102.74,768.83,0,771,0,10.2,5.9727310000000005,1.0105840703274342,51.751955919510486,126.01171875,0.28783943329397876,0.9695817490494296,0.3717310087173101,0.7744044008379317,0.2376792095450855,proxy +envoy,relay-ka-50k-2000,2,5.31485425664,12911.26,148.48,153.76,169.4,362.94,0,0,0,10.2,7.174924,1.5353196166772545,78.6139285383975,300.78515625,0.18993080410403246,0.9705042816365367,0.22296437659033078,0.5280098750131275,0.15021219471815234,proxy +direct,relay-ka-50k-2000,2,35.64822855680001,86506.43,21.14,24.02,27.89,34.35,0,0,0,8.65,0.0,0.19411904266081662,9.899675656869231,0.0,0.8825775656324583,0.8624127617148555,0.9566318455207344,2.871538265427221,0.766753027026885,origin +3proxy-0.9.9.2,relay-ka-50k-2000,2,6.17141501952,14991.9,27.64,34.92,40.15,61.67,0,317,0,10.41,7.202287999999999,1.3494474077110008,69.06159816897204,103.55859375,0.2271965525496768,0.9895437262357415,0.2907419150285352,0.638362295756037,0.20535577731045057,proxy +3proxy-1.0.2,relay-ka-2k-50k-2000,2,5.52121401344,13412.45,31.89,38.79,45.01,75.59,0,250,0,10.43,6.868793,1.5112618311278356,77.29074808255216,102.703125,0.21859356376638855,0.9914448669201521,0.32773907536415453,0.5765347099315582,0.2451904356259637,proxy +3proxy-devel-c37,relay-ka-2k-50k-2000,2,6.619282800640001,16079.99,26.44,30.27,34.92,55.18,0,240,0,10.37,6.460639,1.2533079866595036,64.13705662244487,65.78515625,0.24553039332538737,0.9866793529971456,0.36810207336523126,0.6526109151675512,0.2718924679587614,proxy +3proxy-bp,relay-ka-2k-50k-2000,2,8.589934592,20883.07,95.17,96.34,102.89,864.99,0,0,0,10.16,5.36448,0.9462237358093262,48.33767864958989,116.5625,0.3076194983435873,0.966698382492864,0.46778269109286164,0.8304759796553959,0.32132392256257003,proxy +nginx,relay-ka-2k-50k-2000,2,4.90842619904,11923.76,80.64,88.93,96.78,105.61,0,284,0,10.22,5.964739000000001,1.6657070247076504,85.22987882679654,112.5234375,0.24568863690054335,0.9714828897338403,0.27915869980879543,0.5698676872738943,0.19679168114840523,proxy +nginx-halfclose,relay-ka-2k-50k-2000,2,5.0356813824,12233.03,65.91,77.25,84.85,95.08,0,366,0,10.26,5.98747,1.6299680970061843,83.33265649239367,103.76171875,0.2453857075248462,0.9752851711026616,0.28585055643879176,0.5755887507011259,0.20724067504160587,proxy +haproxy,relay-ka-2k-50k-2000,2,3.85766916096,9285.8,199.01,225.36,259.52,1140.0,0,0,0,10.17,6.329891000000001,2.109045555885699,108.95416854149258,149.63671875,0.24988009592326138,0.9667300380228137,0.23028785982478098,0.5460681146417776,0.15400208103554874,proxy +haproxy-splice-auto,relay-ka-2k-50k-2000,2,7.38734374912,18014.45,97.11,104.73,112.99,714.97,0,747,0,10.17,5.816496,1.1013430911441182,56.12644731178048,133.35546875,0.2677595628415301,0.9676498572787822,0.4173748819641171,0.7239837407078029,0.29471589360823347,proxy +envoy,relay-ka-2k-50k-2000,2,4.9111105536,11930.32,158.1,173.75,187.92,350.24,0,0,0,10.2,7.000147999999999,1.6615386501569305,84.94195632984128,298.24609375,0.18980709692783995,0.9695817490494296,0.26976597090449084,0.5165834620950945,0.18918452033611236,proxy +direct,relay-ka-2k-50k-2000,2,24.0518168576,58433.03,32.2,40.03,41.62,42.89,0,0,0,8.51,0.0,0.2830555396420615,14.475078541333918,0.0,0.6831087584215592,0.8334965719882468,0.9556681443951869,2.116960079728941,0.790707690059961,origin +3proxy-0.9.9.2,relay-ka-2k-50k-2000,2,5.54176610304,13462.3,34.55,42.07,48.12,67.5,0,250,0,10.48,6.879793,1.5128751095072128,77.30323817953824,105.04296875,0.22558361124344925,0.9961977186311787,0.3363982244768548,0.588876823380423,0.23955415054721485,proxy +3proxy-1.0.2,relay-close-1k,2,0.05377097728,5281.64,11.54,13.64,16.07,20.65,0,0,0,10.02,6.8391649999999995,149.07670281420633,189.44980147475894,13.234375,0.14906242582482793,0.9524714828897338,0.1767337807606264,0.3129947262551058,0.08935939625606924,proxy +3proxy-devel-c37,relay-close-1k,2,0.06148849664,6037.45,10.09,11.44,13.37,19.03,0,0,0,10.01,6.396292,130.2357422541141,165.64346113749565,11.3828125,0.17552182163187854,0.9515209125475285,0.2094723458359822,0.3672338789961517,0.1045817276635682,proxy +3proxy-bp,relay-close-1k,2,0.07113539584,6985.88,8.55,11.07,13.94,20.13,0,0,0,10.0,6.304558999999999,112.46159391583136,142.9388221841052,6.05859375,0.19179051663128097,0.949667616334283,0.2246261533566656,0.4071960611478399,0.11409246001380625,proxy +nginx,relay-close-1k,2,0.07751073792,7613.52,8.06,8.94,10.25,11.08,0,0,0,10.02,5.302995999999999,103.41792911678165,131.43224418589398,32.09765625,0.2094240837696335,0.9515669515669516,0.2375886524822695,0.4318946905060257,0.12263483060346199,proxy +nginx-halfclose,relay-close-1k,2,0.08111783936,7966.22,7.78,8.07,8.69,10.24,0,0,0,10.0,5.528571,98.62195619506205,125.41072010835487,31.6875,0.20310262529832934,0.9505703422053232,0.2403225806451613,0.426159341858116,0.12542658333501544,proxy +haproxy,relay-close-1k,2,0.08413773824,8263.28,7.09,8.05,9.52,11.05,0,0,0,10.13,5.793615,96.3182534914787,121.38423562681237,31.21484375,0.20669197911722828,0.9601895734597157,0.2695349572919962,0.44333163573076506,0.13689990439125452,proxy +haproxy-splice-auto,relay-close-1k,2,0.07952400384000001,7806.59,7.81,8.65,9.81,10.94,0,0,0,10.01,5.759663000000001,100.69915513952068,128.00675200450132,35.56640625,0.20359848484848486,0.9524262607040913,0.26639344262295084,0.43475501975804604,0.13402534288993032,proxy +envoy,relay-close-1k,2,0.050751078399999996,4984.4,12.51,13.46,14.42,16.87,0,0,0,10.0,7.219475,157.63211841425618,200.2042082924583,23.578125,0.13216485078162007,0.9505703422053232,0.17091024824952258,0.28638046302524905,0.08366454199719203,proxy +direct,relay-close-1k,2,0.50600083456,49682.28,0.744,1.93,2.83,4.14,0,0,0,8.65,0.0,13.675866772072386,17.238493056773432,0.0,0.764116352969934,0.8763931104356636,0.8869201030927835,2.1150636723028446,0.577296585464864,client +3proxy-0.9.9.2,relay-close-1k,2,0.05100273664,5009.16,12.31,14.34,16.92,20.78,0,0,0,10.02,6.748311,157.1680370130037,199.6334077143768,13.25,0.14055463379947855,0.9515669515669516,0.16629499840713602,0.29018495253376747,0.08553619678833116,proxy diff --git a/bench/data/results-full7/intel-socks.csv b/bench/data/results-full7/intel-socks.csv new file mode 100644 index 0000000..492ea3f --- /dev/null +++ b/bench/data/results-full7/intel-socks.csv @@ -0,0 +1,91 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +direct,socks-stream1-down,0,45.44685824194053,nan,nan,nan,nan,nan,0,0,0,6.22,0.0,0.10947890117997928,nan,0.0,0.26052765093860986,0.6499477533960293,0.36454515161612794,0.70763246524964,0.7447076421030929,none +3proxy-0.9.9.2,socks-stream1-down,0,19.239637075415175,nan,nan,nan,nan,nan,0,0,0,9.98,6.309641,0.4149324938659041,nan,8.54296875,0.19788333743539258,0.9513822688274547,0.13980210660708586,0.49004234243729844,0.2862027330192495,proxy +3proxy-1.0.2,socks-stream1-down,0,20.91204898200301,nan,nan,nan,nan,nan,0,0,0,10.02,6.791262000000001,0.3832790177340389,nan,7.30859375,0.21724581724581724,0.99800796812749,0.18386243386243387,0.5004970452794675,0.35820516499279226,proxy +3proxy-devel-c37,socks-stream1-down,0,31.980256056704356,nan,nan,nan,nan,nan,0,0,0,10.0,5.241284,0.2501276811766442,nan,9.54296875,0.25653436592449175,0.9514747859181731,0.2338403041825095,0.6955575436963665,0.49824991355272275,proxy +3proxy-bp,socks-stream1-down,0,32.47878780970436,nan,nan,nan,nan,nan,0,0,0,10.01,5.221067000000001,0.24653454687373902,nan,11.21484375,0.26150121065375304,0.9506172839506173,0.24186927691821913,0.7098124445939458,0.5077207809279861,proxy +direct,socks-stream16,0,147.76269338455515,nan,nan,nan,nan,nan,0,0,3209,8.8,0.0,0.047634491257259014,nan,0.0,0.9563800451240912,0.9034907597535934,0.9876871880199667,3.0832065149273475,2.5454951400433092,origin +3proxy-0.9.9.2,socks-stream16,0,19.150016204456414,nan,nan,nan,nan,nan,0,0,672,10.05,6.884323,0.4174947458240542,nan,76.1640625,0.13183431952662722,0.9535104364326376,0.2716688227684347,0.3393572583055545,0.47777628835768793,proxy +3proxy-1.0.2,socks-stream16,0,18.772099027333947,nan,nan,nan,nan,nan,0,0,759,10.03,6.989876000000001,0.42597403251153676,nan,80.65625,0.13544124587069373,0.9543292102759277,0.2675509543836946,0.34031168749343454,0.4634999569067985,proxy +3proxy-devel-c37,socks-stream16,0,30.527330050354575,nan,nan,nan,nan,nan,0,0,727,10.03,5.205187,0.2623492872345577,nan,96.671875,0.1943127962085308,0.9525166191832859,0.34991974317817015,0.5608149595475642,0.7635631587466997,proxy +3proxy-bp,socks-stream16,0,29.82312472901609,nan,nan,nan,nan,nan,0,0,1260,10.03,5.311879,0.2687642539483828,nan,99.390625,0.20233834407062753,0.9525166191832859,0.38258659040355897,0.5407945906015328,0.803371912249243,proxy +direct,socks-ka-1k,0,1.2229751603199999,119615.55,0.534,0.603,0.66,0.91,0,0,0,7.99,0.0,5.226598386779572,6.613860632132767,0.0,0.571501014198783,0.7856440511307768,0.9537682077264091,1.6558440294433112,0.8495419753227111,origin +3proxy-0.9.9.2,socks-ka-1k,0,0.2961178624,28964.88,2.06,2.43,2.85,4.67,0,0,0,10.1,6.905571999999999,27.286432282445112,34.550704013355045,5.57421875,0.2195888754534462,0.9591642924976258,0.3813968458319923,0.5608545014804411,0.3305740367652914,proxy +3proxy-1.0.2,socks-ka-1k,0,0.29687283712,29038.73,2.07,2.39,2.79,4.18,0,0,0,10.09,6.921066000000001,27.19009283000583,34.42393640612739,5.50390625,0.22749273959341723,0.9591254752851711,0.3822294022617124,0.57697896422278,0.3219807361700954,proxy +3proxy-devel-c37,socks-ka-1k,0,0.30727471104000004,30058.29,2.01,2.29,2.69,3.59,0,0,0,10.1,6.877148,26.295688221957754,33.32200605074843,6.96875,0.22378299830467427,0.9591642924976258,0.3869719445340213,0.5722250484294916,0.29920015261587024,proxy +3proxy-bp,socks-ka-1k,0,0.43134222336,42193.0,0.23500000000000001,16.0,27.64,36.22,0,0,0,10.12,6.418880000000001,18.7693194905314,23.749345836941497,4.60546875,0.2840742550073278,0.9592417061611375,0.5056689342403629,0.7412199190669496,0.4444067325776596,proxy +direct,socks-ka-50k-2000,0,34.18793967616,83114.48,22.93,25.05,27.55,34.12,0,0,0,8.77,0.0,0.2052185673210489,10.451736692508,0.0,0.8469656992084432,0.8648915187376726,0.9537682077264091,2.755141987666397,0.7600073576208964,origin +3proxy-0.9.9.2,socks-ka-50k-2000,0,5.6619748556800005,13754.36,105.68,131.7,148.88,229.57,4,0,0,10.25,6.7108170000000005,1.448257932790693,73.83981442793954,258.15625,0.2356581766246132,0.9752616555661275,0.2834744433991847,0.6264480898095739,0.17762331629670097,proxy +3proxy-1.0.2,socks-ka-50k-2000,0,5.39236499456,13099.45,121.75,140.38,155.09,236.21,1,1,0,10.24,6.653099,1.5191849973554026,77.45019438183552,257.66015625,0.23815194093831865,0.9715370018975332,0.28742138364779873,0.6225901487151232,0.1785737599897964,proxy +3proxy-devel-c37,socks-ka-50k-2000,0,6.29380481024,15289.22,79.38,108.07,125.67,202.47,0,0,0,10.24,6.3948149999999995,1.301597403635976,66.31780736749391,215.0234375,0.25659928656361475,0.973384030418251,0.313953488372093,0.6834252431660582,0.20991901616694128,proxy +3proxy-bp,socks-ka-50k-2000,0,9.0194313216,21962.17,90.36,93.72,97.21,111.23,2,0,0,10.11,5.443900999999999,0.8967305932726178,45.608542466470276,122.48828125,0.33356973995271866,0.961941008563273,0.40068707058088693,0.9163475063530346,0.26217017545977356,client +direct,socks-ka-2k-50k-2000,0,22.849226014720003,55418.43,33.52,43.07,44.35,161.01,0,0,0,8.62,0.0,0.3018045335783994,15.456199962345684,0.0,0.7079112397491558,0.8393378773125608,0.955337345581248,2.1609311407502787,0.7784078941372417,origin +3proxy-0.9.9.2,socks-ka-2k-50k-2000,0,4.692755087359999,11399.98,106.58,147.19,173.93,344.96,2,0,0,10.23,6.566967,1.743964866618272,88.88386883764575,260.67578125,0.21263958184842005,0.9733587059942912,0.30269413629160064,0.5446849296813348,0.20415979361230893,proxy +3proxy-1.0.2,socks-ka-2k-50k-2000,0,4.6930906316800005,11400.64,122.29,154.3,177.8,242.77,1,0,0,10.24,6.548124,1.7455448110678153,88.94216153772659,273.30078125,0.21683309557774608,0.9715370018975332,0.30961416824794435,0.5560682132879631,0.20992884772301185,proxy +3proxy-devel-c37,socks-ka-2k-50k-2000,0,5.82412664832,14148.33,81.38,104.07,124.91,183.49,1,2,0,10.18,6.212597,1.3983212405501484,71.24959755875642,218.83203125,0.23577042152893546,0.967680608365019,0.34903572557698387,0.6197712602592128,0.2411901051568478,proxy +3proxy-bp,socks-ka-2k-50k-2000,0,8.074538516479999,19683.46,95.47,96.29,101.56,142.18,4,0,0,10.15,5.306540999999999,1.0056302268454371,51.069439343091034,123.49609375,0.3014705882352941,0.964828897338403,0.4404423380726698,0.81845772312875,0.3077566108571336,proxy +direct,socks-close-1k,0,0.5167382528,50737.25,0.787,1.91,2.9,4.3,0,0,0,8.55,0.0,13.236875657911426,16.6856290872473,0.0,0.7452462213554364,0.8715596330275229,0.8866045615162222,2.056825903649173,0.5698949086148576,client +3proxy-0.9.9.2,socks-close-1k,0,0.04563402752,4481.0,4.15,7.26,9.89,12.88,18,0,0,10.13,6.735499,177.58677987491384,223.95153980500962,7.11328125,0.2453944260746339,0.9620132953466287,0.16376306620209058,0.6093310018488786,0.08071054725658589,proxy +3proxy-1.0.2,socks-close-1k,0,0.0423624704,4158.43,4.49,8.07,11.04,16.26,25,0,0,10.09,6.747008,190.54601688196163,240.26097723592724,6.9140625,0.23381550865544226,0.9591254752851711,0.16005080978088282,0.58360625280438,0.0778846145397718,proxy +3proxy-devel-c37,socks-close-1k,0,0.049576673280000004,4871.57,4.09,7.1,9.56,13.01,17,0,0,10.09,6.463056,162.818508503199,205.4027644891395,7.52734375,0.26124197002141325,0.9563981042654028,0.17970737913486004,0.6663039352039232,0.08830571654548061,proxy +3proxy-bp,socks-close-1k,0,0.05041553408,4953.29,3.76,6.73,9.4,13.84,21,0,0,10.09,6.418151,160.10938190580805,201.7798220177982,5.1953125,0.2635973282442748,0.9582146248812915,0.18283343969368218,0.6738982310316541,0.0911470082886417,proxy +3proxy-0.9.9.2,socks-stream1-down,1,19.76028871145013,nan,nan,nan,nan,nan,0,0,2,10.01,6.357983,0.40521379780129624,nan,5.9140625,0.19072164948453607,0.9506172839506173,0.15201523325928276,0.4586529022478355,0.2985611914995177,proxy +3proxy-1.0.2,socks-stream1-down,1,19.25986473604619,nan,nan,nan,nan,nan,0,0,0,10.0,6.813248,0.4153271998982013,nan,7.14453125,0.1835178351783518,0.9505703422053232,0.15063694267515923,0.45386291458643446,0.3090074802023313,proxy +3proxy-devel-c37,socks-stream1-down,1,32.85560570458961,nan,nan,nan,nan,nan,0,0,0,9.99,5.184418,0.24322013781576196,nan,10.28125,0.2642512077294686,0.9469194312796209,0.23758304334071495,0.7098659566413225,0.5077940366486384,proxy +3proxy-bp,socks-stream1-down,1,27.52829750541318,nan,nan,nan,nan,nan,0,0,0,10.0,5.343489,0.2905793969808576,nan,13.05859375,0.2423654871546292,0.9505703422053232,0.19434741187678628,0.6584272887578433,0.4164305691867495,proxy +direct,socks-stream1-down,1,47.44875368101423,nan,nan,nan,nan,nan,0,0,0,6.39,0.0,0.10772599746038594,nan,0.0,0.26157760814249365,0.665625,0.360694027360694,0.7193112502307768,0.7485451186509717,none +3proxy-0.9.9.2,socks-stream16,1,19.588806482603065,nan,nan,nan,nan,nan,0,0,712,10.03,6.903421000000001,0.40737217998050257,nan,81.375,0.1281807372175981,0.9534220532319392,0.2734021949644932,0.3364156784214898,0.484283708638796,proxy +3proxy-1.0.2,socks-stream16,1,18.81538263987668,nan,nan,nan,nan,nan,0,0,732,10.02,7.011683,0.42469824337021256,nan,81.5390625,0.13306546915622786,0.9533777354900095,0.27228682170542634,0.33742819205174635,0.4718014636518726,proxy +3proxy-devel-c37,socks-stream16,1,30.410270239940374,nan,nan,nan,nan,nan,0,0,719,10.05,5.222644,0.2635872249462429,nan,103.7265625,0.19234427009034713,0.9535104364326376,0.34704370179948585,0.561666527241363,0.7596402710201489,proxy +3proxy-bp,socks-stream16,1,29.7120793806344,nan,nan,nan,nan,nan,0,0,1230,10.03,5.344947,0.2694171662545197,nan,103.328125,0.1945971790580923,0.9525166191832859,0.3781459063395986,0.5284098462750182,0.8001097661163373,proxy +direct,socks-stream16,1,143.47670780503768,nan,nan,nan,nan,nan,0,0,3020,8.7,0.0,0.04847289777598575,nan,0.0,0.9591273821464393,0.894141829393628,0.9792988313856428,3.1429385174251396,2.5242130941914653,origin +3proxy-0.9.9.2,socks-ka-1k,1,0.31708938239999995,31012.12,1.96,2.2,2.56,3.47,0,0,0,10.06,6.895562,25.38085614562665,32.23677042676869,5.5703125,0.2265246853823814,0.9562737642585551,0.39368556701030927,0.5827208303288175,0.3087234593617972,proxy +3proxy-1.0.2,socks-ka-1k,1,0.29729226752,29080.13,2.08,2.42,2.8,3.71,0,0,0,10.09,6.927086,27.151732089557175,34.387098533180655,5.6015625,0.22581423401688783,0.9591254752851711,0.3814133591481123,0.5712826908424882,0.3427604587872733,proxy +3proxy-devel-c37,socks-ka-1k,1,0.30928797696,30253.85,1.99,2.24,2.67,4.73,0,0,0,10.09,6.898217000000001,26.09865433289683,33.07025708929297,6.953125,0.2248062015503876,0.9591254752851711,0.3823151125401929,0.577985765133105,0.31729211214815767,proxy +3proxy-bp,socks-ka-1k,1,0.41305505792,40400.95,0.256,16.54,28.23,36.21,0,0,0,10.06,6.399977,19.484085343312092,24.71046264568979,4.5546875,0.267333984375,0.9571836346336822,0.4624108878807518,0.7044624307203157,0.38287026993221995,proxy +direct,socks-ka-1k,1,1.30300248064,127445.88,0.417,0.601,0.713,0.95,0,0,0,8.41,0.0,5.163459087733575,6.533611976475889,0.0,0.5712136409227683,0.8393213572854291,0.9585574185384372,1.6587500996341011,0.8413029333954187,origin +3proxy-0.9.9.2,socks-ka-50k-2000,1,5.54075947008,13459.89,126.71,139.0,155.87,239.54,2,0,0,10.22,6.675249999999999,1.4756099852647007,75.1995879474633,261.671875,0.2361868626986009,0.9705603038936372,0.2784770295783512,0.6121545795076011,0.1728748362518781,proxy +3proxy-1.0.2,socks-ka-50k-2000,1,4.97243127808,12079.42,119.12,146.3,168.63,265.83,1,0,0,10.27,6.726843,1.6523104172839236,84.2735814220654,257.5,0.22882968601332065,0.9762357414448669,0.2775149795017345,0.5940876422500235,0.18237950857751017,proxy +3proxy-devel-c37,socks-ka-50k-2000,1,5.6375640064,13695.16,103.3,131.02,154.81,242.9,0,0,0,10.22,6.274122,1.450271782407838,73.89625601943573,218.48828125,0.24720968890999762,0.969639468690702,0.2993710691823899,0.6406449051516291,0.1947095080927768,proxy +3proxy-bp,socks-ka-50k-2000,1,8.41813590016,20364.91,92.64,95.43,100.65,139.38,2,0,0,10.13,5.442704,0.9626834368219184,49.26204196756389,121.484375,0.31328143430054256,0.9601895734597157,0.3833229620410703,0.850505772998166,0.24679011886363295,proxy +direct,socks-ka-50k-2000,1,32.81355014144,79710.42,23.1,26.43,31.85,259.22,0,0,0,8.76,0.0,0.21357030768669089,10.880122413797386,0.0,0.8720038350910834,0.8839556004036327,0.9537535635096611,2.804268566918035,0.7447988768451461,origin +3proxy-0.9.9.2,socks-ka-2k-50k-2000,1,5.0039724441599995,12155.85,129.66,149.58,176.95,283.36,3,1,0,10.21,6.593875,1.6323031533742058,83.23821946844937,262.5390625,0.22679924242424243,0.970532319391635,0.3201267828843106,0.5798386584663466,0.21931858153233683,proxy +3proxy-1.0.2,socks-ka-2k-50k-2000,1,4.949865922560001,12024.6,118.42,142.67,161.76,208.9,2,0,0,10.26,6.635877000000001,1.658226733494013,84.48894891136072,264.21484375,0.22630331753554503,0.9734345351043643,0.3236133122028526,0.5750814643658427,0.21656938352204336,proxy +3proxy-devel-c37,socks-ka-2k-50k-2000,1,5.87009622016,14259.9,90.28,123.74,144.0,187.84,1,0,0,10.26,6.283891000000001,1.3982735021975972,71.25989720794554,222.77734375,0.23907882241215575,0.9734345351043643,0.34770206022187006,0.6226255225621284,0.2392726610059545,proxy +3proxy-bp,socks-ka-2k-50k-2000,1,7.64504178688,18539.66,96.08,99.11,138.68,146.47,1,0,0,10.11,5.30947,1.0579405875688188,54.01275790958339,121.23828125,0.28146561979538426,0.961941008563273,0.4193954659949622,0.7642229988393952,0.30863123562321465,proxy +direct,socks-ka-2k-50k-2000,1,27.917287424,67918.95,28.41,30.05,32.5,41.02,0,0,0,8.65,0.0,0.247875085243812,12.64878776357734,0.0,0.7758537758537759,0.8505408062930186,0.9543870763382959,2.4507365023721674,0.7856436370100142,origin +3proxy-0.9.9.2,socks-close-1k,1,0.04370464768,4292.67,4.71,8.15,10.88,14.15,16,0,0,10.11,6.705216,185.06040957518593,233.23413385009343,7.1484375,0.23628192999053926,0.959203036053131,0.15673781459063396,0.5837056195609562,0.07600241590073108,proxy +3proxy-1.0.2,socks-close-1k,1,0.044543508479999994,4377.36,4.38,7.73,10.51,14.36,19,0,0,10.09,6.752362,181.21608008548142,228.2237452217774,7.05078125,0.24314096499526963,0.9591254752851711,0.16338207247298156,0.6036330582971052,0.08074433685176531,proxy +3proxy-devel-c37,socks-close-1k,1,0.051254394880000005,5034.69,4.07,6.95,9.21,12.17,15,0,0,10.07,6.4565280000000005,157.17676540443435,198.38846312969127,7.390625,0.2718653709409813,0.9572243346007605,0.18193384223918574,0.6852519480926768,0.08927292612677513,proxy +3proxy-bp,socks-close-1k,1,0.05150605312,5055.41,3.48,6.21,8.65,12.71,22,0,0,10.07,6.432157,156.40880075262115,197.29623824451411,5.25390625,0.27067490494296575,0.9581351094196003,0.18506700701978301,0.6872492909165132,0.09213828913642438,proxy +direct,socks-close-1k,1,0.48209330176,47338.09,0.93,2.09,3.02,4.22,0,0,0,8.56,0.0,14.204719242104575,18.065474683010013,0.0,0.7201550387596899,0.9164882226980728,0.9202163624070318,1.9059130445297459,0.5896270866266695,origin +3proxy-1.0.2,socks-stream1-down,2,20.318751218747398,nan,nan,nan,nan,nan,0,0,0,9.98,6.787341,0.3928963978527568,nan,6.88671875,0.20269607843137255,0.9513822688274547,0.16237686685732444,0.48813917678614327,0.34042447795646397,proxy +3proxy-devel-c37,socks-stream1-down,2,32.36760479580435,nan,nan,nan,nan,nan,0,0,0,9.99,5.277905,0.24689317497558363,nan,11.16796875,0.26553808948004837,0.950523311132255,0.2186999679795069,0.7298407810023809,0.5125003725762988,proxy +3proxy-bp,socks-stream1-down,2,31.395692045442843,nan,nan,nan,nan,nan,0,0,0,9.99,5.187386,0.25453056787642264,nan,9.37109375,0.2784134248665141,0.9970059880239521,0.2647644326476443,0.7223299041611931,0.5770087696818855,proxy +direct,socks-stream1-down,2,46.1026084111958,nan,nan,nan,nan,nan,0,0,0,6.28,0.0,0.10896259780460571,nan,0.0,0.26140127388535034,0.6562173458725182,0.3621495327102804,0.7162940045797985,0.746667098228627,none +3proxy-0.9.9.2,socks-stream1-down,2,18.723352589996573,nan,nan,nan,nan,nan,0,0,0,10.0,6.32131,0.4272279792836784,nan,6.98828125,0.18554927500614402,0.9505703422053232,0.14479924122668353,0.45672401898350745,0.2852206889831259,proxy +3proxy-1.0.2,socks-stream16,2,19.65415631980094,nan,nan,nan,nan,nan,0,0,738,10.03,6.975499,0.407153262896989,nan,78.8515625,0.1327182398864443,0.9534220532319392,0.2707792207792208,0.3431736501200824,0.4759027598060294,proxy +3proxy-devel-c37,socks-stream16,2,31.493843372624426,nan,nan,nan,nan,nan,0,0,724,10.03,5.19311,0.25433174625076443,nan,98.01171875,0.19189511323003575,0.9516129032258065,0.35739493102341996,0.572021819269568,0.7737142675294089,proxy +3proxy-bp,socks-stream16,2,30.960205426638133,nan,nan,nan,nan,nan,0,0,1285,10.03,5.30432,0.25895085850759364,nan,100.66015625,0.1985611510791367,0.9516129032258065,0.3830465264499681,0.546489826368392,0.8129076961686117,proxy +direct,socks-stream16,2,144.38950199277957,nan,nan,nan,nan,nan,0,0,4007,8.86,0.0,0.0490569362958282,nan,0.0,0.9604010025062657,0.9022403258655805,0.9857000332557366,3.105514351267219,2.5449528662416756,origin +3proxy-0.9.9.2,socks-stream16,2,19.05858605404639,nan,nan,nan,nan,nan,0,0,731,10.06,6.909188,0.4198854927150805,nan,83.40625,0.12805311833056676,0.9526515151515151,0.2727272727272727,0.3317263230140589,0.4794272884646494,proxy +3proxy-1.0.2,socks-ka-1k,2,0.3112173568,30438.62,1.98,2.25,2.66,3.71,0,0,0,10.1,6.9299100000000005,25.96256225256907,32.90223800371372,5.51171875,0.2221142162818955,0.9582542694497154,0.38444230151076825,0.5770293238824706,0.3201284245722156,proxy +3proxy-devel-c37,socks-ka-1k,2,0.30752636928,30082.39,2.01,2.3,2.67,3.6,0,0,0,10.1,6.928221000000001,26.27416965549134,33.2559556148236,6.96484375,0.2309558466763707,0.9591642924976258,0.39165588615782665,0.5921022124609482,0.3390372815077882,proxy +3proxy-bp,socks-ka-1k,2,0.42899341312,41961.03,0.242,15.85,27.59,36.6,0,0,0,10.09,6.418941,18.816139719474116,23.817279684261713,4.54296875,0.27883675464320623,0.9591254752851711,0.48179453836150843,0.7329634400243646,0.4540680502812054,proxy +direct,socks-ka-1k,2,1.2647504281600002,123700.34,0.516,0.5730000000000001,0.6940000000000001,0.844,0,0,0,8.06,0.0,5.09823903311957,6.451204958623445,0.0,0.5583270345175108,0.7894221351616063,0.959203036053131,1.610264593372863,0.8416500815671584,origin +3proxy-0.9.9.2,socks-ka-1k,2,0.32178700288,31477.55,1.94,2.16,2.5,3.37,0,0,0,10.08,6.913461,25.060055029653284,31.76473924867568,5.578125,0.22832929782082326,0.9581749049429658,0.390032154340836,0.5912021375088223,0.3124738495182935,proxy +3proxy-1.0.2,socks-ka-50k-2000,2,5.52398225408,13419.1,112.91,137.26,160.15,228.73,0,0,0,10.22,6.731399,1.4800916483685707,75.44718328054984,260.62109375,0.23364263621222936,0.9705603038936372,0.2792452830188679,0.6169808108569996,0.17956009192425482,proxy +3proxy-devel-c37,socks-ka-50k-2000,2,6.04449538048,14683.58,88.04,114.41,141.29,209.5,1,0,0,10.21,6.34245,1.3513121420156287,68.87386840436584,216.80859375,0.24881065651760229,0.970532319391635,0.30583437892095355,0.6596466039104529,0.19186473220080563,proxy +3proxy-bp,socks-ka-50k-2000,2,8.84763262976,21463.63,89.11,93.45,98.06,136.1,2,0,0,10.11,5.490233000000001,0.9141428378021831,46.665343481853135,122.5,0.3226339391078593,0.9610266159695817,0.3916849015317287,0.8782804404898771,0.26499254520043314,proxy +direct,socks-ka-50k-2000,2,35.734127902720004,86704.7,21.19,24.2,28.59,31.97,0,0,0,8.67,0.0,0.194100161584524,9.902754267778699,0.0,0.8854489164086687,0.8567193675889329,0.9547611515343246,2.9026482460561294,0.7699775802958495,origin +3proxy-0.9.9.2,socks-ka-50k-2000,2,5.65283127296,13732.18,90.95,126.8,141.47,205.31,1,0,0,10.21,6.8074520000000005,1.4449396427364052,73.61688934393725,253.87890625,0.23577042152893546,0.970532319391635,0.28799749294891885,0.6311944724671337,0.1861746503012688,proxy +3proxy-1.0.2,socks-ka-2k-50k-2000,2,5.24858425344,12750.16,106.6,137.76,159.75,211.0,4,0,0,10.25,6.664971,1.5623260681441093,79.6147423200901,265.609375,0.22525516259197723,0.9743346007604563,0.3231939163498099,0.5826768150745352,0.2298653432139361,proxy +3proxy-devel-c37,socks-ka-2k-50k-2000,2,6.14322929664,14923.48,104.89,121.56,136.9,189.67,2,0,0,10.2,6.280518,1.3282916209009257,67.6747102261795,220.203125,0.25575872714319636,0.9686609686609686,0.3668357641090679,0.6691646244136547,0.25073602719343646,proxy +3proxy-bp,socks-ka-2k-50k-2000,2,7.988639170560001,19367.87,95.69,97.23,105.1,142.71,1,0,0,10.11,5.330627,1.0124377665981168,51.710645436829644,118.97265625,0.29864575908766927,0.9601139601139601,0.4343562163872192,0.8165427197810385,0.3049326533958673,proxy +direct,socks-ka-2k-50k-2000,2,15.11828488192,36547.82,24.93,171.33,307.96,930.6,0,19,0,10.05,0.0,0.5318063565275886,27.307630648671708,0.0,0.5815620998719591,0.956232159847764,0.8098871930988719,1.6342434194605895,0.5209480031934852,client +3proxy-0.9.9.2,socks-ka-2k-50k-2000,2,4.96446210048,12059.89,125.49,144.47,161.1,209.11,1,0,0,10.31,6.651422,1.661408594337446,84.65460755897494,268.08984375,0.21779359430604983,0.9800380228136882,0.31037765788638527,0.5608004965495998,0.21086360403050045,proxy +3proxy-1.0.2,socks-close-1k,2,0.04504682496,4419.5,4.08,7.18,9.88,12.57,26,0,0,10.09,6.766235,179.19131941413522,226.04565719022335,6.98046875,0.24439197166469895,0.9591254752851711,0.16428797970187123,0.6074090259935575,0.0797915843481717,proxy +3proxy-devel-c37,socks-close-1k,2,0.0520093696,5108.62,3.73,6.52,8.84,11.96,23,0,0,10.09,6.482953,155.20280407321067,195.60328784119108,7.29296875,0.27195064072140485,0.9591254752851711,0.18431122448979592,0.6900786618569017,0.09023778263816196,proxy +3proxy-bp,socks-close-1k,2,0.05511315456,5415.01,3.27,5.75,8.03,11.89,24,0,0,10.1,6.434303,146.60746721009323,184.69078008996817,5.13671875,0.2827586206896552,0.9591642924976258,0.19349697162894486,0.7233604246866858,0.0959284406507165,proxy +direct,socks-close-1k,2,0.53007613952,52049.52,0.8180000000000001,1.89,2.77,4.05,0,0,0,8.56,0.0,12.91889879480535,16.28391848909586,0.0,0.7124969310090842,0.8833849329205367,0.8933376040999359,1.9753708618985844,0.586406467125717,client +3proxy-0.9.9.2,socks-close-1k,2,0.04538236928,4453.16,3.98,7.18,10.08,13.65,24,0,0,10.1,6.721658,178.04270971724813,224.66411602455736,7.01171875,0.24438135793707122,0.9582542694497154,0.1636536631779258,0.6083693770263742,0.07978713378291001,proxy diff --git a/bench/data/results-full7/intel-socks8-dante.csv b/bench/data/results-full7/intel-socks8-dante.csv new file mode 100644 index 0000000..e0e4c7a --- /dev/null +++ b/bench/data/results-full7/intel-socks8-dante.csv @@ -0,0 +1,37 @@ +proxy,scenario,rep,gbit,rate,p50_ms,p75_ms,p90_ms,p99_ms,errors,timeouts,retrans,prx_cpu_s,prx_task_s,cpu_s_per_gb,cpu_us_per_req,peak_mb,cli_util,prx_util,srv_util,cli_thread,srv_thread,bound +3proxy-bp,socks-stream1-down,0,30.35942609095088,nan,nan,nan,nan,nan,0,0,0,10.0,5.297124,0.26348142640928857,nan,13.5234375,0.26785714285714285,0.949667616334283,0.25007913896802786,0.688736988808293,0.5415899336969784,proxy +dante,socks-stream1-down,0,6.96084497383584,nan,nan,nan,nan,nan,0,0,1,11.65,10.105591,1.3387725187007653,nan,30.78125,0.06184705390722942,0.967607973421927,0.06476612233600886,0.14486538293311665,0.10396688657200935,proxy +3proxy-bp,socks-stream16,0,29.41879210854576,nan,nan,nan,nan,nan,0,0,1316,10.03,5.32453,0.2724861381482078,nan,102.05859375,0.22070266446592784,0.9507109004739337,0.3904700991365526,0.5634216859817105,0.8182718833334589,proxy +dante,socks-stream16,0,14.25357689770778,nan,nan,nan,nan,nan,0,0,0,11.58,9.128783,0.6496443889251443,nan,83.05859375,0.11731843575418995,0.9609958506224067,0.2103932584269663,0.2503201614772933,0.3713320208611771,proxy +3proxy-bp,socks-ka-1k,0,0.39048970239999997,38193.99,0.267,14.79,26.83,37.24,0,0,0,10.04,6.385117,20.569044332371107,26.11855848449926,4.484375,0.2779265027987345,0.9543726235741445,0.4823795667636599,0.7223945126616442,0.41311407571975106,proxy +dante,socks-ka-1k,0,0.23664263168000002,23145.28,1.51,5.29,5.52,5.91,0,0,0,11.7,9.401263,39.55331266201036,50.15475098380473,98.0234375,0.19420108468919484,0.972568578553616,0.2960616909942165,0.4557963984431746,0.24345010131083542,proxy +3proxy-bp,socks-ka-50k-2000,0,7.988639170560001,19461.16,91.69,97.44,126.76,144.61,1,0,0,10.15,5.499898,1.0164434550910868,51.691561798153366,120.46875,0.3152918931694635,0.9629981024667932,0.37964408367155794,0.8554091461504926,0.24408552366840341,proxy +dante,socks-ka-50k-2000,0,4.52238245888,10985.95,2.36,307.95,316.31,331.6,3,0,0,11.86,9.008255,2.0980091989720324,107.00784062508458,1452.62109375,0.194815881505863,0.9858686616791354,0.22537517053206002,0.47581923888973243,0.1437735290674667,proxy +3proxy-bp,socks-ka-2k-50k-2000,0,8.24633720832,20087.94,95.0,96.3,100.16,140.63,0,0,0,10.09,5.318838,0.9788588310281435,49.740697651489754,125.078125,0.30809399477806787,0.9591254752851711,0.4511349306431274,0.8402922244966345,0.3210702090028313,proxy +dante,socks-ka-2k-50k-2000,0,4.64326230016,11279.6,2.46,311.69,317.1,332.21,2,0,0,11.92,8.796989,2.0537284744114936,104.64401720656659,1365.48046875,0.1922838869403755,0.9908561928512053,0.2570644718792867,0.4733320759056346,0.17203452052388538,proxy +3proxy-bp,socks-close-1k,0,0.0536870912,5272.82,3.82,6.5,8.8,12.68,14,0,0,10.07,6.428009,150.0546932220459,189.1221875821658,5.19140625,0.2807600950118765,0.9572243346007605,0.19444444444444445,0.7101324402533838,0.09689877187282735,proxy +dante,socks-close-1k,0,0.0155189248,1521.41,13.13,23.07,30.56,42.16,11,0,0,11.69,10.331479999999999,602.619068042652,761.0677083333334,132.015625,0.09329747621017791,0.971737323358271,0.07196235815112095,0.21298873282511735,0.03241520413880088,proxy +dante,socks-stream1-down,1,8.346011697590468,nan,nan,nan,nan,nan,0,0,1,11.63,10.207127,1.1146687067967829,nan,31.109375,0.06545378502718528,0.9675540765391015,0.06081643987781172,0.15736970915098922,0.10565035827794214,proxy +3proxy-bp,socks-stream1-down,1,33.0466003556227,nan,nan,nan,nan,nan,0,0,0,9.98,5.266013999999999,0.2415728843614169,nan,13.0859375,0.26101613291596437,0.9486692015209125,0.2168481742472774,0.7270127605788417,0.5030327391059426,proxy +dante,socks-stream16,1,16.12521768251293,nan,nan,nan,nan,nan,0,0,0,11.62,9.258521,0.576230017699755,nan,83.54296875,0.10630330767630539,0.9659185369908562,0.195176668536175,0.24543307547368545,0.34657222492611217,proxy +3proxy-bp,socks-stream16,1,33.12007854599873,nan,nan,nan,nan,nan,0,0,1232,10.02,5.2938350000000005,0.24146398944751354,nan,100.26953125,0.2043425814234017,0.9524714828897338,0.39649122807017545,0.5683256464618265,0.8432708978774334,proxy +dante,socks-ka-1k,1,0.25870467072,25304.29,1.55,3.27,5.29,5.83,0,0,0,11.65,9.320719,36.02563484478863,45.64760830042004,103.140625,0.17586783772480133,0.9684123025768911,0.28114663726571115,0.4284458490688116,0.22522678921334102,proxy +3proxy-bp,socks-ka-1k,1,0.43293605888,42347.21,0.23800000000000002,15.76,27.65,37.34,0,0,0,10.08,6.403438,18.626307129190078,23.601030203699366,4.546875,0.26401755241345687,0.9581749049429658,0.4630589760207388,0.69684287260773,0.5044825472300721,proxy +dante,socks-ka-50k-2000,1,5.0658803712,12306.13,2.17,308.93,315.95,328.35,2,0,0,11.89,9.008137,1.8776598148816548,95.73654333910383,1471.82421875,0.19484536082474227,0.9883624272651704,0.2192718313714755,0.4866587837369462,0.13879533718181541,proxy +3proxy-bp,socks-ka-50k-2000,1,9.19123001344,22278.34,88.29,92.25,96.75,121.27,0,0,0,10.12,5.507034,0.8808396687017421,45.00337970045181,121.00390625,0.32481665483794653,0.9619771863117871,0.38502340093603743,0.891636578996387,0.24792667004161706,proxy +dante,socks-ka-2k-50k-2000,1,4.5994737664,11173.33,2.39,311.32,316.56,328.48,4,0,0,11.86,8.810199,2.0628446822137745,105.11481977151264,1466.6796875,0.1818931738502784,0.9866888519134775,0.2465753424657534,0.44924111709001974,0.15957769572065464,proxy +3proxy-bp,socks-ka-2k-50k-2000,1,8.67583393792,21008.3,94.92,95.35,97.45,138.8,2,0,0,10.11,5.342065,0.9322446761745038,47.72086832155652,117.86328125,0.30663180413596386,0.961941008563273,0.4547169811320755,0.8440802959815976,0.31342581821823035,proxy +dante,socks-close-1k,1,0.01652555776,1625.88,13.79,22.87,29.42,39.03,7,0,0,11.67,10.34461,564.943110277205,710.4157789005905,129.42578125,0.09768690623709211,0.9684647302904564,0.07194244604316546,0.2221362125557198,0.03156360011810044,proxy +3proxy-bp,socks-close-1k,1,0.054442065920000005,5349.75,3.21,5.63,7.95,12.05,22,0,0,10.06,6.406265,147.82686630272534,186.50352243233223,5.0703125,0.2812202097235462,0.9553656220322887,0.1958041958041958,0.7233097731068245,0.09687779940737334,proxy +3proxy-bp,socks-stream1-down,2,33.6388518997542,nan,nan,nan,nan,nan,0,0,0,10.01,5.233325,0.23803290515745434,nan,11.8359375,0.2767630644342973,0.9980059820538385,0.24849498327759198,0.7192986232020445,0.5560263880249092,proxy +dante,socks-stream1-down,2,8.270728416790337,nan,nan,nan,nan,nan,0,0,0,11.6,10.222825,1.1219128918728767,nan,33.6875,0.06895110739657334,0.9642560266001663,0.06766500277315585,0.1631944329279224,0.12393987864368505,proxy +3proxy-bp,socks-stream16,2,31.63438553222238,nan,nan,nan,nan,nan,0,0,1221,10.03,5.318629,0.25301737247409406,nan,102.45703125,0.1891304347826087,0.9525166191832859,0.3746001279590531,0.5369948180892826,0.7992816087785266,proxy +dante,socks-stream16,2,16.124999461399714,nan,nan,nan,nan,nan,0,0,2,11.57,9.220887000000001,0.5738027569866969,nan,105.5390625,0.10688292784362653,0.9633638634471274,0.19532789192231917,0.24788585319420656,0.3498444174795848,proxy +3proxy-bp,socks-ka-1k,2,0.44694503424,43711.55,0.216,16.21,27.89,36.4,0,0,0,10.12,6.415961,18.11408423804664,22.923570731221133,4.73046875,0.27137637028014616,0.9601518026565465,0.46837495945507623,0.7148535889377573,0.45880056054846025,proxy +dante,socks-ka-1k,2,0.2675965952,26174.97,1.5,3.27,5.24,5.77,0,0,0,11.59,9.270485,34.649170304540554,43.97630819082455,91.73046875,0.17791282481139983,0.9634247714048213,0.2866978793720738,0.44260120538958087,0.24684347572482865,proxy +3proxy-bp,socks-ka-50k-2000,2,9.19123001344,22276.01,88.65,92.42,97.34,135.06,3,0,0,10.13,5.501526999999999,0.8817100636312895,45.02782568497413,121.04296875,0.321157495256167,0.9629277566539924,0.3882978723404255,0.8849522900687673,0.25645897534675266,proxy +dante,socks-ka-50k-2000,2,4.82747613184,11727.05,2.02,304.98,314.09,331.46,2,0,0,11.87,9.142377000000002,1.9670734231845044,100.21867427664407,1428.87109375,0.18054410552349548,0.9875207986688852,0.20794520547945206,0.4525537220036973,0.12715419637362912,proxy +3proxy-bp,socks-ka-2k-50k-2000,2,8.24633720832,20093.21,94.77,96.36,101.0,140.82,2,0,0,10.12,5.340447999999999,0.9817692140738169,49.86523575120598,123.93359375,0.29625237191650855,0.9619771863117871,0.43614001892147586,0.8118043312420647,0.3115846674162313,proxy +dante,socks-ka-2k-50k-2000,2,4.888461312,11875.35,2.29,311.19,315.43,326.95,2,0,0,11.89,8.823331999999999,1.9458065417538075,99.13868576621947,1422.59375,0.1869969040247678,0.9891846921797005,0.2533589251439539,0.466730045826534,0.17121549645901002,proxy +3proxy-bp,socks-close-1k,2,0.05603590144,5501.33,3.42,6.05,8.36,11.87,16,0,0,10.08,6.4224250000000005,143.90774115830837,181.4418144181442,5.1796875,0.27602674307545366,0.9563567362428842,0.1925150650174437,0.7110771873854003,0.09499884974561111,proxy +dante,socks-close-1k,2,0.016777216,1643.59,12.73,21.78,28.56,38.4,9,0,0,11.68,10.334273,556.94580078125,703.6568467979998,131.0,0.09739454094292804,0.970906068162926,0.07641196013289037,0.2221333970078656,0.03241491636770625,proxy