Benchmark results
3proxy against nginx, haproxy, envoy, squid, tinyproxy, dante and stunnel on two
machines, as an HTTP proxy, through CONNECT and SOCKSv5 tunnels, as a TCP
relay, ending or beginning TLS, and with 20000 connections open at once; and
the version ladder 0.9.9.2 / 1.0.2 / devel / experimental against them all.
The current figures are from 29-30 October 2026: the four 3proxy versions,
every proxy, the plain suite and the mix over a shaped link (the section
The four 3proxy versions
below); the sessions before them are at the end. How the benchmark works is
in README.md; the measurements are in data/, and
bench/report.py turns them into the older tables.
In short
Ranges are over the two machines, ARM and Intel; the tables give each.
- The version ladder: 0.9.9.2 collapses on small kept-alive requests as
an HTTP proxy (1.5k req/s against 17.7k for 1.0.2 on Intel; fixed in
1.0.2) and is otherwise level with 1.0.2. devel adds splice(): streams go
from 18-25 to 30-63 Gbit/s. experimental (the current head) adds the
buffer pool and loop relay work: +50-100% over devel on every request
scenario, close-1k and all mixes, with half the memory (28-35 MB
idle-scale against 130+ MB).
- experimental against everyone: best of all proxies as an HTTP proxy
from 2000 clients (14.2k against nginx 8.7k on Intel), best through
CONNECT and SOCKS on both machines, best 3proxy everywhere in the mix -
9.2k against nginx 7.4k req/s on Intel plain, 5.4-6.0k shaped - and the
only proxy with no failed exchange anywhere. nginx and haproxy still lead
the small-request scenarios (44-50k against 34.9k on ka-1k, 15.4k against
7.0k on close-1k, Intel).
- dante manages 40-65% of experimental through SOCKS with the only
nonzero errors of the set, and cannot stand 20000 connections at all: on
8 GB machines its per-connection processes exhaust memory, and it is only
measurable with a smaller pool (2.5k req/s at 2000, 2.13k at 10000, ARM
shaped, against 2.58k/2.43k for experimental).
- Memory with few connections: experimental needs 4-35 MB, envoy 16-31,
nginx and haproxy 28-44.
Setup
|
M4 |
Skylake |
| host |
Apple M4 Pro laptop, UTM (Apple Virtualization) |
OpenStack virtual machine, KVM |
| virtual machine |
8 CPUs, 8 GB |
8 CPUs (Intel Xeon, Skylake, 2.0 GHz), 8 GB |
| system |
Ubuntu 24.04, Linux 6.8, aarch64 |
AlmaLinux 10, Linux 6.12, x86_64 |
| nginx |
1.28.3 |
1.26.3 |
| haproxy |
3.2.25 |
3.0.5 |
| squid |
7.7 |
6.10 |
| tinyproxy |
1.11.2 (built from source) |
1.11.2 |
| dante |
1.4.4 |
1.4.4 |
| wrk, iperf3 |
4.2.0, 3.20 |
4.2.0, 3.17.1 |
| proxychains-ng |
4.17 |
4.17 |
| envoy |
1.34.1 (BoringSSL) |
1.34.1 (BoringSSL) |
| stunnel, OpenSSL |
5.72, 3.0.13 |
5.72, 3.5.8 |
How the client, the proxy and the origin were kept apart
- Network: each runs in a network namespace of its own, linked by veth
pairs (client 10.0.1.2 - 10.0.1.1 proxy 10.0.2.1 - 10.0.2.2 origin), so they
share no loopback and every proxy is crossed by the same path. MTU 1500.
- CPU: each runs in a cgroup pinned to CPUs of its own: the client
(wrk, iperf3) on CPUs 0-3, the proxy on CPU 4, the origin (nginx serving
files from tmpfs, iperf3 -s) on CPUs 5-7. RPS steers what each veth receives
to the receiving side's CPUs, so the kernel's network work for a role is
done on its own CPUs too. The proxy has the fewest CPUs on purpose: it has to
be what runs out first.
- Every proxy gets the same CPU: one nginx worker, one haproxy thread, and
3proxy's thread per connection, squid's, tinyproxy's and dante's processes
all confined to the same CPU.
- CPU time is the busy time of the role's CPUs from
/proc/stat, its own
processes plus the interrupts and softirqs handled there (a quarter of a
proxy's time here), so a proxy is also charged for the kernel's work on its
connections - which is where splice() moves the copying.
- Which side set the pace is recorded for every run: the role whose CPUs,
or one thread of it, were busy at least 90% of the time.
- Repetitions: three runs of 10 seconds per proxy and scenario, the order
of the proxies rotated between repetitions; the tables give medians.
- Tunnels: wrk and iperf3 run under proxychains-ng, which opens a CONNECT
or SOCKSv5 tunnel for each connection they make, blocking in
connect()
until the proxy has answered. This costs the client CPU time per connection,
so wrk gets more threads there (16 against 4).
Proxies
| column |
configuration |
| 0.9.9.2 |
the 0.9 LTS line's last release, no splice(), 64 KB buffers, a thread per connection |
| 1.0.2 |
release 1.0.2, no splice(), 64 KB buffers |
| devel |
devel as of 30 October (c3702866): 16 KB buffers, the thread pool, splice() in its automatic mode |
| experimental (bp) |
the experimental head (5de7ae2): devel plus the event loops relaying by default (loopmode cb) and the pool of 16 KB buffers |
| nginx |
proxy_pass to an upstream with keepalive 1024, stream for the TCP relay, reuseport |
| nginx-halfclose |
the same with proxy_half_close on on the relays (not nginx's default) |
| haproxy |
mode http with http-reuse always, mode tcp for the TCP relay |
| haproxy splice-auto |
option splice-auto: splices a direction once reads fill the buffer three times in a row |
| envoy |
one worker (--concurrency 1), http_connection_manager with the router filter as an HTTP proxy for the origin, tcp_proxy for the TCP relay |
| squid |
no cache, no logs, via off |
| tinyproxy |
DisableViaHeader Yes, critical messages only |
| dante |
no authentication, one sockd process tree (-N 1) |
| stunnel |
TLS scenarios only |
nginx and envoy have no splice() support. None of nginx, haproxy and envoy has
CONNECT or SOCKS, so they are measured as HTTP proxies and TCP relays only; squid and tinyproxy
only as HTTP proxies and through CONNECT, dante only through SOCKS. 3proxy
versions are built with the Makefile they shipped with (-O3 -flto). Logging
is off everywhere.
Scenarios
| scenario |
load |
| stream1, stream1-down |
one iperf3 stream, upload and download |
| stream16 |
16 iperf3 streams, upload |
| ka-1k, http-ka-1k |
1 KB answers over 64 kept-alive connections |
| http-ka-1m |
1 MB answers over 16 kept-alive connections |
| ka-50k-2000, http-ka-50k-2000 |
2000 kept-alive connections, 50 KB answers |
| http-ka-2k-50k-2000 |
the same, each request a POST with a 2 KB body |
| close-1k, http-close-1k |
64 connections, a new one for every request |
http-* go through the HTTP proxy (absolute URIs). The CONNECT, SOCKS and
relay tables run the same loads through a CONNECT tunnel, a SOCKSv5 tunnel or
a TCP relay to the origin (3proxy tcppm, nginx stream, haproxy
mode tcp): the HTTP requests are then plain HTTP inside the tunnel.
How to read the tables
- A table for each machine, ARM (the M4) and Intel (the Skylake host): the
two are different machines in different conditions, and an average of them
would mean nothing. Each cell is the median of three runs; TCP streams and
1 MB answers in Gbit/s, the other HTTP scenarios in thousands of requests
per second. "–" marks a proxy that does not serve the scenario.
- wrk runs a closed loop, each connection sending its next request once the
answer is in, so a proxy answering fewer requests shows a longer median
by that alone; what compares is the 99th percentile against the median,
how evenly a proxy serves its connections, which matters most with 2000
clients and in the mix. wrk leaves requests over 2 seconds out (they are
counted as timeouts).
- CPU time per gigabyte or request and peak memory are in the tables of the
section below. Every proxy ran at its CPU limit in the plain runs, so its
CPU per unit of work is close to the inverse of its throughput; the shaped
link runs, where the pace is set by netem, are where it separates proxies.
The four 3proxy versions and every proxy (30 October 2026)
3proxy 0.9.9.2, 1.0.2, devel (c3702866) and experimental (5de7ae2, the
head) against nginx, nginx with proxy_half_close on, haproxy, haproxy
splice-auto, envoy, squid and tinyproxy: the whole plain suite (streams,
1 KB / 1 MB / 50 KB and 2 KB+50 KB requests, a new connection per request,
the 20000-connection mix) and the same mix over a shaped link of 20 Mbit/s,
5 ms delay and 0.5% loss. Three runs of 10 s per cell plain, 20 s shaped;
medians. The proxy's cgroup is capped at 6 GB (--prx-mem-mb). The data is
in data/results-full7/.
Notes on the tables:
- dante* numbers are from the rerun of 30 October, same conditions as
the rest of the tables. dante cannot take part in a
20000-connection mix on these 8 GB machines - its process per connection
exhausts memory and the kernel kills the benchmark's origin - so the
common tables have no dante mix cells; its mix behaviour, measured with
smaller pools where it survives, is in
its own table.
- nginx errors: the plain
nginx column runs its relays without
proxy_half_close, nginx's default, and that is what its 518 (Intel) and
213 (ARM) errors in mix-relay shaped are: exchanges cut short on a
half-closed connection. nginx-halfclose, with it on, has none. nginx's
own default configuration, in other words, is what fails - it is marked
in the tables as nginx, and the fix is one directive.
- Logging is off for every proxy: 3proxy runs with no log or dlog
directive at all, nginx with
access_log off, envoy at --log-level error, squid with access_log none, tinyproxy at critical level; dante
and stunnel write their error files. No proxy was doing per-request
logging during any run.
- The Intel figures are from a clean rerun after a dante run had killed the
host's sshd; the ARM shaped mix is client-bound (2.4-2.5k req/s for every
proxy alike), so compare Intel for differences there.
- tinyproxy's 22-24k errors in the shaped mix are its connection-per-request
behaviour under loss; they are real, not a measurement artifact.
Intel — throughput (Gbit/s for streams, k req/s else) — bold = row winner
| scenario |
0.9.9.2 |
1.0.2 |
devel |
exp |
nginx |
nginx-hc |
haproxy |
hap-sa |
envoy |
squid |
tiny |
dante* |
| stream1 |
18.1 |
18.4 |
32.1 |
30.4 |
9.3 |
9.4 |
9.3 |
31.2 |
17.7 |
– |
– |
– |
| stream1-down |
19.5 |
19.6 |
31.1 |
31.3 |
9.7 |
9.7 |
9.5 |
29.1 |
17.9 |
– |
– |
– |
| stream16 |
18.6 |
18.6 |
30.4 |
29.9 |
9.6 |
9.1 |
8.8 |
28.3 |
14.7 |
– |
– |
– |
| http-ka-1k |
1.5 |
17.7 |
22.2 |
34.9 |
34.8 |
32.9 |
34.9 |
34.7 |
10.5 |
9.1 |
3.7 |
– |
| http-ka-1m |
1.7 |
2.1 |
3.3 |
3.3 |
0.7 |
0.7 |
0.9 |
2.9 |
1.5 |
0.2 |
0.1 |
– |
| http-ka-50k-2000 |
10.0 |
10.2 |
11.4 |
14.2 |
8.7 |
8.8 |
7.1 |
7.2 |
6.3 |
2.2 |
1.6 |
– |
| http-ka-2k-50k-2000 |
9.2 |
9.2 |
10.2 |
12.4 |
8.3 |
8.4 |
7.2 |
7.3 |
5.9 |
1.8 |
1.5 |
– |
| http-close-1k |
4.7 |
4.7 |
5.9 |
7.0 |
12.7 |
12.9 |
15.4 |
15.4 |
6.2 |
4.1 |
3.7 |
– |
| relay-stream1-down |
18.4 |
19.7 |
32.1 |
31.2 |
9.3 |
9.7 |
9.4 |
31.5 |
18.6 |
– |
– |
– |
| relay-stream16 |
18.7 |
18.1 |
30.2 |
31.0 |
9.4 |
9.6 |
9.1 |
29.6 |
14.5 |
– |
– |
– |
| relay-ka-1k |
30.3 |
30.4 |
30.7 |
41.4 |
46.9 |
49.1 |
45.4 |
46.5 |
35.7 |
– |
– |
– |
| relay-ka-50k-2000 |
14.7 |
14.6 |
18.0 |
21.3 |
12.4 |
12.0 |
9.6 |
19.5 |
12.5 |
– |
– |
– |
| relay-ka-2k-50k-2000 |
13.5 |
13.5 |
15.7 |
20.0 |
11.9 |
12.2 |
9.1 |
18.0 |
11.9 |
– |
– |
– |
| relay-close-1k |
5.3 |
5.0 |
6.1 |
7.0 |
7.9 |
8.2 |
8.4 |
8.1 |
5.0 |
– |
– |
– |
| connect-stream1-down |
19.1 |
19.7 |
32.4 |
32.0 |
– |
– |
– |
– |
– |
13.4 |
1.2 |
– |
| connect-stream16 |
19.0 |
18.7 |
30.8 |
32.1 |
– |
– |
– |
– |
– |
13.1 |
1.2 |
– |
| connect-ka-1k |
30.8 |
30.0 |
30.1 |
39.9 |
– |
– |
– |
– |
– |
37.7 |
29.3 |
– |
| connect-ka-50k-2000 |
13.6 |
13.0 |
15.0 |
20.2 |
– |
– |
– |
– |
– |
10.7 |
2.3 |
– |
| connect-ka-2k-50k-2000 |
12.2 |
12.4 |
13.8 |
19.7 |
– |
– |
– |
– |
– |
10.7 |
2.4 |
– |
| connect-close-1k |
4.6 |
4.3 |
5.3 |
5.5 |
– |
– |
– |
– |
– |
3.6 |
4.8 |
– |
| socks-stream1-down |
19.2 |
20.3 |
32.4 |
31.4 |
– |
– |
– |
– |
– |
– |
– |
8.3* |
| socks-stream16 |
19.2 |
18.8 |
30.5 |
29.8 |
– |
– |
– |
– |
– |
– |
– |
16.1* |
| socks-ka-1k |
31.0 |
29.1 |
30.1 |
42.0 |
– |
– |
– |
– |
– |
– |
– |
25.3* |
| socks-ka-50k-2000 |
13.7 |
13.1 |
14.7 |
21.5 |
– |
– |
– |
– |
– |
– |
– |
11.7* |
| socks-ka-2k-50k-2000 |
12.1 |
12.0 |
14.3 |
19.4 |
– |
– |
– |
– |
– |
– |
– |
11.3* |
| socks-close-1k |
4.5 |
4.4 |
5.0 |
5.1 |
– |
– |
– |
– |
– |
– |
– |
1.6* |
| mix-http |
6.0 |
6.1 |
7.8 |
9.2 |
7.4 |
7.4 |
7.2 |
8.3 |
5.4 |
2.4 |
1.6 |
– |
| mix-connect |
5.6 |
8.6 |
8.3 |
11.2 |
– |
– |
– |
– |
– |
7.0 |
2.7 |
– |
| mix-socks |
8.1 |
8.3 |
8.3 |
11.0 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay |
8.7 |
8.5 |
9.5 |
11.4 |
9.4 |
9.8 |
7.7 |
9.3 |
8.9 |
– |
– |
– |
| mix-http [shaped] |
4.0 |
3.8 |
4.2 |
5.4 |
4.3 |
4.4 |
5.0 |
5.5 |
3.3 |
1.8 |
1.5 |
– |
| mix-connect [shaped] |
4.6 |
4.6 |
4.8 |
5.8 |
– |
– |
– |
– |
– |
4.4 |
2.5 |
– |
| mix-socks [shaped] |
4.8 |
4.6 |
4.9 |
5.8 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay [shaped] |
4.7 |
4.7 |
4.9 |
6.0 |
5.5 |
5.8 |
5.4 |
5.8 |
5.1 |
– |
– |
– |
Intel — peak memory MB / errors (medians)
| scenario |
0.9.9.2 |
1.0.2 |
devel |
exp |
nginx |
nginx-hc |
haproxy |
hap-sa |
envoy |
squid |
tiny |
dante* |
| stream1 |
7 / 0 |
9 / 0 |
12 / 0 |
13 / 0 |
32 / 0 |
33 / 0 |
31 / 0 |
44 / 0 |
32 / 0 |
– |
– |
– |
| stream1-down |
8 / 0 |
7 / 0 |
13 / 0 |
10 / 0 |
33 / 0 |
33 / 0 |
31 / 0 |
43 / 0 |
32 / 0 |
– |
– |
– |
| stream16 |
93 / 0 |
89 / 0 |
97 / 0 |
103 / 0 |
108 / 0 |
107 / 0 |
53 / 0 |
105 / 0 |
152 / 0 |
– |
– |
– |
| http-ka-1k |
10 / 0 |
10 / 0 |
8 / 0 |
5 / 0 |
32 / 0 |
32 / 0 |
30 / 0 |
36 / 0 |
26 / 0 |
22 / 0 |
8 / 37007 |
– |
| http-ka-1m |
13 / 0 |
16 / 0 |
17 / 0 |
17 / 0 |
45 / 0 |
44 / 0 |
45 / 0 |
51 / 0 |
45 / 0 |
43 / 0 |
9 / 1332 |
– |
| http-ka-50k-2000 |
159 / 0 |
173 / 0 |
83 / 0 |
162 / 0 |
113 / 0 |
114 / 0 |
179 / 0 |
184 / 0 |
364 / 0 |
184 / 0 |
30 / 16222 |
– |
| http-ka-2k-50k-2000 |
156 / 0 |
179 / 0 |
80 / 0 |
162 / 0 |
119 / 0 |
117 / 0 |
179 / 0 |
184 / 0 |
367 / 0 |
190 / 0 |
30 / 15445 |
– |
| http-close-1k |
174 / 0 |
49 / 0 |
9 / 0 |
7 / 0 |
32 / 0 |
32 / 0 |
31 / 0 |
36 / 0 |
29 / 0 |
19 / 0 |
8 / 37575 |
– |
| relay-stream1-down |
9 / 0 |
7 / 0 |
13 / 0 |
12 / 0 |
32 / 0 |
33 / 0 |
31 / 0 |
44 / 0 |
33 / 0 |
– |
– |
– |
| relay-stream16 |
90 / 0 |
92 / 0 |
95 / 0 |
105 / 0 |
111 / 0 |
106 / 0 |
54 / 0 |
101 / 0 |
151 / 0 |
– |
– |
– |
| relay-ka-1k |
6 / 0 |
6 / 0 |
7 / 0 |
5 / 0 |
31 / 0 |
32 / 0 |
29 / 0 |
35 / 0 |
23 / 0 |
– |
– |
– |
| relay-ka-50k-2000 |
104 / 0 |
78 / 0 |
55 / 0 |
120 / 0 |
107 / 0 |
115 / 0 |
151 / 0 |
126 / 0 |
300 / 0 |
– |
– |
– |
| relay-ka-2k-50k-2000 |
105 / 0 |
88 / 0 |
59 / 0 |
116 / 0 |
109 / 0 |
104 / 0 |
150 / 0 |
130 / 0 |
297 / 0 |
– |
– |
– |
| relay-close-1k |
13 / 0 |
13 / 0 |
11 / 0 |
6 / 0 |
32 / 0 |
32 / 0 |
29 / 0 |
36 / 0 |
24 / 0 |
– |
– |
– |
| connect-stream1-down |
8 / 0 |
10 / 0 |
12 / 0 |
13 / 0 |
– |
– |
– |
– |
– |
21 / 0 |
2 / 0 |
– |
| connect-stream16 |
78 / 0 |
74 / 0 |
96 / 0 |
101 / 0 |
– |
– |
– |
– |
– |
65 / 0 |
71 / 0 |
– |
| connect-ka-1k |
10 / 0 |
9 / 0 |
7 / 0 |
5 / 0 |
– |
– |
– |
– |
– |
20 / 0 |
6 / 0 |
– |
| connect-ka-50k-2000 |
388 / 2 |
255 / 0 |
220 / 2 |
120 / 1 |
– |
– |
– |
– |
– |
244 / 0 |
130 / 0 |
– |
| connect-ka-2k-50k-2000 |
391 / 1 |
261 / 1 |
224 / 0 |
115 / 1 |
– |
– |
– |
– |
– |
251 / 0 |
136 / 0 |
– |
| connect-close-1k |
11 / 26 |
12 / 14 |
8 / 22 |
5 / 27 |
– |
– |
– |
– |
– |
21 / 2 |
7 / 18 |
– |
| socks-stream1-down |
7 / 0 |
7 / 0 |
10 / 0 |
11 / 0 |
– |
– |
– |
– |
– |
– |
– |
31 / 0* |
| socks-stream16 |
81 / 0 |
81 / 0 |
98 / 0 |
101 / 0 |
– |
– |
– |
– |
– |
– |
– |
84 / 0* |
| socks-ka-1k |
6 / 0 |
6 / 0 |
7 / 0 |
5 / 0 |
– |
– |
– |
– |
– |
– |
– |
98 / 0* |
| socks-ka-50k-2000 |
258 / 2 |
258 / 1 |
217 / 0 |
122 / 2 |
– |
– |
– |
– |
– |
– |
– |
1453 / 2* |
| socks-ka-2k-50k-2000 |
263 / 2 |
266 / 2 |
220 / 1 |
121 / 1 |
– |
– |
– |
– |
– |
– |
– |
1423 / 2* |
| socks-close-1k |
7 / 18 |
7 / 25 |
7 / 17 |
5 / 22 |
– |
– |
– |
– |
– |
– |
– |
131 / 9* |
| mix-http |
2950 / 0 |
2366 / 0 |
1414 / 0 |
674 / 0 |
222 / 0 |
226 / 0 |
497 / 0 |
423 / 0 |
606 / 0 |
656 / 0 |
789 / 9749 |
– |
| mix-connect |
3217 / 20497 |
2080 / 0 |
1501 / 0 |
452 / 0 |
– |
– |
– |
– |
– |
1805 / 329 |
1075 / 124 |
– |
| mix-socks |
2139 / 0 |
1979 / 0 |
1514 / 0 |
472 / 0 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay |
1785 / 0 |
1788 / 0 |
1324 / 0 |
429 / 0 |
645 / 455 |
662 / 0 |
480 / 0 |
342 / 0 |
713 / 0 |
– |
– |
– |
| mix-http [shaped] |
2995 / 0 |
2288 / 0 |
1507 / 0 |
724 / 0 |
261 / 0 |
258 / 0 |
446 / 0 |
414 / 0 |
625 / 0 |
830 / 0 |
792 / 22353 |
– |
| mix-connect [shaped] |
3320 / 2 |
2028 / 0 |
1488 / 0 |
473 / 0 |
– |
– |
– |
– |
– |
1860 / 408 |
1090 / 312 |
– |
| mix-socks [shaped] |
1958 / 0 |
1957 / 0 |
1505 / 0 |
493 / 0 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay [shaped] |
1917 / 0 |
1895 / 0 |
1411 / 0 |
472 / 0 |
688 / 518 |
706 / 0 |
458 / 0 |
418 / 0 |
719 / 0 |
– |
– |
– |
Intel — p75 / p90 / p99, ms (medians; streams have none)
| scenario |
0.9.9.2 |
1.0.2 |
devel |
exp |
nginx |
nginx-hc |
haproxy |
hap-sa |
envoy |
squid |
tiny |
dante* |
| stream1 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| stream1-down |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| stream16 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| http-ka-1k |
41 / 41 / 42 |
4 / 5 / 7 |
3 / 4 / 5 |
17 / 28 / 36 |
2 / 2 / 3 |
2 / 2 / 3 |
2 / 2 / 3 |
2 / 2 / 3 |
6 / 7 / 10 |
7 / 9 / 11 |
19 / 22 / 27 |
– |
| http-ka-1m |
25 / 41 / 45 |
9 / 12 / 17 |
6 / 7 / 10 |
6 / 8 / 11 |
24 / 27 / 32 |
24 / 26 / 31 |
21 / 23 / 27 |
6 / 7 / 8 |
12 / 13 / 15 |
69 / 74 / 84 |
126 / 136 / 160 |
– |
| http-ka-50k-2000 |
59 / 67 / 115 |
63 / 70 / 116 |
52 / 62 / 120 |
157 / 163 / 1010 |
144 / 158 / 187 |
136 / 147 / 166 |
287 / 307 / 686 |
282 / 294 / 637 |
321 / 349 / 512 |
516 / 579 / 642 |
681 / 869 / 1710 |
– |
| http-ka-2k-50k-2000 |
67 / 79 / 139 |
77 / 88 / 126 |
58 / 66 / 113 |
163 / 196 / 893 |
147 / 153 / 167 |
138 / 145 / 164 |
279 / 297 / 697 |
283 / 295 / 641 |
347 / 384 / 539 |
539 / 586 / 596 |
730 / 811 / 1690 |
– |
| http-close-1k |
16 / 19 / 23 |
15 / 19 / 24 |
12 / 14 / 20 |
11 / 14 / 21 |
5 / 6 / 7 |
5 / 6 / 7 |
4 / 5 / 6 |
4 / 5 / 6 |
11 / 12 / 16 |
16 / 18 / 23 |
19 / 21 / 27 |
– |
| relay-stream1-down |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| relay-stream16 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| relay-ka-1k |
2 / 3 / 4 |
2 / 3 / 4 |
2 / 3 / 4 |
16 / 28 / 36 |
1 / 2 / 2 |
1 / 2 / 2 |
1 / 2 / 2 |
1 / 2 / 2 |
2 / 2 / 3 |
– |
– |
– |
| relay-ka-50k-2000 |
37 / 45 / 68 |
33 / 38 / 56 |
25 / 30 / 50 |
97 / 126 / 826 |
77 / 78 / 93 |
84 / 89 / 95 |
220 / 233 / 1040 |
95 / 106 / 769 |
167 / 192 / 368 |
– |
– |
– |
| relay-ka-2k-50k-2000 |
41 / 47 / 75 |
33 / 39 / 62 |
30 / 35 / 51 |
98 / 138 / 865 |
83 / 92 / 106 |
79 / 85 / 95 |
226 / 260 / 1140 |
106 / 115 / 715 |
174 / 192 / 383 |
– |
– |
– |
| relay-close-1k |
13 / 16 / 20 |
15 / 17 / 21 |
11 / 13 / 19 |
11 / 14 / 20 |
8 / 9 / 11 |
8 / 9 / 11 |
8 / 9 / 11 |
8 / 9 / 11 |
13 / 14 / 17 |
– |
– |
– |
| connect-stream1-down |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| connect-stream16 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| connect-ka-1k |
2 / 3 / 4 |
2 / 3 / 4 |
2 / 3 / 4 |
16 / 28 / 36 |
– |
– |
– |
– |
– |
2 / 2 / 2 |
2 / 3 / 4 |
– |
| connect-ka-50k-2000 |
138 / 154 / 228 |
140 / 159 / 231 |
111 / 130 / 205 |
96 / 104 / 141 |
– |
– |
– |
– |
– |
179 / 191 / 218 |
618 / 715 / 1090 |
– |
| connect-ka-2k-50k-2000 |
148 / 169 / 228 |
142 / 159 / 225 |
121 / 149 / 190 |
97 / 102 / 142 |
– |
– |
– |
– |
– |
177 / 183 / 195 |
614 / 718 / 1340 |
– |
| connect-close-1k |
7 / 10 / 13 |
8 / 11 / 14 |
6 / 9 / 12 |
5 / 8 / 11 |
– |
– |
– |
– |
– |
12 / 13 / 17 |
7 / 10 / 12 |
– |
| socks-stream1-down |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| socks-stream16 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| socks-ka-1k |
2 / 3 / 3 |
2 / 3 / 4 |
2 / 3 / 4 |
16 / 28 / 36 |
– |
– |
– |
– |
– |
– |
– |
3 / 5 / 6* |
| socks-ka-50k-2000 |
132 / 149 / 230 |
140 / 160 / 236 |
114 / 141 / 210 |
94 / 98 / 136 |
– |
– |
– |
– |
– |
– |
– |
308 / 316 / 331* |
| socks-ka-2k-50k-2000 |
147 / 174 / 283 |
143 / 162 / 211 |
122 / 137 / 188 |
97 / 105 / 143 |
– |
– |
– |
– |
– |
– |
– |
311 / 317 / 328* |
| socks-close-1k |
7 / 10 / 14 |
8 / 11 / 14 |
7 / 9 / 12 |
6 / 9 / 13 |
– |
– |
– |
– |
– |
– |
– |
23 / 29 / 39* |
| mix-http |
11 / 49 / 5505 |
12 / 90 / 5505 |
7 / 14 / 4194 |
229 / 344 / 1769 |
164 / 254 / 4194 |
139 / 229 / 3932 |
229 / 557 / 2753 |
311 / 557 / 1442 |
377 / 426 / 508 |
86 / 1376 / 7340 |
1901 / 3670 / 5767 |
– |
| mix-connect |
90 / 213 / 3408 |
18 / 221 / 3277 |
11 / 238 / 3539 |
139 / 254 / 1901 |
– |
– |
– |
– |
– |
131 / 188 / 4063 |
188 / 1901 / 5505 |
– |
| mix-socks |
47 / 238 / 3408 |
33 / 238 / 3408 |
16 / 262 / 3539 |
147 / 262 / 1966 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay |
9 / 27 / 3408 |
8 / 18 / 3539 |
4 / 11 / 3277 |
22 / 205 / 2228 |
6 / 12 / 3146 |
5 / 12 / 3015 |
188 / 590 / 2621 |
111 / 246 / 2490 |
229 / 254 / 344 |
– |
– |
– |
| mix-http [shaped] |
98 / 819 / 6554 |
115 / 852 / 7340 |
188 / 885 / 6291 |
377 / 623 / 3539 |
262 / 442 / 6291 |
262 / 393 / 6291 |
344 / 819 / 3801 |
459 / 852 / 2032 |
623 / 721 / 950 |
754 / 1704 / 8389 |
1769 / 3277 / 6291 |
– |
| mix-connect [shaped] |
123 / 459 / 5767 |
102 / 524 / 5767 |
90 / 475 / 5243 |
279 / 557 / 3408 |
– |
– |
– |
– |
– |
188 / 295 / 5767 |
123 / 1507 / 11534 |
– |
| mix-socks [shaped] |
119 / 410 / 5243 |
123 / 393 / 5767 |
127 / 524 / 5243 |
279 / 524 / 3408 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay [shaped] |
102 / 492 / 5505 |
115 / 492 / 5767 |
86 / 508 / 5243 |
262 / 524 / 3277 |
156 / 311 / 4456 |
139 / 262 / 4194 |
328 / 623 / 2621 |
393 / 590 / 1245 |
410 / 492 / 721 |
– |
– |
– |
ARM (M4) — throughput (Gbit/s for streams, k req/s else) — bold = row winner
| scenario |
0.9.9.2 |
1.0.2 |
devel |
exp |
nginx |
nginx-hc |
haproxy |
hap-sa |
envoy |
squid |
tiny |
dante* |
| stream1 |
24.2 |
25.2 |
62.7 |
62.0 |
18.7 |
19.3 |
9.0 |
27.0 |
34.8 |
– |
– |
– |
| stream1-down |
24.5 |
25.0 |
61.1 |
59.9 |
19.7 |
20.0 |
8.9 |
26.3 |
33.7 |
– |
– |
– |
| stream16 |
23.8 |
24.3 |
55.6 |
48.2 |
18.8 |
18.7 |
9.6 |
27.4 |
20.0 |
– |
– |
– |
| http-ka-1k |
1.5 |
15.5 |
16.6 |
35.6 |
44.2 |
44.9 |
50.0 |
50.0 |
25.0 |
22.2 |
4.5 |
– |
| http-ka-1m |
2.3 |
3.1 |
5.5 |
5.5 |
1.7 |
1.6 |
0.7 |
2.2 |
3.0 |
0.4 |
0.1 |
– |
| http-ka-50k-2000 |
10.1 |
10.1 |
10.3 |
16.5 |
14.4 |
14.4 |
10.3 |
10.2 |
11.0 |
4.3 |
1.9 |
– |
| http-ka-2k-50k-2000 |
8.9 |
9.3 |
9.3 |
14.1 |
13.3 |
13.1 |
9.7 |
9.7 |
11.2 |
3.2 |
1.9 |
– |
| http-close-1k |
4.6 |
4.8 |
5.7 |
9.4 |
14.1 |
14.0 |
16.6 |
16.5 |
15.5 |
7.4 |
4.6 |
– |
| relay-stream1-down |
24.2 |
24.3 |
64.3 |
61.3 |
19.5 |
19.5 |
9.2 |
27.4 |
33.8 |
– |
– |
– |
| relay-stream16 |
24.2 |
23.8 |
55.7 |
48.5 |
18.8 |
18.6 |
8.8 |
28.0 |
19.9 |
– |
– |
– |
| relay-ka-1k |
21.0 |
20.7 |
20.8 |
37.5 |
52.4 |
52.2 |
51.8 |
50.1 |
38.0 |
– |
– |
– |
| relay-ka-50k-2000 |
12.6 |
12.4 |
12.7 |
23.0 |
18.1 |
18.0 |
14.2 |
25.2 |
14.7 |
– |
– |
– |
| relay-ka-2k-50k-2000 |
11.5 |
11.5 |
11.7 |
21.4 |
16.3 |
16.4 |
13.2 |
23.5 |
14.2 |
– |
– |
– |
| relay-close-1k |
5.3 |
5.3 |
6.2 |
10.2 |
8.8 |
8.8 |
10.2 |
10.2 |
9.3 |
– |
– |
– |
| connect-stream1-down |
24.4 |
25.5 |
63.6 |
59.6 |
– |
– |
– |
– |
– |
15.3 |
1.5 |
– |
| connect-stream16 |
24.1 |
24.1 |
55.0 |
48.1 |
– |
– |
– |
– |
– |
20.0 |
1.5 |
– |
| connect-ka-1k |
20.5 |
20.2 |
20.2 |
35.1 |
– |
– |
– |
– |
– |
42.2 |
17.4 |
– |
| connect-ka-50k-2000 |
11.7 |
11.7 |
11.8 |
22.9 |
– |
– |
– |
– |
– |
16.1 |
2.6 |
– |
| connect-ka-2k-50k-2000 |
10.8 |
10.7 |
10.9 |
21.4 |
– |
– |
– |
– |
– |
15.2 |
2.5 |
– |
| connect-close-1k |
4.1 |
4.1 |
4.7 |
6.0 |
– |
– |
– |
– |
– |
5.4 |
4.3 |
– |
| socks-stream1-down |
24.6 |
25.0 |
61.0 |
69.3 |
– |
– |
– |
– |
– |
– |
– |
11.3* |
| socks-stream16 |
24.1 |
24.2 |
55.8 |
47.2 |
– |
– |
– |
– |
– |
– |
– |
15.5* |
| socks-ka-1k |
20.6 |
20.5 |
20.2 |
35.4 |
– |
– |
– |
– |
– |
– |
– |
28.2* |
| socks-ka-50k-2000 |
11.8 |
11.8 |
12.0 |
23.0 |
– |
– |
– |
– |
– |
– |
– |
14.3* |
| socks-ka-2k-50k-2000 |
10.9 |
10.8 |
11.0 |
21.6 |
– |
– |
– |
– |
– |
– |
– |
14.2* |
| socks-close-1k |
3.9 |
3.9 |
4.4 |
5.7 |
– |
– |
– |
– |
– |
– |
– |
3.6* |
| mix-http |
4.9 |
4.7 |
5.6 |
8.6 |
9.2 |
9.2 |
7.5 |
9.3 |
7.2 |
3.0 |
1.8 |
– |
| mix-connect |
5.7 |
6.2 |
6.0 |
9.8 |
– |
– |
– |
– |
– |
7.9 |
2.4 |
– |
| mix-socks |
6.2 |
6.3 |
6.1 |
9.8 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay |
6.6 |
6.5 |
6.3 |
9.8 |
8.8 |
8.9 |
7.5 |
8.9 |
7.9 |
– |
– |
– |
| mix-http [shaped] |
2.3 |
2.3 |
2.3 |
2.4 |
2.5 |
2.5 |
2.5 |
2.5 |
2.5 |
2.5 |
1.6 |
– |
| mix-connect [shaped] |
2.4 |
2.4 |
2.4 |
2.5 |
– |
– |
– |
– |
– |
2.5 |
2.1 |
– |
| mix-socks [shaped] |
2.4 |
2.4 |
2.4 |
2.5 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay [shaped] |
2.4 |
2.4 |
2.4 |
2.5 |
2.5 |
2.5 |
2.5 |
2.5 |
2.5 |
– |
– |
– |
ARM (M4) — peak memory MB / errors (medians)
| scenario |
0.9.9.2 |
1.0.2 |
devel |
exp |
nginx |
nginx-hc |
haproxy |
hap-sa |
envoy |
squid |
tiny |
dante* |
| stream1 |
18 / 0 |
18 / 0 |
23 / 0 |
35 / 0 |
33 / 0 |
33 / 0 |
34 / 0 |
41 / 0 |
22 / 0 |
– |
– |
– |
| stream1-down |
20 / 0 |
20 / 0 |
22 / 0 |
34 / 0 |
37 / 0 |
36 / 0 |
34 / 0 |
43 / 0 |
24 / 0 |
– |
– |
– |
| stream16 |
107 / 0 |
126 / 0 |
126 / 0 |
111 / 0 |
60 / 0 |
58 / 0 |
46 / 0 |
134 / 0 |
184 / 0 |
– |
– |
– |
| http-ka-1k |
131 / 0 |
131 / 0 |
134 / 0 |
28 / 0 |
34 / 0 |
34 / 0 |
35 / 0 |
41 / 0 |
19 / 0 |
26 / 0 |
135 / 44575 |
– |
| http-ka-1m |
55 / 0 |
58 / 0 |
58 / 0 |
43 / 0 |
47 / 0 |
45 / 0 |
38 / 0 |
47 / 0 |
39 / 0 |
36 / 0 |
41 / 1475 |
– |
| http-ka-50k-2000 |
241 / 0 |
231 / 0 |
229 / 0 |
185 / 0 |
77 / 0 |
73 / 0 |
159 / 0 |
165 / 0 |
255 / 0 |
158 / 0 |
158 / 19051 |
– |
| http-ka-2k-50k-2000 |
254 / 0 |
240 / 0 |
232 / 0 |
184 / 0 |
72 / 0 |
76 / 0 |
156 / 0 |
166 / 0 |
325 / 0 |
175 / 0 |
175 / 18947 |
– |
| http-close-1k |
197 / 0 |
161 / 0 |
136 / 0 |
31 / 0 |
33 / 0 |
34 / 0 |
35 / 0 |
41 / 0 |
20 / 0 |
25 / 0 |
133 / 45992 |
– |
| relay-stream1-down |
20 / 0 |
19 / 0 |
23 / 0 |
35 / 0 |
35 / 0 |
34 / 0 |
34 / 0 |
43 / 0 |
24 / 0 |
– |
– |
– |
| relay-stream16 |
95 / 0 |
101 / 0 |
103 / 0 |
125 / 0 |
63 / 0 |
57 / 0 |
39 / 0 |
100 / 0 |
127 / 0 |
– |
– |
– |
| relay-ka-1k |
130 / 0 |
130 / 0 |
16 / 0 |
28 / 0 |
33 / 0 |
35 / 0 |
34 / 0 |
40 / 0 |
17 / 0 |
– |
– |
– |
| relay-ka-50k-2000 |
197 / 0 |
197 / 0 |
101 / 0 |
143 / 0 |
114 / 0 |
114 / 0 |
165 / 0 |
142 / 0 |
242 / 0 |
– |
– |
– |
| relay-ka-2k-50k-2000 |
199 / 0 |
198 / 0 |
112 / 0 |
143 / 0 |
110 / 0 |
107 / 0 |
165 / 0 |
140 / 0 |
225 / 0 |
– |
– |
– |
| relay-close-1k |
146 / 0 |
149 / 0 |
18 / 0 |
30 / 0 |
35 / 0 |
35 / 0 |
34 / 0 |
40 / 0 |
19 / 0 |
– |
– |
– |
| connect-stream1-down |
19 / 0 |
20 / 0 |
25 / 0 |
34 / 0 |
– |
– |
– |
– |
– |
23 / 0 |
23 / 0 |
– |
| connect-stream16 |
133 / 0 |
116 / 0 |
132 / 0 |
108 / 0 |
– |
– |
– |
– |
– |
122 / 0 |
122 / 0 |
– |
| connect-ka-1k |
131 / 0 |
133 / 0 |
132 / 0 |
29 / 0 |
– |
– |
– |
– |
– |
32 / 0 |
133 / 0 |
– |
| connect-ka-50k-2000 |
434 / 0 |
341 / 1 |
340 / 0 |
147 / 0 |
– |
– |
– |
– |
– |
368 / 0 |
368 / 0 |
– |
| connect-ka-2k-50k-2000 |
436 / 0 |
344 / 0 |
343 / 0 |
140 / 0 |
– |
– |
– |
– |
– |
375 / 0 |
375 / 0 |
– |
| connect-close-1k |
132 / 5 |
132 / 1 |
134 / 6 |
30 / 4 |
– |
– |
– |
– |
– |
32 / 0 |
129 / 1 |
– |
| socks-stream1-down |
20 / 0 |
19 / 0 |
21 / 0 |
35 / 0 |
– |
– |
– |
– |
– |
– |
– |
13 / 0* |
| socks-stream16 |
109 / 0 |
123 / 0 |
94 / 0 |
81 / 0 |
– |
– |
– |
– |
– |
– |
– |
116 / 0* |
| socks-ka-1k |
131 / 0 |
131 / 0 |
18 / 0 |
28 / 0 |
– |
– |
– |
– |
– |
– |
– |
40 / 0* |
| socks-ka-50k-2000 |
333 / 0 |
333 / 1 |
225 / 0 |
143 / 1 |
– |
– |
– |
– |
– |
– |
– |
785 / 0* |
| socks-ka-2k-50k-2000 |
335 / 2 |
336 / 0 |
228 / 0 |
145 / 1 |
– |
– |
– |
– |
– |
– |
– |
787 / 0* |
| socks-close-1k |
132 / 5 |
134 / 4 |
18 / 5 |
29 / 5 |
– |
– |
– |
– |
– |
– |
– |
59 / 2* |
| mix-http |
3031 / 0 |
2457 / 0 |
1676 / 0 |
721 / 0 |
192 / 0 |
188 / 0 |
311 / 0 |
306 / 0 |
635 / 0 |
873 / 0 |
976 / 11770 |
– |
| mix-connect |
3323 / 0 |
2603 / 0 |
1626 / 0 |
494 / 0 |
– |
– |
– |
– |
– |
2850 / 382 |
1135 / 108 |
– |
| mix-socks |
2137 / 0 |
2167 / 0 |
1523 / 0 |
526 / 0 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay |
1932 / 0 |
1952 / 0 |
1333 / 0 |
480 / 0 |
794 / 422 |
794 / 0 |
474 / 0 |
358 / 0 |
644 / 0 |
– |
– |
– |
| mix-http [shaped] |
3348 / 0 |
2602 / 0 |
1871 / 0 |
1079 / 0 |
657 / 0 |
660 / 0 |
504 / 0 |
479 / 0 |
775 / 144 |
846 / 0 |
968 / 24582 |
– |
| mix-connect [shaped] |
3423 / 1 |
2613 / 0 |
1872 / 0 |
696 / 0 |
– |
– |
– |
– |
– |
3007 / 224 |
1137 / 471 |
– |
| mix-socks [shaped] |
2156 / 0 |
2154 / 0 |
1777 / 0 |
716 / 0 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay [shaped] |
2054 / 1 |
2052 / 0 |
1678 / 0 |
688 / 0 |
1090 / 213 |
1093 / 0 |
530 / 0 |
529 / 0 |
831 / 0 |
– |
– |
– |
ARM (M4) — p75 / p90 / p99, ms (medians; streams have none)
| scenario |
0.9.9.2 |
1.0.2 |
devel |
exp |
nginx |
nginx-hc |
haproxy |
hap-sa |
envoy |
squid |
tiny |
dante* |
| stream1 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| stream1-down |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| stream16 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| http-ka-1k |
44 / 46 / 53 |
5 / 6 / 10 |
5 / 6 / 10 |
3 / 4 / 8 |
2 / 2 / 2 |
1 / 2 / 2 |
1 / 2 / 2 |
1 / 2 / 2 |
3 / 3 / 4 |
3 / 3 / 4 |
16 / 19 / 23 |
– |
| http-ka-1m |
27 / 36 / 43 |
6 / 8 / 12 |
4 / 5 / 8 |
4 / 5 / 8 |
11 / 14 / 19 |
11 / 14 / 20 |
25 / 26 / 28 |
8 / 8 / 9 |
6 / 6 / 7 |
47 / 48 / 52 |
118 / 123 / 136 |
– |
| http-ka-50k-2000 |
77 / 101 / 474 |
78 / 101 / 256 |
75 / 99 / 257 |
120 / 124 / 561 |
58 / 64 / 70 |
55 / 61 / 69 |
191 / 197 / 705 |
196 / 200 / 682 |
184 / 193 / 324 |
280 / 295 / 507 |
572 / 617 / 1430 |
– |
| http-ka-2k-50k-2000 |
96 / 124 / 299 |
90 / 114 / 243 |
85 / 110 / 591 |
144 / 146 / 538 |
53 / 58 / 66 |
57 / 63 / 68 |
207 / 214 / 761 |
205 / 214 / 760 |
182 / 201 / 305 |
312 / 340 / 359 |
568 / 603 / 1400 |
– |
| http-close-1k |
15 / 18 / 22 |
15 / 17 / 21 |
12 / 15 / 19 |
8 / 10 / 14 |
5 / 5 / 5 |
5 / 5 / 5 |
4 / 4 / 5 |
4 / 4 / 5 |
4 / 5 / 6 |
9 / 9 / 10 |
16 / 18 / 22 |
– |
| relay-stream1-down |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| relay-stream16 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| relay-ka-1k |
4 / 5 / 8 |
4 / 5 / 8 |
4 / 5 / 8 |
2 / 4 / 6 |
1 / 1 / 2 |
1 / 1 / 2 |
1 / 1 / 2 |
1 / 2 / 2 |
2 / 2 / 3 |
– |
– |
– |
| relay-ka-50k-2000 |
64 / 86 / 531 |
67 / 88 / 400 |
63 / 85 / 274 |
95 / 95 / 353 |
58 / 66 / 73 |
56 / 64 / 147 |
140 / 145 / 948 |
81 / 85 / 1290 |
139 / 148 / 268 |
– |
– |
– |
| relay-ka-2k-50k-2000 |
74 / 97 / 404 |
71 / 91 / 224 |
70 / 91 / 432 |
96 / 99 / 366 |
54 / 60 / 66 |
54 / 61 / 66 |
151 / 154 / 905 |
88 / 92 / 1280 |
143 / 150 / 261 |
– |
– |
– |
| relay-close-1k |
14 / 16 / 19 |
14 / 16 / 20 |
11 / 13 / 18 |
8 / 10 / 14 |
7 / 8 / 9 |
7 / 8 / 8 |
6 / 7 / 7 |
6 / 7 / 7 |
7 / 8 / 9 |
– |
– |
– |
| connect-stream1-down |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| connect-stream16 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| connect-ka-1k |
4 / 5 / 7 |
4 / 5 / 7 |
4 / 5 / 8 |
3 / 4 / 7 |
– |
– |
– |
– |
– |
2 / 2 / 2 |
4 / 5 / 8 |
– |
| connect-ka-50k-2000 |
186 / 234 / 358 |
184 / 232 / 347 |
186 / 234 / 352 |
95 / 95 / 98 |
– |
– |
– |
– |
– |
123 / 127 / 130 |
761 / 879 / 1600 |
– |
| connect-ka-2k-50k-2000 |
196 / 244 / 367 |
202 / 248 / 368 |
194 / 239 / 358 |
96 / 97 / 109 |
– |
– |
– |
– |
– |
129 / 134 / 139 |
795 / 918 / 1670 |
– |
| connect-close-1k |
9 / 12 / 14 |
10 / 12 / 14 |
8 / 11 / 13 |
6 / 8 / 11 |
– |
– |
– |
– |
– |
8 / 9 / 10 |
10 / 12 / 15 |
– |
| socks-stream1-down |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| socks-stream16 |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
– |
| socks-ka-1k |
4 / 5 / 7 |
4 / 5 / 7 |
4 / 5 / 8 |
3 / 4 / 7 |
– |
– |
– |
– |
– |
– |
– |
4 / 4 / 4* |
| socks-ka-50k-2000 |
187 / 234 / 351 |
188 / 233 / 347 |
184 / 231 / 351 |
95 / 95 / 98 |
– |
– |
– |
– |
– |
– |
– |
188 / 191 / 203* |
| socks-ka-2k-50k-2000 |
196 / 242 / 355 |
201 / 246 / 360 |
195 / 239 / 350 |
95 / 96 / 102 |
– |
– |
– |
– |
– |
– |
– |
188 / 191 / 200* |
| socks-close-1k |
10 / 12 / 15 |
10 / 12 / 15 |
9 / 11 / 14 |
7 / 9 / 12 |
– |
– |
– |
– |
– |
– |
– |
11 / 15 / 19* |
| mix-http |
19 / 51 / 6554 |
16 / 35 / 7078 |
16 / 30 / 5767 |
188 / 295 / 2097 |
6 / 11 / 3277 |
6 / 11 / 3277 |
262 / 295 / 2228 |
213 / 221 / 1835 |
279 / 311 / 377 |
459 / 1049 / 4981 |
1016 / 3146 / 5243 |
– |
| mix-connect |
180 / 344 / 5243 |
164 / 344 / 4719 |
172 / 344 / 4719 |
197 / 262 / 1245 |
– |
– |
– |
– |
– |
90 / 156 / 3408 |
655 / 819 / 4456 |
– |
| mix-socks |
147 / 311 / 4456 |
147 / 311 / 4719 |
188 / 344 / 4719 |
197 / 262 / 1114 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay |
14 / 29 / 4719 |
15 / 27 / 4719 |
16 / 32 / 4719 |
139 / 221 / 1966 |
6 / 13 / 3408 |
6 / 12 / 3277 |
94 / 655 / 3539 |
66 / 254 / 2884 |
254 / 279 / 377 |
– |
– |
– |
| mix-http [shaped] |
852 / 1966 / 6291 |
819 / 1966 / 6554 |
819 / 1835 / 6291 |
786 / 1835 / 6291 |
786 / 1769 / 6029 |
754 / 1769 / 6029 |
754 / 1769 / 6029 |
754 / 1769 / 6029 |
754 / 1704 / 6029 |
524 / 1376 / 8389 |
1638 / 3015 / 6029 |
– |
| mix-connect [shaped] |
786 / 1835 / 6554 |
754 / 1835 / 6554 |
786 / 1835 / 6291 |
754 / 1769 / 6291 |
– |
– |
– |
– |
– |
754 / 1769 / 6291 |
442 / 786 / 9437 |
– |
| mix-socks [shaped] |
786 / 1835 / 6291 |
754 / 1835 / 6291 |
754 / 1769 / 6291 |
754 / 1769 / 6291 |
– |
– |
– |
– |
– |
– |
– |
– |
| mix-relay [shaped] |
786 / 1835 / 6291 |
786 / 1835 / 6291 |
754 / 1835 / 6291 |
786 / 1769 / 6029 |
786 / 1769 / 6029 |
786 / 1769 / 6029 |
786 / 1769 / 6029 |
786 / 1769 / 6029 |
754 / 1769 / 6291 |
– |
– |
– |
dante in the shaped mix, by pool size (ARM, earlier runs)
Dante keeps a process per connection, so its memory grows with the pool;
20000 connections cannot be measured on an 8 GB machine at all.
| pool |
dante: rate, p99, cpu s/GB, peak |
experimental: the same |
| 2000 |
2.50k, 0.48 s, 8.8, 796 MB |
2.58k, 0.72 s, 6.1, 110 MB |
| 10000 |
2.13k, 6.29 s, 10.1, 3710 MB |
2.43k, 3.80 s, 7.8, 403 MB |
| 20000 |
OOM: the origin is killed (ARM), or 0 req/s with 5 GB (Intel) |
6.0k req/s on Intel plain |
Caveats
- Every scenario but the mix ones is synthetic: the links between the
client, the proxy and the origin have no bandwidth limit and no delay, and
one or a few kinds of request are repeated, so each connection goes as fast
as the CPUs allow. The mix scenarios, many connections with web-like
exchanges, and above all over the shaped link, are the closest to a proxy
giving clients access to the Internet.
- Both machines are virtual: their CPUs cannot be pinned to physical cores, so
absolute figures move between sessions; compare within a table.
- The roles have CPUs of their own but share the memory, and memory bandwidth,
which copying proxies use most, cannot be split. On the Skylake host it may
well be the limit; a CPU waiting for memory counts as busy, so this shows as
less work per busy second rather than as idle time.
- wrk measures in a closed loop: a slower proxy is offered less load, so
latencies compare only between runs of similar throughput, and requests over
2 seconds are left out of its latency figures.
- The tool versions differ between the machines (haproxy 3.2 against 3.0,
nginx 1.28 against 1.26, squid 7.7 against 6.10); both envoy builds are
the same 1.34.1 binary.
- In the tunnel scenarios proxychains-ng's work is done in the client: with a
new tunnel for every request it sets the pace on the M4.
- The shaped ARM mix is client-bound: every proxy lands at 2.4-2.5k req/s,
so the shaped tables' differences are meaningful on Intel only; ARM still
separates the proxies by errors and CPU.
bb52a5fb0e