----------------------------------------------------------------------
Autobench

./autobench --single_host --host1 127.0.0.1 --uri1 /index.html.en     \
          --low_rate 20 --high_rate 200 --rate_step 20 --num_call 10 \
          --num_conn 5000 --timeout 5 --file results.tsv

index.html.en is a 34 byte file. 

 Will benchmark our server, with a series of tests starting at 20 connections per second (with 10 requests per connection), and increasing by 20 connections per second until 200 connections a second are being requested. Each test will comprise a total of 5000 connections, and any responses which take longer than 5 seconds to arrive will be counted as errors. The results will be saved in the file 'results.tsv'. We run this for 256 server threads and 128 server threads on samwise and idaho-lnx.

-----------------------------------------------------------------------

Simple httperf tests

Here are some weak benchmarks:

all the same filesize, which is 50K all fresh files, this should show some good results w/o caching getting in the way.





--------------------------
SAMWISE


samwise (dp), 256 server threads:

[puyan@samwise:bin]% ./httperf --server=localhost --port=1337 --uri /test256_dp\
   --rate 5000 --num-conn 10000 \
   --num-call 1 --timeout 5
httperf --timeout=5 --client=0/1 --server=localhost --port=1337 --uri=/test256_dp --rate=5000 --send-buffer=4096 --recv-buffer=16384 --num-conns=10000 --num-calls=1
Maximum connect burst length: 4279

Total: connections 1261 requests 1246 replies 570 test-duration 9.056 s

Connection rate: 139.2 conn/s (7.2 ms/conn, <=1022 concurrent connections)
Connection time [ms]: min 17.3 avg 2741.3 max 5878.4 median 2425.5 stddev 1665.6
Connection time [ms]: connect 1114.5
Connection length [replies/conn]: 1.000

Request rate: 137.6 req/s (7.3 ms/req)
Request size [B]: 70.0

Reply rate [replies/s]: min 95.6 avg 95.6 max 95.6 stddev 0.0 (1 samples)
Reply time [ms]: response 2108.7 transfer 117.2
Reply size [B]: header 215.0 content 51200.0 footer 0.0 (total 51415.0)
Reply status: 1xx=0 2xx=570 3xx=0 4xx=0 5xx=0

CPU time [s]: user 0.11 system 7.26 (user 1.2% system 80.1% total 81.3%)
Net I/O: 3169.7 KB/s (26.0*10^6 bps)

Errors: total 9430 client-timo 691 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 8739 addrunavail 0 ftab-full 0 other 0













samwise (dp), 128 server threads:

[puyan@samwise:bin]% ./httperf --server=localhost --port=1337 --uri /test128_dp\
   --rate 5000 --num-conn 10000 \
   --num-call 1 --timeout 5
httperf --timeout=5 --client=0/1 --server=localhost --port=1337 --uri=/test128_dp --rate=5000 --send-buffer=4096 --recv-buffer=16384 --num-conns=10000 --num-calls=1
Maximum connect burst length: 8303

Total: connections 1021 requests 947 replies 767 test-duration 10.066 s

Connection rate: 101.4 conn/s (9.9 ms/conn, <=1022 concurrent connections)
Connection time [ms]: min 4946.5 avg 5018.8 max 5065.0 median 5027.5 stddev 34.2
Connection time [ms]: connect 1702.5
Connection length [replies/conn]: 1.000

Request rate: 94.1 req/s (10.6 ms/req)
Request size [B]: 70.0

Reply rate [replies/s]: min 0.0 avg 76.7 max 153.4 stddev 108.5 (2 samples)
Reply time [ms]: response 2087.0 transfer 1490.4
Reply size [B]: header 215.0 content 51200.0 footer 0.0 (total 51415.0)
Reply status: 1xx=0 2xx=767 3xx=0 4xx=0 5xx=0

CPU time [s]: user 0.08 system 5.11 (user 0.8% system 50.8% total 51.5%)
Net I/O: 3832.3 KB/s (31.4*10^6 bps)

Errors: total 9233 client-timo 254 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 8979 addrunavail 0 ftab-full 0 other 0











samwise (dp), 32 server threads:

[puyan@samwise:bin]% ./httperf --server=localhost --port=1337 --uri /test32_dp\
   --rate 5000 --num-conn 10000 \
   --num-call 1 --timeout 5
httperf --timeout=5 --client=0/1 --server=localhost --port=1337 --uri=/test32_dp --rate=5000 --send-buffer=4096 --recv-buffer=16384 --num-conns=10000 --num-calls=1
Maximum connect burst length: 6055

Total: connections 1021 requests 533 replies 398 test-duration 6.821 s

Connection rate: 149.7 conn/s (6.7 ms/conn, <=1022 concurrent connections)
Connection time [ms]: min 6699.5 avg 6738.5 max 6769.8 median 6735.5 stddev 20.5
Connection time [ms]: connect 1439.3
Connection length [replies/conn]: 1.000

Request rate: 78.1 req/s (12.8 ms/req)
Request size [B]: 69.0

Reply rate [replies/s]: min 0.0 avg 0.0 max 0.0 stddev 0.0 (1 samples)
Reply time [ms]: response 4096.1 transfer 59.5
Reply size [B]: header 215.0 content 51200.0 footer 0.0 (total 51415.0)
Reply status: 1xx=0 2xx=398 3xx=0 4xx=0 5xx=0

CPU time [s]: user 0.03 system 0.16 (user 0.5% system 2.3% total 2.8%)
Net I/O: 2934.8 KB/s (24.0*10^6 bps)

Errors: total 9602 client-timo 623 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 8979 addrunavail 0 ftab-full 0 other 0










samwise (dp), 8 server threads:

[puyan@samwise:bin]% ./httperf --server=localhost --port=1337 --uri /test8_dp\
   --rate 5000 --num-conn 10000 \
   --num-call 1 --timeout 5
httperf --timeout=5 --client=0/1 --server=localhost --port=1337 --uri=/test8_dp --rate=5000 --send-buffer=4096 --recv-buffer=16384 --num-conns=10000 --num-calls=1
Maximum connect burst length: 2154

Total: connections 1266 requests 1266 replies 502 test-duration 8.029 s

Connection rate: 157.7 conn/s (6.3 ms/conn, <=1022 concurrent connections)
Connection time [ms]: min 13.1 avg 2297.8 max 4978.7 median 1970.5 stddev 1406.2
Connection time [ms]: connect 295.1
Connection length [replies/conn]: 1.000

Request rate: 157.7 req/s (6.3 ms/req)
Request size [B]: 68.0

Reply rate [replies/s]: min 98.6 avg 98.6 max 98.6 stddev 0.0 (1 samples)
Reply time [ms]: response 2263.7 transfer 44.3
Reply size [B]: header 215.0 content 51200.0 footer 0.0 (total 51415.0)
Reply status: 1xx=0 2xx=502 3xx=0 4xx=0 5xx=0

CPU time [s]: user 0.10 system 6.47 (user 1.3% system 80.6% total 81.9%)
Net I/O: 3149.7 KB/s (25.8*10^6 bps)

Errors: total 9498 client-timo 764 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 8734 addrunavail 0 ftab-full 0 other 0



END SAMWISE
--------------------------------------



IDAHO-LNX









idaho (up), 256 server threads:

[puyan@idaho-lnx:bin]% ./httperf --server=localhost --port=1337 --uri /test256_up\
   --rate 5000 --num-conn 10000 \
   --num-call 1 --timeout 5
httperf --timeout=5 --client=0/1 --server=localhost --port=1337 --uri=/test256_up --rate=5000 --send-buffer=4096 --recv-buffer=16384 --num-conns=10000 --num-calls=1
Maximum connect burst length: 6325

Total: connections 1021 requests 907 replies 216 test-duration 10.141 s

Connection rate: 100.7 conn/s (9.9 ms/conn, <=1022 concurrent connections)
Connection time [ms]: min 5178.3 avg 5191.1 max 5206.4 median 5190.5 stddev 8.1
Connection time [ms]: connect 3547.8
Connection length [replies/conn]: 1.000

Request rate: 89.4 req/s (11.2 ms/req)
Request size [B]: 70.0

Reply rate [replies/s]: min 0.0 avg 21.6 max 43.2 stddev 30.6 (2 samples)
Reply time [ms]: response 4126.7 transfer 459.0
Reply size [B]: header 215.0 content 51200.0 footer 0.0 (total 51415.0)
Reply status: 1xx=0 2xx=216 3xx=0 4xx=0 5xx=0

CPU time [s]: user 0.06 system 5.11 (user 0.6% system 50.4% total 50.9%)
Net I/O: 1075.6 KB/s (8.8*10^6 bps)

Errors: total 9784 client-timo 805 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 8979 addrunavail 0 ftab-full 0 other 0








idaho (up), 128 server threads:


[puyan@idaho-lnx:bin]% ./httperf --server=localhost --port=1337 --uri /test128_up\
   --rate 5000 --num-conn 10000 \
   --num-call 1 --timeout 5
httperf --timeout=5 --client=0/1 --server=localhost --port=1337 --uri=/test128_up --rate=5000 --send-buffer=4096 --recv-buffer=16384 --num-conns=10000 --num-calls=1
Maximum connect burst length: 4085

Total: connections 1021 requests 280 replies 217 test-duration 11.141 s

Connection rate: 91.6 conn/s (10.9 ms/conn, <=1022 concurrent connections)
Connection time [ms]: min 6356.4 avg 6383.9 max 6409.9 median 6404.5 stddev 24.0
Connection time [ms]: connect 1068.0
Connection length [replies/conn]: 1.000

Request rate: 25.1 req/s (39.8 ms/req)
Request size [B]: 70.0

Reply rate [replies/s]: min 0.0 avg 21.7 max 43.4 stddev 30.7 (2 samples)
Reply time [ms]: response 4429.1 transfer 52.7
Reply size [B]: header 215.0 content 51200.0 footer 0.0 (total 51415.0)
Reply status: 1xx=0 2xx=217 3xx=0 4xx=0 5xx=0

CPU time [s]: user 1.03 system 3.93 (user 9.3% system 35.3% total 44.5%)
Net I/O: 979.7 KB/s (8.0*10^6 bps)

Errors: total 9783 client-timo 804 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 8979 addrunavail 0 ftab-full 0 other 0




idaho (up), 32 server threads:

[puyan@idaho-lnx:bin]% ./httperf --server=localhost --port=1337 --uri /test32_up\
   --rate 5000 --num-conn 10000 \
   --num-call 1 --timeout 5
httperf --timeout=5 --client=0/1 --server=localhost --port=1337 --uri=/test32_up --rate=5000 --send-buffer=4096 --recv-buffer=16384 --num-conns=10000 --num-calls=1
Maximum connect burst length: 9059

Total: connections 1021 requests 908 replies 219 test-duration 10.132 s

Connection rate: 100.8 conn/s (9.9 ms/conn, <=1022 concurrent connections)
Connection time [ms]: min 5161.0 avg 5171.2 max 5182.2 median 5170.5 stddev 5.9
Connection time [ms]: connect 3798.6
Connection length [replies/conn]: 1.000

Request rate: 89.6 req/s (11.2 ms/req)
Request size [B]: 69.0

Reply rate [replies/s]: min 0.0 avg 21.9 max 43.8 stddev 31.0 (2 samples)
Reply time [ms]: response 3557.4 transfer 745.5
Reply size [B]: header 215.0 content 51200.0 footer 0.0 (total 51415.0)
Reply status: 1xx=0 2xx=219 3xx=0 4xx=0 5xx=0

CPU time [s]: user 0.06 system 5.13 (user 0.6% system 50.6% total 51.2%)
Net I/O: 1091.3 KB/s (8.9*10^6 bps)

Errors: total 9781 client-timo 802 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 8979 addrunavail 0 ftab-full 0 other 0






idaho (up), 8 server threads:

[puyan@idaho-lnx:bin]% ./httperf --server=localhost --port=1337 --uri /test8_up\
   --rate 5000 --num-conn 10000 \
   --num-call 1 --timeout 5
httperf --timeout=5 --client=0/1 --server=localhost --port=1337 --uri=/test8_up --rate=5000 --send-buffer=4096 --recv-buffer=16384 --num-conns=10000 --num-calls=1
Maximum connect burst length: 6259

Total: connections 1021 requests 335 replies 222 test-duration 12.119 s

Connection rate: 84.2 conn/s (11.9 ms/conn, <=1022 concurrent connections)
Connection time [ms]: min 7510.1 avg 7535.2 max 7572.7 median 7550.5 stddev 21.1
Connection time [ms]: connect 2099.3
Connection length [replies/conn]: 1.000

Request rate: 27.6 req/s (36.2 ms/req)
Request size [B]: 68.0

Reply rate [replies/s]: min 0.0 avg 22.2 max 44.4 stddev 31.4 (2 samples)
Reply time [ms]: response 4144.5 transfer 61.2
Reply size [B]: header 215.0 content 51200.0 footer 0.0 (total 51415.0)
Reply status: 1xx=0 2xx=222 3xx=0 4xx=0 5xx=0

CPU time [s]: user 1.18 system 3.61 (user 9.8% system 29.8% total 39.5%)
Net I/O: 921.6 KB/s (7.5*10^6 bps)

Errors: total 9778 client-timo 799 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 8979 addrunavail 0 ftab-full 0 other 0