Socket Performance Testing
RPC
Local loopback
Key:
- Num Clients - the number of independent client processes
- Client Threads - value given for
cougar.client.socket.clientExecutor.maximumPoolSizeand the number of client threads trying to make RPC calls. - Server Threads - value given for
cougar.socket.serverExecutor.maximumPoolSizeandcougar.commandProcessor.maximumPoolSize - Total TPS - average total throughput on the server during the test
- Avg Latency - average response time for each RPC operation during the test (ms)
| Num Clients | Client Threads | Server Threads | Total TPS | Avg Latency |
|---|---|---|---|---|
| 1 | 10 | 10 | 15211 | .65 |
| 1 | 25 | 10 | 15344 | 1.62 |
| 1 | 50 | 10 | 15795 | 3.16 |
| 1 | 100 | 10 | 16604 | 6.02 |
| 3 | 10 | 10 | 14255 | 2.10 |
| 3 | 25 | 10 | 14836 | 5.05 |
| 3 | 50 | 10 | 16218 | 9.24 |
| 3 | 100 | 10 | 16378 | 18.31 |
| 5 | 10 | 10 | 14112 | 3.54 |
| 5 | 25 | 10 | 14800 | 8.44 |
| 5 | 50 | 10 | 15930 | 15.69 |
| 5 | 100 | 10 | 16907 | 29.57 |
| 10 | 10 | 10 | 12882 | 7.76 |
| 10 | 25 | 10 | 15285 | 16.35 |
| 10 | 50 | 10 | 15141 | 33.02 |
| 10 | 100 | 10 | 16786 | 59.57 |
| 1 | 10 | 25 | 15746 | .63 |
| 1 | 25 | 25 | 15587 | 1.60 |
| 1 | 50 | 25 | 15349 | 3.25 |
| 1 | 100 | 25 | 15408 | 6.49 |
| 3 | 10 | 25 | 13683 | 2.19 |
| 3 | 25 | 25 | 14900 | 5.03 |
| 3 | 50 | 25 | 16136 | 9.29 |
| 3 | 100 | 25 | 17216 | 17.42 |
| 5 | 10 | 25 | 13862 | 3.60 |
| 5 | 25 | 25 | 14990 | 8.33 |
| 5 | 50 | 25 | 15194 | 16.45 |
| 5 | 100 | 25 | 16573 | 30.16 |
| 10 | 10 | 25 | 12994 | 7.69 |
| 10 | 25 | 25 | 13999 | 17.85 |
| 10 | 50 | 25 | 15258 | 32.76 |
| 10 | 100 | 25 | 15693 | 63.72 |
| 1 | 10 | 50 | 14550 | .68 |
| 1 | 25 | 50 | 14656 | 1.70 |
| 1 | 50 | 50 | 13409 | 3.72 |
| 1 | 100 | 50 | 15403 | 6.49 |
| 3 | 10 | 50 | 13391 | 2.24 |
| 3 | 25 | 50 | 14671 | 5.11 |
| 3 | 50 | 50 | 14771 | 10.15 |
| 3 | 100 | 50 | 15477 | 19.38 |
| 5 | 10 | 50 | 13902 | 3.59 |
| 5 | 25 | 50 | 14308 | 8.73 |
| 5 | 50 | 50 | 14961 | 16.71 |
| 5 | 100 | 50 | 15921 | 31.40 |
| 10 | 10 | 50 | 12856 | 7.77 |
| 10 | 25 | 50 | 13836 | 18.06 |
| 10 | 50 | 50 | 13655 | 36.61 |
| 10 | 100 | 50 | 15642 | 63.93 |
| 1 | 10 | 100 | 14380 | .69 |
| 1 | 25 | 100 | 14053 | 1.77 |
| 1 | 50 | 100 | 15466 | 3.23 |
| 1 | 100 | 100 | 15422 | 6.48 |
| 3 | 10 | 100 | 14225 | 2.10 |
| 3 | 25 | 100 | 14318 | 5.23 |
| 3 | 50 | 100 | 16061 | 9.33 |
| 3 | 100 | 100 | 13389 | 22.40 |
| 5 | 10 | 100 | 13241 | 3.77 |
| 5 | 25 | 100 | 14735 | 8.48 |
| 5 | 50 | 100 | 16299 | 15.33 |
| 5 | 100 | 100 | 16172 | 30.91 |
| 10 | 10 | 100 | 13594 | 7.35 |
| 10 | 25 | 100 | 14268 | 17.52 |
| 10 | 50 | 100 | 15211 | 32.87 |
| 10 | 100 | 100 | 16099 | 62.11 |
LAN
TODO
Connected objects
Local loopback
Key:
- Num Heaps - the number of independent heaps
- Num Clients - the number of independent client processes (each subscribed to all heaps)
- Num Threads - value given for
cougar.socket.push.processingThreads - Subscription Time - the maximum time for any one client to subscribe to all the heaps (ms)
- Avg Subscription Latency - the average time for the slowest client to subscribe to each heap (ms)
- Replication Time - the maximum time for any one client to receive all updates (ms)
- Avg Replication Latency - the average time spent by each update to be received by the slowest client (ms)
Num updates for each heap for these tests was 100k.
| Num Heaps | Num Clients | Num Threads | Subscription Time | Avg Subscription Latency | Replication Time | Avg Replication Latency |
|---|---|---|---|---|---|---|
| 5 | 1 | 1 | 255 | 5.10 | 8917 | .0891 |
| 5 | 1 | 5 | 255 | 5.10 | 5687 | .0568 |
| 5 | 1 | 10 | 243 | 4.86 | 3579 | .0357 |
| 5 | 1 | 25 | 245 | 4.90 | 3675 | .0367 |
| 5 | 1 | 50 | 243 | 4.86 | 3625 | .0362 |
| 5 | 1 | 100 | 239 | 4.78 | 4098 | .0409 |
| 5 | 3 | 1 | 246 | 4.92 | 8693 | .0869 |
| 5 | 3 | 5 | 246 | 4.92 | 5705 | .0570 |
| 5 | 3 | 10 | 244 | 4.88 | 5140 | .0514 |
| 5 | 3 | 25 | 251 | 5.02 | 4338 | .0433 |
| 5 | 3 | 50 | 246 | 4.92 | 4308 | .0430 |
| 5 | 3 | 100 | 248 | 4.96 | 3692 | .0369 |
| 5 | 5 | 1 | 259 | 5.18 | 9397 | .0939 |
| 5 | 5 | 5 | 244 | 4.88 | 5266 | .0526 |
| 5 | 5 | 10 | 240 | 4.80 | 7378 | .0737 |
| 5 | 5 | 25 | 252 | 5.04 | 6146 | .0614 |
| 5 | 5 | 50 | 236 | 4.72 | 6087 | .0608 |
| 5 | 5 | 100 | 260 | 5.20 | 5275 | .0527 |
| 10 | 1 | 1 | 466 | 4.66 | 16663 | .1666 |
| 10 | 1 | 5 | 470 | 4.70 | 11666 | .1166 |
| 10 | 1 | 10 | 475 | 4.75 | 10600 | .1060 |
| 10 | 1 | 25 | 476 | 4.76 | 6021 | .0602 |
| 10 | 1 | 50 | 467 | 4.67 | 6576 | .0657 |
| 10 | 1 | 100 | 460 | 4.60 | 6460 | .0646 |
| 10 | 3 | 1 | 459 | 4.59 | 18435 | .1843 |
| 10 | 3 | 5 | 472 | 4.72 | 10924 | .1092 |
| 10 | 3 | 10 | 457 | 4.57 | 11920 | .1192 |
| 10 | 3 | 25 | 466 | 4.66 | 8610 | .0861 |
| 10 | 3 | 50 | 473 | 4.73 | 7199 | .0719 |
| 10 | 3 | 100 | 464 | 4.64 | 6057 | .0605 |
| 10 | 5 | 1 | 460 | 4.60 | 18574 | .1857 |
| 10 | 5 | 5 | 457 | 4.57 | 14298 | .1429 |
| 10 | 5 | 10 | 458 | 4.58 | 11738 | .1173 |
| 10 | 5 | 25 | 461 | 4.61 | 10608 | .1060 |
| 10 | 5 | 50 | 461 | 4.61 | 9655 | .0965 |
| 10 | 5 | 100 | 462 | 4.62 | 10234 | .1023 |
| 20 | 1 | 1 | 894 | 4.47 | 36430 | .3643 |
| 20 | 1 | 5 | 908 | 4.54 | 30948 | .3094 |
| 20 | 1 | 10 | 909 | 4.54 | 27875 | .2787 |
| 20 | 1 | 25 | 888 | 4.44 | 26200 | .2620 |
| 20 | 1 | 50 | 907 | 4.53 | 27863 | .2786 |
| 20 | 1 | 100 | 869 | 4.34 | 28761 | .2876 |
| 20 | 3 | 1 | 896 | 4.48 | 36670 | .3667 |
| 20 | 3 | 5 | 897 | 4.48 | 29784 | .2978 |
| 20 | 3 | 10 | 919 | 4.59 | 25308 | .2530 |
| 20 | 3 | 25 | 911 | 4.55 | 28680 | .2868 |
| 20 | 3 | 50 | 913 | 4.56 | 26183 | .2618 |
| 20 | 3 | 100 | 913 | 4.56 | 25457 | .2545 |
| 20 | 5 | 1 | 901 | 4.50 | 37495 | .3749 |
| 20 | 5 | 5 | 904 | 4.52 | 30806 | .3080 |
| 20 | 5 | 10 | 906 | 4.53 | 27512 | .2751 |
| 20 | 5 | 25 | 905 | 4.52 | 31089 | .3108 |
| 20 | 5 | 50 | 901 | 4.50 | 28180 | .2818 |
| 20 | 5 | 100 | 901 | 4.50 | 30412 | .3041 |
| 30 | 1 | 1 | 1328 | 4.42 | 56126 | .5612 |
| 30 | 1 | 5 | 1327 | 4.42 | 46566 | .4656 |
| 30 | 1 | 10 | 1337 | 4.45 | 46319 | .4631 |
| 30 | 1 | 25 | 1341 | 4.47 | 41315 | .4131 |
| 30 | 1 | 50 | 1334 | 4.44 | 41844 | .4184 |
| 30 | 1 | 100 | 1331 | 4.43 | 43950 | .4395 |
| 30 | 3 | 1 | 1329 | 4.43 | 54625 | .5462 |
| 30 | 3 | 5 | 1331 | 4.43 | 45676 | .4567 |
| 30 | 3 | 10 | 1335 | 4.45 | 48147 | .4814 |
| 30 | 3 | 25 | 1336 | 4.45 | 43679 | .4367 |
| 30 | 3 | 50 | 1352 | 4.50 | 44099 | .4409 |
| 30 | 3 | 100 | 1346 | 4.48 | 45620 | .4562 |
| 30 | 5 | 1 | 1338 | 4.46 | 56531 | .5653 |
| 30 | 5 | 5 | 1305 | 4.35 | 46084 | .4608 |
| 30 | 5 | 10 | 1302 | 4.34 | 52708 | .5270 |
| 30 | 5 | 25 | 1331 | 4.43 | 48493 | .4849 |
| 30 | 5 | 50 | 1336 | 4.45 | 46561 | .4656 |
| 30 | 5 | 100 | 1334 | 4.44 | 43964 | .4396 |
| 40 | 1 | 1 | 1791 | 4.47 | 86468 | .8646 |
| 40 | 1 | 5 | 1789 | 4.47 | 79468 | .7946 |
| 40 | 1 | 10 | 1756 | 4.39 | 75674 | .7567 |
| 40 | 1 | 25 | 1758 | 4.39 | 74790 | .7479 |
| 40 | 1 | 50 | 1753 | 4.38 | 70224 | .7022 |
| 40 | 1 | 100 | 1753 | 4.38 | 66629 | .6662 |
| 40 | 3 | 1 | 1769 | 4.42 | 97055 | .9705 |
| 40 | 3 | 5 | 1627 | 4.06 | 85539 | .8553 |
| 40 | 3 | 10 | 1628 | 4.07 | 87448 | .8744 |
| 40 | 3 | 25 | 1692 | 4.23 | 83888 | .8388 |
| 40 | 3 | 50 | 1641 | 4.10 | 83669 | .8366 |
| 40 | 3 | 100 | 1626 | 4.06 | 71634 | .7163 |
| 40 | 5 | 1 | 1627 | 4.06 | 106251 | 1.0625 |
| 40 | 5 | 5 | 1798 | 4.49 | 93676 | .9367 |
| 40 | 5 | 10 | 1773 | 4.43 | 89964 | .8996 |
| 40 | 5 | 25 | 1753 | 4.38 | 88371 | .8837 |
| 40 | 5 | 50 | 1866 | 4.66 | 87970 | .8797 |
| 40 | 5 | 100 | 1811 | 4.52 | 76853 | .7685 |