Skip to main content

Network Suite

The Networking workload suite is a set of 4 workloads that are the recommended benchmarks for the Azure Networking team. The workloads are each designed to test network performance and reliability.

The workloads that are a part of the suite include:

  • CPS
    This workload that is used to measure network socket connection establishment efficiencies and reliability between a client and a server.

  • Latte
    This workload that is used to measure network communications latencies between a client and a server. This workload runs on Windows systems only.

  • NTttcp
    This workload is used to measure network communications bandwidth/throughput between a client and a server.

  • SockPerf
    This workload that is used to measure network communications latencies between a client and a server. This workload runs on Unix/Linux systems only.

What is Being Tested?

The following performance analysis scenarios are covered as part of the network workload suite.

  • CPS

    • Network connection establishment reliability and speed on both Unix/Linux and Windows systems.

  • NTttcp

    • Network throughput and bandwidth with TCP communications on both Unix/Linux and Windows systems.
    • Network throughput and bandwidth with UDP communications on both Unix/Linux and Windows systems.

  • Latte

    • Network latencies with TCP communications on Windows systems.
    • Network latencies with UDP communications on Windows systems.

  • SockPerf

    • Network latencies with TCP communications on Unix/Linux systems.
    • Network latencies with UDP communications on Unix/Linux systems.

Workload Metrics

The following metrics are examples of those captured by the Virtual Client when running the various workloads that are part of the Networking suite.

Note:
For the Latte and SockPerf workloads, the client measurements are the only ones that matter. Server-side measurements are not of captured or of concern.

ScenarioMetric NameExample Value (min)Example Value (max)Example Value (avg)Unit
CPS ClientCps10202.019591.012418.48717948718
CPS ClientRexmitConnPercentage0.03.54782.698990497737556
CPS ClientRexmitPerConn0.01.03280.9713179487179486
CPS ClientSynRttMean3462.020725.010515.586726998492
CPS ClientSynRttMedian1688.05919.03624.135746606335
CPS ClientSynRttP25667.02179.01057.6681749622927
CPS ClientSynRttP754749.012701.010201.94419306184
CPS ClientSynRttP908886.044139.015424.107088989442
CPS ClientSynRttP9511781.072848.023776.671191553545
CPS ClientSynRttP9917330.0497044.069282.47209653093
CPS ClientSynRttP99_930938.03007013.01396051.3288084465
CPS ClientSynRttP99_9939198.03014102.02916708.707390649
CPS ServerCps10573.019756.012509.789552238806
CPS ServerRexmitConnPercentage0.01.02270.6096656716417908
CPS ServerRexmitPerConn0.01.0240.9697847761194024
CPS ServerSynRttMean694.011696.03653.4910447761196
CPS ServerSynRttMedian423.01880.0915.2
CPS ServerSynRttP25338.01580.0667.0850746268657
CPS ServerSynRttP75573.03411.01933.9432835820897
CPS ServerSynRttP90898.036344.05342.064179104477
CPS ServerSynRttP951342.068352.015316.823880597014
CPS ServerSynRttP997213.0165167.061413.89552238806
CPS ServerSynRttP99_922961.01484531.089663.93134328358
CPS ServerSynRttP99_9929292.03186825.0108853.4223880597
CPS ClientCps9720.015897.014383.082585278276
CPS ClientRexmitConnPercentage6.435913.09227.698681687612204
CPS ClientRexmitPerConn1.01.02961.0052050269299802
CPS ClientSynRttMean15016.041122.032903.09515260323
CPS ClientSynRttMedian9778.015000.012877.229802513464
CPS ClientSynRttP251841.09048.05232.140035906643
CPS ClientSynRttP7516000.022011.019099.5368043088
CPS ClientSynRttP9023300.033322.027326.92459605027
CPS ClientSynRttP9532393.046958.038655.06283662478
CPS ClientSynRttP9959249.01031000.01018665.6876122083
CPS ClientSynRttP99_979617.01054000.01042016.7612208258
CPS ClientSynRttP99_9991125.03049000.01374617.987432675
CPS ServerCps9812.015990.014502.646643109541
CPS ServerRexmitConnPercentage0.02.71161.8959323321554767
CPS ServerRexmitPerConn0.01.75921.3311212014134273
CPS ServerSynRttMean10250.015660.013091.466431095407
CPS ServerSynRttMedian8919.014372.012187.097173144877
CPS ServerSynRttP251706.08587.04712.268551236749
CPS ServerSynRttP7514304.020912.017795.948763250883
CPS ServerSynRttP9020286.031713.024133.104240282686
CPS ServerSynRttP9525785.039049.030722.782685512368
CPS ServerSynRttP9947377.072409.056250.68727915194
CPS ServerSynRttP99_974810.0367477.086169.82155477032
CPS ServerSynRttP99_9991533.0627165.0114658.16077738516
ScenarioMetric NameExample Value (min)Example Value (max)Example Value (avg)Unit
Latte ClientLatency-Average0.0502.28248.65472527472529microseconds
Latte ClientLatency-Max0.09998.06868.153846153846microseconds
Latte ClientLatency-Min0.0153.0100.75824175824175microseconds
Latte ClientLatency-P250.0483.0147.56043956043957microseconds
Latte ClientLatency-P500.0535.0223.16483516483516microseconds
Latte ClientLatency-P750.0582.0310.3296703296703microseconds
Latte ClientLatency-P900.01114.0421.3956043956044microseconds
Latte ClientLatency-P990.01648.0639.2307692307693microseconds
Latte ClientLatency-P99.90.02566.01207.2417582417582microseconds
Latte ClientLatency-P99.990.07760.03300.868131868132microseconds
Latte ClientLatency-P99.9990.09998.06075.197802197802microseconds
Latte ClientContextSwitches/sec0.015014.07100.780219780219
Latte ClientInterrupts/sec0.015014.07100.780219780219
Latte ClientSystemCalls/sec0.015025.09317.0
Latte ServerN/A. No server-side metrics.
ScenarioMetric NameExample Value (min)Example Value (max)Example Value (avg)Unit
NTttcp ClientAvgBytesPerCompl262144.0262144.0262144.0
NTttcp ClientAvgCpuPercentage1.0038.3481.6551020408163267
NTttcp ClientAvgFrameSize1416.2781417.0071416.9609489795924
NTttcp ClientAvgPacketsPerInterrupt0.5691.811.1293571428571432
NTttcp ClientCyclesPerByte0.8476.361.3787653061224492
NTttcp ClientErrors0.00.00.0
NTttcp ClientInterruptsPerSec3860.0499881.3865011.198642857144
NTttcp ClientPacketsRetransmitted44.03701.0824.4081632653062
NTttcp ClientThroughputMbps1275.481928.1441748.5727857142854
NTttcp ClientTotalBytesMB9123.2513793.012508.461734693878
NTttcp ServerAvgBytesPerCompl148758.33228660.3206218.26020408167
NTttcp ServerAvgCpuPercentage2.11311.1944.108795918367347
NTttcp ServerAvgFrameSize1416.6771417.0331416.9609081632655
NTttcp ServerAvgPacketsPerInterrupt16.87245.38231.823214285714284
NTttcp ServerCyclesPerByte1.6998.8563.4371326530612245
NTttcp ServerErrors0.00.00.0
NTttcp ServerInterruptsPerSec3549.8739191.5854922.264214285715
NTttcp ServerPacketsRetransmitted0.01.00.10204081632653062
NTttcp ServerThroughputMbps1275.4861928.1871748.5868469387747
NTttcp ServerTotalBytesMB9123.7513794.012508.49867857143
Test NameMetric NameExample Value (min)Example Value (max)Example Value (avg)Unit
SockPerf ClientLatency-Average211.387372.585335.3205522388059
SockPerf ClientLatency-P25118.546335.709297.53847761194029
SockPerf ClientLatency-P50205.239362.025328.1263582089553
SockPerf ClientLatency-P75278.214396.483360.8234776119402
SockPerf ClientLatency-P90333.078429.849394.0734626865671
SockPerf ClientLatency-P99408.152529.951472.29831343283578
SockPerf ClientLatency-P99.9785.8482207.1431455.0127462686565
SockPerf ClientLatency-P99.994239.648768.0276637.732552238807
SockPerf ClientLatency-P99.9999222.60423002.86515495.719104477614
SockPerf ClientLatency-Stdev116.05184.24158.41534328358214
SockPerf ServerN/A. No server-side metrics.