Skip to main content

SPECcpu

SPEC CPU is a workload created and licensed by the Standard Performance Evalution Corporation. The SPEC CPU® 2017 benchmark package contains SPEC's next-generation, industry-standardized, CPU intensive suites for measuring and comparing compute intensive performance, stressing a system's processor, memory subsystem and compiler.

System Requirements​

The following section provides special considerations required for the system on which the SPEC CPU workload will be run.

https://spec.org/cpu2017/Docs/system-requirements.html

  • Physical Memory = 16 GB minimum
  • Disk Space = 250 GB minimum on the OS disk

How to Get and Integrate SPEC CPU 2017​

The SPEC CPU 2017 workload is not provided out-of-box with Virtual Client. SPEC CPU 2017 requires the user to have a valid license. The license and workload files required can be found on the SPEC website linked below. The following steps describe how to download SPEC CPU 2017 and create the package in the format required for integration with Virtual Client.

  1. Purchase a license for SPEC CPU 2017 from the SPEC website https://www.spec.org/cpu2017/. After purchasing a license, download the ISO file cpu2017-1.1.8.iso from the SPEC website.

  2. Place the SPEC CPU 2017 ISO file and a speccpu2017.vcpkg json file together in a directory. The directory structure should look like the following:

  speccpu
  ├───cpu2017-1.1.8.iso
  └───speccpu2017.vcpkg

speccpu2017.vcpkg JSON content definition

{
  "name": "speccpu2017",
  "description": "SPEC CPU 2017 benchmark toolsets.",
  "version": "1.1.8",
  "metadata": {
      "isoName": "cpu2017-1.1.8.iso"
  }
}
  1. Zip the directory into speccpu.2017-1.1.8.zip:
  speccpu.2017-1.1.8.zip
  ├───cpu2017-1.1.8.iso
  └───speccpu2017.vcpkg

How to Get and Integrate SPEC CPU 2026​

The SPEC CPU 2026 workload is not provided out-of-box with Virtual Client. SPEC CPU 2026 requires the user to have a valid license. The license and workload files required can be found on the SPEC website linked below. The following steps describe how to download SPEC CPU 2026 and create the package in the format required for integration with Virtual Client.

  1. Purchase a license for SPEC CPU 2026 from the SPEC website https://www.spec.org/cpu2026/. After purchasing a license, download the ISO file cpu2026-1.0.1.iso from the SPEC website.

  2. Place the SPEC CPU 2026 ISO file and a speccpu2026.vcpkg json file together in a directory. The directory structure should look like the following:

  speccpu
  ├───cpu2026-1.0.1.iso
  └───speccpu2026.vcpkg

speccpu2026.vcpkg JSON content definition

{
  "name": "speccpu2026",
  "description": "SPEC CPU 2026 benchmark toolsets.",
  "version": "1.0.1",
  "metadata": {
      "isoName": "cpu2026-1.0.1.iso"
  }
}
  1. For Windows scenario usage, include the required code header files. SPEC CPU 2026 requires all six headers for operation on Windows and copies them to /usr/local/include/speccpu2026.
speccpu2026.vcpkg
cpu2026-1.0.1.iso
virtualclient/
└── cygwin/
    └── include/
        ├── execinfo.h
        ├── link.h
        ├── speccpu-cygwin-femflow.h
        ├── speccpu-cygwin-flac.h
        ├── speccpu-cygwin-gcc.h
        └── speccpu-cygwin-omnetpp.h
  1. Zip the directory into speccpu.2026-1.0.1.zip:
  speccpu.2026-1.0.1.zip
  ├───cpu2026-1.0.1.iso
  ├───speccpu2026.vcpkg
  └───virtualclient/
      └───cygwin/
          └───include/
              ├───execinfo.h
              ├───link.h
              ├───speccpu-cygwin-femflow.h
              ├───speccpu-cygwin-flac.h
              ├───speccpu-cygwin-gcc.h
              └───speccpu-cygwin-omnetpp.h

What is Being Measured (SPEC CPU 2017)?​

SPEC teams designed these suites to provide a comparative measure of compute-intensive performance across the widest practical range of hardware using workloads developed from real user applications. The benchmarks are provided as source code and require the use of compiler commands as well as other commands via a shell or command prompt window. SPEC CPU 2017 also includes an optional metric for measuring energy consumption.

The SPEC CPU 2017 benchmark package contains 43 benchmarks, organized into four distinct workload suites:

  • SPECspeed® 2017 Integer
    • Used for measure the time required for the computer to complete single integer calculations.
  • SPECspeed® 2017 Floating Point
    • Used to measure the time required for the computer to complete single floating-point calculations.
  • SPECrate® 2017 Integer
    • Measure the throughput or work per unit of time on the computer for integer calculations.
  • SPECrate® 2017 Floating Point
    • Measure the throughput or work per unit of time on the computer for floating-point calculations.

Workload Metrics (SPEC CPU 2017)​

The following metrics are examples of those captured by the Virtual Client when running the SPECcpu workload.

ScenarioMetric NameExample Value (min)Example Value (max)Example Value (avg)Unit
INTspeedSPECcpu-base-600.perlbench_s5.055.445.291236749116601Score
INTspeedSPECcpu-base-602.gcc_s7.077.687.355406360424022Score
INTspeedSPECcpu-base-605.mcf_s5.075.985.436749116607786Score
INTspeedSPECcpu-base-620.omnetpp_s3.815.515.185088339222612Score
INTspeedSPECcpu-base-623.xalancbmk_s3.043.533.3250176678445224Score
INTspeedSPECcpu-base-625.x264_s3.623.783.7309893992932956Score
INTspeedSPECcpu-base-631.deepsjeng_s3.493.653.5914487632508944Score
INTspeedSPECcpu-base-641.leela_s3.323.453.419363957597164Score
INTspeedSPECcpu-base-648.exchange2_s6.656.956.884946996466445Score
INTspeedSPECcpu-base-657.xz_s9.2410.39.804134275618383Score
INTspeedSPECspeed(R)2017_int_base4.825.25.07127208480564Score
INTrateSPECcpu-base-500.perlbench_r16.016.816.39600000000001Score
INTrateSPECcpu-base-502.gcc_r18.419.818.812666666666673Score
INTrateSPECcpu-base-505.mcf_r16.518.116.872666666666679Score
INTrateSPECcpu-base-520.omnetpp_r10.111.510.736666666666674Score
INTrateSPECcpu-base-523.xalancbmk_r9.5510.310.016400000000007Score
INTrateSPECcpu-base-525.x264_r14.414.814.65066666666666Score
INTrateSPECcpu-base-531.deepsjeng_r14.015.515.25466666666666Score
INTrateSPECcpu-base-541.leela_r14.715.615.44600000000001Score
INTrateSPECcpu-base-548.exchange2_r22.024.023.70733333333333Score
INTrateSPECcpu-base-557.xz_r13.714.714.183333333333318Score
INTrateSPECrate(R)2017_int_base14.915.715.179999999999988Score
FPspeedSPECcpu-base-603.bwaves_s22.927.026.577027027027027Score
FPspeedSPECcpu-base-607.cactuBSSN_s22.023.122.409459459459474Score
FPspeedSPECcpu-base-619.lbm_s4.458.348.101216216216216Score
FPspeedSPECcpu-base-621.wrf_s13.315.415.07432432432433Score
FPspeedSPECcpu-base-627.cam4_s11.612.011.767567567567568Score
FPspeedSPECcpu-base-628.pop2_s12.714.213.904054054054047Score
FPspeedSPECcpu-base-638.imagick_s1.91.971.9393243243243255Score
FPspeedSPECcpu-base-644.nab_s20.521.320.995945945945946Score
FPspeedSPECcpu-base-649.fotonik3d_s11.421.120.560810810810805Score
FPspeedSPECcpu-base-654.roms_s14.116.515.964864864864867Score
FPspeedSPECspeed(R)2017_fp_base11.313.413.18108108108109Score
FPrateSPECcpu-base-503.bwaves_r54.757.656.76533333333332Score
FPrateSPECcpu-base-507.cactuBSSN_r14.615.715.186666666666673Score
FPrateSPECcpu-base-508.namd_r12.112.712.536000000000005Score
FPrateSPECcpu-base-510.parest_r19.620.420.148000000000005Score
FPrateSPECcpu-base-511.povray_r15.916.916.657333333333339Score
FPrateSPECcpu-base-519.lbm_r10.311.210.857333333333328Score
FPrateSPECcpu-base-521.wrf_r17.818.518.244Score
FPrateSPECcpu-base-526.blender_r18.819.419.101333333333323Score
FPrateSPECcpu-base-527.cam4_r15.616.115.981333333333329Score
FPrateSPECcpu-base-538.imagick_r21.121.721.482666666666668Score
FPrateSPECcpu-base-544.nab_r21.221.821.581333333333335Score
FPrateSPECcpu-base-549.fotonik3d_r28.530.429.62Score
FPrateSPECcpu-base-554.roms_r13.414.413.927999999999992Score
FPrateSPECrate(R)2017_fp_base18.519.318.99866666666667Score