HEPiX Working group
Back to HEPiX

What is Benchmarking

CPU benchmarks provide performance measurements that can be used to compare compute-intensive workloads (e.g. the LHC applications) on different computer systems. The HEPiX Benchmarking Working Group develops and maintains 2 types of CPU benchmarks:

  • HS06 is the official benchmark to measure installed capacities of the WLCG project, for instance for accounting on procurements. This benchmark is based on the industry-standard SPEC® CPU2006 benchmark suite. The HS06 benchmark starts as many copies of SPEC CPU2006 on an idle host as there are job slots configured, using the default compiler (GCC) with mandatory optimizing flags (-O2 -pthread -fPIC -m32). See https://w3.hepix.org/benchmarks/ for details.
  • In many cases no HS06 score is available, for instance when running in commercial clouds. It's uneconomic to run the HS06 benchmark in possibly short running jobs or VMs because it takes several hours. Therefore the group is currently evaluating fast benchmarks with a runtime of around 1 minute to estimate the performance of the job slot.