2024-02-19
This reminds me of a great in depth video @AdoredTV made a handful of years ago about benchmark shenanigans. https://www.tomshardware.com/ ...
PCWorld
SPEC invalidates 2,600 benchmark results for some Intel Xeon CPUs, saying their compiler artificially inflated the results of its benchmark by as much as 9%
Benchmarks, while inherently contentious and not always representative of real-world performance, are an important tool in any kind of quantitative evaluation.