> >I would normally make the source available, but there's the problem
> >of vendors tampering with the code.
> Any vendor dumb enough to tamper with publicly available benchmarks
> will get what they deserve when someone else runs the real benchmarks
> on said vendors machine.
It isn't that people will tamper with the benchmarks themselves,
it's that they'll look at the benchmarks and tamper their hardware
so the hardware (maybe) does great on the benchmarks without really
being all that much faster in normal usage.
Quote:> IMO, It's a good idea to have benchmarks open for public scrutiny,
> makes for good checks all around.
I'd tend to agree with this, even with the danger of vendor's
optimizing their hardware for the benchmark.
ITS Systems Programmer (handles NeXT-type mail)
Rensselaer Polytechnic Institute; Troy NY USA