Originally Posted by diplication
I'm waiting for Gatorguy and KDarling to weigh in on this issue!
It was underhanded. It was also extremely dumb, publicity and reputation wise, for someone at Samsung to do this. They need to send an edict from the top, telling their employees to straighten up or expect to be fired.
At the same time, it's hardly shocking or rare. That's why I didn't care to comment. It's like a news article about someone getting an email from a fake Nigerian prince. Tuning for benchmarks has gone on since benchmarks were invented.
Remember the 2003 Power Mac G5 benchmark scandal? Where Steve Jobs quoted tests from a company they hired to "prove" that the G5 outperformed Intel desktops? It turned out they used Apple supplied tools to tweak the performance, and also changed the malloc code to work faster.
Graphics card makers are infamous for watching for benchmarks.
Various browsers often had / have code that watches for benchmarks. Then there's the opposite problem. Sometimes companies come up with their own benchmarks that favor themselves. Microsoft has done that.
This is why benchmarks need to be changed fairly often, so that programmers can't watch for them.
The upshot is, I'd actually be more surprised if every OS didn't have something tweaked to look good in benchmarks, even if they don't go so far as to explicitly watch for certain apps. That's why I tell people to never trust benchmarks. Or emails from Nigerian princes.