Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Guy 1: My phone is faster than your phone!

Guy 2: I have a girlfriend.

Yes. However, all this translates into millions of dollars spent on ads touting faster speeds, which translate into billion of dollars of revenue, so it's trivial.
 
Now I'm curious to Moto and Apple if they were to cheat, how much higher the specs would be? Is it still 0-5%, or is it more? Hmmmm

I suspect given the very low clock rate and more modern architecture of the A7 it would have a higher ceiling. Wait till we see the A7X in a few weeks.
 
No, it's more like: Don't look at benchmarks. Wait, why are you looking at benchmarks? Ok, you're looking at benchmarks. That's fine. Look, these two devices use the same processor but get different scores. Doesn't that seem funny? Wait, why are you still buying it? Yes, it will stop playing video when you look away to reflect on the fact you hate yourself and only feel fulfilled with a bigger number. It comes in gold now too! WEEEEEEE!

Relax.

The benchmarks are good as a comparison guide re: speed. Thats it. But the good thing is that they are an objective and not a subjective guide.
 
I'm glad this has been published. A little reassurance on which company is the bigger scumbag.
 
What I don't get is, that as long as Samsung and others are cheating, why don't they cheat across all benchmarks and for all phones? Fear of detection?
 
But, what I can't figure out is why fake these scores. The galaxy s4, htc one and most of the phones and tablets on this list are pretty fast. Of course the galaxy line has its stutters because the os isn't fully optimized, but why cheat if you've already passed the test lol. But I use an iPhone so doesn't matter to much to me
 
i don't really know many (if any) people who actually use benchmarks to decide which phone they are going to purchase. especially when trying to decide on a platform (i.e. ios, wm, android)

i guess this is mostly used on the android side since there are so many different sets put out?
 
...good to see nexus 4 with straight row of Ns. It is actually quite snappy even with a live wallpaper with an aquarium full o fishes! :)
 
What I don't get is, that as long as Samsung and others are cheating, why don't they cheat across all benchmarks and for all phones? Fear of detection?

While only Samsung can answer, my guess is since they do not own the development tools, frameworks, and operating system, they are stuck on the outside looking in trying to game the benchmarks, thus limiting a bit what they can do to differentiate their phone from the sea of other android phones all using the same chip.

Apple owns the CPU design, the development language, the compilers, the frameworks, and the operating system. They have been highly successful in mobilizing this to achieve real gains. And really their primary competitor is the previous apple model.
 
Key takeaway: don't make purchasing decisions solely based on benchmarks, especially benchmarks that are don't mimic real-world scenarios.
 
Wonder if there will be a class action lawsuit? It is like buying a car with an advertised 400hp, but the 400hp is only available on a test track and it is not disclosed to the buyer.
 
All they do in Korea is copy everything. I love Koreans but they don't innovate in any business. When you go there all you see is fake Nikes, Adidas, cheap suits, faux leather, faux wood, faux gold, faux everything. It should be expected that they cheat in benchmark tests.
 

Attachments

  • 1007_1352673549_large.jpg
    1007_1352673549_large.jpg
    19.6 KB · Views: 111
  • fake-iphone-4-notes.jpg
    fake-iphone-4-notes.jpg
    141.8 KB · Views: 154
I remember folks telling me that the Galaxy S2 performed better than my iPhone 3GS according to benchmarks, but in practice (side-by-side) my iPhone 3GS seemed to be twice as fast with no stutter on tasks that seemed to stutter and lag on the GS2.
In fairness, a lot of that is probably also because iOS was (and still is) significantly more optimized than Android to "feel" smooth, because Apple has put priority on that from the beginning.


Also, while most of the devices only saw a ~5% increase from their shenanigans, it's worth noting that in Ars' testing of the Galaxy Note 3, which is what kicked off this investigation, it was a full 30% faster in some benchmarks than when you changed the name of the benchmarking app.

That's hardly negligible. In addition to a very substantial speed boost, assuming that the chip is really drawing that much more power, it would be that much more likely to be harmful to the device if run for an extended period in that state, rather than just extra battery drain.
 
What I don't get is, that as long as Samsung and others are cheating, why don't they cheat across all benchmarks and for all phones? Fear of detection?

Incompetence. Once the Samsung bosses see this chart they'll be like, "You didn't cheat the GeekBench?!? Thar's one of the best known benchmarks! You aren't the kind of opimization engineer we need here at Samsung. Ya fired!" ;)

Seriously, I kind-of wonder if they don't focus on the benchies they happen to be using internally to verify performance of a particular product. I'm sure for each product they set goals internally, and could well use different benchmarks for different products and subgroups. So this might just be a product development group's way of stretching to hit the mark when they are a little short.
 
All they do in Korea is copy everything. I love Koreans but they don't innovate in any business. When you go there all you see is fake Nikes, Adidas, cheap suits, faux leather, faux wood, faux gold, faux everything. It should be expected that they cheat in benchmark tests.

Sweet, kicks! Where can I get me a pair of those Adadis?
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.