Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Nearly All Mobile Device Makers Cheat on Benchmarks, Except Apple and Motorola

philips said:
They might be doing it for a different reasons then?

I see lots of talking about the benchmarks in the article. But I do not see any attempt to see whether it is not the benchmarks which are targeted, but particular types of the workloads. I know for a fact that GPU drivers (from both nVidia and AMD/ATI) can adapt some settings in run-time based on how the game has initialized and uses the 3D subsystem. But then, with PC games/benchmarks/drivers the cheating was confirmed by simply renaming the executable. In the article, nothing similar was done, and neither tests were done with real actual workloads to see whether they trigger the same behavior.

All in all, if there is no change in performance, why they then consider it to be a cheating at all?
Click to expand...

They already looked at this a day or two ago. Do you really think a website as highly regarded as Anandtech is going to make this up? They would lose all credibility. It is only for these benchmarks and a few specific apps.
 
Cultural differences..? Samsung, LG, HTC, and ASUS are asian companies; all cheat on the benchmarks. Apple and Moto are american companies and do not.
 
jonnysods said:
Glad to see the Nexus 4 being well behaved.

And here's hoping that the Nexus 5 is based off the G2 (with no cheating!)
Click to expand...

Cheating done in software, so Nexus should be ok even with Samsung hardware. Actually it would be interesting to see results of S4 Google edition.
 
glad there is still some honesty from some companies. this is why Apple gets my money all the time. :D
 
Seriously - who cares about benchmarks? It's never ever come into a phone purchasing decision for me. The only people I see talking about it are iPhone fanboys on here.
 
Further proof that Apple is not concerned whatsoever in winning the spec war amongst device makers. Which makes the comments by the Qualcomm executive about the A7 being nothing but a gimmick all the more funny.
 
Greg. said:
Seriously - who cares about benchmarks? It's never ever come into a phone purchasing decision for me. The only people I see talking about it are iPhone fanboys on here.
Click to expand...

Obviously those that are cheating on benchmarks think someone cares. :rolleyes:
 
giantfan1224 said:
Further proof that Apple is not concerned whatsoever in winning the spec war amongst device makers. Which makes the comments by the Qualcomm executive about the A7 being nothing but a gimmick all the more funny.
Click to expand...

How is that proof of what Apple wants. All that's given as proof is that some manufacturers have "rigged" the test. That has nothing to do with what Apple does or does not care about.

If they didn't care about specs - they wouldn't place them prominently on their website nor talk about them during keynotes. Of course Apple cares about specs.
 
samcraig said:
How is that proof of what Apple wants. All that's given as proof is that some manufacturers have "rigged" the test. That has nothing to do with what Apple does or does not care about.

If they didn't care about specs - they wouldn't place them prominently on their website nor talk about them during keynotes. Of course Apple cares about specs.
Click to expand...

I didn't say they didn't care about specs. I said they're not concerned about winning the spec war, as in filling a spec sheet just because, like those that find it necessary to cheat.
 
giantfan1224 said:
I didn't say they didn't care about specs. I said they're not concerned about winning the spec war, as in filling a spec sheet just because, like those that find it necessary to cheat.
Click to expand...

Ok - what proof can you provide that they aren't concerned with winning the spec war?
 
Maybe we are all looking at this the wrong way...

Its actually kind of like a cheat code.
So your game, video player, emulator or other application is running slowly.
Well no problem, just rename it to the name of a benchmark application and turbo boost it. :D
 
samcraig said:
Ok - what proof can you provide that they aren't concerned with winning the spec war?
Click to expand...

uhh...like cheating on benchmark scores, which appears to be almost an industry standard.

Or cramming as much RAM as possible, or putting in a 41 megapixel camera, or an SD card slot, etc. etc. etc. They could if they wanted to, if all they cared about was "winning the spec war".
 
samcraig said:
How is that proof of what Apple wants. All that's given as proof is that some manufacturers have "rigged" the test. That has nothing to do with what Apple does or does not care about.

If they didn't care about specs - they wouldn't place them prominently on their website nor talk about them during keynotes. Of course Apple cares about specs.
Click to expand...

Apple doesn't need to rig the benchmarks; they are benchmarking performance between generations of iDevices. These are metrics, not specs.

Specs would be a 15% larger imager vs a metric of a 30% ISO improvement.
 
giantfan1224 said:
uhh...like cheating on benchmark scores, which appears to be almost an industry standard.

Or cramming as much RAM as possible, or putting in a 41 megapixel camera, or an SD card slot, etc. etc. etc. They could if they wanted to, if all they cared about was "winning the spec war".
Click to expand...

All you've posted are what you believe the other companies are doing to win a spec war. You haven't proved that this news is "Further proof that Apple is not concerned whatsoever in winning the spec war"

Nor have you really proved that Apple is not concerned whatsoever in winning the spec war in general.
 
TWSS37 said:
I love how having a girlfriend is a tech forum user's trump card
Click to expand...

I assumed the majority of us here were married with kids. :confused:

That's worse than not having a girlfriend, so apparently girlfriend is the sweet spot. :D
 
samcraig said:
All you've posted are what you believe the other companies are doing to win a spec war. You haven't proved that this news is "Further proof that Apple is not concerned whatsoever in winning the spec war"

Nor have you really proved that Apple is not concerned whatsoever in winning the spec war in general.
Click to expand...

Alright dude, you got me. I don't have a quote from any Apple executive stating "we are not concerned with winning the spec war". What's obvious to most is Apple is more concerned with the user experience and how the hardware specs make it the best experience possible. Not just filling up a spec sheet to beat their competitors. Maybe that's just an opinion but articles like this tend to afford indirect proof of exactly what I'm arguing.
 
Raffi said:
All they do in Korea is copy everything. I love Koreans but they don't innovate in any business. When you go there all you see is fake Nikes, Adidas, cheap suits, faux leather, faux wood, faux gold, faux everything. It should be expected that they cheat in benchmark tests.
Click to expand...

Just a personal example...

I am into the printing industry... We print a lot of packaging materials for various industries... Once a client approached me for packaging needs for a new product they had developed... And we're exhibiting it in a 15 day exhibition of some sort... They wanted a huge amount of cartons to be delivered within the first three days of the exhibition... Which wasn't possible given my production constraints... I told them I would deliver certain amounts throughout the exhibition duration and that they definitely won't be making all the sales in the first five days... What my client told me so many years ago is what I've seen happening throughout with companies like Hyundai and Samsung... He said "We have just five days to sell our product as unique... Because on the first day there'll be a lot of Korean manufacturers taking samples and on the third day they'll be selling our exact product at half the price... Which we can't afford given our r & d costs... So we have just five days to make our profits..."

I don't mean to generalize... But that's straight from someone whose experienced it first hand...

----------
eloscurosecreto said:
And if you have both?, which I do...
Click to expand...

I have a wife and a kid... His point is invalid... :p ;)
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back