Samsung Again Caught Inflating Benchmarking Scores, Phil Schiller Calls 'Shenanigans'

[beosound3200]

Why would battery life matter when measuring what the device is capable of doing from a horsepower perspective?

I understand your stance, but you're just arbitrarily picking things to measure against as a counterpoint.

Why not measure against how hot the device gets, too? Or how long the screen would last until it burns out? That's the thing about specs and stats, they can prove whatever you want them to.

Remember, when iPhone specs are announced, it's not about spec scores (unless the scores are better than other products).

because its not achievable in real life. its like car manufacturers report 0-100 without cars interior, only metal construction...

they dont, they usualy put 2 persons + half tank of gas, get it? real life?

now imagine if apple clocked a7 at 2.5 ghz?

 

[juanmanas]

Have you read those articles? GPU is overclocked NOT ONLY for benchmarks but for some selected apps too. For example, camera app is executed in the same mode. This looks like a primitive implementation of turbo mode where overclocking is based on app type rather than on thermal conditions. Obviously Phil is too dumb to understand this.

And you are more intelligent than Phil...

 

[Yojimbo007]

What i would like to see is a giant, well publisized class action law suit against samsung for misleading consumers and fraudulant behavior .
Something that will expose this low life company wide open to the whole world !

 

[Rafterman]

But doesn't that mean the device IS in fact capable of going that fast, if coders write their apps to take advantage of it?

 

[Lone Deranger]

Does this seem more of a feature only to me?
When a particularly demanding task, like a benchmark, is executed, the CPU releases more power. I call this "efficiency".
And these numbers came out from the CPU's calculating power, not from nowhere.. how is this fake?

It's the equivalent of sucking in your gut and puffing up your pecs when a pretty girl walks by, only to exhale and gasp for breath when she's passed. Then when you get to the gym you find you still can't bench press your body weight.

Pointless, but to be expected from a shady company like Samsung.

 

[Tones2]

Evidently, Samsung cares. A lot.

Well the UN-BOOSTED Note 3 score are pretty much in line with the iPhone 5s scores. So let's just say they are BOTH fast.

http://www.pcmag.com/article2/0,2817,2424668,00.asp

 

[Sodner]

Exactly.

But since the unwritten rule of benchmarking is to test the "normal activity" of the device, they are somehow distorted.

I don't know about you, but when I notice the need for power it's because it's lagging or stuttering. That's higher intensity stuff where - wait for it - I'll wait all possible power dedicated to completing the task. I'd rather know what the phone is capable of, rather than someone else's definition of normal usage.

But it will never ever ever ever ever (I'll add one more for you) EVER produce those results during any real world use. What good is that? It's code to ONLY produce those results when a specific benchmark tests are run. It's a blatant lie to then publish those results as its capability when no user would ever see them.

Blind eye'd Android fanboy much?

 

[Rafterman]

What i would like to see is a giant, well publisized class action law suit against samsung for misleading consumers and fraudulant behavior .
Something that will expose this low life company wide open to the whole world !

Why would you want a company that has played a significant role in iPhone's success to fail? You do know Samsung makes many iPhone components, including the soon to exist A9 processor, right?

 

[Tubamajuba]

Yes he's quite good at whoa is me, we're the victims.

It's just business, man up and quit whining Apple. If you're still sad look at the billions you have. With Apple greed knows no limits.

Any company that looks at their cash stash and says "Well, that's good enough" is going to lose that stash.

 

[Collegiatelad]

But doesn't that mean the device IS in fact capable of going that fast, if coders write their apps to take advantage of it?

I can create a game that over clocks the CPU and doubles as a game?

 

[scaredpoet]

Well the UN-BOOSTED Note 3 score are pretty much in line with the iPhone 5s scores. So let's just say they are BOTH fast.

Yes, they are. Yet, Samsung felt they had to cheat, which actually makes what they did even more classless and cheap.

People can say "bah! no one cares about the scores anyway!" but the mere fact the Samsung is deliberately slipping in some code to juice their benchmark scores speaks volumes. If no one cared about the benchmarks, then Samsung wouldn't be juicing the scores with extra code. But SOMEONE out there I guess likes to point at their Geekbench scores and lord it over others that their bar on the graph is MUCH BIGGER than everyone else's bar, even though when the performance is actually needed, they get... shrinkage.

 

[SPUY767]

What's the big deal? Samsung knows that its target market is spec hounds who want to claim that they have the "fastest" device, regardless of the fact that it doesn't respond to user input as quickly as an iOS device, so good on them for figuring out a novel way of more quickly separating fools and their money.

 

[mightyneek]

Does not surprise me. Samsuck.

 

[winston1236]

My guess is if they did, you'd get about 30 minutes of battery life...

I'm not sure I understand this. Galaxy devices have a low power mode that can be toggled on and off, so here they make sure its off when testing power. So the problem is what, that people want them to test on power saving mode?

 

[bbeagle]

Why would you want a company that has played a significant role in iPhone's success to fail? You do know Samsung makes many iPhone components, including the soon to exist A9 processor, right?

Why would you want a company which is deceitful and lies to get off scott-free?

 

[gnasher729]

And no other company has ever done this?

Video card makers have done this. And have been ripped to pieces in the relevant press when it was found out. Like in this case, it is quite clear that the company did this to mislead their customers into thinking that the product was better than it actually was.

 

[violaboy]

My guess is if they did, you'd get about 30 minutes of battery life...

That's only 5 minutes less than normal with an Android, right?

 

[OnlyGerman]

so who's buying a note 3

 

[Aidyn's X]

Why would battery life matter when measuring what the device is capable of doing from a horsepower perspective?

I understand your stance, but you're just arbitrarily picking things to measure against as a counterpoint.

Why not measure against how hot the device gets, too? Or how long the screen would last until it burns out? That's the thing about specs and stats, they can prove whatever you want them to.

Remember, when iPhone specs are announced, it's not about spec scores (unless the scores are better than other products).

The point is that a person using the Note will never experience the benchmarks that Samsung is claiming (unless they are running benchmark tests). This is false advertising. "This tablet is faster than most (but not really)"

 

[Rafterman]

I can create a game that over clocks the CPU and doubles as a game?

Why not add code to games that does what what the code in Android did? Its an open standard, the designers can probably do that if they can find the right calls.

 

[Unggoy Murderer]

Samsung is a joke lol. Apple will always be the superior company. If only there was a way to make others see this...like to baptize them or something.

Baptize? More like an exorcism.

 

[Phil A.]

I'm personally banning ALL samsung device in my house. Washer machine, ssd, screen, tv and ....

Don't forget that most Apple devices are crammed full of Samsung stuff (including the 5s)...

 

[XboxMySocks]

It's just not within the unwritten rules of what benchmarking is.

Exactly. Hence why it's viewed as dishonest.

 

[everything-i]

Does this seem more of a feature only to me?
When a particularly demanding task, like a benchmark, is executed, the CPU releases more power. I call this "efficiency".
And these numbers came out from the CPU's calculating power, not from nowhere.. how is this fake?

I don't think that is what is going on here. When specifically a benchmark is running the processor is boosted way above its normal operating speed which if happened for other apps would reduce the battery life significantly. This is therefore misleading potential buyers into thinking that all things being equal other applications would see this performance and they don't. This may actually constitute false advertising.

 

[scaredpoet]

I'm not sure I understand this. Galaxy devices have a low power mode that can be toggled on and off, so here they make sure its off when testing power. So the problem is what, that people want them to test on power saving mode?

No, the problem is that the scores have no accurate merit on actual usage, due to actions Samsung is taking to ensure the results are skewed. The only time you can access this super-duper non-power saving mode is when you're benchmarking, no other time. Yet, the whole point of benchmarking is to see how devices stack up against others when doing real-world tasks.

So, the correct way to benchmark this, and any other device, is to use the same power management settings and performance modes that are available to the user on all other apps.