Samsung Again Caught Inflating Benchmarking Scores, Phil Schiller Calls 'Shenanigans'

There is zero chance Apple is doing this. They might be out for huge profit margins, but they aren't deceptive. The fact that Phil is calling Shenanigans is proof enough.

Apple has never been about specs. They're about the user experience. Based on the Note 3 review it has a sluggish feel at times. That's what matters. Not synthetic benchmarks to make yourself feel better. I've yet to hear anyone say the iPhone 5S feels sluggish.

I meant Apple is probably doing something like Intel's Core Turbo feature.
 
Many people don't pay attention to benchmarks. But review websites and sales personnel often do. And when these sources start selling the product with sales pitches as "fastest phone on the market" and "faster than iPhone5S", etc. because this benchmark said so, a far larger audience is sucked into the deceit. Samsung knows this and that's what they're gunning for.

You are talking as if Geekbench (a paid application, for your interest) holds any real world value in regard to speed or anything else, outside a series of tests that we can't really examine, being a close source, commercial application.
I don't see what's wrong with Samsung's modification. The application Geekbench is not being manipulated. Reportedly, the system allows its core to run at full potential when benchmarked.
No one has ever claimed that Geekbench provides an objective method to compare how "fast" a phone is, if not well within the tests Geekbench performs.
As many marketing terms, "fast" is ambiguous, too. It can be referred to a number of different entities - processor clock speed, RAM, the result of a particular benchmarking application (Geekbench is only one), the result of internal benchmarking, how fast a part of the UI is, etc.
Samsung has not claimed, as far as I'm aware, that the Note 3 is the fastest phone on the market based on Geekbench. :rolleyes:
 
This is equivalent to 'hypermiling' for a car's EPA mileage test, and then advertising using *those* results instead of the much lower results you get when you actually follow the EPA test standards.


EPA standards are still a load of crap, my car is rated for 89MPGe, even with 0-60 runs, quarter mile runs, test drives the lowest i have ever gotten is 100MPGe, i average 125MPGe and for several hypermilling runs ive gotten over 200MPGe.

with the note 3, the numbers are not made up, the CPU pushed those numbers in REAL life, however you cannot keep performance mode for long unless you want the battery dead in 2 hours, if you look at the benchmark even the stealthbench mode comes out faster than another phone with the exact same cpu,

also it seems anandtech must of left the benchmark running in the background if they found the phone "Sluggish", my galaxy note 2 while being half the speed is not sluggish unless im asking it to compile something.

 
Same old Samsung, same old scum.

They're a weasely company. It goes to their corporate culture and will be very hard to eradicate should they ever decide to try. But they're not incompetent, and they do make some good stuff, even if they lie about how good it really is, as this episode illustrates.

I do factor in a company's ethics when making purchases, along with its track-record for supporting customers, consumers having face-to-face access with helpful staff, and other intangible benefits. Hence, I rarely if ever purchase Samsung products. Can't remember the last time, frankly. Because against those metrics they rank "fail" at every one.
 
But they actually DID do it. I am not debating if they were overclocked for specifically a benchmarking purpose. All I am saying is that the cores did hit a measurable level and thus the device IS capable of doing it. It's just not within the unwritten rules (?) of what benchmarking is.

You can get 350hp out of a Renualt clio. A few times. For a few seconds.

It then explodes.

Your phone would grossly overheat if it actually performed at that level.
 
About as classy as Apple and antennagate with Jobs bagging out every other vendor saying they have the same issue.

You mean the same issue that the other vendors had already admitted to having, based solely on the manuals which pointed out where you shouldn't touch the phone to avoid hampering reception?

----------

I said MBP, not rMBP.

1) A MacBook Pro with Retinal Display is still A MacBook Pro.
2) Look at the first chart in that article. It shows the 15" MacBook Pro (Early 2011) getting 7.34 hours of battery life.

But feel free to continue with the easily-disproved, senseless, rant with no basis in reality.
 
Whats the majority? Most I know Jailbreak to get more out of their device.

Jailbreaking is done by an incredibly small minority of phone users. Best figures show that it is done by approximately 0.5-2% of iPhone users. It may well be significantly higher for folks with Android phones that never got official updates, but even then it strains credibility to think it the 'rooting' phenomena accounts for more than 10% of those users.
 
I don't see what's wrong with Samsung's modification. The application Geekbench is not being manipulated. Reportedly, the system allows its core to run at full potential when benchmarked.
No one has ever claimed that Geekbench provides an objective method to compare how "fast" a phone is, if not well within the tests Geekbench performs.

Making your device run benchmarking software differently is a form of manipulation of Geekbench. The idea behind benchmarking isn't so much to give you an absolute measurement of day-to-day usage, but a relative one. At least, that's what I, as a consumer, can use benchmarking for.

And what Samsung did here was try to invalidate that as an objective, relative comparison.
 
Last edited:
Making your device run benchmarking software differently is a form of manipulation of Geekbench. The idea behind benchmarking isn't so much to give you an absolute measurement of day-to-day usage, but a relative one. At least, that's what I, as a consumer, can use benchmarking for.

And what Samsung did here was try to invalidate that as an objective, relative compression.

Samsung is Kirk.
 
EPA standards are still a load of crap, my car is rated for 89MPGe, even with 0-60 runs, quarter mile runs, test drives the lowest i have ever gotten is 100MPGe, i average 125MPGe and for several hypermilling runs ive gotten over 200MPGe.

The EPA standards are, indeed, a load of crap. However, they tend to *over* estimate actual mileage. They were recently revised to provide a more accurate measure, but it still almost always over estimates (just by a smaller margin).

So, paying attention to the analogy, if your car were advertized with a 200MPGe rating for normal driving, and you had to do highly optimized hypermiling runs to reach that level, but averaged only 65% of that rating, you'd be OK with the claim of 200MPGe?

Note: Many hypermiling practices are actively discouraged as they involve unsafe driving, such as following too close behind larger vehicles. In some places, these practices are even *illegal*, and will result in tickets. (Just an FYI to folks not familiar with the practice.)
 
Whats the majority? Most I know Jailbreak to get more out of their device.
But not more speed. Usually JB slows the phone down.
You also don't need a TV with a contrast ratio of 100,000,000:1
Perhaps not. But it was kinda disappointing to some that we went from TVs with infinite contrast to 1000:1 and were told it was ok. They are only just now getting back to decent color and constrast in the LCD world.
 
Almost all Android manufacturers (with only a few exceptions like Motorola) ARE CHEATERS. Anandtech just did a great article here.

Before the Apple haters chime in, notice this line "With the exception of Apple and Motorola, literally every single OEM we’ve worked with ships (or has shipped) at least one device that runs this silly CPU optimization."
 
I haven't 'thrown a tantrum', did you read my post and realise I have actually NOT defended Samsung and now changed your wording then? seems like it. Also those TV ads only show the features the iPhone lacks really. Like NFC for one. But hey I didn't feel insulted by them, then again I've never queued for several hours to buy a phone :confused:
And Phil Schiller is not exactly an Apple employee in the same light as a store assistant! He is a well known Apple executive who should behave better rather than stoke the fire.

Hey Apolloa, how outraged are you by the fact that a Qualcomm marketing exec is "slandering" Apple? Let me quess, it's not the same right? LOL.
 
Many long years ago I had been through a process of selecting a new 8 bit processor for a project. Looked at all the information and compared benchmarks. One processor looked heads and tails above every other processor out there; getting almost 2x the performance at the same speed and cost.

Turns out that they ran their "benchmark" by running ONLY NOP's into the processor. Thus it could process 2x the number of MIPS then the competitor as long as it wasn't really doing anything.

These types of cheats / misleading information has been going on for decades; it sucks that companies legitimize it by saying, "Well we are just doing what we can to show the best results because under special conditions it COULD happen." Yeah, no, cheating is cheating.

BTW, in the end we chose a different processor because when it came to real world performance, that processor was only about 1/2 the speed as the others.
 
Who cares? It's the result of benchmark produced by an application.
I don't see what's the deal.
I don't buy a phone because it has good benchmarks.
:rolleyes:

It's an indication of expected performance. The day when mobile devices will be expected to do more than check Facebook and play Angry Birds is a year or two away. Eventually, we will litterally have pocketable PCs that will need to be capable of a very high level of performance.
 
the remark....No need to offense tough, if the "moronic" undertaking is coming from me. In that case, you can go to hell......

:):apple:

Not about you;)

Certainly about the group. Too much gamesmanship will likely limit this to a very few OEM's.
 
Samsung is a joke lol. Apple will always be the superior company. If only there was a way to make others see this...like to baptize them or something.
Some people out there do prefer Android, and Samsung's one of the best Android phone makers. Don't compare two companies that focus on two entirely different experiences.
 
Last edited by a moderator:
But not more speed. Usually JB slows the phone down.

Perhaps not. But it was kinda disappointing to some that we went from TVs with infinite contrast to 1000:1 and were told it was ok. They are only just now getting back to decent color and constrast in the LCD world.

Wasn't referring to speed improvements. And the JB itself does not slow the phone down. It all depends on what tweaks you install
 
Making your device run benchmarking software differently is a form of manipulation of Geekbench. The idea behind benchmarking isn't so much to give you an absolute measurement of day-to-day usage, but a relative one.

Who says that Samsung's way is not the correct way? No one, it just happens that other companies use it differently, by running a benchmark application as a standard application. This doesn't have to be the rule, especially since Geekbench is not a standard in anything.

Also, what do you mean by saying that Geekbench is a "relative" measurement of anything? Since, as you have stated, and I agree with that, these benchmarks have no role in day to day usage, why shouldn't a system allow its core to run at full potential for the benchmarking's sake?

If anything, I would like to know how a system performs at its maximum. What's the point otherwise? So I can see an application's perspective? You have many other ways to do it with debugging applications provided by Apple's SDK.

There is no absolute or correct view. Samsung is free to do whatever it thinks works best for them.

And what Samsung did here was try to invalidate that as an objective, relative comparison.

Objective? What do you have to back that up? Please, provide the source code of Geekbench and the tests it performs, along with a thorough analysis of it all, then we can talk about it.
 
Who cares? It's the result of benchmark produced by an application.
I don't see what's the deal.
I don't buy a phone because it has good benchmarks.
:rolleyes:

+1

I suspect the decision whether to go with an iPhone vs. various flavors of Android is made by most people irrespective of what benchmarks show. Even if the iPhone 5s scored significantly lower than the equivalent Samsung or LG, I would still go with an iPhone because the other factors (namely ecosystem) is more important to me. Even if the iPhone doubled the performance of any Android phone currently available, the lack of customizability, the walled garden approach, the relative smallness of the display, etc. would still drive many consumers towards an Android phone.

In general, there is a korniness about Samsung that just rubs me the wrong way. In addition, I like to feel high and mighty so I am wagging my virtual finger at Samsung because of their shenanigans. But at the end of the day, I still own 2 Samsung monitors and a Samsung t.v.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Back
Top