Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Samsung Again Caught Inflating Benchmarking Scores, Phil Schiller Calls 'Shenanigans'

magbarn said:
No, it's more nefarious than that. It's like increasing the boost on a turbocharged car specifically for cars that go to car mags to be tested for 0-60 times and 1/4 mile and then selling cars to the public that are much slower as the higher boost levels aren't available to regular consumers as in long-term boosting causes overheating problems.
Click to expand...


It's not Macrumors until the Phone - Car analogies.
 
Zerilos said:
I am certain of several things:
1. You have no idea what the word slander means
2. Samsung has been publicly badmouthing their biggest customer for years
3. Samsung has publicly been badmouthing Apple customers for years.
4. You seem very willing to defend a corporation that has again been caught red-handed intentionally deceiving the public about the quality of its products.
Click to expand...

And when apple bad mouthed PC's from 2006 to 2009 ???? Im not pro samsung, but please.... Apple is not innocent when it comes to badmouthing ;)

http://en.wikipedia.org/wiki/Get_a_Mac

Watch a few ads, they do stick it to PC.
 
gpat said:
Does this seem more of a feature only to me?
When a particularly demanding task, like a benchmark, is executed, the CPU releases more power. I call this "efficiency".
And these numbers came out from the CPU's calculating power, not from nowhere.. how is this fake?
Click to expand...

Because the end user cannot actually access that calculating power. When they test the same app renamed (to avoid the trigger that turns on that boost) they get scores 20% lower. So unless Samsung is specifically telling the phone to bump up speeds for an app or giving the consumer a way to enable those speeds it only acts as a false marketing tool for Samsung.
 
Samsung is such a freaking joke. When they can't compete, they choose to cheat.

At Samsung, if you ain't cheatin', you ain't tryin'...
 
TheHateMachine said:
This thread turned out as I predicted. Never change MR Users... never change.
Click to expand...

Every thread turns like that. If you have an Apple oriented forum, what a better way of getting 1000s of hits / clicks and Google ratings than creating a non-Fanboi subforum, I mean non-iOS device subforum ;)
 
AngryCorgi said:
Samsung is such a freaking joke. When they can't compete, they choose to cheat.

At Samsung, if you ain't cheatin', you ain't tryin'...
Click to expand...

cheat? I did not realize it was a benchmarking competition, if it was, PCs have always been ahead lol.

Samsung are copycats, this stuff is marketing BS.
 
Essentially, the iPhone 5S, with it's "only 2 cores" outperforms the quad core Note 3 by a tiny margin, so Samsung chose to bull$h!t us all with software. Thanks, Sammy. Don't ever change.
 
neoelectronaut said:
Holy cow, it's just a cell phone, calm your tits.
Click to expand...

Yeah, i guess it's far too much to expect an apparently professional executive to behave in a mature manner :rolleyes:

Zerilos said:
I am certain of several things:
1. You have no idea what the word slander means
2. Samsung has been publicly badmouthing their biggest customer for years
3. Samsung has publicly been badmouthing Apple customers for years.
4. You seem very willing to defend a corporation that has again been caught red-handed intentionally deceiving the public about the quality of its products.
Click to expand...

1: Yes I Do
2: Really? got any actual proof then from a NON Apple fan site? or are you going to talk about TV adverts?
3: See above.
4: Actually, if you bother to read what I typed, I have NOT defended Samsung in any way....

sundragon said:
LOL, I use Android (Google Nexus 7 and Nexus 7^2) and:

Samsung hardware = awesome.
Samsung software = awful bloatware
Samsung attitude = 15 year old geek...

You defend a company that got caught with it's pants down lying to you and it's customers yet you still align your lips to their butt? That's the best kind of fanboy to make fun of...

Meanwhile Snapdragon 800 running at 2.3 GHz with 4 cores (actually 8 w/ low power cores) < A7 with 2 cores running at 1.3GHz....

Yeah - go look at the benchmarks...

http://arstechnica.com/apple/2013/0...-apple-lays-groundwork-for-a-brighter-future/

ERMA GERD! :D
Click to expand...

I guess your on the same level of maturity as Phil Schiller? Oh and you need to learn how to read too.. Oh and good luck with your 1GB of RAM in that A7.
 
gpat said:
Does this seem more of a feature only to me?
When a particularly demanding task, like a benchmark, is executed, the CPU releases more power. I call this "efficiency".
And these numbers came out from the CPU's calculating power, not from nowhere.. how is this fake?
Click to expand...

The article implies is that it won't do this for a normal app, only for one that it knows is a benchmark (i.e. that has a name that someone is testing for). So real world performance won't match the benchmarks. The reason the CPU doesn't always run this fast is, of course, because of battery drain.

Basically, it's bypassing the point of the benchmark to give an inflated performance result. If true, that's pretty cynical.
 
TWSS37 said:
Exactly.

But since the unwritten rule of benchmarking is to test the "normal activity" of the device, they are somehow distorted.

I don't know about you, but when I notice the need for power it's because it's lagging or stuttering. That's higher intensity stuff where - wait for it - I'll wait all possible power dedicated to completing the task. I'd rather know what the phone is capable of, rather than someone else's definition of normal usage.
Click to expand...

Only the Samsung device wasn't speeding up when it detected a "when the need for power." I think we'd all agree there was nothing wrong with that.

It was speeding up when it detected that the application you were running was in a list of benchmarking applications that were coded into the device. So the benchmark reported performance 20% above that of any real-world applicaton.
 
Impressive scores, but do apps even take advantage of these speeds?

With Android, it's like they have a V12 capable of 700hp but you could only use it on a 75 mph speed limit. With iOS, it's like they have a really crazy (and efficient) V6 also capable of 700hp, but you could use it on the Autobahn.
 
gpat said:
Does this seem more of a feature only to me?
When a particularly demanding task, like a benchmark, is executed, the CPU releases more power. I call this "efficiency".
And these numbers came out from the CPU's calculating power, not from nowhere.. how is this fake?
Click to expand...

The trouble is that the device DOES NOT release more power for a demanding task. It only ups the power for SPECIFIC benchmark apps. In daily use you'll never actually get to use that power on anything you do (except running specific benchmarks).

The main point is that Samsung is speeding up the benchmarks, but the user experience is equivalent to devices with lower benchmarks. In other words, they're lying.
 
TWSS37 said:
But they actually DID do it. I am not debating if they were overclocked for specifically a benchmarking purpose. All I am saying is that the cores did hit a measurable level and thus the device IS capable of doing it. It's just not within the unwritten rules (?) of what benchmarking is.
Click to expand...

That makes no sense. Every CPU can be over clocked. Yet, they are not generally sold that way because doing so hurts the CPU and can cause overheating, sporadic OS issues, and decreased battery life.

Benchmarking is not to test what the chip can do when pushed to its over clocked absolute max, but the performance of the shipping product. I guarentee if Apple did this it would be sued by people who relied on the test to make buying decisions.
 
gpat said:
Does this seem more of a feature only to me?
When a particularly demanding task, like a benchmark, is executed, the CPU releases more power. I call this "efficiency".
And these numbers came out from the CPU's calculating power, not from nowhere.. how is this fake?
Click to expand...

If I understand right, that's not actually the case. The phone actually specifically checks for benchmark apps:

MacRumors said:
Samsung uses special code inside its operating system to identify benchmarking apps by name to boost CPU clock speeds
Click to expand...

So they're purposely overlocking the CPU just for the benchmark apps. The question remains whether such overclocking ever happens with any non-benchmark apps, or if this feature is exclusively there to fake benchmarks.

I'm guessing the CPU can indeed reach that performance, but for battery life and overheating reasons, it's limited to never do so. And then an exception is made for benchmarks, I guess.
 
apolloa said:
1: Yes I Do
2: Really? got any actual proof then from a NON Apple fan site? or are you going to talk about TV adverts?
3: See above.
4: Actually, if you bother to read what I typed, I have NOT defended Samsung in any way....
Click to expand...

1. If you think an Apple VP linking an article and saying "Shenanigans" is slander, then no you don't.
2. Yes I was talking about TV ads. This doesn't count? Why? They were certainly approved by Samsung execs.
3. see #2
4. You just throw a tantrum when an Apple employee points to an article that points to the fact that Samsung has again been caught intentionally deceiving reviewers (and thus potential consumers). Oh…I forgot…he also said shenanigans.
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back