Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
I posted an explaination here of all these benchmarking discrepancies:

http://slashdot.org/comments.pl?sid=69975&cid=6373223

Furthermore, to address this specific instance, one should note that these overclockers never did any benchmarking themselves, they merely copy and pasted official scores as given from the manufacturers. The only thing he said that remotely gives credence to the comparisons are that the amount of RAM used was the same ( 2GB ). We don't know which types of hard-drives are used, what OSes and versions were used, etc. So, right off, those numbers are irrelevant.

Secondly, this whole issue of using the ICC compiler for the P4s. What Intel has done, is spent a lot of time creating a compiler that is very good at compiling simple programs, like benchmarks. At my work we use Visual C++ 6 on WinNT, Solaris CC on Solaris, and whatever True64 on Alpha uses for a compiler. Each one of these has defficiencies, forcing us to use a common subset of functionality. We do not even consider using ICC since it could never handle the C/C++ language features that we use. Thus ICC is a nice toy that is very good at pumping out benchmarks, but is almost never used in large scale software projects, and thus cannot compare to GCC, which is used by many large software projects. That is why it was valid for Apple to use GCC for the P4. But to be more legitimate, they should have instead used the newest MS VC++ compiler, as that is the #1 compiler for x86, which would have forced them to do this on MS Windows, not RedHat. Or they could have done both.

None-the-less, the question of speed, when both chips are now in the same class, is merely a masterbatorial affair that only affects 2% of the market. Expect PC users to cling to their speed crown, as that is the only thing they can cling to, against the ever growing superiority of the computing experience on the Mac.
 
Originally posted by MarkCollette
I posted an explaination here of all these benchmarking discrepancies:

http://slashdot.org/comments.pl?sid=69975&cid=6373223

Furthermore, to address this specific instance, one should note that these overclockers never did any benchmarking themselves, they merely copy and pasted official scores as given from the manufacturers. The only thing he said that remotely gives credence to the comparisons are that the amount of RAM used was the same ( 2GB ). We don't know which types of hard-drives are used, what OSes and versions were used, etc. So, right off, those numbers are irrelevant.

Secondly, this whole issue of using the ICC compiler for the P4s. What Intel has done, is spent a lot of time creating a compiler that is very good at compiling simple programs, like benchmarks. At my work we use Visual C++ 6 on WinNT, Solaris CC on Solaris, and whatever True64 on Alpha uses for a compiler. Each one of these has defficiencies, forcing us to use a common subset of functionality. We do not even consider using ICC since it could never handle the C/C++ language features that we use. Thus ICC is a nice toy that is very good at pumping out benchmarks, but is almost never used in large scale software projects, and thus cannot compare to GCC, which is used by many large software projects. That is why it was valid for Apple to use GCC for the P4. But to be more legitimate, they should have instead used the newest MS VC++ compiler, as that is the #1 compiler for x86, which would have forced them to do this on MS Windows, not RedHat. Or they could have done both.

None-the-less, the question of speed, when both chips are now in the same class, is merely a masterbatorial affair that only affects 2% of the market. Expect PC users to cling to their speed crown, as that is the only thing they can cling to, against the ever growing superiority of the computing experience on the Mac.

In my opinion, ICC 4 was a benchmark compiler, ICC 5, 6, and 7 were all pretty darn good production compilers and theirs quite a few companies that use them to make production software (Oracle, SGI, IBM, Newtek, CERN, MusicMatch, ALIAS/Wavefront, Bell Laboratories to name a few). True theirs a lot fewer applications compiled with ICC than say GCC or VC++ but thats not to say they can't effectively be used for large scale software projects.

"The Intel compilers have performed excellently on our ROOT code. On average, the Intel C++ Compiler for Linux produces executables that run 30% faster than ones produced by gcc 3.2. Due to the excellent compatibility with the GNU compilers, the porting effort was reduced to a minimum. Furthermore, the strong technical support that is provided with the Intel Compilers enables very quick turnaround on fixes for customer issues."
Dr. Fons Rademakers
Senior Scientist
CERN
Geneva


" We are impressed with the results we have seen using the Intel Version 6.0 Compiler with IBM DB2 database software. The performance, reliability and compatibility of the compiler and the quality technical support Intel provides were important factors in selecting the Intel compiler for the future development of DB2 for Windows and Linux, for both the IA-32 and the Itanium architecture."
Berni Schiefer
Distinguished Engineer and Manager of DB2 Universal Database Performance and Advanced Technology
IBM


"We recently switched to the Intel C++ Compiler from a leading compiler for use on Maya 5.0's dynamics code. The output ran so much faster - up to 90% faster - than before, that our engineer didn't actually believe it and rechecked his data. To say the least, we are impressed with the Intel product."
Kevin Tureski
General Manager of Maya Engineering
Alias|Wavefront


"MUSICMATCH, Inc.: "After optimizing our code, (with the Intel complier) MP3 encoding speeds dramatically increased, and MUSICMATCH Jukebox was able to rip MP3 files from audio CDs at a blistering 35x speed for the first time"
Jim McLaughlin
Director Hardware Alliances
MUSICMATCH, Inc."
 
Yes, we've established that the ICC compiler is pretty good at compiling number crunching code, which explains the media companies and scientists using it, but how about it's support of templates, namespaces, and its compliance to the ARM and to the ISO standards? Furthermore, how many third party development tools support ICC?

The point being, the important thing about computer preformance is how well real world applications run on it, which is determined to some degree by which compiler those applications are compiled under, which for the most part is simply not ICC. Thus, how relevent can benchmarks be which are compiled under ICC?

Since Apple chose to go against RedHat with GCC 3.3, it's clear that they are claiming that their platform is superior when using opensource software. Of course PC users are complaining that their other software, on other operating systems, compiled by other compilers are faster. Apple simply should have ommitted their claims of the fastest workstation, when they had only proven a very narrow area of being the fastest in.
 
Mark Collete:

The point of my post was to demonstrate that ICC isn't solely used as a benchmark compiler but is also used by many big name developers to produce code for real world applications and software like Lightwave, Maya, Jukebox, DB2, and Oracle 9i to name a few. I don't think I need to prove that ICC produces very fast code in some instances.
 
The proof will be in the pudding

Wintel stalwarts are going to keep saying that Apple tweaked GCC to their benefit when it seems clear that they didn't blatantly do so... they could have used Altivec and other CPU tweaks but Veritest have been pretty forthcoming on what they did and did not do. Was it a completely level playing field? No because that goal seems impossible but given that there were no OUTRAGEOUS advantages given to the Mac, the results show that the G5 is a fantasticaly capable chip. It's in it's early days too unlike the P4 and so time is all on IBM and Apple's side here. Further, the first tirade against these benchmarks specifically included the observation that the Intel chip would have performed much better had it been using an optimized compiler. What was left out of this "discourse" was the obvious... so too, would have the G5. In any case, there are now multiple articles popping up supporting the impression that the G5 is one of the best performers out there (start with MacBytes.com as one source) and no amount of handwringing from Wintellers is going to change the fact hat Apple and IBM have one hell of a CPU and that it will get faster and by the end of the year there will be real world observations to finally prove the point. Wait til the benchmarks come out that include every tweak conceivable, permitting the G5 to show its true form. There will be howls, of not fair but no passionate Winteller could stand to think that a Mac could trump the fatuous fatigued platform they love to struggle with.
 
Re: World's Fastest Personal Computer!

Originally posted by Edot
"World's Fastest Personal Computer" into "World's Fastest Processor", which Apple has never claimed.

-Edot

I think that's the most eloquent, elegant, and concise statement addressing this whole argument in the press I've yet heard. Damn good point.

Thank you for keeping your eye on the ball.
 
The only real world benchmark I've seen for the G5 is Jet3d (simulation code, heavy in floating point math) and on that particular test, a single 2 GHz G5 achieves rough parity with a 2.66 GHz P4, despite that neither machines were using their best compilers. Quite a difference from Apple's SPECfp test where a single 2 GHz G5 would probably outperform a estimated 3.6 GHz Pentium 4. Of course, SPECfp is alot more bandwidth intensive than Jet3d but that alone can't account for such a big difference.
 
Trollfest 2003 - SPEC scores

OK... the scores for the G5 are provided by Apple. The low scores for the x86's are by Apple. The high scores for the x86's are provided by SPEC on their website.

The best part to me is that everyone acknowledges that the G5 is what, 2x faster than the fastest G4's? The high end Intel chips are out now, and have been getting incrementally faster very 4-6 months. Yet people would argue that the G4 was as fast as the x86's. NOT.

Whatever... this is all worthless until true comparisons can be run. SJ up on stage is just that, staged.
 
Regarding Jet3d, I've come across a 2 GHz Pentium 4 submission using a IFC compiler. Not sure if it's scalar or packed although SSE2 seems to lower performance on this particular benchmark. The test configurations seem different as the scores are dramatically higher. This would give a comparison of how a Pentium 4 with a optimized compiler would fare. Now if only we can get some results for a G5 with a optimized compiler.

Pentium 4 2 GHz/RAMBUS
RH Linux 7.3 / IFC
1 CPU-SCALAR(?)
842 MFLOPS

Pentium 4 3.2 GHz (assuming only linear increase in clockspeed)
RH Linux 7.3 / IFC
1 CPU-SCALAR(?)
1347 MFLOPS

PowerMac G4 1GHz
OS X 10.1.5 / Absoft f77
1 CPU-SCALAR
236 MFLOPS

PowerMac G5 2 GHz (Extrapolating from Craig's Numbers)
OS X 10.2.7 / Absoft f77
1 CPU-SCALAR
571 MFLOPS

http://vivaldi.bio.bnl.gov/asda/bb/archive/ccp4bb/ccp4bb.200208/7049.html
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.