Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

wizard

macrumors 68040
May 29, 2003
3,854
571
Its a shame that this testing wasn't done with up to date compilers. It appears that they just ran existing binaries.

On the other hand it does reinforce some things, one of which is that the G5 isn't all that its cracked up to be but isn't a slouch either. Apparently this is with old code that was written for the G4, it would be very interesting to see how everything runs when compiled against a modern compiler targetting the G5.

Thanks
Dave
 

nagromme

macrumors G5
May 2, 2002
12,546
1,196
Looks like well-design tests, for their purpose. Results use only a single CPU, but they note the G5s dual performance in the text: very nearly double, which is good!

I suppose they used single CPUs for fairness in comparison to Pentiums, which don't exist in duals? Fairness, of course, meaning evaluating the chip's capabilities for their very specific needs. Not fairness in terms of benchmarks for marketing, as they make clear.

They do mention that they did no optimisations for the G5, and that better compilers might give the G5 a boost in future tests. Encouraging, since the G5 did well even so!
 

maradong

macrumors 65816
Mar 7, 2003
1,058
0
Luxembourg
well they are really good for apple...
the g5 2ghz single cpu is 22% slower than the 3200 intel with fsb 800. well, but if the new compilers come, with optimisations the difference is only 2%....
a dual g5 2ghz is the fastest system aviable. because the intel machines have only one bus per processor, while the ibm chip has got one for each. that is significantly faster in dual cpu mode...
peace!
 

Blackcat

macrumors regular
Jun 10, 2002
187
0
Cirencester, UK
Interesting!

If I'm reading this right, a single 2GHz G5 is nearly 50% faster than a 1.25GHz G4 in MFLOPS, and 25% faster than a 2GHz P4.

Impressive!
 

rjstanford

macrumors 6502
Oct 30, 2002
272
0
Austin, TX
Vector Performance

One thing that struck me as interesting:
Jet3D vector benchmark results are presented in Figures 3 and 4. Again, note that the vector benchmark does not include P4 systems because the AltiVec instruction set is only available on G4 and G5 systems. Consistent with earlier Jet3D tests, the vector version of Jet3D runs an order of magnitude faster than the scalar version (speedups of 10X-13X are typical). In this particular test, the raw vector performance of the G5 is impressive at 2755 MFLOPS, but a look at the normalized levels reveals that the G5 is nearly identical to the G4 in terms of vector performance per clock cycle. Thus, the increased raw vector performance of the G5 is largely due to its higher clock speed.
There was a lot of speculation that the Alitvec unit was bus-limited in the G4. I'm not familiar with the test in question, but this should certainly be an interesting point, no? Is anyone more familiar with the code to know if it would have been expected to benefit from the faster bus?

-Richard
 

allpar

macrumors 6502
May 20, 2002
365
122
So then a 1.6 G5 would not be much faster, if at all faster, than a dual 1.256?

Originally posted by Blackcat
Interesting!

If I'm reading this right, a single 2GHz G5 is nearly 50% faster than a 1.25GHz G4 in MFLOPS, and 25% faster than a 2GHz P4.

Impressive!
 

Blackcat

macrumors regular
Jun 10, 2002
187
0
Cirencester, UK
Originally posted by allpar
So then a 1.6 G5 would not be much faster, if at all faster, than a dual 1.256?

Prolly not, but if a SINGLE 1.6 is the same speed as a DUAL 1.25, that's still impressive, no?

I'm no math whizz, but I think a 1.6 GHz G5 is 36% faster than a 1.25 GHz G4 in this test.
 

Heltik

macrumors 6502
Jul 16, 2002
254
51
USA
Even though the margins are quite small for the benchmarks used, we have to consider that the Pentium did not use Vector processing.

For applications such as Photoshop/Final Cut/DVD authoring/Cd ripping, etc, surely we can expect the G5 to be leagues ahead, therefore. In fact, just about everything I use my Mac for on a daily basis.
 

scan300

macrumors 6502
Mar 25, 2003
256
0
Melbourne, Australia
Originally posted by Blackcat
Prolly not, but if a SINGLE 1.6 is the same speed as a DUAL 1.25, that's still impressive, no?

I'm no math whizz, but I think a 1.6 GHz G5 is 36% faster than a 1.25 GHz G4 in this test.

Keep in mind that these benchmarks test floating point and vector computational performance only. The programs only use 1 Mb of ram. They don't take into account system bandwidth.

So when evaluating the 1.6 GHz G5, the vector figures may not be much better than the G4, the floating point an improvement, but the data throughput on the bus will be significantly better than the G4.
 

maradong

macrumors 65816
Mar 7, 2003
1,058
0
Luxembourg
Originally posted by scan300
Keep in mind that these benchmarks test floating point and vector computational performance only. The programs only use 1 Mb of ram. They don't take into account system bandwidth.

So when evaluating the 1.6 GHz G5, the vector figures may not be much better than the G4, the floating point an improvement, but the data throughput on the bus will be significantly better than the G4.
exactly, and that is much more important than raw gflops values.
 

nuckinfutz

macrumors 603
Jul 3, 2002
5,539
406
Middle Earth
What impressed me the most was not the Altivec. Jon "Hannibal" Stokes from Arstechnica pretty much called the Altivec preformance correctly on his breakdown of the 970. I expect that the probably PPC 980 will shore up Altivec even better(adding it more cleanly to the design) resulting in good performance.

What we should be focusing on is the incredible FPU preformance on non Optimized Code. Recompile that code to take advantage of the G5's prodigious FPU capability and you will see some nice Real World gains.
 

allpar

macrumors 6502
May 20, 2002
365
122
...so the extra $300 to buy a single 1.6 is well worth it over the Dual 1.25 ... ? Just confirming ... the duals seem like a good deal ... I don't figure I'll ever need PCI-X...
 

aarond12

macrumors 65816
May 20, 2002
1,146
107
Dallas, TX USA
With two processors...

Did anyone notice the author's comment that enabling both processors in the G5 system made the G5 system nearly twice as fast as the Pentium 4 2.66GHz system?
 

Sayer

macrumors 6502a
Jan 4, 2002
981
0
Austin, TX
Lots of wiggle room there.

The G5-updated compilers will do several things to help boost the performance:

* The G5 has a differnet pipleline and it needs to be properly filled for efficient use of CPU resources. The newer compiler will do this.

* The OS does not have all the tweaks and changes Apple will most likely be putting into Panther (if Smeagol performed as well as Panther on a G5 Apple would lose the $129 upgrade since many people would stick with Smeagol with the same performance as Panther and save the money).

* The G5 works on instructions in groups, if the groups are not filled up optimally the G5 will not run optimally. The newer compiler and tools will properly handle the G5's quirks here.

I continue to be amazed at people who see a Mac finally on an equal footing to a top-end PeeCee and whine that its not FASTER than the absolute top-end PeeCee.

Apple essentially erased the only compelling hardware reason to not buy an Mac with the G5. It has every Wintel buzzword and trumps them (1 GHz busses, FireWire 800, optical audio I/O built in).

Now its just up to the software to step up and remove another reason NOT to use a Mac. Do you think Apple's X11 and Ports Manager software is meant to compete with XFree86 and the Darwin community or to get more big name Linux software on the Mac with an officially-sanctioned cross-grade option?
 

Mercury

macrumors regular
Jul 6, 2003
168
7
Yay! Finally, some independent testing of the new units. It seems that finally we have the efficiency and the horsepower to brag to our PC friends.

Now, another $2200 to get top of the line with 23" HD...
 

ibookin'

macrumors 65816
Jul 7, 2002
1,164
0
Los Angeles, CA
Originally posted by Mercury
Yay! Finally, some independent testing of the new units. It seems that finally we have the efficiency and the horsepower to brag to our PC friends.

Well they'll just tell us how our machines are too expensive. :D
 

iriejedi

macrumors 6502a
Oct 4, 2000
821
120
Nor Cal
Stats that matter

Maybe I've missed some of the threads that I'm requesting.... but show us some stats that matter!

How fast will games play?

How much will the DP 2gig benefit a gamer vs a 1.8gig single brain?

I use photoshop so I'm going dual processor - but I'm a soap box preacher trying to convert the UNSAVED PC users. How can I sell the slower models to people who play game instead of sequencing DNA without key data?

Iriejedi
 

nighthawk

macrumors regular
Jan 3, 2003
104
0
Also note that the Pentiums were running Red Hat Linux, and not Windows... this actually places the P4s with a overall more effecient OS than OSX (but equal standing in low-level features). In my opinion, the scores are actually more impressive than they appear. Remember that Apple tests and the other tests compared the G5 to Windows OS machines.
 

g3ski

macrumors member
Jun 18, 2002
89
0
Re: Stats that matter

Originally posted by iriejedi
How fast will games play?

How much will the DP 2gig benefit a gamer vs a 1.8gig single brain?

Iriejedi

The 970 should be pretty competitive on the games front with the 1ghz bus and fast clock speeds, and a Radeon 9800 Pro.

But we will have to wait for some real benchmarks, until then it's just specualtion. Maybe they will be demoing the Towers at MWCP, possilby even an nVidia or ATI gaming station showing them off.

Seems like UT 2003 would be a great test.

Of course only a few games are optimized for dual processors...so Black and White should fly, but UT2003 will only see slightly more than 200Mhz bump between the 1.8 and the dual 2.0.
 

nighthawk

macrumors regular
Jan 3, 2003
104
0
Re: Stats that matter

Originally posted by iriejedi
Maybe I've missed some of the threads that I'm requesting.... but show us some stats that matter!

How fast will games play?

How much will the DP 2gig benefit a gamer vs a 1.8gig single brain?

I use photoshop so I'm going dual processor - but I'm a soap box preacher trying to convert the UNSAVED PC users. How can I sell the slower models to people who play game instead of sequencing DNA without key data?

Iriejedi

First of all, in order to take advantage of a dual CPU, the software must be multi-threaded. Some of the top end games may start recoding for duals, but in the PC world, few end-user machines are dual. The only option (other than Xeon) are the Althon MP which are much more expensive and slower per chip than their XP counterparts.

I was at WWDC, and they had an entire group of computers just for gaming... at least 36. They were playing Unreal and Medal of Honor. The image quality and fluid motion were incredible... and best of all, they were only running on the G4s.

When I tested the G5's in the lab with Carbon Fractal Altivec, the dual 2.0ghz scored 12.4 GFLOPS at it's highest score (default settings).

Don't worry, the G5 will blow away the gamers with horsepower to spare.
 

allpar

macrumors 6502
May 20, 2002
365
122
How'd the dual G4 do in your test? I'm really looking hard for comparative benchmarks...
 

Flynnstone

macrumors 65816
Feb 25, 2003
1,438
96
Cold beer land
Couple interesting bits:
The memory footprint was 1 meg. So on the G4 is probably all resided in L3 cache. So perhaps it wasn't beating up system bus!
So a dual G4 should be twice as fast.
The G5 doesn't have L3 cache, so it was likely using its system bus. Interesting the running on dual processors was twice as fast. Perhaps the lack of L3 cache is not an issue.

I like to see the person rerun the test on:
-G5 using the optimized compiler
- P4 Xeon (like Apple used for comparison) in single and dual configuration.
- P4 (non-Xeon) at 3.2 Ghz
- Athlon 3200
- Opterons Duals
- Athlon 64
 

jamesbsd

macrumors newbie
Aug 8, 2003
2
0
Denver
Don't ignore Altivec in this test

One thing which seems to have been missed in the discussion is that the problem being solved runs 10-13X faster when using code which accesses the Altivec unit. The P4 was not tested using this version of the code because the P4 is missing an Altivec unit. :)

One way to interpret these results, therefore, is: the G5 is the fastest computer for solving this problem, and only the G4 machines (with Altivec) were close.

Early posters seemed discouraged by these results, but I found them very encouraging, given that the G5 has very specific compiler requirements that couldn't be met when the Jet3D program was compiled. Presumably the test could be run again using IBM's recently released xlf compiler. There is reason to believe that very significant (40%) speed improvements may be forthcoming with a more G5-aware OS X (Panther), so stacking these two things together, it's quite likely that rerunning this simulation with xlf and Panther would demonstrate the G5's superiority vs. the P4 (without using Altivec...when using Altivec, it already isn't close) at higher GHz (3.2+?).

Benchmarking the G5 on code that doesn't utilize the VMX unit is really very misleading, as far as expectations of real world performance are concerned. Code that runs on the G5 *will* be written to use Altivec/VMX in the real world, and "testing" the G5 while the VMX unit lays idle can't be a good real-world test. It would be like benchmarking a Pentium on Mandelbrot fractals without compiling any code for the FPU--this would be very misleading. A benchmark which ignores large parts of a processor's real abilities is never a good benchmark, and this is part of my complaint about running the SPEC code to test machines that have vector processing units. The SPEC code ignores the VMX/Altivec units, a situation which no well-written real world code would ever do, and SPEC is therefore a very poor benchmark for processors like the G4 and G5 which have outstanding vector processing units.

All benchmarks need to be read with a grain of salt and a lot of knowledge. Without the grain of salt and only a little knowledge, benchmarking can be more dangerous than useful.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.