More G5 Benchmarks (NASA)

Discussion in 'Mac Blog Discussion' started by MacRumors, Jul 4, 2003.

  1. MacRumors macrumors bot


    Apr 12, 2001
  2. wizard macrumors 68040

    May 29, 2003
    Its a shame that this testing wasn't done with up to date compilers. It appears that they just ran existing binaries.

    On the other hand it does reinforce some things, one of which is that the G5 isn't all that its cracked up to be but isn't a slouch either. Apparently this is with old code that was written for the G4, it would be very interesting to see how everything runs when compiled against a modern compiler targetting the G5.

  3. nagromme macrumors G5


    May 2, 2002
    Looks like well-design tests, for their purpose. Results use only a single CPU, but they note the G5s dual performance in the text: very nearly double, which is good!

    I suppose they used single CPUs for fairness in comparison to Pentiums, which don't exist in duals? Fairness, of course, meaning evaluating the chip's capabilities for their very specific needs. Not fairness in terms of benchmarks for marketing, as they make clear.

    They do mention that they did no optimisations for the G5, and that better compilers might give the G5 a boost in future tests. Encouraging, since the G5 did well even so!
  4. maradong macrumors 65816


    Mar 7, 2003
    well they are really good for apple...
    the g5 2ghz single cpu is 22% slower than the 3200 intel with fsb 800. well, but if the new compilers come, with optimisations the difference is only 2%....
    a dual g5 2ghz is the fastest system aviable. because the intel machines have only one bus per processor, while the ibm chip has got one for each. that is significantly faster in dual cpu mode...
  5. Blackcat macrumors regular

    Jun 10, 2002
    Cirencester, UK

    If I'm reading this right, a single 2GHz G5 is nearly 50% faster than a 1.25GHz G4 in MFLOPS, and 25% faster than a 2GHz P4.

  6. rjstanford macrumors 6502

    Oct 30, 2002
    Austin, TX
    Vector Performance

    One thing that struck me as interesting:
    There was a lot of speculation that the Alitvec unit was bus-limited in the G4. I'm not familiar with the test in question, but this should certainly be an interesting point, no? Is anyone more familiar with the code to know if it would have been expected to benefit from the faster bus?

  7. allpar macrumors 6502

    May 20, 2002
    So then a 1.6 G5 would not be much faster, if at all faster, than a dual 1.256?

  8. Blackcat macrumors regular

    Jun 10, 2002
    Cirencester, UK
    Prolly not, but if a SINGLE 1.6 is the same speed as a DUAL 1.25, that's still impressive, no?

    I'm no math whizz, but I think a 1.6 GHz G5 is 36% faster than a 1.25 GHz G4 in this test.
  9. Heltik macrumors 6502

    Jul 16, 2002
    Even though the margins are quite small for the benchmarks used, we have to consider that the Pentium did not use Vector processing.

    For applications such as Photoshop/Final Cut/DVD authoring/Cd ripping, etc, surely we can expect the G5 to be leagues ahead, therefore. In fact, just about everything I use my Mac for on a daily basis.
  10. scan300 macrumors 6502

    Mar 25, 2003
    Melbourne, Australia
    Keep in mind that these benchmarks test floating point and vector computational performance only. The programs only use 1 Mb of ram. They don't take into account system bandwidth.

    So when evaluating the 1.6 GHz G5, the vector figures may not be much better than the G4, the floating point an improvement, but the data throughput on the bus will be significantly better than the G4.
  11. maradong macrumors 65816


    Mar 7, 2003
    exactly, and that is much more important than raw gflops values.
  12. Freg3000 macrumors 68000


    Sep 22, 2002
    New York
  13. nuckinfutz macrumors 603


    Jul 3, 2002
    Middle Earth
    What impressed me the most was not the Altivec. Jon "Hannibal" Stokes from Arstechnica pretty much called the Altivec preformance correctly on his breakdown of the 970. I expect that the probably PPC 980 will shore up Altivec even better(adding it more cleanly to the design) resulting in good performance.

    What we should be focusing on is the incredible FPU preformance on non Optimized Code. Recompile that code to take advantage of the G5's prodigious FPU capability and you will see some nice Real World gains.
  14. allpar macrumors 6502

    May 20, 2002
    #14 the extra $300 to buy a single 1.6 is well worth it over the Dual 1.25 ... ? Just confirming ... the duals seem like a good deal ... I don't figure I'll ever need PCI-X...
  15. aarond12 macrumors 65816


    May 20, 2002
    Dallas, TX USA
    With two processors...

    Did anyone notice the author's comment that enabling both processors in the G5 system made the G5 system nearly twice as fast as the Pentium 4 2.66GHz system?
  16. Sayer macrumors 6502a


    Jan 4, 2002
    Austin, TX
    Lots of wiggle room there.

    The G5-updated compilers will do several things to help boost the performance:

    * The G5 has a differnet pipleline and it needs to be properly filled for efficient use of CPU resources. The newer compiler will do this.

    * The OS does not have all the tweaks and changes Apple will most likely be putting into Panther (if Smeagol performed as well as Panther on a G5 Apple would lose the $129 upgrade since many people would stick with Smeagol with the same performance as Panther and save the money).

    * The G5 works on instructions in groups, if the groups are not filled up optimally the G5 will not run optimally. The newer compiler and tools will properly handle the G5's quirks here.

    I continue to be amazed at people who see a Mac finally on an equal footing to a top-end PeeCee and whine that its not FASTER than the absolute top-end PeeCee.

    Apple essentially erased the only compelling hardware reason to not buy an Mac with the G5. It has every Wintel buzzword and trumps them (1 GHz busses, FireWire 800, optical audio I/O built in).

    Now its just up to the software to step up and remove another reason NOT to use a Mac. Do you think Apple's X11 and Ports Manager software is meant to compete with XFree86 and the Darwin community or to get more big name Linux software on the Mac with an officially-sanctioned cross-grade option?
  17. Mercury macrumors regular

    Jul 6, 2003
    Yay! Finally, some independent testing of the new units. It seems that finally we have the efficiency and the horsepower to brag to our PC friends.

    Now, another $2200 to get top of the line with 23" HD...
  18. ibookin' macrumors 65816


    Jul 7, 2002
    Los Angeles, CA
    Well they'll just tell us how our machines are too expensive. :D
  19. iriejedi macrumors 6502a


    Oct 4, 2000
    Nor Cal
    Stats that matter

    Maybe I've missed some of the threads that I'm requesting.... but show us some stats that matter!

    How fast will games play?

    How much will the DP 2gig benefit a gamer vs a 1.8gig single brain?

    I use photoshop so I'm going dual processor - but I'm a soap box preacher trying to convert the UNSAVED PC users. How can I sell the slower models to people who play game instead of sequencing DNA without key data?

  20. nighthawk macrumors regular

    Jan 3, 2003
    Also note that the Pentiums were running Red Hat Linux, and not Windows... this actually places the P4s with a overall more effecient OS than OSX (but equal standing in low-level features). In my opinion, the scores are actually more impressive than they appear. Remember that Apple tests and the other tests compared the G5 to Windows OS machines.
  21. g3ski macrumors member

    Jun 18, 2002
    Re: Stats that matter

    The 970 should be pretty competitive on the games front with the 1ghz bus and fast clock speeds, and a Radeon 9800 Pro.

    But we will have to wait for some real benchmarks, until then it's just specualtion. Maybe they will be demoing the Towers at MWCP, possilby even an nVidia or ATI gaming station showing them off.

    Seems like UT 2003 would be a great test.

    Of course only a few games are optimized for dual Black and White should fly, but UT2003 will only see slightly more than 200Mhz bump between the 1.8 and the dual 2.0.
  22. nighthawk macrumors regular

    Jan 3, 2003
    Re: Stats that matter

    First of all, in order to take advantage of a dual CPU, the software must be multi-threaded. Some of the top end games may start recoding for duals, but in the PC world, few end-user machines are dual. The only option (other than Xeon) are the Althon MP which are much more expensive and slower per chip than their XP counterparts.

    I was at WWDC, and they had an entire group of computers just for gaming... at least 36. They were playing Unreal and Medal of Honor. The image quality and fluid motion were incredible... and best of all, they were only running on the G4s.

    When I tested the G5's in the lab with Carbon Fractal Altivec, the dual 2.0ghz scored 12.4 GFLOPS at it's highest score (default settings).

    Don't worry, the G5 will blow away the gamers with horsepower to spare.
  23. allpar macrumors 6502

    May 20, 2002
    How'd the dual G4 do in your test? I'm really looking hard for comparative benchmarks...
  24. Flynnstone macrumors 65816


    Feb 25, 2003
    Cold beer land
    Couple interesting bits:
    The memory footprint was 1 meg. So on the G4 is probably all resided in L3 cache. So perhaps it wasn't beating up system bus!
    So a dual G4 should be twice as fast.
    The G5 doesn't have L3 cache, so it was likely using its system bus. Interesting the running on dual processors was twice as fast. Perhaps the lack of L3 cache is not an issue.

    I like to see the person rerun the test on:
    -G5 using the optimized compiler
    - P4 Xeon (like Apple used for comparison) in single and dual configuration.
    - P4 (non-Xeon) at 3.2 Ghz
    - Athlon 3200
    - Opterons Duals
    - Athlon 64
  25. jamesbsd macrumors newbie

    Aug 8, 2003
    Don't ignore Altivec in this test

    One thing which seems to have been missed in the discussion is that the problem being solved runs 10-13X faster when using code which accesses the Altivec unit. The P4 was not tested using this version of the code because the P4 is missing an Altivec unit. :)

    One way to interpret these results, therefore, is: the G5 is the fastest computer for solving this problem, and only the G4 machines (with Altivec) were close.

    Early posters seemed discouraged by these results, but I found them very encouraging, given that the G5 has very specific compiler requirements that couldn't be met when the Jet3D program was compiled. Presumably the test could be run again using IBM's recently released xlf compiler. There is reason to believe that very significant (40%) speed improvements may be forthcoming with a more G5-aware OS X (Panther), so stacking these two things together, it's quite likely that rerunning this simulation with xlf and Panther would demonstrate the G5's superiority vs. the P4 (without using Altivec...when using Altivec, it already isn't close) at higher GHz (3.2+?).

    Benchmarking the G5 on code that doesn't utilize the VMX unit is really very misleading, as far as expectations of real world performance are concerned. Code that runs on the G5 *will* be written to use Altivec/VMX in the real world, and "testing" the G5 while the VMX unit lays idle can't be a good real-world test. It would be like benchmarking a Pentium on Mandelbrot fractals without compiling any code for the FPU--this would be very misleading. A benchmark which ignores large parts of a processor's real abilities is never a good benchmark, and this is part of my complaint about running the SPEC code to test machines that have vector processing units. The SPEC code ignores the VMX/Altivec units, a situation which no well-written real world code would ever do, and SPEC is therefore a very poor benchmark for processors like the G4 and G5 which have outstanding vector processing units.

    All benchmarks need to be read with a grain of salt and a lot of knowledge. Without the grain of salt and only a little knowledge, benchmarking can be more dangerous than useful.

Share This Page