Become a MacRumors Supporter for $25/year with no ads, private forums, and more!

MacRumors

macrumors bot
Original poster
Apr 12, 2001
54,263
16,112
Apple announced a preview of Xgrid technology today.
Apple today previewed Xgrid, a computational clustering technology from Apple’s Advanced Computation Group (ACG). Xgrid helps scientists and others working in compute intensive environments to fully utilize all IT resources, including desktops and servers, by creating a grid enabled “virtual” IT environment that takes advantage of unused computing capacity to run batch and workload processing.
Xgrid is available as a free download from Apple starting today, according to the press release.

Xgrid was first trademarked in 2002, spawning much speculation.
 

Nicky G

macrumors 6502a
Mar 24, 2002
974
907
Baltimore
This is potentially great -- perhaps more and more apps will now come to support rendering on a network of machines. That would kick butt for apps such as, say, MojoWorld Generator, which can take a really good amount of time to render!
 
Comment

spankalee

macrumors member
Jul 22, 2002
66
0
I think, along with the G5 XServe, this is possibly the biggest announcement of the day (iPod Mini would have been if it was priced at $200).

Clusters are notoriously hard to set up, especially if you're interested in using the computing power of, say, your iMac lab for a night time render or simulation.

Bringing Rendezvous and "Apple Ease of Use" to clustering automatically increases the value of all existing Macs for institutions, and will create a lot more interest in Macs among corporate and educational markets.

Imagine an Apple pitch to a major university: "Not only do you get 500 easy to use iMacs for your english labs, and 50 powerful G5s for your art department, but you'll get a top 100 super computer for free!"

I can't wait to see programs like LightWave, Maya and RenderMan support Xgrid. I wonder if Xcode's distributed compiling already uses it?
 
Comment

ffakr

macrumors 6502a
Jul 2, 2002
617
0
Chicago
Originally posted by spankalee
I think, along with the G5 XServe, this is possibly the biggest announcement of the day (iPod Mini would have been if it was priced at $200).
The mini ipod isn't cheap.. but neither are decent flash MP3 players. I shoped for one a while ago and decided it wasn't worth dropping over $150 for a decent player with crap for storage. For what you get I think $249 is a very good price, though i would of course preferred to see it come in cheaper.
I wonder if Xcode's distributed compiling already uses it?
I was told by an upity up in the xcode project that they did not use the same technology in xcode as in other (pending) clustering projects. I was basically told.. no, it's not the same, no I can't tell you what's coming, yes, it's very cool.
:)
 
Comment

woodgie

macrumors newbie
Jan 6, 2004
11
0
Re: Xgrid Previewed

Originally posted by Macrumors

Xgrid is available as a free download from Apple starting today, according to the press release.

Where, dammit... Need linkage... can't find... pant, pant, pant

;)
 
Comment

Pedro Estarque

macrumors regular
Dec 5, 2002
131
0
Photoshop

I'll be waiting for the day when I can use all my macs ( 4.5 GHz of combined processing power! ) to run photoshop batch.
 
Comment

liudger

macrumors newbie
Jul 23, 2002
10
0
tachometer!!

tachometer is coool is shows the amount of power of your renderfarm :)
 
Comment

liudger

macrumors newbie
Jul 23, 2002
10
0
lol

As more people on the network share their resources, you can solve more problems. Not a bad metaphor for life, either.
 
Comment

///M Power

macrumors newbie
Oct 27, 2003
17
0
USA
Originally posted by sosumi
Anybody knows if programs must be updated to be distributed by xGrid, or is it all handled automatically?

Something I want to know as well!

It be great to have all the Macs at my home all working on one SETI unit or something... Heck, I just want to see this in action on my network! haha
 
Comment

Koyder

macrumors newbie
Nov 14, 2003
26
0
For the love of God, why another Brushed Metal app? I can't take it anymore!
 
Comment

Krevnik

macrumors 68040
Sep 8, 2003
3,827
1,039
Well, looking into Xgrid, it seems to send commands across the network, and get the output that app creates. The question I have for this is this: will it copy programs needed to run if they don't exist on the other machines in the grid? I would love to use this to take certain video conversion apps available (OpenShiva) and write a similar-functioning plug-in for Xgrid, which is doable (audio on some machines, video on others)... but the CLI software that is needed to do the actual processing would need to exist on all machines... does Xgrid copy this stuff over automagically, or do I have to have copies of the software already available on all systems to participate in the grid?
 
Comment

spankalee

macrumors member
Jul 22, 2002
66
0
Originally posted by sosumi
Anybody knows if programs must be updated to be distributed by xGrid, or is it all handled automatically?

It looks like programs will need to use the Xgrid APIs to take full advantage of it, but that you can use it out of the box for launching distributed batch command-line programs (not truly a distributed app).

What's interesting is that it looks like Xgrid is not really a cluster communication system; the page mentions that it doesn't replace protocols like MPI. Instead Xgrid helps you manage the cluster and apps, and helps make sure that each instance has access to all the necessary resources (files, settings, etc).

I think this is a good strategy, because a program that uses MPI will not have to be radically altered, but can be enhanced by using the Xgrid API.
 
Comment

sky131

macrumors member
Jul 25, 2003
37
0
I used the demo of Xgrid and had my own little 5GHz cluster in my house. Way cool.

Hopefully this technology will be effective for many of us creative type without being too much of a hassle. I have faith in Apple that it will be all good.
 
Comment

varmit

macrumors 68000
Aug 5, 2003
1,830
0
So.......

so this clusters two or more computers together. does it work with any program, what did you run on your 5ghz cluster.
 
Comment

GovornorPhatt

macrumors regular
Dec 19, 2003
152
0
Where do YOU live?
I wonder if this would work with folding@home? Imagine the work units! Would sometime in the future it be possible to render final cut pro movies using x-grid? The curent x-grid plugins are of little use to me, but i would use it with photoshop.
 
Comment

sky131

macrumors member
Jul 25, 2003
37
0
Originally posted by GovornorPhatt
Would sometime in the future it be possible to render final cut pro movies using x-grid? The curent x-grid plugins are of little use to me, but i would use it with photoshop.

I am in agreement. It will be great if I can use it with PS and FCP4, but other than that, I would have little use for it.

I just tested it with the demo processes.
 
Comment

Krevnik

macrumors 68040
Sep 8, 2003
3,827
1,039
Well, XGrid only works with commands/scripts that can be sent across the network. It cannot send threads across the network, so you aren't going to see MP type performance, but rather a way to take multiple processes that need to occur and do them simultaneously on multiple machines.

I would definitely like to see FCP4 get integrated enough that it could break up a render job into chunks and send the chunks to various machines, BUT... all machines have to have access to the proper source footage, which would be problematic without some sort of built-in networking code in FCP4.

I think a good first test is to take an open source app like OpenShiiva and see if we can get it working with XGrid as proof.
 
Comment

woodsey

macrumors regular
Nov 15, 2001
154
0
Anyone know if this is going to remain free when the final version comes out?

Is it going to be seperately purchaseable software, or will it come as part of OS X?
 
Comment

GregA

macrumors 65816
Mar 14, 2003
1,248
15
Sydney Australia
Yeah... hopefully with Apple's focus on video we'll see that automatically using Xgrid before long. DVD compressing, FCP, iMovie, why not all of them?

Yes Apple may need some way of moving/sharing files to do this - but it's not like they don't already share files, just need to manage it in Xgrid.

(My only extra requirement is that it use LATENT cpu and network time - I don't want it noticeably slowing down my network or another machines in use.)
 
Comment

ffakr

macrumors 6502a
Jul 2, 2002
617
0
Chicago
Originally posted by GregAussie
Yeah... hopefully with Apple's focus on video we'll see that automatically using Xgrid before long. DVD compressing, FCP, iMovie, why not all of them?

Yes Apple may need some way of moving/sharing files to do this - but it's not like they don't already share files, just need to manage it in Xgrid.

(My only extra requirement is that it use LATENT cpu and network time - I don't want it noticeably slowing down my network or another machines in use.)

All the info on xgrid is in the readme and faq included with the package. There really isn't any need to wonder about these things.

xGrid can run in a screensave mode... just like Zilla (it's daddy)
You tell xgrid to connect to the first cluster it finds, or to connect to a specific cluster, you tell it to only run when idle (screen saver mode). You can even change the screensaver to a new one that displays the number of cycles being donated to xgrid.
 
Comment
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.