Separation gets around the bottleneck that will occur when the application and scratch are running simultaneously (disk is trying to read say PS, and write the scratch data at the same time; the disk's available bandwidth is shared this way). Even if it's a stripe set, as random access performance (what an OS/applications disk needs), doesn't scale as sequential throughputs do (in fact, there's very little gain, whether it's one disk or n in the case of random access performance). Stripe sets do scale to ~ n disks * performance of a single disk in the set for sequential access only.
Thus better performance is possible, particularly for scratch, when it has it's very own location that's not shared with anything else.
Another alternative for scratch, is a single, inexpensive SSD. It's a bit faster at sequential access than a pair of 2 or 3TB mechanical disks (even more of a difference with smaller capacity disks; based on the fact most SSD's can do ~250MB/s for sustained/sequential throughputs; ~70MB/s for random access).
The same goes for the OS/applications disk, as SSD's have the best random access performance of any drive technology (mechanical is doing good to reach ~40MB/s in this area). It's just using the advantage of it's random access performance for this particular usage instead.
NP.Thanks Nanofrog, your answers are always 5 star answers.
The only reason to stripe a pair of SSD's for an OS/applications disk, is if you can get the capacity cheaper than a single disk (and you can spare the additional SATA port). That's it.Could you please give your opinion on this:
My plan was for 2x 100GB OWC RE's in a Raid0 array for boot/app/scratch. And 4 disk 12tb Raid0 for Data. But with this new info I wonder if in fact I could stretch my resources further and only use one of the SSD's for boot/app and then put Scratch on the 4 disk 12TB Raid0. I have 24GB of RAM so the scratch won't be used heavily, unless I have misunderstood things. Could it be that the performance won't suffer that much?
That Leaves me with an SSD that I can use elsewhere in another machine.
Thanks in advance,
NP.
The only reason to stripe a pair of SSD's for an OS/applications disk, is if you can get the capacity cheaper than a single disk (and you can spare the additional SATA port). That's it.
Now as an OS/applications disk is primarily read, you don't need the additional over-provisioning of the RE series either. Nor do I see a reason you need 200GB capacity, unless there's a massive amount of libraries I'm not aware of (but even if there are, you could go for the 240GB Pro series instead, and save $70USD). If you don't have such a library, then the 120GB Pro is probably overkill.
Using 4x 3TB in a stripe set for scratch is also overkill. Use smaller disks if you're going with mechanical. Otherwise, you can do better I think with a pair of SSD's (but you'd really want to get these off of the ICH if you do, as the ICH has a bandwidth limitation of ~660MB/s, and it doesn't scale with SSD's as it will with mechanical disks).
Either way, you're over-doing it on both areas (i.e. wasting your money).
The first thing you actually need to do in terms of scratch (to make sure 24GB is enough, but it should be), is check your efficiency in PS. If it's not 100% (or near it, as it may only show 99.9% at best), then upgrade the memory. The point behind this is, memory is far faster than scratch space, no matter if it's HDD or SSD based. It's even faster than a RAM disk, due to the bandwidth limitation of the PCIe slot it would be inserted in.
If you've sufficient memory, PS won't go to scratch that much, and actually run faster (takes advantage of the memory instead). Then the more important bottleneck to be addressed will be the primary data storage area (where ever you're placing the completed projects/files).
This is why a single SSD for OS/applications, and a separate SSD for scratch work well (it does assume there's sufficient memory in the system where scratch isn't thrashed).
You can create a stripe set for your primary project data, and make sure you've a proper backup for it, as the data will be gone when one of those disks fails. Personally, I prefer a redundant form of RAID (10 if you won't/can't go for a proper RAID card), as OS X can handle that (0/1/10 and JBOD).
RAID 5/6/50/60 will require a proper RAID card, but there's other advantages by getting one (faster performance, better recovery options, online expansion, and changing levels with redundant arrays without data loss are the major ones).
I can't stress enough how important a proper backup system is though. And a good UPS as well, particularly with RAID (can save you having to go back and re-perform lost work in the event of a power failure, and the application doesn't automatically resume).
Then go the following:Brilliant, thankyou. Great info. Actually the 12TB is for all my Data. Lightroom Library, Retouched PS files, Motion, Logic. There's quite a lot of data... My reference to scratch there was that it would be on a partition of that array, and 64gb would be enough, not the entire 12TB. But it does seem best to keep the scratch seperate then, even if I have overkilled on that one. Maybe I should use it separately as a working and scratch disk.
I have a fairly intensive backup system. Externally to another eSata Stripe and another rotated offsite. It has been working well this way for a few years now. I'm going to look into a UPS now, thanks for the info.
Hint: you need a bigger card (more ports) for guinea pig operations err.... future growth and performance.
An ARC-1880ix24 should do the trick.
Not as fancy, but a lot cheaper might be this solution here for a 2008 mac pro:
http://www.barefeats.com/hard108.html
however this raid solution tops out at 180MB / sec. because the raid chip is not able to handle more.. still a lot cheaper then 1100 bucks for the areca card...
Hey. I shoot 3-5 times a week and each job/day has 2-3000 frames plus motion too sometimes, so each job has it's own job folder containing it's own C1/DPP/LR catalogues, RAW Files, 16bit working PSDs and CMYK/RGB finals. All that happens on the working drive which as of monday will be the SSD. It then gets moved to the data drive and backed up in a couple different places. Time Machine covers it on the SSD.
Thanks for your input on this btw it's been a good learning experience.
if you work in Develop mode in LR then putting the cache on SSD is going to be a big bump
I hate the darn lag in the white sliders !!!!! but over the last 6 months I have got mine down to almost no lag
a graphic I had from a post on another forum shows you can gain some speed with the SSD cache
notice the 3rd one down showing cache on SSD and catalog on regular HDD still about as quick as catalog on SSD also doing raid 0 did not really help ?
I did a ton more testing than this but just posted the main info
about a month later
I had added a new machine configurations etc..
so the chart below did not use the same test files as the chart above ! the chart above was on my mac 3,1
I was not as concerned about comparing the file times as I was machines in my next test comparing a 3,1 to a 5,1
so here it is a month later further tweaking LR is getting pretty darn quick for me
I was amazed at the jump in speed I got from a newer machine ?
also trying raid 0 again and more discs I went up to 3 discs and noticed each disc was .02 second gain ?
I have a post production company for pro photographers and we do mostly album design and PS work and raw conversions
I am also a commercial photographer who does some weddings
just so you know where I am coming from
my main machine is a Mac Pro 5,1 is a 4 core 3.2Ghz model with 24 gigs areca 1222x with 8 750 gig HDDs and a few other raid boxes for bu etc..
SSD are from OWC I have two of the 100 RE and three of the 40 gig regular
I used to use C1 a lot
not as much these days but in the old Rob Golbraith days I did a lot to promote them so never had to pay for C1 they gave me a few lic to have
my setup is LR cache and PS scratch are on SSD
my main files and catalogs live on the areca raid which is pretty quick and secure etc..
then backup to a PM setup and TM is also on a PM setup
my boot is on SSD
all my testing showed the cache was the main thing to get on SSD and with catalogs and files being larger figured why waste the expensive space of SSD
3 SSD on the ICH throttles I had a post with numbers some months back ?
raid 0 wont speed up PS ? on its own
what will is a combination of things
your version of PS your OS your memory and of course the chip speed and scratch and storage a bit depending on the other factors
for the Mac being on SL and using CS5 is the biggest gain along with enough memory ? how much ? well that depends on your file size and such
12 gigs or 16 gigs should do it for most people
you can check PS efficiency I wrote how a few times an
then hit that little triangle to bring up info options check off scratch size and efficiency
basically you want your efficency to stay as close to %100 as you can
your scratch numbers are the left one is how much the document is taking up and the right one is how much your system has left to use
also note its the last thing done in PS for efficiency so if you have a action with 3 things it only shows the last step done not a total of all 3 !
so you want to check things as you work
also check your activity monitor for total memory used
I tend to use 4-6 gigs all the time in my system so with 24 figure I have about 18 left over for PS
so doing a little bit of work on this will help you decide how much memory you need
also a google search will turn up tons of info
in PS hit F8 or go to window>info
basically you want PS to run without going to your scratch disc
if PS hits scratch meaning it ran out of memory then having a SSD as scratch will help things out
24 gigs should give you more than enough room for files up to a gig
most of my files are 300 + megs and I never run into a memory issue
but my system while I am working in PS ends up using about 14-18 or so gigs of memory so 24 fit my work
large files over say 300 megs save as uncompressed TIFF
not sure your SSD size ?
I would run one as boot and one as scratch.cache depending on the size of them ?
if you use LR at all get the cache on SSD !!! it helps a ton just the cache not the catalog or original files
so what size are your SSD
what are your other HDDs you are going to use ?
how big are your PS files ?
how much time do you spend in PS ?
what other programs do you use a lot ?
these will help get your a bit more efficient setup
Is that hdd for Time Machine backing up your Mac Pro? If you store data all on one device that may be convenient, but it's not a very good idea imo to store backups of data on the same device as the primary copy. Offsite backup of important data is crucial.On top of that I have 4 more HDs on my MacPro. 1tb for my main drive, 2tb for media files, 1tb for past work archives and 2tb for Time machine.
regards
Is that hdd for Time Machine backing up your Mac Pro? If you store data all on one device that may be convenient, but it's not a very good idea imo to store backups of data on the same device as the primary copy. Offsite backup of important data is crucial.
If you backup to another device for Time Machine, that frees up an extra drive bay to put in a SSD or a hard drive for some other purpose.
if you use a SSD for LR cache and PS scratch a few things
40 gigs will allow you to have about 25 gigs of LR cache
if you also double use it for PS just make sure you dump your cache before PS use ! as you might fill it up ? so also in PS set a second scratch disc such as your BU disc that is not in play with working on files
so 40 will work but a big of juggling maybe
if you dont dump your LR cache not a big deal as PS will just jump to the next drive but with files that large it will jump to the next drive if it runs out of memory so just be aware of that
if you use LR as a large catalog and regularly sort your images etc..
vs using it to develop your raw files and export and move on this will also determine how much cache size you want to have and if you want to be dumping it all the time !!!
if you're working on big files. I think you'll find 8gb RAM is too little.
If you haven't already, you can see how much you're using now by taking a look at activity monitor. Down the bottom, click System Memory. Also check your photoshop efficiency either at the bottom of the standard window info dialogue. Or the info palette ensure it's visable in the info palette options. 100% or very near is the goal. Below 75% means there's something that needs to be looked at...
Photoshop is my main use, I work on files that are 2 or 3+gb and find that the 24GB of RAM I have is enough but I could use 32gb easily.
I have a RAID 0 array of two SSD's using it for my boot/app/working and a partition for scratch/cache. It's a really quick machine. I have a separate partition so I can quickly and easily erase it.
I also have a 4x Raid 0 HDD array which in some cases such as Sequential Uncached Write is better with speeds, at the moment, of 455.76 MB/sec compared to around 285.22 MB/sec for the SSD Raid 0.
Thanks!
Sorry for my ignorance but what is LR (Lightroom?) If it is I don't use it at all. Aperture here and there, but not much.
Most of my composites are for graphic design. I don't play much with photographs.