I'm assuming that the rendering of high-quality photos is done through the graphics card. When you zoom in and all, especially in high-res photos, the graphics card has to redraw the image which takes memory.
I don't think that you will benefit from more than 256MB. I may be wrong though, as those are just educated guesses.