It should be fine. Just don't mix and match different pairs... obviously they need to be installed in pairs for dual-channel operation (doesn't operate in single channel..) but it might not work even mixing groups of two different speeds.
You might want to consider a Quad G5, by the way. Basically twice the power, and not much more money these days.