I believe you can run a Mac Pro with only a single CPU. I'm not sure why you wan't to downgrade to a single e5320 though or if it is supported. Even If you plan on adding another at a later date you'd have to have a pretty special workflow for it to be an improvement.