Well, only you can answer that, but if you are reconsidering it so soon, I would definitely go exchange it. 32g is a good size and you never know when you might need the 4g. Better to have it and not need it than to need it and ot have it?
I am coming from a 16g wifi iPad 2, and my new 32g Verizon LTE is being delivered Thursday.