Not having a computer with 4gb of RAM, nor a computer with as SSD, take this with a grain of salt, but wouldn't the difference between the two be exactly the same as with a spinning drive, but less noticeable because the SSD has a faster read time*? Additionally, if you aren't going to make constant use of 4gb of RAM (unless you're really taxing your mac, you probably won't), that would leave you with 4gb or RAM that is not even being used.
*but a slower random write time, so don't use an SSD for writing large files, but I'm assuming that if you're looking to spend $$$ on an SSD you know the drawbacks.