Whatever you do, don't for the love of all things holy get anything less than 8GB. The amount of RAM is crucial to a comfortable usage. I have 4GB on my bones stock rMBP and notoriously get a large swap file slowing the system down.
...
Depends on what you do with your computer. I have 4GB and don't swap a lot and my memory pressure is always green.