Absolutely, you should.
I had an Intel iMac at my old job with 512MB for a while. Even when using just using Word, Outlook and Flash it would often pause for 5-10 seconds switching between apps. With 1GB of RAM all pauses disappeared, even when running tons of apps.