It really depends on what you do with your current iMac. In situations where you don't do anything demanding, an SSD would be just fine.
I can't really say if it will be worth it, since you are providing enough detail on what you use it for an what model you are thinking about upgrading to.