Just did some thinking, and realized that it really is not a good idea for me to upgrade at this time. I've only had my 6 for around 8 months, and it's a better idea to wait a bit till I upgrade. I'll stick with my 6 for now, and reassess when the 7 comes out.
Ultimately I just got caught up in the excitement of this SE release, now that I really analyze I really don't think I'd be happy with the smaller size and even if I would be, its not a good time for me to upgrade. Still happy that Apple released a good solid 4" iPhone tho!