Current Note 3 user here and wanted to add my two cents. Also as some back ground, I'm a 25 year old male and roughly 5'10. I would consider myself having small hands (I'll update later with a measurement).
After watching the keynote I plan on moving back to Apple as I previously had an iphone4s and miss the integration with ipad and Mac. I truly believe Samsung did a better job on their one hand made with the Note 3 than apples double click on the plus.
The being said, the note 3 is still too big for my day to day use. Don't get me wrong, it's awesome watching videos or playing games. However even with the one handed modes, it requires too many hand gymnastics to get a task done. It's definitely a tough decision because there are times when both sizes can have their benefits. However, I find myself needing one hand operation more often than enjoying the large screen .
Also take into account exercising, I use an arm band with the note 3 and is just too unwieldy for me.
This is all just my preferences, but I will be going to the 4.7 iPhone 6 based off my note 3 experience. Every one is different and have different needs, Just wanted to share my opinion. Feel free to ask me any questions!