I have lived with the HTC One and just got the Note 3 last week. It is a matter of getting use to it to some extent. I never had a 4.7" screen before so that took some time to get use to. After using the Note 3 for a few days, I don't have a "too big" issue at all. I guess it depends how one uses their smartphone daily. Nothing I use it for do I feel the size is cumbersome.
I say get use to it folks. The trend is obviously BIGGER, it is so obvious that is the way things are going. Soon no 7" tablets either IMHO. We are seeing more and more 8 inch now.