I think this is a VERY common sentiment!
I feel the same. However, the question seems to not be "do you want a bigger phone?" (an emphatic NO, for both of us), but rather "do you mind a larger screen... on a similarly sized phone?", to which I say: "Of course not! It's the phone size I want no larger; what possible issue could I have w/ the screen being larger through bezel shrink?".
Do you feel the same, or would you prefer the same 4.7" screen in a smaller form factor? (which actually doesn't sound terrible to me either, just less likely)