Who is "We"? If you're referring to yourself, let's be realistic.. Apple doesn't really care what you may want. People on this forum who complain about how the iPhone is too small are in the minority. We're (people on this forum) a very small percentage of people and Apple would never make any dramatic changes for such a small percentage of their sales. They look at the pros and cons of making a dramatic change like that and if they don't think it's necessary (Which let's be honest... it's not. Apple will still sell more iPhone 5's than they did iPhone 4/4S regardless if they change the screen size or not.)
I personally couldn't care if the screen size got bumped up. The phone sits in my pocket 70% of the time and when I am using it, it's perfectly fine the way it is. (Size wise)
What I'd really like to see is a better battery, and a more durable phone. I'm kinda over this all glass design.
I honestly think the majority of iPhone users want a bigger screen. Thats my stance. And I don't think the phone is too small, it's just wouldnt hurt to go bigger. This Forum may be a very small percentage of ios users, but at the end of the day, it's speaks to what others who are not on this forum may be thinking.