If they don't go with at least a 4.7" screen a lot of people are going to be done with the iPhone including myself. The 5s will be the real deal breaker though if they don't increase screen size.
There is almost zero chance of that happening, otherwise they risk losing a lot more than a minority bent on huge screens.