Agree with you 100%. I was 50/50 until I printed out the stencil. Also, I paid attention to how often I used my iPhone 5 with one hand. Was shocked because I didn't realize I used it one handed as much as I actually did. I knew the 4.7 was my best choice.
Exact same experience here. When I made the cardboard cutout and put it in my front khakis pocket (how I usually have it at work) and sat down it was clear that it was going to be uncomfortable. And I can easily hold the Plus with one hand, but I can't hold it and use it with one hand. And I use my 5 a lot one handed just like you said. So it will be the 6 for me.
The wife wants the Plus because she prefers to do a lot of reading on hers (even when her iPad is lying beside her). She carries it in a tote bag, never in a pocket. And I don't think I've ever seen her use it one handed. So the Plus will be perfect for her.
I have 2 or 3 guy friends and that's how it shook out at their house also. We're all middle aged professional guys. Your mileage may vary if your lifestyle is different.