I was interested in the N7 but ultimately went with the E-P3 because of price. The wasn't out at the time and a hotshoe was essential, so I couldn't justify the purchase of the N5 without having a way to trigger an off camera strobe without having to try and rely on an optical slave.
The Sony N series have some neat features with the peaking and the larger sensor. I did pre-order an OM-D and I'm waiting for that to arrive. So far, the IQ looks good and the high(er) ISO performance looks much better than the E-P3, which is one of my complaints. The OM-D is providing exactly what I wanted in an EVIL camera with a viewfinder and a hotshoe, where as the E-P3 couldn't use the optional viewfinder at the same time as any other optional hotshoe accessory.
If it weren't for purchasing two Oly lenses, I just very well have switched for the larger sensor and the peaking options. I'm not very fond of the form factor though where the lenses are larger in diameter than the body is tall, at least some that I've seen.
I will say that after ditching the kit lens and switching to the Olympus 45 f/1.8 and the Lumix 20 f/1.7, the camera has become a lot more useful than it was and I actually enjoy shooting with it. The only thing that's a let down right now is the high ISO performance since I use it mainly for food and restaurant reviews and have to shoot in normally unideal lighting situations. My Canon 5D MKII is much, much better in those situations, but carrying a large DSLR with lens into a restaurant is not exactly fun.