Did a factory reset, still dropping out. And i know its not my router because every other device in this house (and there are many) have zero issues.
I guess my time with the Nexus 4 is going to end soon.
Certainly looks like it is the fault of the Nexus, shame really, I quite enjoy mine but if it kept dropping wifi I wouldn't keep it.