"hardware" or "design / build quality"? In terms of HW specs, most Android phones have been ahead of Apple for years now. In terms of design and build quality, the only phone on the market that bests (and even surpasses) Apple HW is the HTC One now and they can't produce even minimal numbers of devices and have to postpone over and over again. I'd go with a One any time if I were sure that HTC will release timely updates. However, the phone already comes with an obsolete version of Android out of the box and is very unlikely to be upgraded within the next 12 months.
I just sold my iPhone 5 because the screen was simply too small for my needs (I do all my reading on my phone). Also, I had to find out that the Nexus 4 has a considerably better keyboard (also an area where Apple used to be way ahead of the competition and is now lacking behind because zero improvements were made in the last 5 years while Google massively improved on their keyboard) and while the UI in general is equally fluid on both the iPhone 5 and the N4, I find that applications load much faster on the N4. What I'm going to miss is the iPhone's camera, which is drastically better than the N4's - but that's a small trade-off for me.