I've used plenty of Android devices for long periods of time, including the "latest and greatest" so to speak.
I have a few friends that work at Verizon and they're always bringing their phones over to show me because they think for some reason they will get me to switch to Android. I use them, I play around with them, I'll even load programs I wrote on to them to test performance, and then thats when my friends see that regardless of the hardware, its the software that is the weakness*.
First, let me say I'd LOVE to release the game I'm working on on both platforms, hence why I am glad my friends let me play with their phones, but its not doable with a satisfactory performance, here is why:
Android is open source. (Although for the most part its really only open source to the OEMs.)
Secondly, open source software, while great, has a major weakness and that is fragmentation. Android is fragmented like you wouldn't believe, and google hasn't done anything yet to stem this. Sure Ice Cream Sandwich is to help with this, but there is still the issue of the sheer amount of hardware out there. Dev's have to dig through each releases documentation and make sure everything is compatible, and thats just with the software. Who knows if it will all be compatible with the hardware.
I know some people try and say "Apple iOS is fragmented too!" but those people don't know anything about software development if they think that iOS is anywhere close to Android as far as fragmentation.
Third, the hardware is usually not that great. Android handset manufacturers are too busy pushing useless hardware specs, and not focused enough on important things (like battery life) in a phone. My friends couldn't grasp the concept that their dual core whatever phones (sorry the specs of each phone are at home) couldn't keep pace with an iPhone 4, iPhone 4S, iPad, and iPad 2 in a simple graphics test.
Fourth, multiple app stores are a mess. I do like how Google created a main one, but its not the only one and thats kind of messy.
Theres lots more I can list but its at risk of becoming a tl;dr. I will say for me to spend time and make something for Android I'd need to see Google do this:
1.Enforce minimum hardware, performance, and screen size requirements for devices to run Android.
2.Put all app stores under the main roof.
3.Require OEMs to update Android for a minimum of 2 years per handset (I know an 18 month requirement is in the works).
As for the glitches you never experienced OP, be glad. There is not a friend I have with an Android phone who hasn't complained about it crashing, slowing down, having a bad battery life, or being laggy. I won't say this is Googles fault, because vanilla Android is much better than what comes on most phones, I blame the OEM's on this one because of their Android mods and they make the hardware.
*Games are what I primarily make and there is a big difference in performance between Android and iOS in that regard, with iOS performing much better. For regular apps, it won't matter much but your Android phones battery will deplete much quicker because its potentially pushing more hardware depending on the phone.
EDIT: This is to support my point about fragmentation. Out of these I'm curious how many people can't upgrade to the latest software due to lack of OEM support:
http://developer.android.com/resources/dashboard/platform-versions.html