Well I went to the 5 from a droid x in 2012 and I will never own another phone other then the iphone. That droid was a POS. Within months of buying it the phone started having problems. Accessing music would crash it, taking a video would freeze it, most of the pix i took were corrupted. My 5 runs the same as it did when I first turned it on. Its build quality is unmatched. The battery still holds a charge very well.
I've owned and used every major OS.
I too had the original DROID X. I even went as far as to start running custom ROMs just to try and make the thing usable. That actually did help, when the ROMs weren't buggy.
Before the X I had one of the first Android phones on Sprint (it was an HTC Hero if I remember correctly), also a poorly executed device.
Before the HTC, I had an iPhone 3G (that I loved). I was younger at the time and was on my mom's plan. She switched to Sprint so I was forced to give up the iPhone. That was a nightmare.
Prior to that I was a BlackBerry fanboy. I was addicted - CrackBerry was home to me haha. Jumping from BlackBerry to the iPhone 3G had its share of problems. If you'll remember, BlackBerry email at the time was World Class and Apple was playing catch up.
Today, I'm on the iPhone 5 on Verizon and I will be picking up the iPhone 6 later today.
Now that I've seen it all. No one executes like Apple. The Android vs. iOS debate is much like Windows vs. OS X.
Apple's products are locked down and don't offer significant customization; however, they flat out work and hold up over time. That's not to say there aren't bugs. There are. As it relates to the iPhone, these bugs tend to get worked out and you're left with a device, albeit somewhat limited at times, that is as close to flawless as you're going to get.
My largest beef with Android was that the updates were hit or miss. You might get the latest greatest, you might not. Look at iOS on the other hand. Technically, you can install iOS 8 on your iPhone 4S if you like! That's crazy but also great for those who can't afford to upgrade or that don't have access to the newer hardware. Heck, I'm running iOS 8 on my iPad 2!
What OS is the Droid X running? I bet you it isn't Kit Kat.
My iPhone 5 is an absolute gem. It's really been perfection for me since I ordered two years ago. I'm hoping the iPhone 6 will be the same.
I wouldn't touch an Android phone unless it were Google's. Your safest bet is to go with their hardware to ensure you get updates etc.
I would guarantee that most coming from Android are loving the iPhone thus far and will come to realize that the iOS environment is just better. Again, does it have its limitations? Yes. However, those limitations are what make the phone operate so well.