It's way too early to say any of that has failed.
Also: Apple TV, Ping, MobileMe... that's all that's coming to mind right now. Those are things that you could have easily called "failures" when they were just 2 years old. Ping went on to definitely be a failure. Apple TV is still in limbo. MobileMe was succeeded by iCloud, which is a modest success, I think.
I don't think a device (Apple TV) is a failure. It's sold millions and has been selling for several years now. While the sales may not be as high as the iPhone, I think most of the delays on improvements are with the cable carriers, not Apple.
We use the Apple TV's at work for Air Play of presentations. I use a few at home for streaming movies, music, Air Play, etc.
Ping was definitely a failure. It was another social network "just because". I was surprised how well the social aspect of Apple Music has grown considering how Ping failed. I thought artists would be more hesitant to start over again. I wonder how much Apple engineers/designers worked with the top artists to create these fan pages.
MobileMe was a failure too. iCloud started out bumpy but has been solid for me at least. I also think Apple learned a lot about cloud usage and is expanding back on it. I see iCloud staying for the next few years before a big change.