I don't have Infinity Blade, but I've had no problems with charging in any circumstance. I've charged while using the Retina updated Real Racing 2 HD without a hitch. It charges fine from my iMac.
And in fact, what's most interesting to me is that to me it seems that the battery is starting to charge faster in the last day or so after putting it through a discharge-charge cycle. Maybe I'm just getting used to it as I haven't measured anything, but either way, I'm less concerned about it 5 days in then I was last Friday.
And for the record, I'm using a 32 GB on Verizon and I've been using the LTE a lot (too much...).
On that note, my only concern now 5 days in is data usage on LTE. Maybe it's just that the outstanding speed makes you feel like you can do more, but, the bottom line is that I'm doing more online and using data faster than I was on my previous 3G iPad. It's wonderful to be able to browse so much content so fast, but when you're able to spend more time browsing and less time waiting for pages to load, you'll blow through data faster. I'm not even touching streaming video and have only made very minimal use of iTunes Match and Spotify.
While this isn't inherently an iPad problem, it illustrates clearly to me the problem with the current data packages on LTE networks, especially considering that LTE networks are generally much more robust than any 3G-flavored network. I'm paying $30 a month for 2 gigs on Verizon and it's looking a lot like it's just not going to be enough, but $50 for 5 gigs seems like too much money for still a rather small amount of data on a truly high speed network. I'd be more open to spending $50 for 10 gigs, but still, they really need to open this up a bit. I get the concerns about heavy data usage on the 3G networks, but it's almost pointless to have LTE if you have to limit yourself so much. I love the speed and I would never want to go backwards at this point, but I'm already quite sick of checking my data usage every day.