That just blew my mind. The panorama infill would have taken hours if not days to do properly by an incredibly skilled touch-up artists. I'm literally speechless. Like we're living in the future or something.
Just remember: we're seeing this at 480 pixels across, and that's a several-thousand-pixel-across image. Turn on the zoom and I suspect you'll still have several hours of "cleanup" to do, and to get that cleanup right will require an incredibly skilled touch-up artist. Watch the video again. Even in the first scene, where he deletes a leaf under the bench, note that the shadow isn't quite right afterwards. In the resulting desert scene there are lots of cloned objects which can easily be seen (which he alludes to in that this is a head start, not a completed image at that point).
Don't get me wrong: this is truly magical stuff. But, it's not like you'll be able to get the same results as someone who really knows what they are doing. And, IMHO, nothing screams amateur hour like someone using one of these tools to change a photo from a depiction of reality to something not real, but not going the rest of the way to make it look right. Its just that if you are someone who really knows what you're doing, the first ~50 steps (picking/cloning/blending) in your 1,000-step workflow are done for you.