And the more your the face moves in the foreground, the more difficult it becomes to achieve the desired effect.
Most editors achieve this effect by shooting the subject in front of a green screen to do a chroma key, where they can then slap a background behind it. It's a billion times easier that way...