I've definitely not experienced that. Even if waterproofing isn't compromised, I'd treat it as if it were to be on the safe side.
Does the button reseat into its original position or close to it? If so, you might be able to get a thin fit case that will stabilize it in place (or at least make it less noticeable. That might not be too bad if it's only for a few months until the Series 9 comes out.