That's absurd. No matter how much testing is done, there are always some issues that get through. Your proposal, to not release until perfect, is preposterous.
It's preposterous to you because you're successfully brainwashed into thinking that software deserves to be excused from all preexisting consumer protection laws and engineering sensibility.
Yes, you do have to stop fiddling and ship at some point. But that's not the problem with this industry.