To your question, I don't think it's possible. Apps can make this choice.
And I am actually of a different opinion on the matter. Even with the mute switch on, if I actively take an action that should yield sound, it bothers me when I can't hear the sound without turning off the mute switch. For me, the mute switch is for blocking unexpected or unrequested sounds, but not to act as a total sound block.