Check your sound settings. If you have vibrate toggled off when on 'silent' but on for 'ring', the switch will behave as you've described. If both are set to vibrate, the phone will vibrate when you switch to silent. And if neither are set to vibrate, toggling the silent switch will do nothing (no vibrate)