Just go into your General - Notification settings and move it out of the Notification Center list.
Now, it will only appear if you swipe across the status bar and only in it's own window.
EDIT - sorry. I misread OP's post. My instructions are for removing SBsettings completely from the Notification Center and just using the standard drop-down box.
If you only want to remove specific toggles, then follow Post #4 below this one.
Thanks.