Are you running VLC in Tiger? VLC currently doesn't support video device support (nor any support, for that matter)
In Panther, load up a movie into VLC. Select the second monitor in the Video Device selection in the Video menu. That should allow for fullscreen in the monitor of your choice.