I have seen this as well in my setup, and had to adjust the unmount scripts to properly find the correct volumes to unmount...
Other than that, the switching doesn't seem to cause any issues; even Fusion isn't fazed when it loads the Bootcamp volume.