Copy the music file to your internal HDD* and then import it from the internal HDD into iMovie, as the method you use now is not working. How can iMovie find the music, if the storage device the music is stored onto is not connected? iMovie does not copy or move the imported music, unless you maybe tell it to.
If you use an external HDD to store your video footage on, copy the music there instead of the internal HDD.