As far as I can see, and I'm far from an iMovie expert. If you drag the video clip from the events browser to the main player window (thing) then select it, go to Edit>Detach Audio, it will seperate the audio track enabling you to edit it using 'Clip Trimmer' or however you want to go about it from there.
Any help, or had you already got that far?