I think wrldwzrd89 has it, you downloaded a disk image that contains the Firefox application. Each time you 'launch' it the Firefox app is extracted and shows up on the desktop. Just drag the Firefox icon to your Applications folder. Then track down the disk image (downloads folder ?) and throw that away.