Okay, I had a CD in my superdrive, and I chose to eject it. The icon disappeared and its files are no longer accessible it seems, but the CD didn't eject.
Also have a look at the following links, as the information presented there might be helpful in your future endeavours into Mac OS X and could clear up initial confusion and may even prevent harm to your system or your files.