I have had this happen multiple times, Apple eventually replaced my 24" white iMac with a new one because of it.
What worked for me a couple times when the eject trick didn't work, was to put a used no good CD in partially behind the stuck one and while ejecting pull on the CD. It gave it a wedge to grab then they both came out.