Sometimes they're not easy to get out. It's a poor design IMO, and I really dislike the top slot more. The top slot requires the bottom one to be removed first otherwise the top HDD won't clear the frame.
You're going to have to keep working at it. Try wiggling it from side to side as you pull it out.