Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
I think you have to hit the Delete key on the keyboard once you have a bookmark selected.
 
Delete key should work. Also, control-click or right click should bring up a contextual menu and Delete is one of the options.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.