It's a safety feature, a bit like music tracks in iTunes playlists. The photos/tracks aren't actually in the album/playlist, it's just a link to the picture/track. If you could delete direct from albums then there is the chance of deleting photos from the main iPhoto library by mistake. 😡