There's a difference for hating a person for what they are, and for who they are.
Do you hate Bill because he's an ass? Does he annoy you all the time? Throw rocks at your house? That's not discrimination. Bill can always choose to wise up, realize what an ass he's been, and quit throwing rocks at your house. He might do this because you pointed out how much an ass he is.
But an ass is what he is, not who he is.
If you hate Bill because he's black, that's another thing entirely. You hate him because of his state of being. Something he can't change. He could be the nicest guy in the world, but you hate him simply because of the color of his skin.
...and that would make you an ass.
So you see why intolerance of intolerance isn't really intolerance by the social definition of the word.