You empower them by treating them just like everyone else.
The rub here is that some people empower folks that way. Others use "I'd treat anyone else the same" as a justification for treating certain people like crap. It's a very subtle line.
The question isn't "could you substitute 'man' and have the same comment said", its "would the comment even have been said if the person being discussed were a man." If the answer to the second is "no" then the comment is sexist.