Based on diversity numbers way more qualified women and visual minorities have been ignored than men. The problem when people respond to diversity initiatives with "they should hire the best person period" is that they don't define what makes the best person, and in many cases, assume that the most qualified person is a white man.
If I own a company that makes consumer products, I want my employees to have a wide variety of perspective, world view, and cultural backgrounds, otherwise my products end up coming out designed for one section of the market. If my employees are 90% white male, the products end up being suitable for, you guessed it, white males.
Sometimes being a non-white male is a qualification, if I already have many of them in my company. Qualification for a tech job is more than programming skill. Once an applicant has met the level required for the job, other qualifications such as perspective, world view, culture, interpersonal skills become much more important. And if that doesn't sit well with you, don't worry, if the percentage of white males drops so low because of diversity initiatives, there will soon be one for them too. Right now, that doesn't seem to be a problem - qualified white males are being hired in the tech industry everywhere. And to those that aren't able to find work, well, they may want to ask themselves if they're as qualified as they think they are.
In addition to this, consider that diversity initiatives aren't just about choosing which applicant to hire. It's also about recruiting. If you have recruiting events in a bar, run ads in specific locations or websites, you may not be reaching "the best qualified person" at all.