I see white as a throwback to the original iPod days. Gender stereotyping the white as girly and the black as more masculine makes no sense. The popularity of the iBook, MacBook, and original iPod were very popular products for men and women alike.
I like black because human eyes have a tendacy to want to shift colors if you stare at then too long, particularly white. I couldn't own a white iPhone because I do a lot of web browsing on my iPhone and prefer black borders.
It's really a preference of how it looks to you, nothing more.