Ahhhh, okay. I think I understand.
The stock answer is, of course, that while some guys are complete and utter jerks who deserve every ounce of loathing and contempt that others bestow upon them, it is neither just nor fair to write off half the species because of its worse members. Nonetheless, because it is all to easy to paint with a broader brush, a certain amount of guilt-by-association is unavoidable. This is regrettable but true.
(For misogyny, simply switch the gender references. For racism, nationalism, sectarianism, ageism, or do-your-own-ism add appropriate qualifiers for the target group.)