One major reason is that feminism, which deeply influences culture, posits that all men are rapists in the waiting. For an example here a quote from a prominent and influential feminist.

“Under patriarchy, every woman’s son is her potential betrayer and also the inevitable rapist or exploiter of another woman.”

• Andrea Dworkin

This chills any frank discussion of male sexuality because that would be implicit endorsement of sexual assault.