Not only men, felursus. Similar comments can and have be heard from women to women (and I suppose, from women to men, and men to men - at least I have no reason to think otherwise). There are fools, and slaves of fashion, in both genders, and in all social classes. Sexual attraction of course pays a role, but it goes both ways, and women are not at all in a passive role in that.
Maybe in some cultures, or in ours in the history, it might have been men who told women what to do and how to dress. But in the modern world I, as a woman, think that I should feel ashamed of myself if I blamed "the men" for my follies and quirks. I am free to choose, and it's my fault if I don't choose as I know to be right.