I mean society seems to think so? Frankly also I just typically get uncomfortable with people peeking down at my crotch. I don't generally wear tight pants for that reason because I'm not looking for that kind of attention.
Well, there are men's ballet leggings and whatever folks wear to your local renaissance festival, but I see your point. Neither really has the fit or look of women's athletic gear or cozy/comfy stuff.