We all want attention, whether it be from the opposite sex or the same sex, or both.
We may do things for our self (self attention?), but ultimately we want others to acknowledge what we have done. Our physique is the outward embodiment of what we have shaped and molded, and if no one took notice or complimented us on our hard work, then the true question is what was the point. After all, this is what people SEE.
If a person wants to get "too muscular" and they are a woman and are judged on it, oh well. That is what humans do, and men do because, well it's a woman. And women judge men as well. You never hear a woman say, "don't be too rich"---men get judged by women based upon their accomplishments, their cars, their monetary worth, their looks, etc. And we take it, because it is what it is.
Bottom line, we all make choices, and the consequences and repercussions of said choices are that we get judged on them. You cannot please everybody, if you are happy, truly happy with those choices, and whoever supports you, then that is vindication enough.