Funny you should bring up this topic Croatch. One thing I've found, is that you don't have to be 'huge' by bodybuilding standards anyways, to receive compliments.
Simply being around the general population who is either Fat, Fatter, Skinny-Fat, Skinny, whatever the body 'type' might be, if you work out... you'll stand out. I work in IT, and the majority of my co-workers match all the body types I mentioned. Standing out from the crowd doesn't take much muscle. I'm sitting in a training course today, only a few guys in the course with me. The teacher asks what everyone does in their free time, he mentions sports, lifting weights, I replied Yes to the latter and he more or less replies "Yeah.. I figured that much". My monster 16" arms stand out next to skinny anemic looking computer dorks with 13" arms. Sad but true!
So from that perspective, I am happy with my gains. I know where I stand in the general population. Though I have higher standards now, as I don't always compare myself to the skinny-fat computer jockies I work with.. it's the other guy in the gym who's just as dedicated that I want to beat. Doesn't hurt to come back to 'reality' though, and realize how you look compared to all the lazy bastards out there. Otherwise you may always be size-hungry (not neccessarily bad), and lose perspective.