look at it like this, you spend 90 percent of your time with your shirt on, i'd rather look bigger than 90 percent of the time.
gettin leaner also means lines in the forearms, capped-delts, tricep separation, and down in the calves, a few lines and veins as well. (parts ususally not covered by clothes)
You look better (and sometimes bigger) when you're leaner, because of the separation and quality. Example Dexter Jackson, dude doesn't look immense in clothes but he explodes when you see him on stage