A schmoe is someone who does not lift weights, does not enter a gym, and overall, is not into physical fitness.
If you are not into the any of the above, and you follow bodybuilding, you are a schmoe. Bodybuilding is one of those niche activities where you really have to participate in it to some degree to be interested in it. Its not like football, basket, baseball, or hockey, where you don't have to necessarily play the sports to be into them. With bodybuilding, its a 100% must. If not, you are deemed a schmoe.