Housing that affordable would reduce the control government, banking, social services, and big business have over our lives to an extent that they'd never allow. It'd also reduce interest rates to a level where people wouldn't see any real return on monies kept in banks. It'd also gut housing costs, obliterating people's main retirement asset.
The idea isn't bad, you just haven't looked at what affordable housing would cost.