Building good homes isn't expensive. The price reflects what a home worth living in costs.
If the cost is too much for some people to afford, the answer isn't to give up and keep building poor houses. Instead, reflect on what is driving up costs, and look around to see who else might be benefitting from having a healthier, more connected society who could (and possibly should) contribute to costs.
Doing good isn't expensive, its necessary.