I still remember 10 years ago when the technology you are referring to was discussed at the higher levels of business and governmental administration, the talks about having this technology had a lot more to do with "enclosures" than homes and my friend who had been part of the discussions, having had the same thoughts as you and I in relation to the housing for poor people, had to move away from the group forever. The thought of being associated with such people anymore was too hard to bare...
So much good can and could come out of this technology, it is hard to imagine now and it is going to seem almost miraculous to the generations as they'll grow up older. At the speed miniaturization is happening and accessibility of this technology becomes available for the commoner, the day where we'll be able to engineer our own things is around the corner. This would empower so many people to such an extent, I wonder if it will even be allowed.
Namaste :)