Yes, it lowers someones self-esteem if they must work and plan for themselves.
It would be interesting to see a comparison to being 'Rich' and being 'Poor' in the rest of the world as compared to the United States. Or, for that matter to the U.S. 100 years ago? I have seen such studies but...