I was poor for some time after deciding to quit my computer science phd for a career in art. I guess I still am compared to others, but it does not feel that way any more. When I was really poor, worrying about money and how to pay the next rent was a regular source of stress for me, which took quite a lot of emotional energy. Now I still have much lower income than people, who have regular well-paying jobs, but I do…
However the situation you describe above shows the many side-effects of being poor which impede life in general: lack of proper sleep (because you live in a noisy area with no other choice), constant stress (paying rent, maybe dangerous neighborhood, etc.), probably not affording good quality food, etc. etc.
Add these side-effects up and one quickly understand that getting out of poverty is an herculean task and I personally couldn't blame someone for not making it.