Right, but housing as a basic human right is not something that exists in the US, at most it is a high priority. If it was really treated like a basic right our society would be unrecognizably distorted around that one thing. A human right is not something you can let slip on a bad day, and that fact has big implications.
If you are allowed to say, "our budget isn't adding up today so some people will have to stay on the wait list a bit longer," you aren't acting like it's a human right. Human rights are maximum priorities, not just high priorities.
An example of a reasonable human right would be that your own government can't kill you without a fair public trial. If a country ended up in a situation where they had to assassinate a businessman to keep their budget balanced, it would be reasonable to say "forget about the budget, you can't just take one of your own citizens out." However, if you had to loosen up the housing program because your tax revenue came in low that year, doing so would be potentially a reasonable option. "Potentially a reasonable option" is not even remotely on the table for human rights violations, which is why housing can't be a human right.