They are the ones that got ratings agencies to give high scores to the mortgage backed securities.And that's an issue between them and the people/institutions they sold those securities to. It does not in any way absolve individuals for making dumb bets, particularly when those individuals often lied on their loan applications.
The housing bubble simply could not have occurred without financially illiterate people making bets they didn't understand in the hopes of getting rich quick. I agree with you that any individual bank had a more harmful effect than any individual real estate speculator, but that's just a matter of size. Collectively, real estate speculators are just as guilty as banks.
I don't disagree with you at all concerning bailouts. We should end "too big to fail".
But on the other hand, try to remember that real estate speculators also received massive subsidies (frannie, mortgage deduction) even before the crisis. The banks, excluding GM, have more or less paid back their portion of the bailout (this even includes the AIG portion). Real estate speculators have not paid back their subsidies.
The anger should mostly be aimed at the banks. Especially in light of their dubious foreclosure practices.
Many loan originators did shoddy paperwork to save a buck, and didn't transfer the lien's to the right party. Real estate speculators are now exploiting the legal problems caused by this shoddy paperwork to break their contracts and squat in homes they don't own. The loan originators absolutely deserve to be sued by the bond purchasers over their negligence.
But the real state speculators are also culpable for exploiting legal quirks to steal homes from their rightful owners [1]. We may not be 100% sure whether BankAm Loan Issuing Corp, BankAm Loan Servicing Corporation or the MBS corporation is the rightful owner of a home - but we are quite sure that the squatters currently occupying it stopped paying their mortgage and therefore do not have any right to it. The squatters deserve to be foreclosed upon, and then the loan issuer, servicer and bondholders can fight over who really owns the home.
Banks are a convenient political target. But real estate speculators are just as guilty as the banks.
[1] Obviously, not all real estate speculators are doing this, but I have read quite a few media accounts of this.