Everything you say is true.
I would like to clarify that the regulations on "the financial system" have probably enabled just as much fraud as they have prevented over the long run. The financial system you speak of is a huge collection of bets and leverage and interesting interpretations of the truth ("why yes, your money is 'safe' with us!"). The regulations make it work just barely well enough that it only comes crashing down, what, every 10 or 20 years now? If instead of adding regulations and saying, "there, now it's totally going to work, put your money back in," I wonder what things would look like if we had instead said, "yup, loaning your money to banks/corporations/governments/individuals is super risky, learn from past mistakes!" ? Maybe people would only risk what they can actually afford to lose and we wouldn't get into these cycles where people get over leveraged, things crash, bankruptcy gets declared, and the poor and middle class foot all the bills. Over and over and over. A libertarian can dream...