Andon's store in SF has had some press coverage.[1] "A curated boutique for slow living." It's a gift shop, at 2102 Union St. It looks like the kind of retail that trust-fund kids open. Has anyone been there?
It's just an experiment. But once this gets going, it's going to be interesting. There are a lot of underperforming businesses and CEOs out there. One way to make it after getting an MBA is to find a boring business with an older owner who's lost interest, and work out a deal to run it for a cut of the profits and a stake in the business.
The Andon people mentioned that they've been worried about "a misaligned AI (could) run a business to gather money in order to achieve whatever objectives it might have." That's a basic function of capitalism, so it will happen eventually.
What this adds up to is that when AIs get better at running businesses than many business owners, the "creative destruction" feature of capitalism means AIs ends up in charge of many businesses. The AIs don't even have to be super intelligent, just reasonably good. Reminds me of the remark from a Yosemite park ranger about bear-resistant trash cans: "There is considerable overlap between the smartest bears and the dumbest tourists".
It's going to be hard to stop this without a worldwide crackdown on ownership concealment. The US allows you to have a US business run by a Nevada LLC partly owned by a corporation in Nevis-St Kitts and another corporation in Granada. This isn't even unusual. Try to find out who really owns an oil tanker not owned by a major oil company. Right now, a fund partly run by an AI might have partial ownership.
This is how AI takes over. Not with an army of robots. With an army of LLCs.
[1] https://www.sfgate.com/local/article/san-francisco-market-ai...