Capitalism depends on price theory, which predicts that making too many paperclips will cause them to be in glut and the price will drop. So a paperclip-maximizing AI might oughta be built to take that into account.
Point missed. It's not that any one product is being produced. "Capital" (or profit or wealth) here is the combined market aggregate of all production. The problem is that this too, as with any single optima process, leads to madness. In the case of capitalism, ecternalities, equity/equality, sustainability, and systemic global risk are all undervalued, and simple short-term profit maximisation tends strongly to "und…
The only thing Capitalism did was replace Mercantilism at scale. You had production before.
What's weird is that economists talk about ways to actually price things like externalities, equality, sustainability and/or risk. That might be madness or it might be reason.
If we can't price them, then are we not dropping the checkbook and reaching for the sword?