Live data from Hacker News

Too much efficiency makes everything worse (2022)

sohl-dickstein.github.io

281–290 of 377 posts

Re: Too much efficiency makes everything worse (2022)

#281
post #89

Earlier quoted context omitted.

what it means to not optimise though is that some people end up better off and many others are worse off.

And what it means to optimise is also that some people end up better off and many others are worse off.

Yes, the point is to find a balance so that the first number is maximised.

Re: Too much efficiency makes everything worse (2022)

#282
post #86

The argument rides on the well-known Goodhart's law ( when a measure becomes a target, it ceases to be a good measure ). However, it only puts it down to measurement problems, as in, we can't measure the things we really care about, so we optimize some proxies. That, in my view, is a far too reductionist view of the problem. The problem isn't just about measurement, it's about human behavior. Unlike particles, humans…

> Unlike particles, humans will actively seek to exploit any control system you've set up.

Well, agents will. If you created a genetic algorithm for an AI agent whose reward function was the amount of dead cobras it got from Delhi, I feel like you'd quickly find that the best performing agent was the one that started breeding cobras. In the human case and in the AI case the reward function has been hacked. In the AI case we decide that the reward function wasn't designed well, but in the human case we decide that the agents are sneaky petes who have a low moral character and "exploited" the system.

Re: Too much efficiency makes everything worse (2022)

#283
post #104

Earlier quoted context omitted.

This is true, these "laws" are approximations and imperfect reductions. Which one is useful or descriptive will depend on the specific example. Optimizing ML VS Optimizing a social media algorithm VS using standardized testing to optimize education systems. There is no perfect abstraction that applies to these different scenarios precisely. We don't need that precision. We just need the subsequent intuition about whe…

I missed the citation on his education point. Has someone proved that “teaching to the test” leads to lower educational outcomes than not having tests?

Not a citation, but I believe it's a mediocritizing measure. For some teachers and some students, teaching to the test is probably better. I suspect more heavily concentrated in the bottom 50% of each group. For a subset of great teachers and great students, it's a detriment.

Re: Too much efficiency makes everything worse (2022)

#284

Earlier quoted context omitted.

I don’t think it’s smart to proactively back track without being very careful. One thing that’s needed is for corporate death to be allowed to occur. Right now the downsides of risky behavior is bailed out for large enough risk. Then the companies that fail aren’t robust and the ones that don’t are but bailouts let non robust companies keep going. Otherwise “robustness” is a property without a measure which means tha…

One of the primary reasons people bail out companies are the knock-on effects. People losing jobs, etc. If society itself is robust enough to cover for people in those situations, we could let companies fail far more.

People los jobs anyway, from the knock-on effects of the bail out. The bail out is more about controlling who loses jobs.

Re: Too much efficiency makes everything worse (2022)

#285

Earlier quoted context omitted.

I can't imagine anyone would object to minimum quality standards for anything receiving federal subsidies.

edit: didn't realize I was feeding a troll. Feel free to ignore. I expect the objections are in how quality is measured and enforced. It reminds me of education system in the US - most people (project 2025 aside) think it's good to have a public education system; having a pipeline of skilled workers makes it easier to build an economy filled with a diverse set of businesses. However, the attacks start to fly when the…

Settling everyone's differences about rural medical subsidies might be a good stepping stone to an NHS.

Re: Too much efficiency makes everything worse (2022)

#286
I noticed an example of this rule at my local hardware superstore.

Around a decade ago, the store installed anti-theft cages.

At first they only kept high-dollar items in the cages. It was a bit of an inconvenience, but not so bad. If a customer is dropping $200+ on some fancy power tool, he or she likely doesn't mind waiting five minutes.

But a few years later, there was a change - almost certainly a 'data-driven' change: suddenly there was no discernible logic to which items they caged and which they left uncaged. Now a $500 diagnostics tool is as likely to sit open on a shelf, as a $5 light bulb to be kept under lock and key.

Presumably the change is a result of sorting a database by 'shrinkage' - they lock up the items that cumulatively lose the hardware store the most money, due to theft.

But the result is (a) the store atmosphere reads as "so profit-driven they don't trust the customers not to steal a box of toothpicks" and (b) it's often not worth it for customers to shop there due to the waiting around for an attendant to unlock the cage.

I doubt the optimization helped their bottom-line, even if it has prevented the theft of some $3 bars of soap.

Re: Too much efficiency makes everything worse (2022)

#287

Earlier quoted context omitted.

A mis-assessment there might be far less consequential and those also do not require a medical diagnosis before making a decision where to go.

I've never needed a medical diagnosis to decide between calling my GP and going to an urgent care. It's just a bit surreal to hear everyone else say my ordinary survival skills are impossible and more than could be asked of anybody!

You said you have a hospital selected you trust (by whatever your metric is). Hospitals tend not be all equal for all things, so trust should probably be differential - how do you assess yourself as a patient then to decide on where to go? And if you do not differentiate the trust any further than to a single hospital regardless of what the issue is: why is that sufficient?

I think it is fine to have some preferences for a hospital, but not sure how much benefit that confers outside of some narrow situations.

Re: Too much efficiency makes everything worse (2022)

#288

The author identifies problems with a system measuring targets, but then all the proposals are about increasing the power and control of the system. Perhaps the answer—as hippy sounding as it is—is to reduce the control of the system outright. Instead of adding more measures, more controls, which are susceptible to the prejudices of control, we let the system fall where it may. This, to me, is a classic post of an ac…

Loosening of control is exactly the answer, but the world pathology is currently that money/power/control are all unalloyed virtues to be pursued at any cost, so we'll have to wait for a global implosion before any of the Certified Geniuses on this site, or anywhere else, consider an alternative approach.

Re: Too much efficiency makes everything worse (2022)

#289
post #199

Earlier quoted context omitted.

> private people) can decide to lower their risk exposure I think the complexities of modern societies make it too difficult to measure this risk adequately. We just don’t have the bandwidth to think about the second-and-third order effects for every social/financial interaction we encounter. And people are generally very poor at estimating high-consequence/low-probability events. This means people will often take ve…

>...farming those risks out to institutions seems to be the current way most societies have decided to mitigate those risks Unfortunately, those institutions --be they governments, insurance companies, UL Labs, banks, venture capitalists, etc.--also need to be vetted. Even when staffed with impeccably well credentialed and otherwise highly capable people, their conclusions may be drawn using a different risk framewor…

I don’t think anyone reasonable is advocating believing institutions on blind faith (possibly with the exception of religious institutions). They need to be transparent and also strive to reflect the values (risk and otherwise) of their constituents.

Re: Too much efficiency makes everything worse (2022)

#290

Earlier quoted context omitted.

This is coincides with my headcannon cause of the business cycle. 1. Firms compete 2. Firms either increase their efficiency or die 3. Efficient firms are more susceptible to shocks 4. Firm shutdown and closures are themselves shocks 5. Eventually the system reaches a critical point where the aggregate susceptibility is higher than the aggregate of shocks that will be generated by shutdowns and closures 6. Any extern…

But in practice we see that: 1. Firms compete 2. Some firms get ahead 3. Accrued advantages to being ahead amplify 4. A small number of firms dominate 5. New competition is bought or crushed 6. Dominate firms become less efficient in competition-free environment

They aren't mutually exclusive. And, not xor.
Post reply on HN