Live data from Hacker News

Efficiency is dangerous and slowing down makes life better

psyche.co

181–190 of 314 posts

Re: Efficiency is dangerous and slowing down makes life better

#181
post #2

I've found "efficiency as the opposite of stability" a very powerful concept to think about - even though it's fairly simple, it seems to be almost a fundamental law. Whether it's about the economy at large, your own household, a supply chain, what have you - as soon as you optimize for efficiency by removing friction, you take all the slack/damping out of the system and become instantly more liable to catastrophic f…

That concept of efficency as opposite of stability seems a bit fallacious in the strong case - inefficency itself can and has caused systems to collapse which is the exact opposite of stability. Cache/reserve and efficency is itself complicated and situational if it helps or hurts efficiency. Overfitting it could make it fragile but it also depends upon relative costs for what a blind pursuit of efficiency goes for.…

If you are strong everywhere you are weak everywhere. The article is you plain out wrong. The problem is the lack of a strategic reserve, not efficiency in itself.

Re: Efficiency is dangerous and slowing down makes life better

#182
I study empathy, and have often said that efficiency is the opposite of empathy. Whatever we want to call it, the human element is overlooked when we strive for the single dimension of efficiency. Hannah Arendt famously talked about the banality of evil. During the Holocaust, the counting and categorizing of people was flattening or reducing to that important human element we all share.

Re: Efficiency is dangerous and slowing down makes life better

#183

Earlier quoted context omitted.

> efficiency as the opposite of stability In statistics, there is a slight variant of this thesis that is true in a precise formal sense: the tradeoff between efficiency and "robustness" (stability in a non-ideal situation). For example, if you have a population sample, the most efficient way to estimate the population mean from your sample is the sample mean. But if some of the data are corrupted, you're better off…

i stumbled on "stability' too, because it's a static quality. rather than robustness, i prefer to use the term resilience, a dynamic quality, since efficiency is also a dynamic quality. you can trade efficiency for resilience and vice versa (as the parent poster switched to later). edit: i should add that i don't entirely agree with the thesis of the article, which exhorts us to slow down, thereby trading efficiency…

I'm completely ignorant on this topic, so I apologize for asking what must be an extremely stupid question to you, but: what makes stability a static quality whereas resilience is a dynamic quality? Are these statistical definitions that I can look up somewhere?

Re: Efficiency is dangerous and slowing down makes life better

#185
post #32

One of my favorite quotes on this topic comes from Aurelius' description of his adopted father in Meditations . [Y]ou would never say of him that he "broke out a sweat": but everything was allotted its own time and thought, as by a man of leisure - his way was unhurried, organized, vigorous, consistent in all . I feel like I spend a lot of time rushing from one thing to the next, constantly questioning whether I'm sp…

Slow is smooth, smooth is fast.

Re: Efficiency is dangerous and slowing down makes life better

#186
post #2

I've found "efficiency as the opposite of stability" a very powerful concept to think about - even though it's fairly simple, it seems to be almost a fundamental law. Whether it's about the economy at large, your own household, a supply chain, what have you - as soon as you optimize for efficiency by removing friction, you take all the slack/damping out of the system and become instantly more liable to catastrophic f…

It is a fundamental law. Systems theory has the concepts of "gain margin" and "phase margin" -- how much you can amplify feedback or delay feedback, respectively, before your self-adjusting feedback mechanism fails to find equilibrium and turns into an oscillator. Even though most non-engineering systems don't fit the mathematical theory, the idea that only a finite amount of gain + delay is available, and that the t…

> It is a fundamental law.

> Systems theory

I'm confused. Is it a law or a theory? And no, it can't be both. Laws are proved. Theories are unproven.

Re: Efficiency is dangerous and slowing down makes life better

#187
post #170

Earlier quoted context omitted.

> efficiency as the opposite of stability In statistics, there is a slight variant of this thesis that is true in a precise formal sense: the tradeoff between efficiency and "robustness" (stability in a non-ideal situation). For example, if you have a population sample, the most efficient way to estimate the population mean from your sample is the sample mean. But if some of the data are corrupted, you're better off…

Wouldn't this be better described as a tradeoff between accuracy and robustness? Interesting concept.

It's a bit different aspect of the same thing. If B can perform better than A given the same data, it usually means B can perform equal to A with less data. From wikipedia:

> Essentially, a more efficient estimator, experiment, or test needs fewer observations than a less efficient one to achieve a given performance.

Re: Efficiency is dangerous and slowing down makes life better

#188
post #18

the article doesn't make sense to me when making decisions: "we should be asking which option will give us good-enough results under the widest range of future states of the world" doesn't that lead you right back to the struggle for the most efficient way to determine the optimal "good-enough" answer? Also, the article talks about efficiency but efficiency of what exactly? What if you're very efficient at a maintain…

As it relates to hacking, I think of it as: clients can be fickle because they don't even know what they want sometimes. So I picture next steps as coalescing, like a wave collapsing. Uncertainty comes to dominate the process, so it works more like evolution than planning (stochastic vs deterministic).

My problem solving algorithm is to look up to 7 steps ahead, along up to 7 different branches in the tree of possibilities (I'd like to examine more choices but my brain can't hold them all). In practice this is always at least 2 and 2, so this task or its alternative, and then looking at the next step along each branch. Then I prune the tree, selecting for the steps that work across as many branches as possible, without rewrites or duplication. I'm often working on a common dependency several steps out that other people aren't aware of yet. This could be thought of as a breadth-first search or parallel search.

Unfortunately on an individual level, the tech industry seems to be going the opposite direction, exploring deeply down very long and linear branches of the tree. Coders are expected to implement an idea and be ready to scrap it without hesitation, iterating over and over again until finished, rather than simulating the outcome in their minds. More of a depth-first, serial search.

I think the split is due to programming moving from an individual endeavor towards teams. We can't see inside each other's heads, so we plot the course and divvy up steps among the members. The cost of this is that serial searches will almost always turn up suboptimal results, because the resources to do broader searches get withheld so we miss elegant solutions and even perceive them as more costly.

To answer your question, the serial approach works best for individual tasks, but misses the big-picture view that might have let us see that the task didn't need to be done in the first place. So my vote would be to see more quiet reflection and less spinning and churning. But I'm mostly outvoted, so it probably comes down to personality, with junior developers being more sought-after than senior developers like me who might be perceived as reserved/overcautious/conservative.

Re: Efficiency is dangerous and slowing down makes life better

#189

Earlier quoted context omitted.

> efficiency as the opposite of stability In statistics, there is a slight variant of this thesis that is true in a precise formal sense: the tradeoff between efficiency and "robustness" (stability in a non-ideal situation). For example, if you have a population sample, the most efficient way to estimate the population mean from your sample is the sample mean. But if some of the data are corrupted, you're better off…

i stumbled on "stability' too, because it's a static quality. rather than robustness, i prefer to use the term resilience, a dynamic quality, since efficiency is also a dynamic quality. you can trade efficiency for resilience and vice versa (as the parent poster switched to later). edit: i should add that i don't entirely agree with the thesis of the article, which exhorts us to slow down, thereby trading efficiency…

I like resilience better as well - here it just happens that the technical terms of statistics match up fairly nicely with what we're trying to say.

Re: Efficiency is dangerous and slowing down makes life better

#190
post #46

This comment thread is making me realize we don't have a good word to distinguish between efficiency as in "we only have 7 hospital beds because that's all we need on 99% of each day" and efficiency as in "we replaced steps X,Y,Z with just step X', because we found that X' could accomplish everything that XYZ could accomplish but it's faster, more accurate, and cheaper". One makes a tradeoff by reducing overheads and…

There's also efficiency like "I picked up some extra screws at Home Depot because I wasn't sure if I had any at home".

Having ways to avoid an unanticipated repetition of a process, which would result in bunging up the works for dependent parts of the system, can make the entire flow more efficient. See also 'drum buffer rope' from constraint theory.

Post reply on HN