Live data from Hacker News

Why effort scales superlinearly with the perceived quality of creative work

markusstrasser.org

71–80 of 125 posts

Re: Why effort scales superlinearly with the perceived quality of creative work

#71
post #20

I liked the post but can someone explain how macro choices change the acceptance volume? Is it their effect on the total number of available choices? Does picking E minor somehow give you fewer options than C major (I'm not a musician)?

It...depends.

If you're working in a continuous environment rather than discrete (choirs and strings can fudge notes up or down a bit, but pianos are stuck with however they're tuned), you'll often find yourself wanting to produce harmonies at perfect whole-number ratios -- e.g., for a perfect fourth (the gap between the first and second notes in "here comes the bride") you want a ratio of 4:3 in the frequencies of the two notes, and for a major third (the gap between the first and second notes in "oh when the saints, go marching in...") you want a ratio of 5:4. Those small, integer ratios sound pleasing to our ears.

Those ratios aren't scale-invariant though when you move up the scale. Here's a truncated table:

Unison (assume to be C as the key we're working in): 1

Major Second (D): 9/8

Major Third (E): 4/3

However, E is also a major second above D, so in the key of D for a "justly tuned" instrument, you would want the ratio D/E to also be 9/8. Let's look at that table though: (4/3)/(9/8) is 32/27 -- 5.3% too big (too "sharp").

When tuning something like a piano then where you can't change the frequency of E based on which key you're playing in, you have to make some sort of compromise. A common compromise is "equal temperament." To achieve scale invariance in any key you need an exponential function describing the frequencies, and the usual one we choose is based on 2^(1/12) since an octave having exactly twice the fundamental frequency is super important and there are 12 gaps in normal western music as you move up the scale from the fundamental frequency to its octave.

Doing so makes some intervals sound "worse" (different anyway, but it makes direct translations hard) than they would in, e.g., a choir. A major third, for example, is 0.8% sharp, and a perfect fourth is 0.1% sharp in that tuning system.

Answering your question, at first glance you would expect the scale invariance to therefore not limit your choices. Every key is identical, by design.

That's not quite right though for a number of reasons:

1. True equal temperament is only sometimes used, even for instruments like pianos. A tuner might choose a "stretched" tuning (slightly sharpening high notes and flattening low notes) or some other compromise to make most music empirically sound better. As soon as you deviate from a strict exponential scale, you actually live in a world where the choice of key matters. It's not a huge effect, but it exists.

2. Even with true equal temperament or in a purely vocal exercise or something, there are other issues. Real-world strings, vocal folds, etc aren't spherical cows in a frictionless vacuum. A baritone voice doesn't sound different just because their voice is lower, but because of a different timbre. When you choose a different key, you'll be moving the pitch of the song up or down a bit, exercising different vocal regions for singers, requiring different vocal types, or otherwise interacting with those real-life deviations from over-simplified physics. Even for something purely mechanical like piano strings, there's a noticeable difference in how notes resonate or what overtones you expect or whatnot. Changing the key changes (a little) which of those you'll hear.

3. Related to (2), our ears also aren't uniform across the frequency spectrum, and even if they were our interpretations of sounds also depends on sounds we've heard before, leading to additional sources of variation in the "experience" of a slightly lower or slightly higher key.

Re: Why effort scales superlinearly with the perceived quality of creative work

#72
post #11

Perceived quality is relative. It's roughly linearly related to rank position along some dimension, but moving up in rank requires exponential effort due to competition.

I would be surprised if anyone perceives quality like that. Like, are you saying that in a situation where there are only two examples of some type of work, it is impossible to judge whether one is much better than the other, it is only possible to say that it's better? What makes you think it works like this?

This insight, that perceived quality is relative, can be understood in a more literary way, in this fragment by Proust describing the Rivebelle restaurant:

> Soon the spectacle became arranged, in my eyes at least, in a more noble and calmer fashion. All this vertiginous activity settled into a calm harmony. I would watch the round tables, whose innumerable assemblage filled the restaurant, like so many planets, such as they are figured in old allegorical pictures. Moreover, an irresistible force of attraction was exerted between these various stars, and at each table the diners had eyes only for the tables at which they were not sitting,

The relative nature of perceived quality indicates that the order of representations (artworks) is judged only in relation to the order of castes (ranking); one can only judge what is equal by comparison to what is unequal, and equivalence is not understood through equality (even approximate) but through inequality (partial order). It is the absence of a ranking relationship between two entities that establishes their equivalence.

Maybe I should have just gone with "in this case, classification is more fundamental than measure", but I feel there is something interesting to be said about the structure of artworks and the structure of their reception by society, indeed Proust continues with:

> ...the diners had eyes only for the tables at which they were not sitting, with the exception of some wealthy host who, having succeeded in bringing a famous writer, strove to extract from him, thanks to the spiritual properties of the 'turning table', insignificant observations at which the ladies marvelled.

See ? Writers (and artists in general) take on the role of a medium. They are used to channel distant entities, like tables during spiritism sessions, and from what Proust tells us, that "the diners had eyes only for the tables at which they were not sitting", maybe we can infer that what writers channel doesn't just come from distant worlds, as incarnated in what their words represent, but as a delta in perceived quality, starting with our own.

This is why I'd like to elaborate on this idea of coupled SSR processes I developed in another comment.

A sample space reducing process is a process that seeks to combine atomic parts into a coherent whole by iteratively picking groups of parts that can be assembled into functional elements ready to be added to this whole.

In that sense, the act of writing a long work already has the shape of a SSR process in a very simple sense: each narrative, stylistic, and conceptual choice constrains what can follow without breaking coherence. As a novel unfolds, fewer continuations remain compatible with its voice, characters, rhythms, arguments. You are not wandering freely in idea-space; you are navigating a progressively narrowed funnel of possibilities induced by your own earlier decisions. A good book is one that survives this internal reduction without collapsing.

On top of that, there is a second, external funnel: the competitive ranking of works and authors. Here too the available space narrows as you move upward. The further you climb in terms of attention, recognition, or canonization, the smaller the set of works that can plausibly dislodge those already in place. Near the top, the acceptance region is tiny: most new works, even competent ones, will not significantly shift the existing order. From that perspective, perceived quality is largely tied to where a work ends up in this hierarchy, not to some independently measurable scalar.

The interesting part is how these two processes couple. To have any chance of entering the higher strata of the external ranking, a work first has to survive its own internal funnel: it has to maintain coherence, depth, and a recognizable voice under increasingly tight self-imposed constraints. At the same time, the shape of the external funnel, market expectations, critical fashions, existing canons, feeds back into the act of writing by making some narrative paths feel viable and others almost unthinkable. So the writer is never optimizing in a vacuum, but always under a joint pressure: what keeps the book internally alive, and what keeps it externally legible.

But what interests me more is that some works don't just suffer this coupling, they encode it. That's what you see in the Proust passage: he is not merely describing a restaurant; he is describing the optics of social distinction, the way people look at other tables, the way a famous writer is used as a medium to channel prestige, the way perception itself is structured by rankings. The text is aware of the hierarchy through which it will itself be read. It doesn't just represent a world; it stages the illusions and comparisons that make that world intelligible. That's a second-order move: the work includes within itself a model of the very mechanisms that will classify it.

If you like a more structural vocabulary: natural language is massively stratified by frequency. Highly frequent words ("I", "of", "after") act as primitive binders; extremely rare words tend to live out on the leaves of the tree; in between you get heavier operators that bind large-scale entities and narratives ("terrorism" being a classic example in the grammar of public opinion). Something similar happens socially. Highly visible figures – the wealthy host, the celebrated writer, the glamorous guest – play the role of grammatical linkers in the social syntax of recognition: they bind other people, distribute attention, create or close off relational triads. Proust's "the diners had eyes only for the tables at which they were not sitting" is exactly this: desire and judgment are mediated through a few high-frequency social operators.

A certain kind of writing operates precisely at that interface: it doesn't just tell a story inside the internal funnel, and it doesn't just try to climb the external ranking; it exposes and recombines the "function words" of social perception themselves: the roles, clichés, prestige tokens, feared or desired third parties (like the forever-imagined intruder in Swann's jealousy). The difficulty is not only to satisfy two nested constraints (a coherent work and a competitive position), but to produce a form that reflects on, and potentially perturbs, the very grammar that links the two. That's where the channeling comes in: literature not only represents something, it re-routes the connective tissue through which quality, status, and desire are perceived in the first place.

Re: Why effort scales superlinearly with the perceived quality of creative work

#73

Just map quality q to e^q or something and it will be sublinear again. Or more directly, if your argument for why effort scales linearly with perceived quality doesn't discuss how we perceive quality then something is wrong. A more direct argument would be that it takes roughly an equal amount of effort to halve the distance from a rough work to its ideal. Going from 90% to 99% takes the same as going from 99% to 99.…

Your first line assumes that `q` fails to refer to an objective property. The `e^q` space isn't quality, as much as `e^t` isnt temperature (holding the property we are talking about fixed). Thus the comment ends up being circular.

I don't think you're wrong but I think I failed to convey the point I wanted to make.

What I was getting at is that without an objective way of measuring the whole idea of super- or sub-linear becomes ill defined. You can kind of define something to be sub-linear by definition, so the argument becomes tautological or indeed circular.

So an article that talks about perceived quality without any discussion about how people perceive quality or importantly differences in quality can say pretty much anything and it will be true for some definition of quality. You can't just silently assume perceived quality to be something objective, if you give no arguments you should assume it to be subjective.

Re: Why effort scales superlinearly with the perceived quality of creative work

#74
post #41

I had a cabinet built and the guy doing the work pointed out that the human eye is really great at detecting line-line deviation; but, building to & correcting for that deviation requires working across the whole surface. He was making an area-effort to linear-quality argument. He said every time you halved the gap, it quadrupled the effort. Also, he said that was what saw-dust & glue were for.

One thing I’ve learned over decades of home/DIY projects is it’s usually better to intentionally target a small overlap/reveal rather than trying to have two materials match perfectly. If you have a piece of door trim that exactly matches the piece behind, any imperfections or subsequent wood movement will be unsightly. If you instead target a 1/4” reveal, imperfections and slight wood movement are wildly less notice…

One thing I learned from theater set construction is that you can slap some gaffer's tape and paint over any flaws, and the audience will never notice.

Re: Why effort scales superlinearly with the perceived quality of creative work

#75
post #57

Earlier quoted context omitted.

"The last 10% take 90% of the time" The author had a shower thought. It was poorly explored, poorly argued and deliberately packaged in complex language to hide the lack of substance. The bibtex reference at the end is the cherry on top.

Hey, I have my share of poorly-explored showethought posts, but at least I don't try to ornament them in sesquipedalian locution that purposely obfuscates the rudimentariness of the notion.

You waste time when few word do trick

Re: Why effort scales superlinearly with the perceived quality of creative work

#76
Isn't there simply a human tendency to try and find a magic formula in what is simply survivor bias?

As creative projects (software, painting...) we finish or satisfactorily achieve relatively few items. And except for the most repetitive of us, these achievements are pretty different. Wide space, chaos, few satisfactory products by comparison. That doesn't bode well for "magic recipe". All the way to "rules of thumb" that we take fun in violating.

So there are two issues in there: We have more taste than skill and so many of our attempts will disappoint us no matter what. And we will obsess on trying to find a magic formula - when it's rather likely that there isn't one. The "space" is large and chaotic and we might want to reassure ourselves instead that serendipity has something to do with it.

Is there then place for rules of thumb? Whatever let's us get to work in the morning, I guess. For me, I do like the recognition of past track record: with a bit of age hindsight, I know I can do it - no need to dispair. That is useful and reassuring. If I just try some more - in ever varying manners, it will happen.

One place for "rules of thumbs" is in them being tropes. We can get some impact on the viewer by violating them. There is a trope of learning the rules so you can violate them. For example a Rule of Thirds - can be fertile grounds for getting at the viewer. The rule doesn't do much for us, and we have no problem violating it, but our less savvy viewers might remember it and get one more whiff of meaning from the violation. And if we are less concerned with our own satisfaction and more interested in sales, we might pay attention to "what's popular these days" and produce some of that. Not all artists are dead set on personal achievement at the cost of sales. A slightly different look at such rules.

Re: Why effort scales superlinearly with the perceived quality of creative work

#77
post #41

I had a cabinet built and the guy doing the work pointed out that the human eye is really great at detecting line-line deviation; but, building to & correcting for that deviation requires working across the whole surface. He was making an area-effort to linear-quality argument. He said every time you halved the gap, it quadrupled the effort. Also, he said that was what saw-dust & glue were for.

One thing I’ve learned over decades of home/DIY projects is it’s usually better to intentionally target a small overlap/reveal rather than trying to have two materials match perfectly. If you have a piece of door trim that exactly matches the piece behind, any imperfections or subsequent wood movement will be unsightly. If you instead target a 1/4” reveal, imperfections and slight wood movement are wildly less notice…

Technical aspects to the trade are a different issue, I feel. "Wood moves, design for it" is a technical aspect of woodworking which comes up frequently. You learn about the medium (same for 3D printing, welding, electronics), and make use of that knowledge. The medium is far from the ideal stuff you might have thought - the more knowledgeable worker makes use of that awareness. It's not a question of guiding your effort through chaos but understanding that physics is NOT all chaos. "Wood moves" is not this big mystery - it's just the reality of the medium.

This comes up a lot in investing and economics also. The difference between the naive view and a bit more awareness of how the world works is not some kind of deep conspiracy and "magic recipe" to be discovered. It's just how the world is.

Re: Why effort scales superlinearly with the perceived quality of creative work

#78

How often is a drawing really trashed and restarted? There's the saying, "Plan to throw one away," but seems like it varies in practice (for software). There are even books about patching paintings, like Master Disaster: Five Ways to Rescue Desparate Watercolors. In architecture, it's understood the people, vehicles, and landscape are not as exact as the building or structure, and books encourage reusing magazine cli…

> Draw 50

For me, "draw 50" series is about letting loose, NOT about skill. On the contrary, it's about exploring the space of all the different ways a prompt can be worked with in an UN-literal manner. Overall drawing facility will improve merely as a byproduct. The ability to be whimsical and exploit drawing flaws, erm, deliberately, is the real prize.

Different from "limbering up" exercizes like drawing your hand - where you do one at the beginning of a session just because it gets you started and in the flow without having to think or pick a "real" topic. (A similar idea is to leave some already decided work mid-done: when you arrive in the morning you can work on that and limber up and do something useful without having to think clearly yet.)

Different from thumbnails which are about picking a direction.

Re: Why effort scales superlinearly with the perceived quality of creative work

#79
post #48

Earlier quoted context omitted.

Fewer absolute or relative? If you scale down your search space... This only makes some kind of sense if your step size is fixed. While I agree with another poster that a reduction of a creative process to gradient descent is not wise, the article also misses the point what makes such a gradient descent hard -- it's not sharp peaks, it's the flat area around them -- and the presence of local minima.

I see your point. I'd meant relatively fewer progressive options compared to an absolute and unchanging number of total options. But that's not what the author's analogy would imply. Still, I think you're saying the author is deducing the creative process as a kind of gradient descent, whereas my reading was the author was trying to abductively explore an analogy.

True, but my point is that not only does the analogy not work, the author also doesn't understand the thing he makes the analogy with, or at least explores the thought so shoddily that it makes no sense.

It's somewhat like saying cars are faster than motorbikes because they have more wheels-- it's like with horses and humans, horses have four legs and because of that are faster than humans with two legs. It's wrong on both sides of the analogy.

Re: Why effort scales superlinearly with the perceived quality of creative work

#80
post #76

Isn't there simply a human tendency to try and find a magic formula in what is simply survivor bias? As creative projects (software, painting...) we finish or satisfactorily achieve relatively few items. And except for the most repetitive of us, these achievements are pretty different. Wide space, chaos, few satisfactory products by comparison. That doesn't bode well for "magic recipe". All the way to "rules of thumb…

I follow a few landscape photographers on YouTube and really enjoy watching them go out into the field (whether it's an actual field or mountain or beach). They've got their art (at least their own style) so dialed in, that the technical details, the subject, the composition, those are almost a forgone conclusion. What matters at that point is light. And light is luck. The difference between an average image and an outstanding one lies in something beyond their control.

And when fortune smiles on them, they get positively giddy.

I really appreciate people who understand that they have to meet luck half way. Even though they've spent hours upon hours upon hours honing their craft, the thing that puts them over the hump is both unpredictable and uncontrollable.

Post reply on HN