Live data from Hacker News

Donald Knuth on work habits, problem solving, and happiness (2020)

shuvomoy.github.io

111–120 of 171 posts

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#111

Earlier quoted context omitted.

I see it differently. It's not prediction based on anything statistical but based on one's understanding. I've made it a habit to ask myself what I expect the output to be for any programming operation, and why. It forces me to gain clarity into my mental model of what's happening, and it immediately highlights deficiencies in my model when it's proven wrong. I ask the same of others when I pair program with juniors…

> not prediction based on anything statistical but based on one's understanding It is still statistical. You still want to predict a distribution over expected next token. However, the function needed to estimate the likely next tokens are not simple max over enumerated next tokens like in a language model. It's more like a transition model in reinforcement learning.

> It is still statistical. You still want to predict a distribution over expected next token.

The fact that a process can be described statistically does not make the process itself statistical.

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#112

Every day I look at the things that I'm ready to do, and choose the one that I like the least, the one that's least fun — the task that I would most like to procrastinate from doing, but for which I have no good reason for procrastination. I'm not sure I've seen this approach to combating procrastination before. I can see how it might work: once you've completed the thing you least wanted to do, you might feel relief…

The key is asking "Is there a reasonable chance that this unpleasant task/expensive purchase/other potential PITA will go away if I put it on a list and continue to avoid it?" If the answer if yes, then procrastination can actually be a good thing. Kicking a can down the road can actually be a pretty good strategy.

Otherwise, you might as well bite the bullet, especially if there's some advantage in doing it sooner rather than later.

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#113
post #83

Earlier quoted context omitted.

(In his digestive summaries, Knuth does provide citations, to be clear)

I guess I don't understand why someone would make the contrary assumption about famous academic work.

His citation lists at the back of each book are immense.

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#114
His "0.8 is enough" idea is close to an observation I made a few years ago, that the Dunning-Kreuger effect seems to reflect an ideal breakpoint for social stratification.

People low on the curve drift towards evaluating themselves at ~0.75 (round to Knuth's 0.8), and those above that marker drift towards it as well.

So when we are actually around the 80th percentile of anything, we're in the sweet spot everyone else's self-image trends towards.

It makes sense too - we're very social beings, and being an outlier is inherently isolating.

To Knuth's example - if he were 100% happy all the time, that could actually cause more social integration issues than being mostly happy (80%). For example, "Congrats on the funeral, it looks awesome!"

Typically, good enough is perfect.

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#115
post #41

Earlier quoted context omitted.

There will always be a "higher" type of engineers who want to read TAOCP and similar. My issue with the books is that they're actually quite long winded even by what you'd expect from the tone. There's some really cool stuff in them, obviously, but I think they're objectively not very good textbooks for any purpose. Then again I'm coming from a background of physics rather than mathematics so I'm not set out for a re…

Related to your higher type of engineer: http://employees.oneonta.edu/blechmjb/JBpages/m360/Professio... It’s a good short story if you’ve got 20min.

Excellent suggestion. I enjoyed it. Just one question. How the hell does anyone read all that in 20 minutes?

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#116

Earlier quoted context omitted.

Ah, to my mind "algebra" is the structure. It sounds like you want a survey of mathematical notation?

> a survey of mathematical notation YES!

I think in some part you had it right that it differs a bit by specialty, but I think the bigger part of it is that the syntax doesn't mean much without the concepts behind it. Notation is a way to compress concepts that are already understood in elaboration.

Being able to recognize notation without the conceptual underpinning might be useful in directing you towards what you need to learn for a particular task, but it's going to be difficult to learn without anything to hang it on. That said, maybe what you actually want is a math notation OCR that can direct you to documentation for possible interpretations.

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#117
> ...it turns up in Philippians 3:16, where the writer says that:

> "You don't race to get to the goal; the process of racing itself, of keeping the pace, is the real goal. When I go on vacation, I like to enjoy the drive."

> In Christian churches I am least impressed by a sermon that talks about how marvelous heaven is going to be at the end. To me that's not the message of Christianity. The message is about how to live now, not that we should live in some particular way because there's going to be pie in the sky some day. The end means almost nothing to me. I am glad it's there, but I don't see it as much of a motivating force, if any. I mean, it's the journey that's important.

---

This is Philippians 3:16: "Only let us live up to what we have already attained."

It's hard for me to connect that to the paraphrase given above. Furthermore, the previous few verses (12-14) of that same chapter seem to be more goal-oriented, than process-oriented:

"Not that I have already obtained all this, or have already arrived at my goal, but I press on to take hold of that for which Christ Jesus took hold of me. Brothers and sisters, I do not consider myself yet to have taken hold of it. But one thing I do: Forgetting what is behind and straining toward what is ahead, I press on toward the goal to win the prize for which God has called me heavenward in Christ Jesus."

Also see 1 Corinthians 15:19:

"If only for this life we have hope in Christ, we are of all people most to be pitied."

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#118

One of my favorite facts about Knuth is how rarely he checks email! https://www.calnewport.com/blog/2008/07/17/bonus-post-how-th...

My favorite Knuth fact is that he thinks P = NP. [1][2] That's a very contrarian view. [1]: https://youtube.com/watch?v=XDTOs8MgQfg [2]: https://www.informit.com/articles/article.aspx?p=2213858&WT....

That's interesting. But my favorite Knuth fact remains the fact that he published his first technical paper in Mad Magazine.[1]

[1]: https://news.ycombinator.com/item?id=20351772

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#119
post #117

> ...it turns up in Philippians 3:16, where the writer says that: > "You don't race to get to the goal; the process of racing itself, of keeping the pace, is the real goal. When I go on vacation, I like to enjoy the drive." > In Christian churches I am least impressed by a sermon that talks about how marvelous heaven is going to be at the end. To me that's not the message of Christianity. The message is about how to…

So, Knuth wrote this rather unusual book called "3:16" in which he took every chapter-3-verse-16 in the Bible (where chapter 3 is too short for that, he continued past the end into chapter 4 in the obvious way), thought about it a lot and wrote down his thoughts, and also commissioned eminent calligraphers to render his translations of all those verses.

(He was inspired, if that's the right idea, by the notion of stratified sampling in statistics. He called this application of it "The Way of the Cross-section".)

Here are a few extracts from what Knuth says about Philippians 3:16 in that book, which may help explain.

"English translations of verse 16 tend to be quite different from each other, because Paul's original Greek words are difficult to render in our language. A literal translation goes something like this: 'Hey, to what we've reached, by this to march!'"

(Presumably the "live up to" in the translation you quote is the "by this to march" in his literal translation. So part of what's going on is that Knuth thinks, while the translators you're quoting don't, that the notion of progress in the Greek metaphor there is essential to what he's saying.)

"Putting all these words together, we can see what verse 16 means: 'Let's keep progressing from the point we've reached.'"

(Making it more explicit. I have to say that the foregoing paragraphs in Knuth's thoughts on this verse don't particularly explain why he thinks it means that rather than, say, "stay on the same road" or "continue marching in the same pattern" or something of the kind, which seems to be the sort of idea most English versions embrace.)

"Paul's main point [sc. in this verse and the chapter as a whole] is that the Christian life is a process of continual striving for greater faith, for greater knowledge of God."

(This seems pretty fair to me. Yes, what comes before verse 16 talks about a goal, but it also emphasizes that it's a goal not yet reached, still the object of constant straining.)

It still seems hard to reconcile what the rest of Philippians 3 actually says with Knuth's "you don't race to get to the goal". (For the avoidance of doubt, in "3:16" he says in so many words "he [sc. Paul] continues to run toward the goal", so it's not like he's missed the aiming-for-the-goal idea here.) Here's my best guess at what he's thinking: Paul doesn't reckon he's reached the goal; he clearly doesn't think anyone else has reached it; indeed, it seems pretty clear that he doesn't expect anyone to reach it before their death. So (I conjecture Knuth thinks) what's the point of all that striving and straining? It can't really be that we need to strive and strain in order to be saved -- Paul seems pretty opposed to that sort of idea, elsewhere. So the real point of the striving and straining must be the effect it has on our lives here on earth.

That's my best guess at Knuth's thinking, anyway. He doesn't make it explicit, at all. Another possibility, of course, is that when he said what the OP here quotes him as saying he was only sketchily remembering what Philippians 3:16 says and attributed to it something related to, but incompatible with, what it actually says, and that if you pointed him at the actual text of the chapter and his own analysis of it in 3:16 he'd say something like "oops, yes, I shouldn't have said it said that".

(Disclaimer: I am not myself a Christian, though I was one for many years; you may or may not wish to discount accordingly anything I say about theology or exegesis. Also: my main reason for writing this comment is that I suspect that any HN readers interested in Knuth's thinking about this kind of thing would enjoy "3:16".)

Re: Donald Knuth on work habits, problem solving, and happiness (2020)

#120
post #30
post #25

Earlier quoted context omitted.

probably the Lex Fridman podcast interviews: https://www.youtube.com/watch?v=2BdBfsXbST8 https://www.youtube.com/watch?v=EE1R8FYUJm0 the second one is definitely where the last paragraph in the article is from. Weird that the interview is dated 2021-09-09 and the post is 2020-04-30?

Wow, Lex has gotten some of the greats on his podcast. I should probably give it a go. The few episodes I've seen were more shallow than I was looking for as an engineer, but I assumed that was because he's helping bring these interviews and ideas to a wider audience.

They sometimes go deep, but that is more at the discretion of the interviewee than Lex. Lex is usually asking questions about topics he has only tangencial knowledge in but is the expertise of the interviewee.

The Chris Lattner episodes are great, and James Gosling had some fun stories in there, and Kernighan had a good interview as well.

Post reply on HN