Earlier quoted context omitted.
> not prediction based on anything statistical but based on one's understanding It is still statistical. You still want to predict a distribution over expected next token. However, the function needed to estimate the likely next tokens are not simple max over enumerated next tokens like in a language model. It's more like a transition model in reinforcement learning.
> It is still statistical. You still want to predict a distribution over expected next token. The fact that a process can be described statistically does not make the process itself statistical.
Donald Knuth on work habits, problem solving, and happiness (2020)
161–170 of 171 posts
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#162> My mother is amazing to watch because she doesn't do anything efficiently, really: She puts about three times as much energy as necessary into everything she does. But she never spends any time wondering what to do next or how to optimize anything; she just keeps working. Her strategy, slightly simplified, is, "See something that needs to be done and do it." All day long. And at the end of the day, she's accomplish…
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#163> My mother is amazing to watch because she doesn't do anything efficiently, really: She puts about three times as much energy as necessary into everything she does. But she never spends any time wondering what to do next or how to optimize anything; she just keeps working. Her strategy, slightly simplified, is, "See something that needs to be done and do it." All day long. And at the end of the day, she's accomplish…
This is effective because analysis paralysis is mentally draining. We tend to think/optimize in terms of time. But I've found it helpful to optimize for mental energy, which is often the limiting factor.
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#164Earlier quoted context omitted.
This is effective because analysis paralysis is mentally draining. We tend to think/optimize in terms of time. But I've found it helpful to optimize for mental energy, which is often the limiting factor.
> We tend to think/optimize in terms of time. But I've found it helpful to optimize for mental energy, which is often the limiting factor. I love this. Very succinct and insightful.
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#165> My mother is amazing to watch because she doesn't do anything efficiently, really: She puts about three times as much energy as necessary into everything she does. But she never spends any time wondering what to do next or how to optimize anything; she just keeps working. Her strategy, slightly simplified, is, "See something that needs to be done and do it." All day long. And at the end of the day, she's accomplish…
As someone with rural/countryside roots, I recall similar advice on physical labor: it is best to work at a steady, consistent pace all day long without getting sweaty or breathless . You'll avoid (or postpone) dehydration, remain more alert and calm, and thus it is much easier to switch tasks immediately. As a tree planter of several seasons, I've realized that this advice works remarkably well. Pushing yourself, sw…
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#166Earlier quoted context omitted.
This is effective because analysis paralysis is mentally draining. We tend to think/optimize in terms of time. But I've found it helpful to optimize for mental energy, which is often the limiting factor.
This carries over to social anxiety as well -- you tend to overthink what people think and such -- the more you do things the better you naturally get from experience as well.
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#167Earlier quoted context omitted.
My only gripe with TAOCP is its usage of MMIX.
If I where to ask “So what should he have used instead?” it would quickly derail this thread. There would be no consensus. Knuth probably foresaw this exact problem and more.
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#168Earlier quoted context omitted.
> We tend to think/optimize in terms of time. But I've found it helpful to optimize for mental energy, which is often the limiting factor. I love this. Very succinct and insightful.
https://news.ycombinator.com/item?id=31500342
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#169Earlier quoted context omitted.
Why should the journey be orthogonal to the destination? The Bible confirms that both are vital. The Sermon on the Mount commands Christians to be kind, loving and good people in this life. Verses like Matthew 6:19-21, Colossians 3:2 and 1 Corinthians 2:9 compel Christians to live this life in light of eternity. To me, if you accept the presuppositions of the Christian worldview, this is logical. If this life and how…
> The Bible confirms that both are vital. Evangelicals just as easily claim the opposite, on the same conceit. "The Bible says". If this wasn't up to interpretation you wouldn't have so many protestant sects. For instance, being kind and loving could be construed as an obligation for Salvation, not a reflection of the importance of Earth life. There are a not-insignificant number that oppose utilitarian improvements…
It certainly can be and has been construed in this way and a proper exegesis of the New Testament has no other conclusion than that interpretation is patently wrong.
The book of Galatians (amongst) others is a clear rebuke of the heresy of salvation by works.
Those who oppose utilitarian improvements to quality of life ignore verses such as
"Do not neglect to do good and to share what you have, for such sacrifices are pleasing to God."
"So whatever you wish that others would do to you, do also to them, for this is the Law and the Prophets."
"Let each of you look not only to his own interests, but also to the interests of others."
"Whoever is generous to the poor lends to the Lord, and he will repay him for his deed."
"Give to the one who begs from you, and do not refuse the one who would borrow from you."
"But love your enemies, and do good, and lend, expecting nothing in return"
The term "good Samaritan" comes from a Biblical parable highlighting the importance of being kind to others.
I don't how anyone can come away from a serious and accurate study of the Bible and not conclude that a Christian's conduct in this life is wholly important.
Re: Donald Knuth on work habits, problem solving, and happiness (2020)
#170> ...it turns up in Philippians 3:16, where the writer says that: > "You don't race to get to the goal; the process of racing itself, of keeping the pace, is the real goal. When I go on vacation, I like to enjoy the drive." > In Christian churches I am least impressed by a sermon that talks about how marvelous heaven is going to be at the end. To me that's not the message of Christianity. The message is about how to…
So, Knuth wrote this rather unusual book called "3:16" in which he took every chapter-3-verse-16 in the Bible (where chapter 3 is too short for that, he continued past the end into chapter 4 in the obvious way), thought about it a lot and wrote down his thoughts, and also commissioned eminent calligraphers to render his translations of all those verses. (He was inspired, if that's the right idea, by the notion of str…
This interpretation appeals to me.