Live data from Hacker News

Billion-Parameter Theories

worldgov.org

91–92 of 92 posts

Re: Billion-Parameter Theories

#91
post #28

He talks about the Santa Fe institute and how they failed to carry their findings into the real world. They did not. They showed that for certain problems one could not do more than figure out some invariant and scaling laws. Showing what is impossible is not failure. For the rest: Modern gene networks and lots of biological modelling is based on their work as well as quite a few other things. That’s also not failure…

Clarke's second law: When a distinguished but elderly scientist states that something is possible, he is almost certainly right. When he states that something is impossible, he is very probably wrong. Also see Minsky's "Perceptrons" The problem with almost all such proofs is that people (even those who know better) read them as "this can't be done" when in fact they tell you "it can't be done unless you break one of…

A positive lyapunov exponent means that your flow has locally diverging properties.

No matter what you do you are bound by that. As soon as you uncertainties become of the order of the systems scale you cannot predict.

You might push from 1 lyapunov time to 3 or use ensemble methods to get probabilities, but the fundamental impossibility remains.

Age of the scientist does not matter.

Re: Billion-Parameter Theories

#92
post #35
post #31

Earlier quoted context omitted.

Indeed, operating human lips, teeth, tongue, and larynx is far beyond language models.

Apologies if I'm stepping on a joke, but just in case: Nativism is about cognitive capacities, not sensorimotor ones. All apes could easily communicate just as well as Helen Keller, yet none of them have ever asked a question, much less written a book!

No joke. Same sensorimotor neurons in the human speech apparatus have cognitive analogues, developed together over vast expanses of history.
Post reply on HN