Viewing profile — greens

https://en.wikipedia.org/wiki/Cutoff_(physics)

355 laptop years seems very low for training GPT-3

It's a paradox of the "look I proved AGI is impossible" papers.

A single consumer GPU for ~hours

This is a common misconception. GPT-3 was trained using a 300B token (~300gb) subset of common-crawl and friends. The model is larger than the dataset.

That's a great point. You could argue despite the huge number of physical degrees of freedom, the operations on DNA can be reduced to copy, repair, express, suppress. On the other …

My 2c (apologies for the aggressive tone -- I'm just excited about AGI): That's a very very weak upper bound on how much hardware it takes. I think it's not all that different from…

Ok, sorry for assuming bad faith and ranting. Still, I think it's pretty hard to compare engineering achievements like this. Is it harder to make a fission bomb in 6 years with 194…

I can't believe that you're talking about the mass-murder of civilians like it's some sort of triumph, especially since you could have made the exact same point citing the trinity …

∫0->∞ x*e^-tx dx = -∂_t ∫0->∞ e^-tx dx = -∂_t (1/t)∫0->∞ e^-u du = -∂_t (1/t) = 1/t^2

L^1's derivative is a perfectly good function, it's not defined or continuous at 0, but whatever... it's for the same reason that the median handles even-sized sets in a special wa…

For gravity and EM fields the inverse square law is a consequence of a massless force carrier particle and Lorentz invariance. Quantum Field Theory in a Nutshell by Zee talks about…