Ilya Sutskever: We're moving from the age of scaling to the age of research

Post by bluecheese452 » Wed, Nov 26, 2025, 2:20 AM UTC

wahnfrieden wrote: post #28

camillomiller wrote: post #22

Earlier quoted context omitted.

Fridman is a morally broken grifter, who just built a persona and a brand on proven lies, claiming an association with MIT that was de facto non-existent. Not wanting to give the guy recognition is not a matter of being liberal or conservative, but just interested in truthfulness.

Patel takes anticommunism to such an extreme that he repeatedly brings up and speculates (despite being met with repudiation by even the staunchest anticommunist of guests) whether naziism is preferable, that Hitler should have the war against Soviets, that the US should have collaborated with Hitler to defeat communism, and that the enduring spread of naziism would have been a good tradeoff to make.

Post by gjvc » Wed, Nov 26, 2025, 2:29 AM UTC

FloorEgg wrote: post #180

samrus wrote: post #174

Earlier quoted context omitted.

Sample efficiency isnt the ability to distill alot of data into good insights. Its the ability to get good insights from less data. Evolution didnt do that it had a lot of samples to get to where it did

> Sample efficiency isnt the ability to distill alot of data into good insights Are you claiming that I said this? Because I didn't.... There's two things going on. One is compressing lots of data into generalizable intelligence. The other is using generalized intelligence to learn from a small amount of data. Billions of years and all the data that goes along with it -> compressed into efficient generalized intellig…

Post by ares623 » Wed, Nov 26, 2025, 2:29 AM UTC

hiddencost wrote: post #179

pxc wrote: post #155

If "Era of Scaling" means "era of rapid and predictable performance improvements that easily attract investors", it sounds a lot like "AI summer". So... is "Era of Research" a euphemism for "AI winter"?

That presumes that performance improvements are necessary for commercialization. From what I've seen the models are smart enough, what we're lacking is the understanding and frameworks necessary to use them well. We've barely scratched the surface on commercialization. I'd argue there are two things coming: -> Era of Research -> Era of Engineering Previous AI winters happened because we didn't have a commercially via…

Post by zombiwoof » Wed, Nov 26, 2025, 2:37 AM UTC

pxc wrote: post #155

If "Era of Scaling" means "era of rapid and predictable performance improvements that easily attract investors", it sounds a lot like "AI summer". So... is "Era of Research" a euphemism for "AI winter"?

Post by zerosizedweasle » Wed, Nov 26, 2025, 2:40 AM UTC

bilsbie wrote: post #184

I don’t think either of those ages is correct. I’d like to see the age of efficiency and bringing decent models to personal devices.