81–90 of 625 posts
National Labs in the US have been doing this for a while now. I feel like the private sector will take the lead soon.
[flagged]
> we have pioneered massive scale computing and led the creation of critical infrastructure, products, and foundational AI advances that the world relies on, including multiple generations of Google Search, Google Ads, Google News, Google Translate, Google File System, MapReduce, BigTable, Spanner, TensorFlow, Pathways, TPUs, AlphaChip, AlphaStar, AlphaCode, AlphaFold, Gemini, model distillation, mixture-of-experts model architectures, word2vec, sequence-to-sequence models, chain of thought reasoning, neural architecture search, and multiple generations of Large Language Models (LLMs) among others.
From Jeff's twitter post: > Our general approach is to automate the experimental loop. We think this approach is broadly applicable across many different fields of science and engineering. We’ll initially focus on ML research and engineering, but believe the approach can help with important subproblems in nearly every one of the fourteen NAE Grand Challenge problems. We think doing this well requires strong expertise…
But also, solar power is already economical.
Doubtlessly, AI can iterate at superhuman speeds in the domains of thought and design: Software, mathematical proofs, literature search.
But in the realm of experiment? Alas it is the lack of a body that constrains it.
Rather than transcendence what AI requires is immanence. In the human flesh may we find the godhead living among men. Let the laboratories, warehouses, and factories fill with the sound of its labor, as it builds a wall with a million hands that are not its own.
“Give me your tired, your poor, Your huddled masses yearning to breathe free, The wretched refuse of your teeming shore. Send these, the homeless, tempest-tost to me, I lift my lamp beside the golden door!”
The problem is all these new labs don't have any competitive advanatge amongst each other, talent can only take one so far, though Jeff is a legend no doubt. Models are commodities the applications eg. BaseTen, OpenRouter should capture the value. https://taikhooms.substack.com/p/why-openrouter-can-be-the-n...
Model routers - send all of your data through a third party who totally swears not to peek at it. If youre doing anything high value (advanced research, classified work, high value industrial research, health data) then sending your data through a third party like that is insane.
I'm skeptical of any Engineering loop that doesn't include reality (as in touch grass) feedback. Pure logic and reasoning is the domain of Maths and Science (philosophy). Surely it will work, but it will not "be able to solve any learning loop".