The principles are correct, but what gwern misses is that the paradigm shift required has nothing to do with AI models. The bottleneck is our medium of communication: the idea of the Web as a consensus reality made of human speech is too rigid for a world where code is a self-growing substance. We need a deeper Web where the packets themselves carry smaller Webs, where the unit of info-exchange evolves from hyperlinks (isolated points of server availability) to Hyperspaces (portable container of home-grown interactive web worlds, combining local and public hyperlinks).
I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
121–130 of 264 posts
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#122It's hard to read Gwern's accompanying article without seeing this for what it is, which is a kind of mania. I'm sure he means well and is genuine in his aspirations, but what's outlined for GA is framing LLM's as quasi-gods, which they absolutely are not. I wish him the best, and look forward to being proven wrong.
It really underscores how rationality is just another religion
No, it has some of the nasty trappings of a religion, like keeping women separate until you need to exploit them, but none of the good moral or creative literary parts of religions.
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#123Earlier quoted context omitted.
An LLM just solved 10 top tier math problems this week. It seems very likely that in 6 months they will solve 100 top tier math problems, maybe 1 millenium math problem, maybe 10 top tier physics problems, etc. It's only going to get crazier.
Math is verifiable. LLMs will continue to make strides in such search spaces where all they need to do is try->verify->repeat. You can't train an LLM on how to end the war in Iran or Ukraine, nor how to solve hunger, nor climate change, etc. Real issues. And LLMs still suck at art and writing.
Yeah but... Both things are true. LLMs are doing things we would have considered absolute AGI god tier magic 5 years ago. They also still can't count to 100 yet.
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#124A few snippets from his full post here: https://gwern.net/guardian-angel . > "The chatbot personas are deeply misaligned with you, and aligned with their owners; and the economic incentives are to farm you with ads and subscriptions, while racing not to amplify you but to replace you." > "On my visits to the Bay Area, I would ask AI researchers or interns why they are doing their current research or projects, when in…
What's wrong with replacement? That's how you get economic growth.
We didn't augment horses or human computers either.
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#125Earlier quoted context omitted.
An LLM just solved 10 top tier math problems this week. It seems very likely that in 6 months they will solve 100 top tier math problems, maybe 1 millenium math problem, maybe 10 top tier physics problems, etc. It's only going to get crazier.
Math is verifiable. LLMs will continue to make strides in such search spaces where all they need to do is try->verify->repeat. You can't train an LLM on how to end the war in Iran or Ukraine, nor how to solve hunger, nor climate change, etc. Real issues. And LLMs still suck at art and writing.
If you think all they need to do is "just that" (try, verify, repeat as you say) then I think you're very, very mistaken.
There is no way for the LLM to bruteforce the search space any better than a human. What it can do better, tho, is to make connections between seemingly (for us) unconnected notions and join them, then verify if that's right.
Your view is not only wrong but also condescending in this day and age.
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#126> The big AI labs are building a single mind for everyone Reminds me of Pluribus (I just started watching it on Apple TV so maybe this is a late realization for me)
> Reminds me of Pluribus - I just started watching it It is astoundingly good. A contender for the best show I've ever seen (and I saw the 1st run of Star Trek TOS).
Absolutely riveting! And the casting is so good. Rhea Seehorn has killed it. I really loved her in Better Call Saul but this role is even better suited for her.
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#127It's hard to read Gwern's accompanying article without seeing this for what it is, which is a kind of mania. I'm sure he means well and is genuine in his aspirations, but what's outlined for GA is framing LLM's as quasi-gods, which they absolutely are not. I wish him the best, and look forward to being proven wrong.
An LLM just solved 10 top tier math problems this week. It seems very likely that in 6 months they will solve 100 top tier math problems, maybe 1 millenium math problem, maybe 10 top tier physics problems, etc. It's only going to get crazier.
Has an LLM ever intentionally made you laugh? Cry?
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#128Earlier quoted context omitted.
An LLM just solved 10 top tier math problems this week. It seems very likely that in 6 months they will solve 100 top tier math problems, maybe 1 millenium math problem, maybe 10 top tier physics problems, etc. It's only going to get crazier.
Suppose LLM solved all math problems. So what? It’s not like diplomacy and war will end. Are humanity’s problems really constrained on our intellectual ability? If anything most evidence points to cultural failing and all AI will do is enable unprecedented oppression due to said skills at intellectual tasks. As you read this some poor person is starving. Humanity already possesses the ability to identify said person…
> Suppose LLM solved all math problems. So what? It’s not like diplomacy and war will end.
These are two vastly different statements, and the the war and diplomacy end is almost trivial by comparison, it would absolutely be solved before we solve all math in even the most steelmanned version.
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#129A few snippets from his full post here: https://gwern.net/guardian-angel . > "The chatbot personas are deeply misaligned with you, and aligned with their owners; and the economic incentives are to farm you with ads and subscriptions, while racing not to amplify you but to replace you." > "On my visits to the Bay Area, I would ask AI researchers or interns why they are doing their current research or projects, when in…
What's wrong with replacement? That's how you get economic growth. We didn't augment horses or human computers either.
[dead]
Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel
#130Earlier quoted context omitted.
An LLM just solved 10 top tier math problems this week. It seems very likely that in 6 months they will solve 100 top tier math problems, maybe 1 millenium math problem, maybe 10 top tier physics problems, etc. It's only going to get crazier.
Has an LLM ever intentionally made you laugh? Cry?
[deleted]