How to build a thinking AI
aithought.com
How to build a thinking AI
1–10 of 74 posts
Re: How to build a thinking AI
#2[deleted]
Re: How to build a thinking AI
#3At best we invite a dystopian future. At worst our own annihilation.
It is crazy how powerless we are to stop it from happening.
Re: How to build a thinking AI
#4Validating and updating memory is an interesting problem with an LLM.
Is it true that the next iteration of GPT is being trained with artificial data and that data is being validated by GPT-3.5?
That LLMs may hallucinate but when prompted are actually pretty good at knowing when a conclusion is wrong?
Re: How to build a thinking AI
#5At best we invite a dystopian future. At worst our own annihilation. It is crazy how powerless we are to stop it from happening.
[deleted]
Re: How to build a thinking AI
#6This is exactly what I started postulating on about 5 years ago… that eventually, transformers working through a REPL with access to a vector-store could likely lead to AGI. Of course, I didn’t predict the LLM/multimodal explosion, but I’ve been thinking along these same lines for a while now. My current direction is a multiagent MOE working into a single REPL with a supervisory transformer that manifests intent through the management of agent delegation and response filtering /regeneration to stay on context.
Re: How to build a thinking AI
#7Many such thinking architectures are probably possible. The hard part is learning a good representation of the world and all its constituents, without which none of these thinking architectures are possible. What's exciting about LLMs is that they are approaching this learned representation. There are already people attempting to build AGI (or less ambitiously, task automation) on top of LLMs with projects like BabyAGI and AutoGPT.
I think it will be hard to say apriori which thinking architecture will work better, because this will also depend on the properties of the learned embedding or representation of the world. We don't need to model how the human mind works. Humans have very tiny working memories, but a computer could have a much larger working memory. Human recall is very quick and the concept map is very robust, whereas I would image the learned representations won't be as good and the recall to be a bottleneck. But all of this is running ahead of ourselves. What we need are even better world models or representations of reality than what the current LLMs can produce, either by modifying transformers or by moving to better architectures.
Re: How to build a thinking AI
#8Not sure why but the lack of a scroll bar is giving me some pretty intense anxiety. How is one supposed to navigate a page like this? I don't see any indexes or indicators of where you are at any given time, and lots of weird moving distractions that make me lose my place.
edit: The PDF version is way more sane https://arxiv.org/pdf/2203.17255.pdf
Re: How to build a thinking AI
#9At best we invite a dystopian future. At worst our own annihilation. It is crazy how powerless we are to stop it from happening.
Framing a threat vaguely enough certainly makes it sound ominous.
Re: How to build a thinking AI
#10“Implementing this in a machine will enable artificial general intelligence”
If that’s true why didn’t he just implement it? Why should I take anyone seriously that just talks about code instead of actually coding it? This would be much more compelling if he just showed benchmarks and performance instead of writing up an argument. Furthermore, I don’t believe him.