61–70 of 74 posts
It's clear we're searching for the god algorithm of AI, just like physicists are searching for theory of everything. Are transformers the answer though?
I think the transformers architecture, or something very similar with eventually-on-policy time series forecasting in a markov decision process, is the right answer actually and was what I have been trying to make progress on for a long time[1].
To save you guys some time, this is a 2 month old paper and not made by OpenAI. It could be related to Q* (I don't know enough to determine that) but it's not OpenAI's Q*.
Is Q the new hottest letter right now?
It's clear we're searching for the god algorithm of AI, just like physicists are searching for theory of everything. Are transformers the answer though?
Algorithm is too simple, but yes - what does the system look like I think the transformers architecture, or something very similar with eventually-on-policy time series forecasting in a markov decision process, is the right answer actually and was what I have been trying to make progress on for a long time[1]. [1] https://kemendo.com/research/streaminference.html
Earlier quoted context omitted.
Algorithm is too simple, but yes - what does the system look like I think the transformers architecture, or something very similar with eventually-on-policy time series forecasting in a markov decision process, is the right answer actually and was what I have been trying to make progress on for a long time[1]. [1] https://kemendo.com/research/streaminference.html
That plus some Monte Carlo search as in AlphaZero makes a very strong (although computationally heavy) contender for 'alive' AI.
Earlier quoted context omitted.
The other robot project posted here yesterday opened drawers at around 80% though https://news.ycombinator.com/item?id=38453047 And they did it in many different homes.
My robot can open drawers at near 100%, but it takes the form of a stick of dynamite. Still working on closing the drawers afterwards, though...
It's clear we're searching for the god algorithm of AI, just like physicists are searching for theory of everything. Are transformers the answer though?
It seems more likely that there will be multiple avenues to AGI, all with their strengths and weaknesses. But perhaps the "God AI" will be a multifaceted model composed of many different models acting in unison.
Being implemented as we speak, by the always impressive LucidRains [1] [1]: https://github.com/lucidrains/q-transformer
It's clear we're searching for the god algorithm of AI, just like physicists are searching for theory of everything. Are transformers the answer though?
Theory of AI is just going to be some weird network with a shit-ton of compute power, where the latter is more important to the outcome than the former.