Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Q-Transformer

qtransformer.github.io

Post reply on HN
Print view View original

51–60 of 74 posts

Re: Q-Transformer

#51

Post by platz »

kstrauser wrote: post #50
Workaccount2 wrote: post #31

Earlier quoted context omitted.

It seems more likely that there will be multiple avenues to AGI, all with their strengths and weaknesses. But perhaps the "God AI" will be a multifaceted model composed of many different models acting in unison.

I could see something like the "modularity of mind" model of human consciousness, where multiple approaches are working on "subconscious" solutions to a given problem in parallel, with a top layer deciding which is appropriate at the moment. My human brain doesn't use the same algorithm for learning to play a song on a piano as learning to play a new board game. I'm not an AI person, but it seems reasonable to imagin…

The Bicameral Mind

Re: Q-Transformer

#52

Post by amelius »

pixl97 wrote: post #46
methodical wrote: post #13

Earlier quoted context omitted.

Correct- as a reference for OC this is known as Moravec's Paradox ( https://en.wikipedia.org/wiki/Moravec%27s_paradox )

At least to me the key point of the article >Encoded in the large, highly evolved sensory and motor portions of the human brain is a billion years of experience about the nature of the world and how to survive in it. The deliberate process we call reasoning is, I believe, the thinnest veneer of human thought, effective only because it is supported by this much older and much more powerful, though usually unconscious,…

I'm not convinced. There's a lot of creative thinking going on in evolutionary anthropology, but the proofs are meager.

Re: Q-Transformer

#54

Post by amelius »

polygamous_bat wrote: post #18
varjag wrote: post #6

Earlier quoted context omitted.

That's a great start. Opening a drawer is pretty hard problem.

The other robot project posted here yesterday opened drawers at around 80% though https://news.ycombinator.com/item?id=38453047 And they did it in many different homes.

They should probably optimize for minimal friction force. If you're pulling the handle not entirely in the direction of movement, you're not doing it right.

Re: Q-Transformer

#58

Post by milanove »

itissid wrote: post #44
GaggiX wrote: post #33

Earlier quoted context omitted.

It's kinda funny how Lucidrains came back to make numerous commits to this repo following Q*.

Apparently this guy like a bunch of others like https://github.com/ggerganov/ggml are implementing transformers from papers for people that want them. Pretty cool.

I’m glad to see people in the open source community taking the initiative to implement these tools for the general public. It’s one thing to understand the high-level concepts in a paper, but another entirely to implement them efficiently. Some people just really have a knack for reading academic papers and implementing those ideas in software.

Re: Q-Transformer

#60

Post by pama »

itissid wrote: post #44
GaggiX wrote: post #33

Earlier quoted context omitted.

It's kinda funny how Lucidrains came back to make numerous commits to this repo following Q*.

Apparently this guy like a bunch of others like https://github.com/ggerganov/ggml are implementing transformers from papers for people that want them. Pretty cool.

The additional link is indeed very useful, however, with one exception, it is limited to inference, ie code for evaluating a model using somebody else’s trained model weights. The original link has code for training (which can also be used for inference, of course.) Inference is super important, of course, so it makes a lot of sense to put effort to make it work well on all kinds of hardware; the papers typically focus on training and only then evaluating/validating a new model.
Post reply on HN