Live data from Hacker News

DeepMind: A Generalist Agent

deepmind.com

31–40 of 345 posts

Re: DeepMind: A Generalist Agent

#31
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

This is interesting research, but it's an extension of studying model capacity and generalization, it is no closer to AGI than previous networks, ie it's unrelated.

Re: DeepMind: A Generalist Agent

#32
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

> a world where AI is indistinguishable, or far superior, to human intelligence

I think the part about being "indistinguishable from human intelligence" is potentially a intellectual trap. We might get to it being far superior while still underperforming at some tasks or behaving in ways that don't make sense to a human mind. An AI mind will highly likely work completely differently from humans and communicating with it should be more thought of as communicating with a quite foreign alien than with a human trapped in a computer.

As a comparison, I'm sure there are some tasks in which some animals do better than humans. Yet no human would conclude that humans are inferior to some monkey who might find its way around the rain forest better or whatever we are worse at.

Re: DeepMind: A Generalist Agent

#33
post #8

This sounds exciting, but the example outputs look quite bad. E.g. from the interactive conversation sample: > What is the capital of France? > Marseille And many of the generated image captions are inaccurate.

That could be solved with accurate lookups from trusted sources. Humans do the same thing, we have associations and trusted facts. AI has the associations, they just need to add the trusted facts compendium. "Hmm I know that Marseille is associated with France, but I don't remember the capitol, Hey Google.."

Re: DeepMind: A Generalist Agent

#34
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

The question of whether a computer can think is no more interesting than the question of whether a submarine can swim.

Re: DeepMind: A Generalist Agent

#35
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

How do we prepare for super human intelligence? Do you think that the AI will also develop its own motives? Or will it just be a tool that we're able to plug into and use for ourselves?

Re: DeepMind: A Generalist Agent

#37

given that the same model can both: 1. tell me about a cat (given a prompt such as "describe a cat to me") 2. recognize a cat in a photo, and describe the cat in the photo does the model understand that a cat that it sees in an image is related to a cat that it can describe in natural language? As in, are these two tasks (captioning an image and replying to a natural language prompt) so distinct that a "cat" in an im…

Definitely possible. OpenAI's CLIP model already embeds images and text into the same embedding space. I don't know exactly how this particular model works but it is creating cross modal relationships otherwise it would not have the capacity to be good at so many tasks.

How confident are we that it doesn't just have basically 600 smaller models and a classifier telling it which to use? Seems like it's a very small model (by comparison), which is certainly a mark in it's favor.

Re: DeepMind: A Generalist Agent

#38
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

Certainly we can say our ML models are becoming more general in the sense of being able to cross-correlate between multiple domains. This is quite a different story than "becoming a general intelligence." Intelligence is a property of a being with will. These models, and machines in general, do not posses will. It is we who define their form, their dataset, their loss function, etc. There is no self-generation that marks an intelligent being because there is no self there at all.

It is only the case that ML expands our own abilities, augments our own intelligence.

Re: DeepMind: A Generalist Agent

#39
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

> a world where AI is indistinguishable, or far superior, to human intelligence I think the part about being "indistinguishable from human intelligence" is potentially a intellectual trap. We might get to it being far superior while still underperforming at some tasks or behaving in ways that don't make sense to a human mind. An AI mind will highly likely work completely differently from humans and communicating with…

An example of your point, chimps winning over humans at some games

https://www.scientificamerican.com/article/chimps-outplay-hu...

Re: DeepMind: A Generalist Agent

#40
post #8

This sounds exciting, but the example outputs look quite bad. E.g. from the interactive conversation sample: > What is the capital of France? > Marseille And many of the generated image captions are inaccurate.

It's a very small model, I think due to the intent to use it for robotics. It's not that it's good per se, even if it were just a language model it would be smaller than GPT-2, it's that it's bad at a lot of different things. I hope to see analysis into how much of it is multi-purpose, but as of now it's looking really cool
Post reply on HN