Live data from Hacker News

DeepMind: A Generalist Agent

deepmind.com

71–80 of 345 posts

Re: DeepMind: A Generalist Agent

#71

given that the same model can both: 1. tell me about a cat (given a prompt such as "describe a cat to me") 2. recognize a cat in a photo, and describe the cat in the photo does the model understand that a cat that it sees in an image is related to a cat that it can describe in natural language? As in, are these two tasks (captioning an image and replying to a natural language prompt) so distinct that a "cat" in an im…

Definitely possible. OpenAI's CLIP model already embeds images and text into the same embedding space. I don't know exactly how this particular model works but it is creating cross modal relationships otherwise it would not have the capacity to be good at so many tasks.

CLIP has a distinct Vision Transformer and distinct Text Transformer model that are then matmul'd to create the aligned embedding space.

Gato apparently just uses a single model.

Re: DeepMind: A Generalist Agent

#72
post #46
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

I'd like to see someone make the argument that current models aren't just combining a number of "tricks", similar to a trained animal. My dog can "sit", "stay" and "beg", all using the same model (its brain). Is the dog generally intelligent?

How good is your dog at Atari games, stacking cubes and image captioning?

You can actually measure the effect of generality by how fast it learns new tasks. The paper is full of tables and graphs showing this ability.

It's just a small model, 170x smaller than GPT-3, has lots of room to grow. But for the first time we have a game playing agent that knows what "Atari" and "game" mean, and can probably comment on the side of the livestream. AlphaGo only knew the world of the Go board. This agent knows what is outside the box.

Re: DeepMind: A Generalist Agent

#73
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

I generally agree that AI continues to impress in very specific ways but, to be fair, some of the points you make are debatable. For example, I would argue that the development of GANs and other algos do no necessarily disprove the statement "ML models can't perform creative work." They definitely represent meaningful steps in that direction, but I don't think it's hard to find flaws with generated content. On the other hand, AI definitely has punted the ball over many moved goalposts as with the AlphaFold example.

Re: DeepMind: A Generalist Agent

#74

This seems huge, am I overestimating the significance?

Basically the achievement here is that they have produced a generic AI capable of engaging in different activities, and from here if we extrapolate, it could lead to even more refinement, wider range of activities with even more dimensions of complexity.

It's reverting to replace somebody sitting in front of a screen, not just artists and coders but literally anything you can do on a screen which also means manipulation of remote hardware in the real world.

Very possible that within our lifetime our networked OS would be able to perform much of these generalist tasks and content creation. I say OS because theres only a few companies that own the datacenters, software and hardware ecosystem to automate, and capital to invest big in a final mile innovation:

Imagine playing Battlefield 15 with realistic and chatty AI while generating Sopranos Season 9 featuring Pauli Gaultieri Jr. with crowdsourced online storyboard to 8k film, while the same AI could be used to scalp money on Google Playstore by generating ad filled free versions of existing productivity apps that it reverse engineered, while your robot maids takes out the trash, cook you a bowl of ramen and massage your shoulders?

The rise of general AI would then optimize the labor force to select candidates based on their "humaneness", no longer the cold rational analytical mind, as those fields are overrun by AI, but what it cannot bring. such "humaneness" would increasingly be mimicked with astounding accuracy that it would become impossible to distinguish what is AI and what is human.

If it can happen with DALL-E-2 and 2D images, it can happen with 3D, moving pictures, sound, music, smell, 3d positional torque (haptic and robotic), socially cohesive and realistic emotion.

We might as well be able to capture entire experiences as we learn to digitally manipulate ALL sensory inputs from vision, touch, sound, taste, etc. Maybe even imagination and mental pictures too, which could be used to fabricate and manipulate objects/vehicles in the real world.

We are being pulled towards a singularity, where we are truly no longer our minds and bodies but whatever our digital avatar of all possible senses live and contribute to a sort of Matrioshka brain.

What would the capacity of such collective knowledge, experiences add to the entropy of the universe and where will it take humanity? Some sort of lightbodies?

Anyways, just extrapolating from this point in the lifetime but future generation of humans could be very much different, socities would function completely different than what we recognize as they would be married in some shape or form of everlasting continuity or eternity.

Re: DeepMind: A Generalist Agent

#75
post #67
post #47

Earlier quoted context omitted.

we have been using ML to solve useful problems in biology for more than 3 decades. However, it was usually called "advanced statistics and probability on large data sets" because, to be honest, that's what most modern ML is.

> advanced statistics There's an emergent quality to AI models. Not all statistical models can dream pandas on the moon or solve hundreds of tasks, even without specific training.

I'd love to believe this, but nobody has demonstrated that yet. Also, I'm of the belief that if you have enough ram, either an infinitely tall-and-thin or wide-but-short MLP could do anything transformers can (happy to be pointed at a proof otherwise).

Re: DeepMind: A Generalist Agent

#76
post #26

Is today the day? Date Weakly General AI is Publicly Known: https://www.metaculus.com/questions/3479/date-weakly-general... (I really like the framing of "weakly general AI" since it puts the emphasis on the generality and not whether it's a superintelligence) Edit: Probably not today, but mostly because 1.2B parameters isn't enough to get it the high winograd scores that PaLM etc have. But it seems pretty clear you…

I think this is a step in the right direction, but the performance on most tasks is only mediocre. The conversation and image captioning examples in the paper are pretty bad, and even on some relatively simple control tasks it performs surprisingly poorly.

That's not to say it's not an important step. Showing that you can train one model on all of these disparate tasks at once and not have the system completely collapse is a big deal. And it lays the foundation for future efforts to raise the performance from "not totally embarrassing" to "human level". But there's still a ways to go on that front.

Re: DeepMind: A Generalist Agent

#77
post #52
post #8

This sounds exciting, but the example outputs look quite bad. E.g. from the interactive conversation sample: > What is the capital of France? > Marseille And many of the generated image captions are inaccurate.

Yeah, the captions are in the right arena but fundamentally wrong. In the baseball picture it recognizes the ball, pitcher, and the act of throwing, but calls the action wrong. Its object recognition and pattern matching are excellent, but higher level thinking and self-correction are totally absent. Which is exactly where GPT, etc., are capping out. Its easier to see the flaws in this one because its more general, s…

> Its easier to see the flaws in this one because its more general, so spread out more thinly.

I really think this is due to the very limited number of parameters in GATO: 1.2B vs. 175B for GPT-3. They intentionally restricted the model size so that they could control a robot arm (!) in real time.

> these models need a sense of self and relational categories.

The places where I personally see GPT-3 getting hung up on higher level structure seem very related to the limited context window. It can't remember more than a few pages at most, so it essentially has to infer what the plot is from a limited context window. If that's not possible, then it either flails (with higher temperatures) or outputs boring safe completions that are unlikely to be contradicted (with lower temperatures)

Re: DeepMind: A Generalist Agent

#78
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

How do we prepare for super human intelligence? Do you think that the AI will also develop its own motives ? Or will it just be a tool that we're able to plug into and use for ourselves?

In machine learning, there’s a long term trend towards automating work that used to be done manually. For instance, ML engineers used to spend a lot of time engineering “features” which captured salient aspects of the input data. Nowadays, we generally use Deep Learning to learn effective features. That pushed the problem to designing DNN architectures, which subsequently led to the rise of AutoML and NAS (Network Architecture Search) methods to save us the trouble. And so on.

We still have to provide ML agents with some kind of objective or reward signal which drives the learning process, but again, it would save human effort and make the process of learning more dynamic and adaptable if we can make machines learn useful goals and objectives on their own.

Re: DeepMind: A Generalist Agent

#79

What I really want to know is what kind of robot arm motion is produced when the network is given a cat image to classify. More specifically, what kind of insights has it learned from one control domain that it then applied to another? I imagine that the simulated 3D environment and the actual control of the robot arm must have some degree of interconnection neurally.

You could also train for this kind of interconnectedness by designing tasks that are explicitly multi-modal. For example, you could:

- Stack boxes collaboratively by controlling your own arm and communicating with another agent helping you.

- First produce a plan in text that another agent has to use to predict how you're going to control the arm. You'd get rewarded for both stacking correctly and being predictable based on the stated plan.

Re: DeepMind: A Generalist Agent

#80
post #76
post #26

Is today the day? Date Weakly General AI is Publicly Known: https://www.metaculus.com/questions/3479/date-weakly-general... (I really like the framing of "weakly general AI" since it puts the emphasis on the generality and not whether it's a superintelligence) Edit: Probably not today, but mostly because 1.2B parameters isn't enough to get it the high winograd scores that PaLM etc have. But it seems pretty clear you…

I think this is a step in the right direction, but the performance on most tasks is only mediocre. The conversation and image captioning examples in the paper are pretty bad, and even on some relatively simple control tasks it performs surprisingly poorly. That's not to say it's not an important step. Showing that you can train one model on all of these disparate tasks at once and not have the system completely colla…

Agreed, I think if they were to drop the real-time constraint for the sake of the robotics tasks, they could train a huge model with the lessons from PaLM and Chincilla and probably slam dunk the weakly general AI benchmark.
Post reply on HN