Live data from Hacker News

DeepMind: A Generalist Agent

deepmind.com

151–160 of 345 posts

Re: DeepMind: A Generalist Agent

#151
post #22

Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…

[deleted]

Re: DeepMind: A Generalist Agent

#152
post #132

So how long until someone trains one of these models to complete tasks by interacting directly with network/unix sockets? At the moment, it seems like the model needs to be trained with each modality of data in mind at the start, but a generalised "supermodality" that can deliver all the others would allow truly generalised learning if the model were still capable of making sense of the input. You'd obviously still n…

https://www.adept.ai/post/introducing-adept pretty much right after writing the transformers paper two of the co authors formed this company

Re: DeepMind: A Generalist Agent

#153

Earlier quoted context omitted.

Why must it apply for a job, rather than just DO a job? But maybe some combination of this [1] and this [2] would do it. If you want to know about a computer actually DOING a remote job for a year without anyone noticing, I'll conclude with many links [a-i]. [1] : https://thisresumedoesnotexist.com/ (Sorry for the bad certificates.) [2] : https://www.businessinsider.com/tiktoker-wrote-code-spam-kel... [a] : An origin…

> Why must it apply for a job, rather than just DO a job? Because being able to manage a business relationship is a part of the job. If you could show an AI which got a job, then wrote a simple script that automated the AI's job and then coasted for a year that would be fine, but your links are just humans doing that, I want an AI that can do that to consider it intelligent. But thanks for demonstrating so clearly ho…

Should the AI be able to use a real human's SSN? And resume, to be able to pass a background check? Can a real human show up to interview, and take a drug test? Can we have real humans provide references, or must those be faked too? Must the computer go to high school and college, to have real transcripts to validate?

Do we need to have a computer baby trick doctors into issuing it a birth certificate, so it can get its own SSN, and then the computer baby needs to have a physical body that it can use to trick a drug test with artificial urine, and it also needs to be able to have either computer-generated video and audio meetings, or at least computer-generated audio calls?

Or can you list some jobs that you think require no SSN, no physical embodiment, no drug test, no video or audio teleconfrencing?

Since you're accusing me of moving the goalposts backwards to make it "easy," let's have you define exactly where you think the goalposts should be, for your intelligence test.

Or maybe, replacing a human driver (or some other job), 1:1, for a job a human did yesterday, and a computer does today could be enough? If it's capable of replacing a human, do you then not think the human needed intelligence to do their job?

Re: DeepMind: A Generalist Agent

#155
post #5

I’m not sure how to word my excitement about the progress we see in AI research in the last years. If you haven’t read it, give Tim Urbans classic piece a slice of your attention: https://waitbutwhy.com/2015/01/artificial-intelligence-revol... It’s a very entertaining read from a couple of years ago (I think I’ve read it in 2017), and man, have things happened in the field since then. If feels like things truly start…

That human intelligence might just be token prediction evolving from successive small bit-width float matrix transformations is depressing to me.

It’s most fascinating (or very obvious) - look at Conway’s Game of Life, then scale it up - a lot. Unlimited complexity can arise from very simple rules and initial conditions.

Now consciousness on the other hand is unfathomable and (in its finitude) extremely depressing for me.

Re: DeepMind: A Generalist Agent

#156

Earlier quoted context omitted.

Definitely possible. OpenAI's CLIP model already embeds images and text into the same embedding space. I don't know exactly how this particular model works but it is creating cross modal relationships otherwise it would not have the capacity to be good at so many tasks.

How confident are we that it doesn't just have basically 600 smaller models and a classifier telling it which to use? Seems like it's a very small model (by comparison), which is certainly a mark in it's favor.

You can optimize pictures straight through it, and the pictures represent the combinatorial nature of the prompt pretty well. This contradicts the "flat array of classifiers" model.

Re: DeepMind: A Generalist Agent

#158
post #5

I’m not sure how to word my excitement about the progress we see in AI research in the last years. If you haven’t read it, give Tim Urbans classic piece a slice of your attention: https://waitbutwhy.com/2015/01/artificial-intelligence-revol... It’s a very entertaining read from a couple of years ago (I think I’ve read it in 2017), and man, have things happened in the field since then. If feels like things truly start…

That human intelligence might just be token prediction evolving from successive small bit-width float matrix transformations is depressing to me.

Dear god I hope that we are using something more complicated than sampling with top_p, top_k, and a set temperature as our decoder!

Re: DeepMind: A Generalist Agent

#159

Earlier quoted context omitted.

> Why must it apply for a job, rather than just DO a job? Because being able to manage a business relationship is a part of the job. If you could show an AI which got a job, then wrote a simple script that automated the AI's job and then coasted for a year that would be fine, but your links are just humans doing that, I want an AI that can do that to consider it intelligent. But thanks for demonstrating so clearly ho…

Should the AI be able to use a real human's SSN? And resume, to be able to pass a background check? Can a real human show up to interview, and take a drug test? Can we have real humans provide references, or must those be faked too? Must the computer go to high school and college, to have real transcripts to validate? Do we need to have a computer baby trick doctors into issuing it a birth certificate, so it can get…

You can use a real persons contact details as long as the AI does all communication and work. Also it has to be the same AI, no altering the AI after you see the tasks it needs to perform after it gets the job, it has to understand that itself.

For teleconferencing it could use text to speech and speech to text, they are pretty good these days so as long as the AI can parse what people say and identify when to speak and what to say it should do fine:

https://cloud.google.com/text-to-speech

But it might be easier to find a more hacker friendly job where all you need is somewhere for them to send money and they just demand you to write code and answer emails. There aren't that many such jobs, but they exist and you just need one job to do this.

Re: DeepMind: A Generalist Agent

#160

Earlier quoted context omitted.

Definitely possible. OpenAI's CLIP model already embeds images and text into the same embedding space. I don't know exactly how this particular model works but it is creating cross modal relationships otherwise it would not have the capacity to be good at so many tasks.

How confident are we that it doesn't just have basically 600 smaller models and a classifier telling it which to use? Seems like it's a very small model (by comparison), which is certainly a mark in it's favor.

You might find looking into the "lottery ticket hypothesis" fascinating.
Post reply on HN