DeepMind: A Generalist Agent

Post by JoeAltmaier » Thu, May 12, 2022, 10:36 PM UTC

JohnPrine wrote: post #169

gurkendoktor wrote: post #111

Earlier quoted context omitted.

Not you specifically, but I honestly don't understand how positive many in this community (or really anyone at all) can be about these news. Tim Urban's article explicitly touches on the risk of human extinction, not to mention all the smaller-scale risks from weaponized AI. Have we made any progress on preventing this? Or is HN mostly happy with deprecating humanity because our replacement has more teraflops? Even t…

Agreed. People think of the best case scenario without seriously considering everything that can go wrong. If we stay on this path the most likely outcome is human extinction. Full stop

Post by woeirua » Thu, May 12, 2022, 10:43 PM UTC

version_five wrote: post #9

weinzierl wrote: post #4

"The same network with the same weights can play Atari, caption images, chat, stack blocks with a real robot arm and much more, deciding based on its context whether to output text, joint torques, button presses, or other tokens." This is rather mind blowing. Does it also mean that the generalist network is smaller than the sum of all specialist networks that are equivalent? Even if not, I find the idea that a single…

I don't find it surprising that a single network can do all those things with appropriate formatting of the data. In itself it just means the network has a large enough capacity to learn all the different tasks. The interesting questions imo, which they studied, is what kind of added generalization takes place by learning across the different tasks. For example, does learning multiple tasks make it better at a given…

Post by idiotsecant » Thu, May 12, 2022, 10:54 PM UTC

gurkendoktor wrote: post #203

idiotsecant wrote: post #183

Earlier quoted context omitted.

>Then what? Growing tomatoes is less efficient than buying them, regardless of your metric. If you just want really cleanly grown tomatoes, you can buy those. If you want cheap tomatoes, you can buy those. If you want big tomatoes, you can buy those. And yet individual people still grow tomatoes. Zillions of them. Why? Because we are inherently over-evolved apes who like sweet juicy fruits. The key to being a success…

Humans are great at making up purpose where there is absolutely none, and indeed this is a helpful mechanism for dealing with post-scarcity. The philosophical problem that I see with the "AI overlord age" (although not directly related to AI) is that we'll then have the technology to change the inherent human desires you speak of, and at that point growing tomatoes just seems like a very inefficient way of satisfying…

Post by machiaweliczny » Thu, May 12, 2022, 10:58 PM UTC

idiotsecant wrote: post #190

fullstackchris wrote: post #173

Earlier quoted context omitted.

I'm in the camp that thinks we're headed in a perpendicular direction and won't ever get to human levels of AGI with current efforts based on the simple idea that the basic tooling is wrong from first principles. I mean, most of the "progress" in AI has been due to getting better and learning how to understand a single piece of technology: neural networks. A lot of recent neuroscience findings have shown that human b…

HN madlibs: I'm in the camp that thinks we're headed in a perpendicular direction and won't ever achieve powered flight with current efforts based on the simple idea that the basic tooling is wrong from first principles. I mean, most of the "progress" in flight has been due to getting better and learning how to understand a single piece of technology: fixed wing aircraft. A lot of recent powered flight findings have…

Post by Jimmy » Thu, May 12, 2022, 11:28 PM UTC

idiotsecant wrote: post #190

fullstackchris wrote: post #173

Earlier quoted context omitted.

I'm in the camp that thinks we're headed in a perpendicular direction and won't ever get to human levels of AGI with current efforts based on the simple idea that the basic tooling is wrong from first principles. I mean, most of the "progress" in AI has been due to getting better and learning how to understand a single piece of technology: neural networks. A lot of recent neuroscience findings have shown that human b…

HN madlibs: I'm in the camp that thinks we're headed in a perpendicular direction and won't ever achieve powered flight with current efforts based on the simple idea that the basic tooling is wrong from first principles. I mean, most of the "progress" in flight has been due to getting better and learning how to understand a single piece of technology: fixed wing aircraft. A lot of recent powered flight findings have…