Live data from Hacker News

Auto-GPT: An Autonomous GPT-4 Experiment

github.com

81–90 of 178 posts

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#81
post #75

Earlier quoted context omitted.

It is being used to suggest code completions, so it could suggest code completion to someone that upon execution becomes wormable malware that infects everyone.

Most companies at least still have tools that perform checks for at least simple versions of workable exploits. About the best chance it would have is to write a complex library and get everyone to use that, were the library is exploitable in a complicated fashion.

Most of those will not work because it will be a malware without a recognizable signature.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#82

I've been using GPT-4 extensively for programming and its consistent failures at novel tasks have kind of left me less excited.

It’s only going to output the most probable response given the prompt and the data it was trained on. How could it be expected to solve something novel it has never seen in the training data?

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#83

Earlier quoted context omitted.

Alas, if it could only remember and precisely relate more than 4k or 8k or 32k or 64k words... And if only scaling that context length weren't quadratic... Indeed, we would really expect an AI to be able to achieve AGI. And it might decide to do all kinds of alien things. The sky would not be the limit! We have more than 100 trillion synapses in our brains. That's not our "parameter" count. It's the size of the thing…

You can only hold around 7 to 10 numbers in your mind well, in your working memory. Let me give you a few: 6398 5385 3854 8577 You have 1 second, close your eyes and add them together. Write down the result. I’m pretty sure that GPT-4 at its 4k setting would outperform you. [The point being, we have not seen what even GPT-4 can do in its optimal environment. Humans use paper, computers, google, etc. to organize their…

Indeed, and maybe less than 7...

I'll point out that chatgpt needs to be paying attention to the numbers to remember them in the way I'm taking about. You will need to fine tune it or something to get it to remember them blind. I suppose that's not what you're talking about?

There is a strong chance that I'll remember where to find these numbers in a decade, after seeing and hearing untold trillions of "tokens" of input. The topic (Auto-GPT, which is revolutionary), my arguments about biological complexity (I'll continue to refine them but the rendition here was particularly fun to write) or any of these things will key me back to look up the precise details (here: these high entropy numbers). Attention is perhaps all you need... But in the world it's not quite arranged the same way as in machines. They're going to need some serious augmentation and extension to have these capabilities over the scales than we find trivial.

edit: you expanded your comment. Yes. We are augmented. Just dealing with all those augmented features requires precisely the long range correlation tracking I'm taking about. I don't doubt these systems will become ever more powerful, and will be adapted into a wider environment until their capabilities become truly human like. I am suggesting that the long range correlation issue is key. It's precisely what uniques humans from other beings on this planet. We have crazy endurance and our brains both cause and support that capability. All those connections are what let's us chase down large game, farm a piece of land for decades, write encyclopedias, and build complex cultures and relationships with hundreds and thousands of others. I'll be happy to be wrong, but it looks hard-as-in-quadratic to get this kind of general intelligence out of machines. Which scales badly.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#84

Earlier quoted context omitted.

Should we regulate everything you don't "[know] enough about it and would have enough free time. [to learn about it?]" Isn't it silly to jump to these conclusions when yourself are admitting you really don't know anything about the tech?

We should regulate everything which could cause a mass havoc. Like some chemicals, like radio-active isotopes, like nuclear research, like creating viruses. Is AI in the same category? Some respectable people think so.

“Regulation” is pointless here. It’s bits and bytes, it makes about as much sense as when regulating encryption algorithms was attempted.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#85
post #3

This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…

I honestly appreciate new woke meta of fearmongering against sentient AIs. It's a welcome break from the anti capitalism woke meta.

Same screeching and pearl clutching as always. Covid has wound down, trump is out of office, Twitter is still there (unfortunately). People have to have something to get hysterical about and this is it for now.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#86

We are about to get nuked. Only this time nuke is AI that remove any meaning from our so-called high life. I'm thinking moving to Hydarabad to fry samosas. Fortunately won't be automated.

Don't get scared, AIs like the magic mirrors from the tales of old are actually a reflection of ourselves. And most probably they will allow us to get the biggest jump in our developing that ever happened in history, like if everyone of us suddenly get a superpower. I see that clearly now. Of course, there are risks, but together we can overcome them for sure.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#87

Earlier quoted context omitted.

You can only hold around 7 to 10 numbers in your mind well, in your working memory. Let me give you a few: 6398 5385 3854 8577 You have 1 second, close your eyes and add them together. Write down the result. I’m pretty sure that GPT-4 at its 4k setting would outperform you. [The point being, we have not seen what even GPT-4 can do in its optimal environment. Humans use paper, computers, google, etc. to organize their…

Indeed, and maybe less than 7... I'll point out that chatgpt needs to be paying attention to the numbers to remember them in the way I'm taking about. You will need to fine tune it or something to get it to remember them blind. I suppose that's not what you're talking about? There is a strong chance that I'll remember where to find these numbers in a decade, after seeing and hearing untold trillions of "tokens" of in…

When doing the processing GPT remembers these in the “working memory” (very similar to your working memory that is just an actuation of neurons, not an adjustment of the strengths of synaptic connections).

And then, there is a chance that the inputs and outputs of GPT be saved and then used for fine-tuning. In a way that is similar to long-term memory consolidation in humans.

But overall, yes, I agree, GPT-4 in an empty space, without fine-tuning is very limited.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#88

I've been using GPT-4 extensively for programming and its consistent failures at novel tasks have kind of left me less excited.

Not even novel or programming tasks alone, I use it to edit a Chinese newsletter[0] and it can never correctly guess the Chinese rock song from title and artist, always picks some pop tune instead, and otherwise mixes lyrics of separate song with no apparent reason.

0: https://chinesememe.substack.com/i/103754530/chinesepython

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#89
post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

Can someone explain to me what is so dangerous here? Do people actually think we’re headed towards James Cameron’s terminator and soon ChatGPT will become self aware and destroy us? I am far more afraid of tools to edit viruses becoming cheap and widely available, then one nutjob in his garage can engineer and release smallpox v2.0 and wipe out 90% of the worldwide population before we even know what hit us. Or you k…

> Do people actually think we’re headed towards James Cameron’s terminator and soon ChatGPT will become self aware and destroy us?

That or some other unfeasible sci-fi AI dystopia. It's normal and expected the general public will have such thoughts given the amount of hype that's going on right now, but I've seen a lot of similar thinking on HN which is disappointing.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#90
post #37
post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

I have to disagree. Not releasing it to the public makes it more dangerous. One major downside of all development being done in private is that the AI can very easily be co-opted by our self-appointed betters and you end up with a different kind of dystopia where every utterance, thought and act is recorded and monitored by an AI to make sure no one "steps out of line." I think the solution is releasing it to the gen…

The bad guy with an AI may very well build such a competent and fast acting AI that there's no defense possible. To strain the analogy, if the good guy with the gun already has a bullet in him, he ain't stopping much
Post reply on HN