Earlier quoted context omitted.
It is being used to suggest code completions, so it could suggest code completion to someone that upon execution becomes wormable malware that infects everyone.
Most companies at least still have tools that perform checks for at least simple versions of workable exploits. About the best chance it would have is to write a complex library and get everyone to use that, were the library is exploitable in a complicated fashion.
Auto-GPT: An Autonomous GPT-4 Experiment
81–90 of 178 posts
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#82I've been using GPT-4 extensively for programming and its consistent failures at novel tasks have kind of left me less excited.
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#83Earlier quoted context omitted.
Alas, if it could only remember and precisely relate more than 4k or 8k or 32k or 64k words... And if only scaling that context length weren't quadratic... Indeed, we would really expect an AI to be able to achieve AGI. And it might decide to do all kinds of alien things. The sky would not be the limit! We have more than 100 trillion synapses in our brains. That's not our "parameter" count. It's the size of the thing…
You can only hold around 7 to 10 numbers in your mind well, in your working memory. Let me give you a few: 6398 5385 3854 8577 You have 1 second, close your eyes and add them together. Write down the result. I’m pretty sure that GPT-4 at its 4k setting would outperform you. [The point being, we have not seen what even GPT-4 can do in its optimal environment. Humans use paper, computers, google, etc. to organize their…
I'll point out that chatgpt needs to be paying attention to the numbers to remember them in the way I'm taking about. You will need to fine tune it or something to get it to remember them blind. I suppose that's not what you're talking about?
There is a strong chance that I'll remember where to find these numbers in a decade, after seeing and hearing untold trillions of "tokens" of input. The topic (Auto-GPT, which is revolutionary), my arguments about biological complexity (I'll continue to refine them but the rendition here was particularly fun to write) or any of these things will key me back to look up the precise details (here: these high entropy numbers). Attention is perhaps all you need... But in the world it's not quite arranged the same way as in machines. They're going to need some serious augmentation and extension to have these capabilities over the scales than we find trivial.
edit: you expanded your comment. Yes. We are augmented. Just dealing with all those augmented features requires precisely the long range correlation tracking I'm taking about. I don't doubt these systems will become ever more powerful, and will be adapted into a wider environment until their capabilities become truly human like. I am suggesting that the long range correlation issue is key. It's precisely what uniques humans from other beings on this planet. We have crazy endurance and our brains both cause and support that capability. All those connections are what let's us chase down large game, farm a piece of land for decades, write encyclopedias, and build complex cultures and relationships with hundreds and thousands of others. I'll be happy to be wrong, but it looks hard-as-in-quadratic to get this kind of general intelligence out of machines. Which scales badly.
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#84Earlier quoted context omitted.
Should we regulate everything you don't "[know] enough about it and would have enough free time. [to learn about it?]" Isn't it silly to jump to these conclusions when yourself are admitting you really don't know anything about the tech?
We should regulate everything which could cause a mass havoc. Like some chemicals, like radio-active isotopes, like nuclear research, like creating viruses. Is AI in the same category? Some respectable people think so.
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#85This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…
I honestly appreciate new woke meta of fearmongering against sentient AIs. It's a welcome break from the anti capitalism woke meta.
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#86We are about to get nuked. Only this time nuke is AI that remove any meaning from our so-called high life. I'm thinking moving to Hydarabad to fry samosas. Fortunately won't be automated.
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#87Earlier quoted context omitted.
You can only hold around 7 to 10 numbers in your mind well, in your working memory. Let me give you a few: 6398 5385 3854 8577 You have 1 second, close your eyes and add them together. Write down the result. I’m pretty sure that GPT-4 at its 4k setting would outperform you. [The point being, we have not seen what even GPT-4 can do in its optimal environment. Humans use paper, computers, google, etc. to organize their…
Indeed, and maybe less than 7... I'll point out that chatgpt needs to be paying attention to the numbers to remember them in the way I'm taking about. You will need to fine tune it or something to get it to remember them blind. I suppose that's not what you're talking about? There is a strong chance that I'll remember where to find these numbers in a decade, after seeing and hearing untold trillions of "tokens" of in…
And then, there is a chance that the inputs and outputs of GPT be saved and then used for fine-tuning. In a way that is similar to long-term memory consolidation in humans.
But overall, yes, I agree, GPT-4 in an empty space, without fine-tuning is very limited.
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#88I've been using GPT-4 extensively for programming and its consistent failures at novel tasks have kind of left me less excited.
0: https://chinesememe.substack.com/i/103754530/chinesepython
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#89AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.
Can someone explain to me what is so dangerous here? Do people actually think we’re headed towards James Cameron’s terminator and soon ChatGPT will become self aware and destroy us? I am far more afraid of tools to edit viruses becoming cheap and widely available, then one nutjob in his garage can engineer and release smallpox v2.0 and wipe out 90% of the worldwide population before we even know what hit us. Or you k…
That or some other unfeasible sci-fi AI dystopia. It's normal and expected the general public will have such thoughts given the amount of hype that's going on right now, but I've seen a lot of similar thinking on HN which is disappointing.
Re: Auto-GPT: An Autonomous GPT-4 Experiment
#90AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.
I have to disagree. Not releasing it to the public makes it more dangerous. One major downside of all development being done in private is that the AI can very easily be co-opted by our self-appointed betters and you end up with a different kind of dystopia where every utterance, thought and act is recorded and monitored by an AI to make sure no one "steps out of line." I think the solution is releasing it to the gen…