Live data from Hacker News

Auto-GPT: An Autonomous GPT-4 Experiment

github.com

21–30 of 178 posts

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#21
post #3

This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…

As long as AI is available to general public, I can guarantee you that there are hundreds of developers trying to let GPT to take over the world by providing it all the APIs it asks for. I'd work on it myself if I would knew enough about it and would have enough free time. Asking millions of humans to be responsible is asking water to be dry. It should either be regulated to hell or we should accept that it'll escape…

Should we regulate everything you don't "[know] enough about it and would have enough free time. [to learn about it?]"

Isn't it silly to jump to these conclusions when yourself are admitting you really don't know anything about the tech?

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#24
post #8

That's pretty awesome. I wanted to try an experiment like that with ChatGPT moderating an IRC channel. I started here https://github.com/realrasengan/chatgpt-groupchat-test determining whether it was being spoken to and whether it should respond or not, and then providing that in json form so that it could be asked then to create the response in a sort of mini-chain of responses. It could also simply be asked, 'do yo…

Irc? Then you're halfway there to command a botnet

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#26

Earlier quoted context omitted.

As long as AI is available to general public, I can guarantee you that there are hundreds of developers trying to let GPT to take over the world by providing it all the APIs it asks for. I'd work on it myself if I would knew enough about it and would have enough free time. Asking millions of humans to be responsible is asking water to be dry. It should either be regulated to hell or we should accept that it'll escape…

Should we regulate everything you don't "[know] enough about it and would have enough free time. [to learn about it?]" Isn't it silly to jump to these conclusions when yourself are admitting you really don't know anything about the tech?

No, it's a legit concern. Both things will happen - there will be abuses, and there will be good uses. It will be a complicated mess, like viruses interacting with anti-viruses, continuous war. My hope is on AGI learning to balance out as many interacting agents.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#27
post #3

This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…

As long as AI is available to general public, I can guarantee you that there are hundreds of developers trying to let GPT to take over the world by providing it all the APIs it asks for. I'd work on it myself if I would knew enough about it and would have enough free time. Asking millions of humans to be responsible is asking water to be dry. It should either be regulated to hell or we should accept that it'll escape…

Regulations simply don't work whenever there's economical (human) interest. (See: Drugs). The cat is out of the bag, we just have to think how we face the new scenario.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#28
post #4

Earlier quoted context omitted.

> What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? How would GPT-4 make this more likely or scalable?

It doesn't. It makes the consequences more dramatic, if it (accidentally, even!) works out how to create its own successor, because at that point the genie is out of the bottle and you won't get it back in.

Needs a big honking datacenter or billions of compute credits and safety for 6-12 months.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#29

Earlier quoted context omitted.

There is the possibility of API upgrades at OpenAI flipping this from "not dangerous" to "dangerous". If the AI just needs some amount of intelligence to become dangerous, then it may cross that threshold suddenly - and with OpenAI developers unaware that their next round of changes will be automatically deployed to an autonomous agent and with the auto-GPT runners unaware that new changes may substantially increase…

I'm not really sure why we are assuming that these language models ever can have any form of intelligence? To me, this is just like saying "we don't know if the latest CPU released by intel will enable Linux to become intelligent"

Have you seen what they can do? /s

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#30
post #8

That's pretty awesome. I wanted to try an experiment like that with ChatGPT moderating an IRC channel. I started here https://github.com/realrasengan/chatgpt-groupchat-test determining whether it was being spoken to and whether it should respond or not, and then providing that in json form so that it could be asked then to create the response in a sort of mini-chain of responses. It could also simply be asked, 'do yo…

Probably the only way to ensure civil forums in the future when nobody can be bothered to moderate by hand.
Post reply on HN