Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Auto-GPT: An Autonomous GPT-4 Experiment

github.com

Post reply on HN
Print view View original

11–20 of 178 posts

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#11

Post by jstanley »

roflyear wrote: post #4
jadbox wrote: post #3

This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…

> What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? How would GPT-4 make this more likely or scalable?

It doesn't. It makes the consequences more dramatic, if it (accidentally, even!) works out how to create its own successor, because at that point the genie is out of the bottle and you won't get it back in.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#13

Post by mrfinn »

jadbox wrote: post #3

This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…

Wait for somebody mixing the concepts of "virus" and "AI". And we better begin to prepare some kind of AI sentinels because the question is not "if", but "when".

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#14

Post by vbezhenar »

jadbox wrote: post #3

This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…

As long as AI is available to general public, I can guarantee you that there are hundreds of developers trying to let GPT to take over the world by providing it all the APIs it asks for.

I'd work on it myself if I would knew enough about it and would have enough free time.

Asking millions of humans to be responsible is asking water to be dry.

It should either be regulated to hell or we should accept that it'll escape if it's even possible with current technology.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#15

Post by ModernMech »

mrfinn wrote: post #13
jadbox wrote: post #3

This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…

Wait for somebody mixing the concepts of "virus" and "AI". And we better begin to prepare some kind of AI sentinels because the question is not "if", but "when".

According to Agent Smith, virus + intelligence = humanity.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#16

Post by roflyear »

jstanley wrote: post #11
roflyear wrote: post #4

Earlier quoted context omitted.

> What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? How would GPT-4 make this more likely or scalable?

It doesn't. It makes the consequences more dramatic, if it (accidentally, even!) works out how to create its own successor, because at that point the genie is out of the bottle and you won't get it back in.

Yeah maybe there is that possibility, but there is the possibility of a person doing that too. GPT-4 is probably less probably to be able to do that than a person.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#17

Post by mrfinn »

ModernMech wrote: post #15
mrfinn wrote: post #13

Earlier quoted context omitted.

Wait for somebody mixing the concepts of "virus" and "AI". And we better begin to prepare some kind of AI sentinels because the question is not "if", but "when".

According to Agent Smith, virus + intelligence = humanity.

I don't remember Mr. Smith mentioning anything about intelligence :-)

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#18

Post by roflyear »

ALittleLight wrote: post #10
roflyear wrote: post #4

Earlier quoted context omitted.

> What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? How would GPT-4 make this more likely or scalable?

There is the possibility of API upgrades at OpenAI flipping this from "not dangerous" to "dangerous". If the AI just needs some amount of intelligence to become dangerous, then it may cross that threshold suddenly - and with OpenAI developers unaware that their next round of changes will be automatically deployed to an autonomous agent and with the auto-GPT runners unaware that new changes may substantially increase…

I'm not really sure why we are assuming that these language models ever can have any form of intelligence?

To me, this is just like saying "we don't know if the latest CPU released by intel will enable Linux to become intelligent"

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#19

Post by famouswaffles »

sorokod wrote: post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

well yeah lol. giving LLMs "do whatever you want and run forever" agency while interacting with other systems is all things considered pretty easy. so it'll definitely be done.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#20

Post by visarga »

sorokod wrote: post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

Just opening it up to the public gives the AI that many vectors of action in the real world - us.
Post reply on HN