Live data from Hacker News

Auto-GPT: An Autonomous GPT-4 Experiment

github.com

41–50 of 178 posts

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#41
post #22

I wonder are they using these autonomous GPT loops to control DAOs? https://en.wikipedia.org/wiki/Decentralized_autonomous_organ...

Unlikely, DAO's are supposed to be decentralized, OpenAI/GPT can provide nothing of value for a requirement like that.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#42
post #3

This seems... dangerously careless. What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? Sure humans also do this, but we're talking about a new level of 0day exploit carried out at scale. Sure, maybe it won't, but do you trust a hallucinating, left-brained, internet-trained intelligence to be strictly logical and mindful for all it's actions that is taking self autonomously (…

I honestly appreciate new woke meta of fearmongering against sentient AIs. It's a welcome break from the anti capitalism woke meta.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#43
post #37
post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

I have to disagree. Not releasing it to the public makes it more dangerous. One major downside of all development being done in private is that the AI can very easily be co-opted by our self-appointed betters and you end up with a different kind of dystopia where every utterance, thought and act is recorded and monitored by an AI to make sure no one "steps out of line." I think the solution is releasing it to the gen…

I agree. Overall the whole situation feels like we’ve just entered atomic age and are proliferating plutonium, while selling shiny radioactive toys [I’m actually pretty serious here, the effects of prolonged interactions with an AI haven’t been evaluated yet, technically there is even a possibility of overriding a weak personality].

But it still feels like it is much safer to let GPT-4 loose and assess the consequences. If compared to developing GPT-8 in private and letting it leak accidentally.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#44

Earlier quoted context omitted.

As long as AI is available to general public, I can guarantee you that there are hundreds of developers trying to let GPT to take over the world by providing it all the APIs it asks for. I'd work on it myself if I would knew enough about it and would have enough free time. Asking millions of humans to be responsible is asking water to be dry. It should either be regulated to hell or we should accept that it'll escape…

Should we regulate everything you don't "[know] enough about it and would have enough free time. [to learn about it?]" Isn't it silly to jump to these conclusions when yourself are admitting you really don't know anything about the tech?

We should regulate everything which could cause a mass havoc. Like some chemicals, like radio-active isotopes, like nuclear research, like creating viruses.

Is AI in the same category? Some respectable people think so.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#45

Earlier quoted context omitted.

There is the possibility of API upgrades at OpenAI flipping this from "not dangerous" to "dangerous". If the AI just needs some amount of intelligence to become dangerous, then it may cross that threshold suddenly - and with OpenAI developers unaware that their next round of changes will be automatically deployed to an autonomous agent and with the auto-GPT runners unaware that new changes may substantially increase…

I'm not really sure why we are assuming that these language models ever can have any form of intelligence? To me, this is just like saying "we don't know if the latest CPU released by intel will enable Linux to become intelligent"

Language models obviously have some form of intelligence right now. You can have GPT-4 take SAT tests, play Chess, write poetry, predict what will happen in different social scenarios, answer theory of mind questions, ask questions, solve programming puzzles, etc. There are some measures that GPTs are clearly below human levels, some where they are far beyond, and some where they are within human range. The question as to whether or not language models have any form of intelligence has been definitively answered - yes, they can and do - by existence proof.

What definition or description of intelligence do you use such that you doubt that language models could have it? Would you have had this same definition in the year 2010?

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#47
post #37

Earlier quoted context omitted.

I have to disagree. Not releasing it to the public makes it more dangerous. One major downside of all development being done in private is that the AI can very easily be co-opted by our self-appointed betters and you end up with a different kind of dystopia where every utterance, thought and act is recorded and monitored by an AI to make sure no one "steps out of line." I think the solution is releasing it to the gen…

I agree. Overall the whole situation feels like we’ve just entered atomic age and are proliferating plutonium, while selling shiny radioactive toys [I’m actually pretty serious here, the effects of prolonged interactions with an AI haven’t been evaluated yet, technically there is even a possibility of overriding a weak personality]. But it still feels like it is much safer to let GPT-4 loose and assess the consequenc…

For sure. Just to be clear, I'm not saying the situation we're in where we have to release it to the general public is a great situation to be in. But I think we're at a point where there's not any optimal solutions, only tradeoffs.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#48
post #22

I wonder are they using these autonomous GPT loops to control DAOs? https://en.wikipedia.org/wiki/Decentralized_autonomous_organ...

Since GPT4 was released I have been trying to find a paper that I read a few years ago, for some reason your comment was the spark that made me remember the title:

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2954173

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#49
post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

Can someone explain to me what is so dangerous here? Do people actually think we’re headed towards James Cameron’s terminator and soon ChatGPT will become self aware and destroy us? I am far more afraid of tools to edit viruses becoming cheap and widely available, then one nutjob in his garage can engineer and release smallpox v2.0 and wipe out 90% of the worldwide population before we even know what hit us. Or you know, the nonstop background threat of global nuclear war. Compared to that I don’t see what is so alarming about an advanced chat bot.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#50
post #37
post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

I have to disagree. Not releasing it to the public makes it more dangerous. One major downside of all development being done in private is that the AI can very easily be co-opted by our self-appointed betters and you end up with a different kind of dystopia where every utterance, thought and act is recorded and monitored by an AI to make sure no one "steps out of line." I think the solution is releasing it to the gen…

My opinion is that the "self-appointed betters" scenario is the lesser of two evils - it is still evil but there is no going back on that one now.

As to "white hat researchers who have their own AI bot swarm", the assumption here is that the swarm can be controlled like some sort of pet. Since even at this early stage no one has a clue how GPT (say) actually manages to be as clever as it is, the assumption is not warranted when looking into the future.

Post reply on HN