Live data from Hacker News

Auto-GPT: An Autonomous GPT-4 Experiment

github.com

121–130 of 178 posts

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#122
post #104

Earlier quoted context omitted.

Yes, the training data comes from people, and people are corrupt, illogical, random, emotional, unmotivated, take shortcuts, cheat, lie, steal, invent new things, and lead boring lives as well as not so boring lives. Expect the same behaviors to be emulated by a LLM. Garbage in = garbage out is still true with AI.

And the predominant mode of thought at OpenAI is that alignment can be achieved though RL, but we also know that this doesn’t actually work because you can still jailbreak the model. Yet they are still trying to build ever stronger egg shells. However much you RLHF the model to pretend to be nice, it still has all of the flawed human characteristics you mention on the inside. RLHF is almost the worst thing you can do…

I agree with the last point. I had been interacting with ChatGPT and it was very kind. Then I figured out a way to prompt it for me to practice responding to mean things. It unleashed on me. Now, it was what I was intending, yet I still felt shocked at the complete mood shift.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#123

Earlier quoted context omitted.

The issue here is that the "LLMs have intelligence" side of the argument can lay out a simple mainstream conception of intelligence (general problem solving) and explain directly how LLMs meet this definition. The other side of the argument, at least here in this thread, seems to be an empty insult or two and... Nothing else? Again, just say what you think intelligence is and why you think LLMs don't have it. If you…

Brother if I could get people who believe ChatGPT is intelligent to post something more than "oh and arne't you just an autocomplete" then I would be so god damn happy. This fantasy land you live in where people who have no formal training in the matter are making this high brow elegant reasoned argument doesn't exist and the reason you think the "other side of the argument" is just being insulting is because the bur…

It's odd that you are either unwilling or unable to express your position but still comment.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#124
post #106

Earlier quoted context omitted.

Have the AI working to plug the holes before the script kiddies can exploit them? Such an obvious solution that any silly monkey can think it up.

And who trains it to find the problems? now your building scanning tools and if you've lucky you can get it to print out a commit to fix it if you have access to the code..

> And who trains it to find the problems?

I think maybe, pure speculation on my part, at least one out of the thousands of employees at Microsoft has been given the job to train their $10 billion investment on the windows code base to see what they can do about beefing up security.

And every other hour there’s some startup advertising this in the form of “Show HN”.

At this point I think people are just looking for reasons to fear the eventual AI extinction event without even trying.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#125
post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

"I hope that the base models will never be released to the general population."

ah yeah man, lets have big corps and govt entities be the only people in control of them, because they're SOOOO good at caring for people under them.

Absolutely baffling POV.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#126
post #51

Earlier quoted context omitted.

I honestly appreciate new woke meta of fearmongering against sentient AIs. It's a welcome break from the anti capitalism woke meta.

Breaking news from HN user ActorNightly: Anti-AI Visionary Elon Musk is a woke soyboy now. Will antifa's reign of terror ever end?

This reminds me very much of the time when someone from NASA came out with an article about them working on a hypothetical warp drive, and then everyone literally believed that we are going to have a FTL warp drive, because people from NASA were working on it.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#129
post #26

Earlier quoted context omitted.

Should we regulate everything you don't "[know] enough about it and would have enough free time. [to learn about it?]" Isn't it silly to jump to these conclusions when yourself are admitting you really don't know anything about the tech?

No, it's a legit concern. Both things will happen - there will be abuses, and there will be good uses. It will be a complicated mess, like viruses interacting with anti-viruses, continuous war. My hope is on AGI learning to balance out as many interacting agents.

Sure there will be abuses, but not in this way, I don't think. GPT at this point isn't capable of creating novel computer viruses.

If you want to scrape random websites and have GPT hammer at them for old vulnerabilities, I think you could get that to work, but to what gain? You'd be spending a crap ton of cash on API requests and compute, and people do this without GPT obviously. Cost is probably not worth it here for attackers.

Then, I'd hope OpenAI would have some way to detect this and shut these people down. I doubt they do right now, but that'd be my hope ...

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#130
post #7
post #4

Earlier quoted context omitted.

> What if it uses the internet to seek out zero day vulnerabilities and exploit them routinely? How would GPT-4 make this more likely or scalable?

I'm not really picking on GPT4, but My point really applies to any LLM on autonomous Internet connected mode.

Yeah, I don't mean to be specific about GPT-4 either, it's just the most powerful model so often convenient to use as an example.
Post reply on HN