Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Auto-GPT: An Autonomous GPT-4 Experiment

github.com

Post reply on HN
Print view View original

91–100 of 178 posts

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#91

Post by GistNoesis »

inciampati wrote: post #67
startupsfail wrote: post #55

Earlier quoted context omitted.

The problem is, human intelligence is likely also based on a similar advanced chat bot setup. While GPT-4 only performs as good as top-10th percentile of human students taking an exam (a professional in the field can do much more than this), it is notable that as a generalist GPT-4 would outperform such professionals. And GPT-4 is much faster than a human. And we have not yet evaluated GPT-4 working in its optimal se…

Alas, if it could only remember and precisely relate more than 4k or 8k or 32k or 64k words... And if only scaling that context length weren't quadratic... Indeed, we would really expect an AI to be able to achieve AGI. And it might decide to do all kinds of alien things. The sky would not be the limit! We have more than 100 trillion synapses in our brains. That's not our "parameter" count. It's the size of the thing…

>And if only scaling that context length weren't quadratic...

There are transformers approximations that are not quadratic (available out of the box since more than a year) :

Two schools of thoughts here :

- People that approximate the neighbor search with something like "Reformer" and O(L log(L) ) time and memory complexity.

- People that use a low-rank approximation of the attention product with something like "Linformer" with O(L) complexity but with more sensibility to transformer rank collapse

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#92

Post by swader999 »

jliptzin wrote: post #49
sorokod wrote: post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

Can someone explain to me what is so dangerous here? Do people actually think we’re headed towards James Cameron’s terminator and soon ChatGPT will become self aware and destroy us? I am far more afraid of tools to edit viruses becoming cheap and widely available, then one nutjob in his garage can engineer and release smallpox v2.0 and wipe out 90% of the worldwide population before we even know what hit us. Or you k…

What's dangerous is that it will amplify both the good and bad in society.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#93

Post by krainboltgreene »

startupsfail wrote: post #55
jliptzin wrote: post #49

Earlier quoted context omitted.

Can someone explain to me what is so dangerous here? Do people actually think we’re headed towards James Cameron’s terminator and soon ChatGPT will become self aware and destroy us? I am far more afraid of tools to edit viruses becoming cheap and widely available, then one nutjob in his garage can engineer and release smallpox v2.0 and wipe out 90% of the worldwide population before we even know what hit us. Or you k…

The problem is, human intelligence is likely also based on a similar advanced chat bot setup. While GPT-4 only performs as good as top-10th percentile of human students taking an exam (a professional in the field can do much more than this), it is notable that as a generalist GPT-4 would outperform such professionals. And GPT-4 is much faster than a human. And we have not yet evaluated GPT-4 working in its optimal se…

> The problem is, human intelligence is likely also based on a similar advanced chat bot setup.

This is so wildly wrong and yet confidently said in every techbro post about LLMs. I beg of you to talk to an expert.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#94

Post by krainboltgreene »

anotherpaulg wrote: post #70

I had ChatGPT write an entire web app for me last week. I was surprised at how capable it was. Here's a writeup of my workflow: https://github.com/paul-gauthier/easy-chat Basically all of the code in that repo was written by ChatGPT.

I have never felt more safe about my job.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#95

Post by dilyevsky »

startupsfail wrote: post #87
inciampati wrote: post #83

Earlier quoted context omitted.

Indeed, and maybe less than 7... I'll point out that chatgpt needs to be paying attention to the numbers to remember them in the way I'm taking about. You will need to fine tune it or something to get it to remember them blind. I suppose that's not what you're talking about? There is a strong chance that I'll remember where to find these numbers in a decade, after seeing and hearing untold trillions of "tokens" of in…

When doing the processing GPT remembers these in the “working memory” (very similar to your working memory that is just an actuation of neurons, not an adjustment of the strengths of synaptic connections). And then, there is a chance that the inputs and outputs of GPT be saved and then used for fine-tuning. In a way that is similar to long-term memory consolidation in humans. But overall, yes, I agree, GPT-4 in an em…

It doesn’t remember anything unless you mean that intermediate values in calculation of forward pass is “remembering”. The prompt continuation feature is just a trick where they refeed previous questions/replies back to it with new questions at the end

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#96

Post by krainboltgreene »

pixl97 wrote: post #79
mjr00 wrote: post #68

Earlier quoted context omitted.

> Would you settle for "behave exactly as if they had some form of intelligence"? Sure, it behaves as if it has some form of intelligence in the sense that it can take external input, perform actions in reaction to this input, and produce outputs dependent on the input. This historically has been known as a computer program.

You're a computer program?

Never fails that when a techbro has been told LLMs aren't what they think they fall back to a field they certainly have more authority on: The human brain/intelligence.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#98

Post by josephg »

jliptzin wrote: post #65
startupsfail wrote: post #55

Earlier quoted context omitted.

The problem is, human intelligence is likely also based on a similar advanced chat bot setup. While GPT-4 only performs as good as top-10th percentile of human students taking an exam (a professional in the field can do much more than this), it is notable that as a generalist GPT-4 would outperform such professionals. And GPT-4 is much faster than a human. And we have not yet evaluated GPT-4 working in its optimal se…

But where is the imminent danger? It is still limited in many ways. For example, it can be turned off or unplugged. Is it because CAPTCHAs won’t work anymore? That sounds like a problem for sites like Twitter that have bot problems. Is it because it may replace people’s jobs? That comes with every technological step forward and there’s always alarmist ludditism to accompany it. Is it because bad people will use it to…

There are two big concerns:

1. GPT-8 or something is able to do 70% of people’s jobs. It can write software, drive cars, design industrial processes, build robots and manufacture anything we can imagine. This is a great thing in the long term, but in the short term society is designed where you need to work in order to have food to eat. I expect a period of rioting, poverty, and general instability.

All we need for this to be the case is a human level AI.

2. But we won’t stop improving AIs when they operate at human level. An ASI (artificial superintelligence) would be deeply unpredictable to us. Trying to figure out what an ASI will do is like a dog trying to understand a human. If we make an ASI that’s not properly aligned with human interests, there’s a good chance it will kill everyone. And unfortunately, we might only get one chance to properly align it before it escapes the lab and starts modifying its own code.

Smart people disagree on how likely these scenarios are. I think (1) is likely within my lifetime. And I think it’s very unlikely we stop improving AIs when they’re at human levels of intelligence. (GPT4 already exceeds human minds in the breadth of its long term memory and its speed.)

That’s why people are worried, and making nuclear weapon analogies in this thread.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#99

Post by UncleEntity »

amrb wrote: post #52
smodad wrote: post #37

Earlier quoted context omitted.

I have to disagree. Not releasing it to the public makes it more dangerous. One major downside of all development being done in private is that the AI can very easily be co-opted by our self-appointed betters and you end up with a different kind of dystopia where every utterance, thought and act is recorded and monitored by an AI to make sure no one "steps out of line." I think the solution is releasing it to the gen…

So there's this little problem, say we can track X number of malware with the current security defenders. But ChatGPT lowers the barrier to programmer to a point which the average teenage could do malware, we now get a wave of hacks going on.. like whats the response there?

Have the AI working to plug the holes before the script kiddies can exploit them?

Such an obvious solution that any silly monkey can think it up.

Re: Auto-GPT: An Autonomous GPT-4 Experiment

#100

Post by Riverheart »

smodad wrote: post #37
sorokod wrote: post #12

AI needn't even try to escape, the clueless humans will plug it into reallity by themselves. Given this totally expected attitude I hope that the base models will never be released to the general population.

I have to disagree. Not releasing it to the public makes it more dangerous. One major downside of all development being done in private is that the AI can very easily be co-opted by our self-appointed betters and you end up with a different kind of dystopia where every utterance, thought and act is recorded and monitored by an AI to make sure no one "steps out of line." I think the solution is releasing it to the gen…

How does releasing AI to everyone prevent AI from being used by authoritarian Govs to monitor everything? Well the three letter agencies would spy on the public but Uncle Bob has an AI and who knows what he might do with it. If anything the more people working on AI is going to make that dystopia a reality faster.
Post reply on HN