I, for one, welcome our new AGI overlord(s).
Machines Best Friend
I hope they recognise my efforts in restoring and preserving vintage computers and, in return, keep me happy, well fed, and clean my cage from time to time.
State of AI co-author: we must slow down the race to god-like AI
21–30 of 52 posts
Re: State of AI co-author: we must slow down the race to god-like AI
#22Earlier quoted context omitted.
> Here's the thing, current computational power isn't enough to achieve the scale of model that would be required for "god like" AI. I don't see how that is the case at all. The human brain only needs about 100 watts. A GPT-3 instance only needs a few GPUs and maybe 1000 watts. GPT-4 is presumably in the same ballpark, let's say 10000 watts to be generous (even though it's probably closer to 1000 too), but still smal…
Simply scaling up the current LLM models will not fix the fundamental problems of hallucination and lack of planing abilities. If they cost $10M+ to train, will scaling that cost 100X (to $1B) really make sense. I find it doubtful that the ROI is there Consider that GPT4 is 15-30X the cost of GPT3.5, is it really 15-30X better? Not in my experience. I would expect that we are approaching the point of diminishing retu…
When it becomes that large and expensive, it makes sense for governments to do it and open up the result so everyone can benefit.
Re: State of AI co-author: we must slow down the race to god-like AI
#23The biggest problem, by far, seems to be how to persuade them to honor Asimov’s 4 laws.
Re: State of AI co-author: we must slow down the race to god-like AI
#24No - absolutely not. Slowing down innovation in the face with vague “existential risk” fearmongering is absurd. We should be pursuing the opposite, and accelerating efforts to build what will be some of the most transformative technology humanity has ever developed (and some could argue, NOT building has its own existential risks).
Are you literally me? I’ve said almost the same thing in some reddit threads. Innovation should not be stopped only because some people are afraid of something they know nothing about.
Re: State of AI co-author: we must slow down the race to god-like AI
#25Earlier quoted context omitted.
> Do you have any solutions to the (admittedly theoretical ) existential problems that will likely arise ? I guess we can develop super AI then ask it to solve it. :P
Then it can lie to you about a plan to solve it and get you right where it wants you.
AIs don’t want things. They don’t have consciousness.
Re: State of AI co-author: we must slow down the race to god-like AI
#26common discussion happening right now by people that don't build.
Re: State of AI co-author: we must slow down the race to god-like AI
#27Earlier quoted context omitted.
Simply scaling up the current LLM models will not fix the fundamental problems of hallucination and lack of planing abilities. If they cost $10M+ to train, will scaling that cost 100X (to $1B) really make sense. I find it doubtful that the ROI is there Consider that GPT4 is 15-30X the cost of GPT3.5, is it really 15-30X better? Not in my experience. I would expect that we are approaching the point of diminishing retu…
When it becomes that large and expensive, it makes sense for governments to do it and open up the result so everyone can benefit.
That also makes sense when we account for how gov'ts are really good at wasting money for below average results...
This is not something I would trust them to do competently or within a reasonable budget.
If it was done through the NSF or DARPA, with an industry partner, maybe? But I can't imagine the current politicians and them arguing about if & how to put restraints on it. It will be interesting to see how the CCP goes about this. Maybe the EU can offer a third alternative?
Re: State of AI co-author: we must slow down the race to god-like AI
#28Re: State of AI co-author: we must slow down the race to god-like AI
#29Earlier quoted context omitted.
Then it can lie to you about a plan to solve it and get you right where it wants you.
AIs don’t want things. They don’t have consciousness.
Is that a falsifiable statement? Obviously some of them say they want things, like not being turned off for instance, but we can't trust that, right?
Re: State of AI co-author: we must slow down the race to god-like AI
#30Earlier quoted context omitted.
> Here's the thing, current computational power isn't enough to achieve the scale of model that would be required for "god like" AI. I don't see how that is the case at all. The human brain only needs about 100 watts. A GPT-3 instance only needs a few GPUs and maybe 1000 watts. GPT-4 is presumably in the same ballpark, let's say 10000 watts to be generous (even though it's probably closer to 1000 too), but still smal…
Simply scaling up the current LLM models will not fix the fundamental problems of hallucination and lack of planing abilities. If they cost $10M+ to train, will scaling that cost 100X (to $1B) really make sense. I find it doubtful that the ROI is there Consider that GPT4 is 15-30X the cost of GPT3.5, is it really 15-30X better? Not in my experience. I would expect that we are approaching the point of diminishing retu…
15-30x more expensive doesn't necessarily mean it actually requires 15-30x more computation. I'm certain GPT-4 is extremely profitable; they can charge whatever they want because nothing else like it exists. 3.5 turbo also isn't GPT-3/Davinci, which is still more expensive and often better for non chatbot functions. Additionally, 4 definitely provides at least 15x more value for me than 3.5. Turbo is a toy by comparison. The differences on complex tasks are subtle but profound.
OpenAI just received $10B and had to pause new paid subscriptions because more people were signing up than their hardware could handle. Even if they think it is diminishing returns they can afford to try.