Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 details leaked?

threadreaderapp.com

Post reply on HN
Print view View original

241–250 of 648 posts

Re: GPT-4 details leaked?

#241

Post by arthur_sav »

PostOnce wrote: post #19

"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…

I would love to use these... but they suck. They don't even come close to what OpenAI offers.

Re: GPT-4 details leaked?

#242

Post by ben_w »

grondilu wrote: post #214
PostOnce wrote: post #19

"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…

> try to pressure the government into making it illegal for you to compete with us. I mean the guy who created GPT-4 literally demanded a ban of any system more powerful than GPT-4.

Are you sure that's not a quote from a game of telephone?

What I've seen from the horse's mouth is more like:

"""There are several other areas I mentioned in my written testimony where I believe that companies like ours can partner with governments, including ensuring that the most powerful AI models adhere to a set of safety requirements, facilitating processes to develop and update safety measures, and examining opportunities for global coordination."""

Now, sure, I could probably take a malevolent moustache twirling villain monologue and use chatGPT to turn it into a bland and prosaic statement like that, or even something utterly milquetoast, but if I try to imagine Altman playing 5D chess with the aid of his own AGI, there's the much easier solution of… just not telling anyone you have GPT-4 in the first place while using its power to manipulate etc.

Re: GPT-4 details leaked?

#243

Post by DeathArrow »

YeGoblynQueenne wrote: post #229
PostOnce wrote: post #19

"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…

>> We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. Just to be clear, there's no science being kept secret because there is no science being done. OpenAI's is a feat of engineering, borne aloft by a huge budget supporting a large team whose expertise lies in tuning neural net systems, and not in doing science. Machine learning, as it is practiced to…

Still, the guys developing ML algorithms like Neural nets, Linear regression, Decision tree, SVM, Naive Bayes, KNN etc., weren't doing science?

Re: GPT-4 details leaked?

#244

Post by arthur_sav »

carabiner wrote: post #59
PostOnce wrote: post #19

"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…

We must destroy OpenAI!

Is this how Terminator begins?

Re: GPT-4 details leaked?

#245

Post by amelius »

YeGoblynQueenne wrote: post #229
PostOnce wrote: post #19

"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…

>> We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. Just to be clear, there's no science being kept secret because there is no science being done. OpenAI's is a feat of engineering, borne aloft by a huge budget supporting a large team whose expertise lies in tuning neural net systems, and not in doing science. Machine learning, as it is practiced to…

It's more a science than pure math or CS, since they are producing falsifiable models.

Re: GPT-4 details leaked?

#246

Post by messe »

getmeinrn wrote: post #47

>If their cost in the cloud was about $1 per A100 hour, the training costs for this run alone would be about $63 million. If someone legitimate put together a crowd funding effort, I would donate a non-insignificant amount to train an open model. Has it been tried before?

I too would be interesting in donating money toward this.

Given that the price since the original training effort has already dropped to ~$20 million, and that (a) the fundraising will take time, and (b) improvements are being made every day with regard to resource usage, you could probably get away with aiming for a much lower number.

Pulling a number out of my arse, I'd guess that training a comparable model will only cost $1-5 million in 12 months time, with the hardest part of doing so once you have the funds being acquiring the training data.

Re: GPT-4 details leaked?

#247

Post by DeathArrow »

antupis wrote: post #92
KronisLV wrote: post #76

Earlier quoted context omitted.

> You can use the above without paying OpenAI. You don't even need a GPU. There are no license issues like with the facebook llama. I actually wrote about getting an LLM chatbot up and running a while ago: https://blog.kronis.dev/tutorials/self-hosting-an-ai-llm-cha... It's good that the technology and models are both available for free, and you don't even need a GPU for it. However, there are still large memory requ…

I bet that open models win in the end because porn. There is already very weird and vibrant community creating "waifus" and tinkering with these models.

Porn will save the world again!

Re: GPT-4 details leaked?

#248

Post by DeathArrow »

potatototoo99 wrote: post #210
KronisLV wrote: post #112

Earlier quoted context omitted.

Huh, more power to those folks then, I guess. But I can easily imagine more conventional forms of entertainment, as well. Like a game of D&D that's narrated by the AI, or a text based adventure set in the Mass Effect universe, Lord of the Rings, Warhammer or any other fandom, really. Maybe like those old Choose Your Own Adventure games. I think some companies are also experimenting with characters in video games that…

Do you seriously think D&D and other choose your adventure games will be more popular than porn? Seriously?

If they also include porn, maybe.

Re: GPT-4 details leaked?

#249

Post by DeathArrow »

pyeri wrote: post #139
PostOnce wrote: post #19

"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…

In today's world, "Science equals Capitalism". Or at least Science is allowed to progress and get funded only as long as it serves the interest of Capitalism.

That's engineering, not science.

Re: GPT-4 details leaked?

#250

Post by TeMPOraL »

why_only_15 wrote: post #201
TeMPOraL wrote: post #133

Earlier quoted context omitted.

> "Mixture Of Experts": An "MoE" is an approach in AI that combines multiple specialized AI models, known as "experts," (...) Wonder when that stopped being called just an "ensemble model", which is a term I recall from 10 years ago. Terminology churn?

Mixture of experts is different from ensembles because MoE happens at every layer as opposed to joining the models once at the end

Thanks, that makes sense - and isn't obvious from the explanations I see people give.
Post reply on HN