Live data from Hacker News

GPT-4 details leaked?

threadreaderapp.com

61–70 of 648 posts

Re: GPT-4 details leaked?

#61
post #54

Everyone hates on crypto because of all the electricity use for mining. But how much electricity is the training of all the giant LLMs costing us?

LLMs actually have tangible use (granted far from bespoke yet). Crypto mining has no tangible benefit.

To be fair, it’s still early for crypto. The best use cases of the technology are yet to emerge.

Re: GPT-4 details leaked?

#62
post #40

Earlier quoted context omitted.

Why the vitriol towards OpenAI? If Elon hadn't pulled the rug out from under them after they refused his forceful takeover*, they wouldn't have had to go to Microsoft and they'd still be open. * a takeover which he predicated on the claim that OpenAI was "doomed to fail"

This a really interesting spin on reality

If it involves Elon being a bad guy, it is certain to have HNers salivating at the thought.

Re: GPT-4 details leaked?

#63

If it was trained on CS textbooks, they weren't very good ones. I asked it (GPT4) to write a quantum computer algorithm to square a number. It very confidently told me that to simplify the problem it would use two bits. Okay, fine. But then the algorithm it (again confidently) implemented did a left shift (which it reminded me was multiplying by 2, so it definitely intended this!) and then add the number to itself. I…

I must be getting old, because GPT-4 is basically magic compared to what has come before... and just a few months in people are happily dunking on it.

Re: GPT-4 details leaked?

#64
post #41

Earlier quoted context omitted.

It's arguably the first useful general purpose AI. Claiming it is not worth anything at all because it can't solve a problem that 99.999% of humans would not be able to solve is a pretty ridiculous definition of 'worth'.

99.999% of humans who haven't seen the data.

If you had just spent 90 days observing the equivalent of millions of books what are the odds you could recall even one thing from each of them.

Re: GPT-4 details leaked?

#65

"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…

Unfortunately I've found the current OSS models to be vastly inferior to the OpenAI models. Would love to see someone actually get close to what they can do with GPT-3.5/4, except capable of running on commodity GPUs. What's the most impressive open model so far?

Re: GPT-4 details leaked?

#66

Earlier quoted context omitted.

LLMs actually have tangible use (granted far from bespoke yet). Crypto mining has no tangible benefit.

To be fair, it’s still early for crypto. The best use cases of the technology are yet to emerge.

Since 12 years?

Re: GPT-4 details leaked?

#67
post #62
post #40

Earlier quoted context omitted.

This a really interesting spin on reality

If it involves Elon being a bad guy, it is certain to have HNers salivating at the thought.

At this point, after attempting to start a literal fight with Zuckerberg, Musk is proposing a penis-measuring contest.

He appears to be decompensating in real time. If that's salivation fodder, so be it, but it just makes me sad. You hate to see it happen... or at least I do.

Re: GPT-4 details leaked?

#68
post #49

Earlier quoted context omitted.

Yeah, they went from v1 to regulatory capture in the span of months

> regulatory capture If this leak is correct, regulatory capture is likely the only moat OpenAI could have hoped for. It would explain why Sam was so absolutely adamant that this tech needed to receive oversight. If correct, every big tech company now has a recipe to build their own GPT-4. I'd expect for the open source efforts to try to duplicate the results as well. LLMs will increase in quality across the board an…

Just wait until the RLHF class action hits them.

Re: GPT-4 details leaked?

#70

"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…

Unfortunately I've found the current OSS models to be vastly inferior to the OpenAI models. Would love to see someone actually get close to what they can do with GPT-3.5/4, except capable of running on commodity GPUs. What's the most impressive open model so far?

Probably Wizard 30B, they released the training weights at every offset as well.
Post reply on HN