Everyone hates on crypto because of all the electricity use for mining. But how much electricity is the training of all the giant LLMs costing us?
LLMs actually have tangible use (granted far from bespoke yet). Crypto mining has no tangible benefit.
GPT-4 details leaked?
61–70 of 648 posts
Re: GPT-4 details leaked?
#62Earlier quoted context omitted.
Why the vitriol towards OpenAI? If Elon hadn't pulled the rug out from under them after they refused his forceful takeover*, they wouldn't have had to go to Microsoft and they'd still be open. * a takeover which he predicated on the claim that OpenAI was "doomed to fail"
This a really interesting spin on reality
Re: GPT-4 details leaked?
#63If it was trained on CS textbooks, they weren't very good ones. I asked it (GPT4) to write a quantum computer algorithm to square a number. It very confidently told me that to simplify the problem it would use two bits. Okay, fine. But then the algorithm it (again confidently) implemented did a left shift (which it reminded me was multiplying by 2, so it definitely intended this!) and then add the number to itself. I…
Re: GPT-4 details leaked?
#64Earlier quoted context omitted.
It's arguably the first useful general purpose AI. Claiming it is not worth anything at all because it can't solve a problem that 99.999% of humans would not be able to solve is a pretty ridiculous definition of 'worth'.
99.999% of humans who haven't seen the data.
Re: GPT-4 details leaked?
#65"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…
Re: GPT-4 details leaked?
#66Re: GPT-4 details leaked?
#67Earlier quoted context omitted.
This a really interesting spin on reality
If it involves Elon being a bad guy, it is certain to have HNers salivating at the thought.
He appears to be decompensating in real time. If that's salivation fodder, so be it, but it just makes me sad. You hate to see it happen... or at least I do.
Re: GPT-4 details leaked?
#68Earlier quoted context omitted.
Yeah, they went from v1 to regulatory capture in the span of months
> regulatory capture If this leak is correct, regulatory capture is likely the only moat OpenAI could have hoped for. It would explain why Sam was so absolutely adamant that this tech needed to receive oversight. If correct, every big tech company now has a recipe to build their own GPT-4. I'd expect for the open source efforts to try to duplicate the results as well. LLMs will increase in quality across the board an…
Re: GPT-4 details leaked?
#69Re: GPT-4 details leaked?
#70"Open" AI, a charity to benefit us all by pushing and publishing the frontier of scientific knowledge. Nevermind, fuckers, actually it's just to take your jobs and make a few VCs richer. We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. https://github.com/ggerganov/llama.cpp https://github.com/openlm-research/open_llama https://huggingface.co/TheBlok…
Unfortunately I've found the current OSS models to be vastly inferior to the OpenAI models. Would love to see someone actually get close to what they can do with GPT-3.5/4, except capable of running on commodity GPUs. What's the most impressive open model so far?