GPT-4 details leaked?
threadreaderapp.com
GPT-4 details leaked?
1–10 of 648 posts
Re: GPT-4 details leaked?
#2Previously posted about here: https://news.ycombinator.com/item?id=36671588 and here: https://news.ycombinator.com/item?id=36674905
With the original source being: https://www.semianalysis.com/p/gpt-4-architecture-infrastruc...
The twitter guy seems to just be paraphrasing the actual blog post? That's presumably why the tweets are now deleted.
---
The fact that they're using MoE was news to me and very interesting. I'd love to know more details about how they got that to work. Variations in that implementation would explain the fluctuations in the quality of output that people have observed.
I'm still waiting for the release of their vision model which is mentioned here but we still know little about, sans a few demos a few months ago.
Re: GPT-4 details leaked?
#3[deleted]
Re: GPT-4 details leaked?
#4Re: GPT-4 details leaked?
#5No, this is fake, a light dusting of nothing on top of a meme post that was circulating in grifting communities as early as Q4 2022. It gains a little bit in every retelling, sort of impressive to see its almost blog scale.
Re: GPT-4 details leaked?
#6No, this is fake, a light dusting of nothing on top of a meme post that was circulating in grifting communities as early as Q4 2022. It gains a little bit in every retelling, sort of impressive to see its almost blog scale.
That explains why an ad when I tried to click through to the tweet.
Re: GPT-4 details leaked?
#7> It is over.
What does this mean?
Re: GPT-4 details leaked?
#8No, this is fake, a light dusting of nothing on top of a meme post that was circulating in grifting communities as early as Q4 2022. It gains a little bit in every retelling, sort of impressive to see its almost blog scale.
No, a meme post from 2022 did not in fact reference papers posted in 2023.
You must be thinking of some other post, or you're just making stuff up.
Re: GPT-4 details leaked?
#9Previously posted about here: https://news.ycombinator.com/item?id=36671588 and here: https://news.ycombinator.com/item?id=36674905 With the original source being: https://www.semianalysis.com/p/gpt-4-architecture-infrastruc... The twitter guy seems to just be paraphrasing the actual blog post? That's presumably why the tweets are now deleted. --- The fact that they're using MoE was news to me and very interesting. I…
The previous posts are to a twitter thread that's been taken down, and the preview of a post that requires a $1000 subscription. This post however is freely available (for now at least).
Re: GPT-4 details leaked?
#10Previously posted about here: https://news.ycombinator.com/item?id=36671588 and here: https://news.ycombinator.com/item?id=36674905 With the original source being: https://www.semianalysis.com/p/gpt-4-architecture-infrastruc... The twitter guy seems to just be paraphrasing the actual blog post? That's presumably why the tweets are now deleted. --- The fact that they're using MoE was news to me and very interesting. I…
I had to ask GPT what MoE means:
"MoE" in the context of artificial intelligence typically stands for "Mixture of Experts". This is a machine learning technique that is based on the idea of dividing a problem into sub-problems, solving each sub-problem with a specialized "expert" (or model), and then combining their outputs.