Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grok 4 Fast now has 2M context window

docs.x.ai

Post reply on HN
Print view View original

41–50 of 328 posts

Re: Grok 4 Fast now has 2M context window

#41

Post by LorenDB »

dmead wrote: post #38
LorenDB wrote: post #35

Earlier quoted context omitted.

I do! I have felt bad vibes from OpenAI for a while now, and eventually defaulted to Grok as somewhat the lesser of many evils. I respect anybody who doesn't wish to use it, but it's good enough for what I need it for. Case in point: it just spit out valid OpenSCAD code for an adapter piece I want to 3D print.

[flagged]

I feel compelled to point out that the Mechahitler thing was prompted by bad actors hiding invisible tokens in tweets, but sure, it's maybe an unpopular opinion.

Basically, the major free options out there for LLMs are OpenAI, Google, Perplexity, DeepSeek, Meta, and Grok. (I could be missing stuff here, but those are the main players.) DeepSeek is out because of China ties. OpenAI and Perplexity have CEOs that seem incredibly shifty to me. I refuse to give Meta and Google any more info than I have to, so I'm avoiding them. Hence we fall back to Grok. Again, maybe not a completely logical progression, but it's my choice and I get to live with the consequences :)

Re: Grok 4 Fast now has 2M context window

#42

Post by andai »

kelsolaar wrote: post #20
behnamoh wrote: post #6

Who here actually uses Grok? It's sad to see Elon's arc but when he doubled down on some of his political ideas he had it coming with the Tesla sales going down and x.ai not taken seriously. I've always tried to remain apolitical and unbiased but it's hard to overlook who's behind a technology you wanna buy. Not that sama and others are saints either, it's just Elon's very obvious and vocal about it. It's a shame, re…

As you point out, Sam Altman is not exactly an altar boy: https://fastcompany.co.za/business/2025-11-07-sam-altmans-tr...

Thought this would be about the whistleblower. They didn't even mention it!

Re: Grok 4 Fast now has 2M context window

#43

Post by vlovich123 »

TheCoolGuy wrote: post #11
chucknthem wrote: post #4

Earlier quoted context omitted.

How do they make the context window longer? (serious question, I want to learn how this works)

You literally just shift the window over by to the next token once you reach the max amount of tokens you want for context window, NOT with what you train on, (only limited with memory now) This has obvious issues since you're now losing information from the now unseen tokens which becomes significant if your context window is small in comparision of the answer/question you're looking at. That's why companies try to…

That’s a very basic way to keep the LLM inferring past the context window size (there’s better, smarter ways) but that’s not at all what the question was which is how they train a 2M token length window. My understanding at a basic level is that you need corpuses that are >2M in length for training data which is where the problem comes in for - there’s only so much long form content and it’s swamped by all the smaller stuff. I think there’s probably tricks now but I suspect it’s still largely an open problem.

Re: Grok 4 Fast now has 2M context window

#45

Post by dmead »

LorenDB wrote: post #41
dmead wrote: post #38

Earlier quoted context omitted.

[flagged]

I feel compelled to point out that the Mechahitler thing was prompted by bad actors hiding invisible tokens in tweets, but sure, it's maybe an unpopular opinion. Basically, the major free options out there for LLMs are OpenAI, Google, Perplexity, DeepSeek, Meta, and Grok. (I could be missing stuff here, but those are the main players.) DeepSeek is out because of China ties. OpenAI and Perplexity have CEOs that seem i…

The best ones are out for... Reasons? This seems completely bad faith and honestly really Elon musk fanboyish.

Literally none of this options you listed are that objectionable.

Do what the rest of us do and switch frequently. Don't use mekafurhur and you'll be fine.

Re: Grok 4 Fast now has 2M context window

#47

Post by ronsor »

dmead wrote: post #38
LorenDB wrote: post #35

Earlier quoted context omitted.

I do! I have felt bad vibes from OpenAI for a while now, and eventually defaulted to Grok as somewhat the lesser of many evils. I respect anybody who doesn't wish to use it, but it's good enough for what I need it for. Case in point: it just spit out valid OpenSCAD code for an adapter piece I want to 3D print.

[flagged]

I find it funny that people are still calling Grok "mechahitler" as if that weren't prompted by trolls and the AI model is going to set up concentration camps on every block.

Re: Grok 4 Fast now has 2M context window

#48

Post by ronsor »

This post really has no reason to be flagged. I know Elon is controversial, and I have a lot of gripes with his business practices myself, but this is literally just documentation for a frontier LLM. Can we stay on topic?

Re: Grok 4 Fast now has 2M context window

#50

Post by chistev »

behnamoh wrote: post #6

Who here actually uses Grok? It's sad to see Elon's arc but when he doubled down on some of his political ideas he had it coming with the Tesla sales going down and x.ai not taken seriously. I've always tried to remain apolitical and unbiased but it's hard to overlook who's behind a technology you wanna buy. Not that sama and others are saints either, it's just Elon's very obvious and vocal about it. It's a shame, re…

What models are better than Grok?
Post reply on HN