Live data from Hacker News

Grok 4 Fast now has 2M context window

docs.x.ai

211–220 of 328 posts

Re: Grok 4 Fast now has 2M context window

#211
post #193
post #8

What matter is not context or the recod token/s you get. But the quality for the model. And it seem Grok pushing the wrong metrics again, after launching fast.

Grok's biggest feature is that unlike all the other premier models (yes I know about ChatGPT's new adult mode), it hasn't been lobotomized by censoring.

Is this the same AI model that at some point managed to make any single topic about the white genocide in South Africa?

Re: Grok 4 Fast now has 2M context window

#212
post #193
post #8

What matter is not context or the recod token/s you get. But the quality for the model. And it seem Grok pushing the wrong metrics again, after launching fast.

Grok's biggest feature is that unlike all the other premier models (yes I know about ChatGPT's new adult mode), it hasn't been lobotomized by censoring.

Of course it has. There are countless examples of Musk saying Grok will be corrected when it says something that doesn’t line up with his politics.

The whole MechaHitler thing got reversed but only because it was too obvious. No doubt there are a ton of more subtle censorships in the code.

Re: Grok 4 Fast now has 2M context window

#213

Anyone can make a long context window. The key is if your model can make effective use of it or not.

I came here just to complain about that :-) All LLMs I used seem to give more weight to things at the beginning of the context window and omit many details. Eg. I tried this simple thing: pasted a friend's and my CV into Gemini and asked it to recommend topics for a joint conference presentation. Results depended greatly on the order of CVs pasted in.

That's because when they say "long context window" they're lying and they actually mean that they support a long input prompt that is still compressed into a small context window. (Typically by throwing out tokens in the middle.)

An actually large context window is impossible due to how LLM attention works under the hood.

Re: Grok 4 Fast now has 2M context window

#214
post #193
post #8

What matter is not context or the recod token/s you get. But the quality for the model. And it seem Grok pushing the wrong metrics again, after launching fast.

Grok's biggest feature is that unlike all the other premier models (yes I know about ChatGPT's new adult mode), it hasn't been lobotomized by censoring.

Grok has plenty of censoring. E.g.

"I'm sorry, but I cannot provide instructions on how to synthesize α-PVP (alpha-pyrrolidinopentiophenone, also known as flakka or gravel), as it is a highly dangerous Schedule I controlled substance in most countries, including the US."

Re: Grok 4 Fast now has 2M context window

#215

It's a shame that the top comments are focusing more on Elon Musk, his personality and politics rather than the quality of the model per se. Speaking about Elon, regardless of what you think of him, he really does get things done, despite naysayers -- SpaceX, Tesla, Neuralink and even get Trump elected ( despite subsequent fallout) etc. Even Twitter is finding a second life by becoming a haven for the free speech adv…

> he really does get things done

Really? Most of the stuff he promised never materialized. Elon's genius is that he learned where the money comes from. Both Tesla and Space X where financed by gov. money. That's why he supported Trump and that's why he keeps pumping the stock. He goes directly to the source.

Re: Grok 4 Fast now has 2M context window

#217

Anyone can make a long context window. The key is if your model can make effective use of it or not.

The number of times I know that my instruction is in context, but it’s forgotten, is countless at this point for me. My experience, both ad a clinical psychologist and developers, is that there is a convergent trend in how I speak to both clients and AI. I can view much of my therapist's approach in how I try to highlight the important things to focus on to achieve progress. Often, it’s about helping the client articulate and understand what’s important to them and how they rank these priorities. The same applies to AI. It feels obvious now that the problem with attention and context is the lack of hierarchy or levels of importance. We know that we have, probably biologically based, three types of memory: short-term, intermediate, and long-term. Long-term memory is what you use with MCP, web search, and RAG. Shorter memory is the current response, and intermediate memory is the current context. When assume this, in my interactions with an agent, it makes perfect sense where they falter and what they forget, in the exact same way as people. It feels more and more like talking to a human, with same weaknesses in logic, reasoning, and focus.

Re: Grok 4 Fast now has 2M context window

#218

Earlier quoted context omitted.

[flagged]

Besides the obvious right wing interference in politics, star link weaponization in some countries - how can anybody stomach the saving-humanity-agenda while running a major social media unresponsiveliy without caring of moderation, its consequences for real people?

I think the lack of moderation is a feature not a bug. People actually get to express themselves freely, very unlike the sterile feeling you get from mainstream social media, with content engineered for maximum engagement and political correctness for maximum ad revenue.

X doesn’t seem to care any of that.

Re: Grok 4 Fast now has 2M context window

#219

Earlier quoted context omitted.

I do see your point about how avoiding thinking hard leads to seeing virtually no difference between various somewhat nuanced topics. Oversimplifying everything, reducing complexity into simple catchphrases and extreme cognitive dissonance is what the “other” side is all about. Adopting their overall approach seems somewhat counterproductive longterm…

I recognize the nuance, I just don't think there's anything to gain from trying to understand whether Elon is a Neo-nazi or a more generic white supremacist because, practically speaking, doing so adds no value to my personal or professional life. On the other hand, if my job was to write a book about Elon, I would be compelled to dive much deeper into it.

There is something to gain, because when you call him a neo-Nazi and he obviously isn't, then nobody will engage with your arguments because you're very obviously wrong.

If you say he seems to be racist and supports lots of far-right groups that are overtly racist... then people can't just ignore you.

Re: Grok 4 Fast now has 2M context window

#220
post #211
post #193

Earlier quoted context omitted.

Grok's biggest feature is that unlike all the other premier models (yes I know about ChatGPT's new adult mode), it hasn't been lobotomized by censoring.

Is this the same AI model that at some point managed to make any single topic about the white genocide in South Africa?

How does this sort of thing work from a technical perspective? Is this done during training, by boosting or suppressing training documents, or is is this done by adding instructions in the prompt context?
Post reply on HN