Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grok 4 Fast now has 2M context window

docs.x.ai

Post reply on HN
Print view View original

271–280 of 328 posts

Re: Grok 4 Fast now has 2M context window

#271

Post by Bender »

behnamoh wrote: post #6

Who here actually uses Grok? It's sad to see Elon's arc but when he doubled down on some of his political ideas he had it coming with the Tesla sales going down and x.ai not taken seriously. I've always tried to remain apolitical and unbiased but it's hard to overlook who's behind a technology you wanna buy. Not that sama and others are saints either, it's just Elon's very obvious and vocal about it. It's a shame, re…

I used it to calculate the size of a greenhouse using a lot of inputs and restrictions. It did that fine but the one thing I did not appreciate was its sense of humor. It said the excavator would be here first thing Monday along with a pot of coffee. Just tell me a dad joke or just skip the attempt at humor all together.

Re: Grok 4 Fast now has 2M context window

#272

Post by bko »

mehdibl wrote: post #8

What matter is not context or the recod token/s you get. But the quality for the model. And it seem Grok pushing the wrong metrics again, after launching fast.

I thought the number of tokens per second doesn't matter until I used Grok Code Fast. I realized that it makes a huge difference. If it take more than 30s to run, I lose focus, and look at something else. I end up being a lot less productive. It also opens up the possibility to automate a lot more simple tasks. I would def recommend people try fast models

Re: Grok 4 Fast now has 2M context window

#274

Post by anon214535 »

LorenDB wrote: post #35
behnamoh wrote: post #6

Who here actually uses Grok? It's sad to see Elon's arc but when he doubled down on some of his political ideas he had it coming with the Tesla sales going down and x.ai not taken seriously. I've always tried to remain apolitical and unbiased but it's hard to overlook who's behind a technology you wanna buy. Not that sama and others are saints either, it's just Elon's very obvious and vocal about it. It's a shame, re…

I do! I have felt bad vibes from OpenAI for a while now, and eventually defaulted to Grok as somewhat the lesser of many evils. I respect anybody who doesn't wish to use it, but it's good enough for what I need it for. Case in point: it just spit out valid OpenSCAD code for an adapter piece I want to 3D print.

I don't understand how anyone can think Grok is the lesser of many evils. It seems to me that Grok is currently playing in its own league of evil.

Most models belong to capitalist companies that are fairly apolitical and all they care about is money. Their evil comes from not caring about consequences as long as it grows their value. Their censorship come from the desire to avoid PR disasters.

On the other hand, Grok belongs to a billionaire involved in destroying America's democracy, and it's being openly manipulated according to Musk's ideology. I can't think of a model I would trust less.

Re: Grok 4 Fast now has 2M context window

#275

Post by ben_w »

NotGMan wrote: post #267
BoiledCabbage wrote: post #265

Earlier quoted context omitted.

Nothing you posted (from an almost two year old article btw) in anyway refutes the prior comment. Grok is significantly the most biased. Did you sleep through its continuous insertion of made up stuff about south africa? This is the same person who is trying to re-write an entire encyclopedia because facts aren't biased enough. A group has created an alternate reality echo chamber, and the more reality doesn't match…

[flagged]

Has the possibility occurred to you that the majority of the editors aren't American and don't care about American culture wars?

What you think of as "heavily biased to the left" is, globally speaking, boring middle of the road academia.

Re: Grok 4 Fast now has 2M context window

#276

Post by razingeden »

wqaatwt wrote: post #74
RobKohr wrote: post #32

Earlier quoted context omitted.

I like grok for noncoding stuff. I find it hasn't been tuned for "Safety" (meaning it isn't tuned much for political correctness). It also seems good at making images and stories up well. I run some choose your own adventures stories with my kids through it. We tell it who each of their characters are and what the theme is for the night and grok gives them each a section of story and 4 choices. They also have the opt…

> it isn't tuned much for political correctness It was tuned to be edgy and annoying though (I mean his general style of speech not necessarily the content).

early iterations i could immediately peg as grok content based on its condescending snarky “OOoooOoOo — so much to unpack here sweaty, lets get started” tone.

im open minded and ive fed grok a few requests recently. it was better at doing creative fiction prompts without the “eddie izzard coming down off of a fifteen day coke bender” vibe.

everything i ask it to do is completely made up nonsense so i dont have an opinion about its bias or the quality of its factual content.

snark and clapback made the world go around on xitter. maybe thats what they thought people wanted. savage insulting content to “own” people. i for one, also found it extremely annoying.

Re: Grok 4 Fast now has 2M context window

#278

Post by cronin101 »

sigmoid10 wrote: post #259
saretup wrote: post #12

Earlier quoted context omitted.

Seems reductive. Some applications require higher context length or fast tokens/s. Consider it a multidimensional Pareto frontier you can optimize for.

It's not just that some absolutely require it, but a lot of applications hugely benefit from more context. A large part of LLM engineering for real world problems revolves around structuring the context and selectively providing the information needed while filtering out unneeded stuff. If you can just dump data into it without preprocessing, it saves a huge amount of development time.

Depending on the application, I think “without preprocessing” is a huge assumption here. LLMs typically do a terrible job of weighting poor quality context vs high quality context and filling an XL context with unstructured junk and expecting it to solve this for you is unlikely to end well.

In my own experience you quickly run into jarring tangents or “ghosts” of unrelated ideas that start to shape the main thread of consciousness and resist steering attempts.

Re: Grok 4 Fast now has 2M context window

#279

Post by alyxya »

mehdibl wrote: post #8

What matter is not context or the recod token/s you get. But the quality for the model. And it seem Grok pushing the wrong metrics again, after launching fast.

Quality of the model tends to be pretty subjective, and people also complain about gaming benchmarks. At least context window length and generation speed are concrete improvements. There's always a way you can downplay how valuable or impressive a model is.

Re: Grok 4 Fast now has 2M context window

#280

Post by R_D_Olivaw »

afavour wrote: post #269
NotGMan wrote: post #267

Earlier quoted context omitted.

[flagged]

Can’t help but feel everyone making a pro-Grok argument here isn’t actually making the case that it’s uncensored, rather that it’s censored in a way that aligns with their politics, and thus is good

It's almost always telling isn't it?

Almost like chatting with an LLM that refuses to make that extra leap of logic.

"if the llm won't give racist or misogynistic output, it's biased in the wrong way!"

Post reply on HN