Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grok 4.3

docs.x.ai

Post reply on HN
Print view View original

311–320 of 608 posts

Re: Grok 4.3

#311

Post by Ukv »

ToucanLoucan wrote: post #294
aembleton wrote: post #285

Earlier quoted context omitted.

> You’re literally just using three different slot machines and claiming one is hot. It's a fair point. I haven't tested many queries across them all and checked their answers, but if I want to ask one of them a question - right now its Grok just because I trust its answers more.

It's not a methodology problem, it's a test-ability problem. LLMs are not deterministic. You can ask the same question to the same LLM five times and you'll likely get at least 3 answers. Again. Slot machine.

You can meaningfully test if one slot machine hits the jackpot more often than another, just that the methodology should involve a large number of repeats rather than a few anecdotes. There are some LLM leaderboard sites that do it with blind comparisons.

Re: Grok 4.3

#312

Post by wyre »

raincole wrote: post #176
Cakez0r wrote: post #144

Earlier quoted context omitted.

If someone from Grok is reading, don't waste time on these chaff features. The market will eventually deliver better 3rd party solutions to all of these things. There is an audience that isn't interested in these walled garden features and are only interested on intelligence per dollar.

Lol I wonder when Anthropic discussed the idea of Claude Code internally, were there bozos saying "3rd parties will eventually deliver this so we shouldn't waste time one it."

The only good thing Claude Code did was bring coding harnesses to a wider audience. It is not a good harness.

Re: Grok 4.3

#313

Post by lukewarm707 »

mythz wrote: post #270
Cakez0r wrote: post #149

Earlier quoted context omitted.

202.7 tok/s is only OK speed? Which providers are you using that are significantly better than that?

I said speed was great, Cerebas and Groq can provide better performance, likewise Fast versions of Cursor's Composer and Claude. The reported speed like benchmarks is only a reported number on paper, we'll see how it holds up in real world usage, so far OpenRouter is only reporting 73tps [1] https://openrouter.ai/x-ai/grok-4.3

i really don't trust openrouter numbers.

i use byok and see responses fail on openrouter while they work perfectly at the provider. the provider is often listed as 'down' and it's very clearly up on the original api and serving requests.

cerebras quotes oss 120b at 3000tps and it is under 800 on openrouter.

same with fireworks, i am getting much higher numbers not on openrouter. but recently i think fireworks deepseek is kind of spotty, the main provider i know that just doesn't go down is vertex and they charge 2-3x the rest

Re: Grok 4.3

#315

Post by [deleted] »

aembleton wrote: post #135
tornikeo wrote: post #30

So, we have: - claude for corps and gov - codex for devs - grok for what, roleplay, racism? Those are the two things I've ever heard grok associated with around me.

I've tried Grok, Gemini and ChatGPT. There have been 2 times now where Gemini and ChatGPT confidently gave me an incorrect answer whereas Grok was correct. I'm now paying for Grok Lite or whatever it is $10 plan. The first question was around setting up timers for a Fox ESS battery in Home Assistant and disconnecting Fox ESS from the cloud. The second was around cornering speed in Sunnypilot and Frogpilot. Somewhat n…

[deleted]

Re: Grok 4.3

#316

Post by sundarurfriend »

michaelbuckbee wrote: post #213
sundarurfriend wrote: post #27

As an English-as-second-language speaker and writer, one thing Grok really shines at is capturing the tone and level of "formality" of a piece of text and the replicating it correctly. It seems to understand the little human subtleties of language in a way the other major providers don't. Chatgpt goes overly stiff and formal sounding, or ends up in a weird "aye guvnor" type informal language (Claude is sometimes bett…

I did a quick eval comparing Grok 4.3, Opus 4.7 and GPT 4.1 and they actually seem pretty similar: https://ofw640g9re.evvl.io/ They all did pretty well at a more "formal" tone, but GPT4.1 was the only one that didn't make me cringe with a "casual" tone. [edit] fwiw, grok was also the fastest+cheapest model, claude was slowest and priciest.

This is the most basic level of eval, of whether they can produce output that will be considered by someone somewhere (usually a young urban US American) as informal toned. Real human communication is far more nuanced than this, different groups have different linguistic registers they're used to and things outside it sound odd even if they can't articulate why. You could also want to be informal but not over-familiar with the other person (for eg. in a discord chat to a new acquaintance) - actually looking at the outputs here, the Claude output seems best fitting for that (in my subjective view anyway) than to the one you gave it - or want many other little variations.

What makes one cringe and another recognize as familiar and comfortable is also pretty subtle and hard to define. These things need nuanced descriptions and examples to actually get right, and it's in understanding those nuances and figuring out the register of the examples that Grok outshines the others.

Re: Grok 4.3

#317

Post by jasonjmcghee »

michaelbuckbee wrote: post #213
sundarurfriend wrote: post #27

As an English-as-second-language speaker and writer, one thing Grok really shines at is capturing the tone and level of "formality" of a piece of text and the replicating it correctly. It seems to understand the little human subtleties of language in a way the other major providers don't. Chatgpt goes overly stiff and formal sounding, or ends up in a weird "aye guvnor" type informal language (Claude is sometimes bett…

I did a quick eval comparing Grok 4.3, Opus 4.7 and GPT 4.1 and they actually seem pretty similar: https://ofw640g9re.evvl.io/ They all did pretty well at a more "formal" tone, but GPT4.1 was the only one that didn't make me cringe with a "casual" tone. [edit] fwiw, grok was also the fastest+cheapest model, claude was slowest and priciest.

That's Grok 4.2 not 4.3 right?

And why are you comparing to gpt-4.1? (As opposed to one of the 6? model releases since then - would have expected gpt 5.5)

Re: Grok 4.3

#318

Post by energy123 »

mythz wrote: post #6

Ok speed (202.7 tok/s) and value (1.25 -> 2.50) look great, with pretty decent intelligence.

Value should be calculated some other way, like cost per task completion or something.

Re: Grok 4.3

#319

Post by afpx »

wincy wrote: post #255
afpx wrote: post #155

Earlier quoted context omitted.

I love how you guys downvote all the old comments to make them hidden from search. My no-name account rarely gets downvoted. But, within 20 minutes of posting this, I drop 10 points. Rando accounts

I upvoted your first comment because it was insightful, interesting, and added to the conversation. I downvoted this one because complaining about downvotes is largely considered to be in bad taste and doesn’t really help anything. I did both of these things before I realized you were the same person.

Yes, for sure I deserve downvotes for the above. Those types of comments should be downvoted. However, I needed to post it to point out that I got the -10 well before the comment above. I never experienced that before and thought it interesting enough to share. Karma doesn't mean anything to me personally. But burst behavior like that is unusual.

Re: Grok 4.3

#320

Post by afavour »

afpx wrote: post #125
2ndorderthought wrote: post #89

Earlier quoted context omitted.

Ah yes the psychosis reinforcement vertical. It's such a lucrative market for those schizophrenics and bipolars. Great way to get lots of engagement. Groks portfolio is so diverse

Except that it pointed at original sources, like reference manuals, archival documents, published newspaper articles, magazine articles, etc. - a lot still available on archive.org. Good try with your 16 day old account. And, why would anyone trust NPR at this point? Get real, bud. Most people with any curiousity know all about the ADL, JStreet, AIPAC, Greater Israel, Mossad / CIA, Chabad networks, Epstein, drones, w…

Rich billionaire Ellison = bad, compromised

Rich billionaire Musk = good, has no vested interest in biasing the output of his AI tool

Post reply on HN