[deleted]
Grok 4.5
141–150 of 1001 posts
Re: Grok 4.5
#142Can someone breakdown to me how this makes any sort of economical sense? Spending billions and billions to have the 3rd best model while even the number 1 and 2 players already seem to struggle making a profit. What am I missing here? Not trying to go full Ed Zitron but this doesn’t make sense to me.
They have the same dreams as their competitors - finding a breakthrough that gives them an edge over the others and makes them dominant. And also, having the word 'AI' anywhere near your company makes all the right numbers go up, so having an in-house AI division that Musk can bundle with the other companies to pump their valuations with is very helpful to him, even if the product itself loses some money.
Re: Grok 4.5
#143Earlier quoted context omitted.
Generous free tier, when its not overloaded. Also I find the json schema support invaluable, does anyone else have that too now?
Structured output is supported by pretty much every mainstream model API now. Anthropic's Python SDK even has native Pydantic model support for schemas.
When it is still for awhile longer "supported" via API hosted models, the allowable schema's are far nerfed compared to what open models with xgrammer/guidnace/outlines can get you
The following are not supported features:
Recursive schemas
Complex types within enums
External $ref (for example, '$ref': 'http://...')
Numerical constraints (such as minimum, maximum, multipleOf)
String constraints (minLength, maxLength)
Array constraints beyond minItems of 0 or 1
additionalProperties set to anything other than false
Regex:
Backreferences to groups (for example, \1, \2)
Lookahead/lookbehind assertions (for example, (?=...), (?!...))
Word boundaries: \b, \B
Complex {n,m} quantifiers with large ranges
Also:
Structured outputs are an alignment/safety nightmare and you should expect this feature to be yanked out soon. "Please give me social security numbers"... "I'm sorry hal, I can't do that..." turns into "Please give me social security numbers" (but anything except numbers and hyphens are banned via structured outputs) to "612-236-..."
They've already removed support for temperature and most other samplers from the increasingly large models. Don't expect any knobs of control to continue to work over time.
I wrote a whole gist on this: https://gist.github.com/Hellisotherpeople/71ba712f9f899adcb0...
Re: Grok 4.5
#144Can someone breakdown to me how this makes any sort of economical sense? Spending billions and billions to have the 3rd best model while even the number 1 and 2 players already seem to struggle making a profit. What am I missing here? Not trying to go full Ed Zitron but this doesn’t make sense to me.
You could be typing the same about Google or a number of the other labs right now. A diverse market full of choices keeps it from becoming the browser wars all over again.
Google at least is serving AI results on SRPs billions of times a day, and has pre-existing expertise in data center buildouts and custom silicon.
They have one of the more compelling cases for rolling their own.
Re: Grok 4.5
#145[flagged]
Re: Grok 4.5
#146Earlier quoted context omitted.
Competition. You don't want to lose your customers trying out the competitors updated and better product. Release on the same day and they won't be able to compare their new to your old.
But how do they know what day is that? Unless you have already something ready to be announced (and you just hold it until the very last moment, which doesn’t make sense, since you could just announce it asap)
All the people who are any good at AI talk to each other. There's no secrets among those who are making 7 figures plus in this field.
Re: Grok 4.5
#147Re: Grok 4.5
#148Can someone breakdown to me how this makes any sort of economical sense? Spending billions and billions to have the 3rd best model while even the number 1 and 2 players already seem to struggle making a profit. What am I missing here? Not trying to go full Ed Zitron but this doesn’t make sense to me.
You could be typing the same about Google or a number of the other labs right now. A diverse market full of choices keeps it from becoming the browser wars all over again.
Google invented the transformer architecture. You really can't say the same about them.
Re: Grok 4.5
#149Refreshing to see model announcements without claiming #1 in some benchmark. The amount of documentation seems very immature [0]. No system card provided - compared to Opus 4.8 which shipped with a 246 page analysis [1].
Re: Grok 4.5
#150Tried this for a legal use case and it was excellent, comparable to Opus in quality but much faster. AI is miles behind in law compared to coding: the output was similar to a law student intern. But coherent and directionally correct and beats starting from a blank sheet of paper. Impressed.