[dead]
GPT-5.6 Sol Ultra will be in Codex
71–80 of 433 posts
Re: GPT-5.6 Sol Ultra will be in Codex
#72Earlier quoted context omitted.
https://archive.ph/NEwVz "However, these inference optimizations, which rival Anthropic refers to as “compute multipliers,” are a big focus for all the labs. Anthropic CEO Dario Amodei has been publicly talking about the concept since at least mid-2023, when he said on a podcast that the company limits “the number of people who are aware of a given compute multiplier” because it could give other AI labs a leg up if t…
> He sure did seem to speed run the 'tech leader with scruples' to 'tech villain' path! What kind of rosy-eyed chump believes in the "tech leader with scruples" bullshit? It always lies. Did some people just ignore Mark Zuckerberg and Tim Cook's sociopathy, somehow? Did anyone buy into their "privacy is a human right" nonsense?
I find this kind of cynicism fascinating tbh. On the one hand, it seems so relatable in some ways, because there is something uncomfortable about being seen as naive, in a way that being seen as cynical or negative doesn't seem to carry. I guess it's just self-protective, almost like some kind of perverse Pascal's wager: it's better to think everyone is horrible and be wrong than to think the opposite and be taken advantage of?
The thing I can't quite square is that it doesn't really fit my lived experience. I have known sincere, genuine people in the types of positions that I'm sure someone like you would declare to be sociopathic.
But beyond that, I just don't know why it would actually be true that everyone at the top is a villain. Why couldn't someone like Dario (or even Altman, gasp) be sincere? Because if he is, it does seem like a lot of the moves he's made would make sense given his worldview.
But if you assume he's just a villain, then you can twist any of those moves to just be further evidence of that which you already believe.
I don't know, I just find cynicism interesting, and a little sad.
Re: GPT-5.6 Sol Ultra will be in Codex
#73Earlier quoted context omitted.
> Fable is the first model that mostly writes without the AI slop format for me I'm not that impressed by Fable's writing to be honest, still has the AI giveaways like em dash.
Humans use em dash as well. I hate that I have had to remove it from my writing style because people assume it’s AI generated. But I think that ship has sailed. I’ll have to do without now.
How do you type the em dash. I thought the point about the em dash "—" is, that it is longer than the normal minus "-". Humans normally have no way to produce it, cause there is no key on the keyboard.
Re: GPT-5.6 Sol Ultra will be in Codex
#74Earlier quoted context omitted.
I tried a pro model out the other day and thought there must have been a bug in Pi’s cost calculations. But no, it’s absolutely fucking insane. Wasn’t even any better at the task.
I really suspect that the models are basically the same below, it’s all in the prompt. The way I use them, surgically, they seem to perform about the same. Fable certainly hasn’t blow my socks off.
Where fable has blown me away is converting entire code bases and or refactoring across many different segments.
It’s far more careful than opus and puts far more effort into testing and validating by default.
Switching back to opus at work was a downgrade. Similar requests felt more clunky and needed far more hand holding.
Re: GPT-5.6 Sol Ultra will be in Codex
#75Earlier quoted context omitted.
> Fable is the first model that mostly writes without the AI slop format for me I'm not that impressed by Fable's writing to be honest, still has the AI giveaways like em dash.
i cant reply to hn_user2, but i have the same experience, i find myself never using emdash where i would have before
Why can't you reply to hn_user2? I just did. Did you say something mean to hn_user2 and now you have a restraining order and can't go near them within one reply?
Re: GPT-5.6 Sol Ultra will be in Codex
#76The full conversation https://xcancel.com/haider1/status/2073695124220006575#m
[flagged]
I made (repurposed an existing) an extension for firefox to cancel xcancel: https://addons.mozilla.org/en-US/firefox/addon/xcancel-to-x/
Re: GPT-5.6 Sol Ultra will be in Codex
#77they better get that out fast, it will become totally meaningless when the next GLM gets there first.
more competition is always good for consumers.
Re: GPT-5.6 Sol Ultra will be in Codex
#78Earlier quoted context omitted.
I tried a pro model out the other day and thought there must have been a bug in Pi’s cost calculations. But no, it’s absolutely fucking insane. Wasn’t even any better at the task.
I really suspect that the models are basically the same below, it’s all in the prompt. The way I use them, surgically, they seem to perform about the same. Fable certainly hasn’t blow my socks off.
> Fable certainly hasn’t blow my socks off.
Same. Its not so much perf increase as cost increase justified by ambiguous perf increase.
Re: GPT-5.6 Sol Ultra will be in Codex
#79Hope this forces Anthropic to be less stingy with Fable.
Re: GPT-5.6 Sol Ultra will be in Codex
#80Earlier quoted context omitted.
I wouldn't
people really dont understand how the transformer works to think this is something trivial if possible at all
Orly?
“ Automatic Prefix Caching (APC in short) caches the KV cache of existing queries, so that a new query can directly reuse the KV cache if it shares the same prefix with one of the existing queries, allowing the new query to skip the computation of the shared part.”
https://docs.vllm.ai/en/latest/features/automatic_prefix_cac...