Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

ploy.ai

Post reply on HN
Print view View original

21–30 of 144 posts

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#21

Post by justAnotherHero »

w4yai wrote: post #10
kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

Can we get over the detective work about if the text was written by LLM or not in 2026 already ? This is a lost cause, and we could instead focus on substance over syntax.

To me it's a useful signal not to read an article that someone didn't bother to write.

Which is a shame as real insights are buried inside some of these articles, which if the author bothered to write in his own words could have reached an audience that would have appreciated them.

Writing is one of the areas where I want no LLM involvement.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#22

Post by try-working »

kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

You should make sure to not read Stratechery then. It's writing is even worse.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#23

Post by thiagoperes »

We run a lot of varied, tiny, simple workflows that were previously running on 5.4-nano and mini. We transitioned them to 5.6 and noticed exactly this range of improvement across the board. In a few cases, we had improvements in classification.

I think a lot of people miss that for many companies, a model upgrade like this is basically a one liner.

Even if you have an amazing model router architecture (which we do for our golden flows), it’s just not worth it. Not to mention reliability and so on

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#24

Post by TacticalCoder »

kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

> The way the LLMs write (Claude perhaps?) With short phrases separated by colons, commas or full stops, is so poor and frustrating.

Yup llmish (from now on it's called "llmish") sucks.

But I'd say: at this point it's probably trivial to write a browser extension that detects llmish and that rewrites the worst sentences: from llmish to something less irritating to read. Heck, I could spent tokens on that: an extension that changes on the fly llmish found on webpages.

Also I'd say there's typically no swearing at all in llmish: llmish is too politically correct for swearing. So the rewrite could maybe also use a few "offending" words.

Offending words that, btw, are not going to go well with Gen Zers. Poor Gen Z... They've been raised with the state and its institutions (like school and then universities) hammering them with the notion that they were precious little unique snowflakes and now they arrive on the job market only to be told they've been pre-emptively replaced by AIs. And because they cannot stand a single curse word (because it's "offensive to minorities" or something), they'll be driven off by text rewritten to contain curse words. So they're condemned to read the bland, dumb, AI-generated llmish for the rest of their lives.

Honestly sucks for them. Fuck that.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#25

Post by CarRamrod »

TacticalCoder wrote: post #24
kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

> The way the LLMs write (Claude perhaps?) With short phrases separated by colons, commas or full stops, is so poor and frustrating. Yup llmish (from now on it's called "llmish") sucks. But I'd say: at this point it's probably trivial to write a browser extension that detects llmish and that rewrites the worst sentences: from llmish to something less irritating to read. Heck, I could spent tokens on that: an extensio…

For me, it's Bottish

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#26

Post by jeremyjh »

w4yai wrote: post #10
kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

Can we get over the detective work about if the text was written by LLM or not in 2026 already ? This is a lost cause, and we could instead focus on substance over syntax.

Evaluating substance takes time - perhaps more than was invested in the article to begin with. So these tells are very distracting because as soon as I see them I wonder if the person who prompted the LLM even bothered to read the output. If they haven't, then I certainly shouldn't invest the time to determine if there is any substance.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#27

Post by conjectures »

w4yai wrote: post #10
kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

Can we get over the detective work about if the text was written by LLM or not in 2026 already ? This is a lost cause, and we could instead focus on substance over syntax.

What substance? That they consume a newer model from the same vendor?

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#28

Post by Tadpole9181 »

bob1029 wrote: post #16

> we’ve made GPT 5.6 Sol the default model powering every Ploy workspace I would consider Luna for parts of the workload that touch actual tools. It is surprisingly capable and it runs fast. Sol is great at talking to the human and orchestration of agent calls, but it's just too expensive to use everywhere. You can get 5 Luna runs for the cost of 1 Sol run. Statistically speaking, going from one to five samples is a…

The problem I always run into with subagents is that they are isolated. This is a double-edged sword, as it keeps context down and lets them "focus", but it often means they must do their own research to continue to do work given to them, which eats uncached tokens.

So depending on how heavily agents are used on what tasks, it's entirely possible that you get worse work for more cost.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#29

Post by icelancer »

kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

Gets a 100% on Pangram. Stuff is so distracting. Write your own posts, FFS. Or at least pass it through "humanizer" type plugins.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#30

Post by dawnerd »

kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

Makes you wonder if any of stats these articles push are even real.
Post reply on HN