Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

ploy.ai

Post reply on HN
Print view View original

91–100 of 144 posts

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#91

Post by blitzar »

w4yai wrote: post #10
kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

Can we get over the detective work about if the text was written by LLM or not in 2026 already ? This is a lost cause, and we could instead focus on substance over syntax.

Its never lupus and its always an LLM. No need for detective work.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#92

Post by make_it_sure »

blfr wrote: post #2

> Ploy’s agent builds and edits real marketing websites. It plans a page, reads the codebase, writes components, generates imagery, screenshots its own work, and decides when it’s done. That job description sets a very high bar for a model, and we test every frontier release against it. For the four months Opus held the default slot (first Opus 4.7, then 4.8), nothing we tested beat it. Well, unlike OP I haven't run…

gpt 5.6 is so much better ar design than fable

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#93

Post by hamandcheese »

znnajdla wrote: post #82

My experience mirrors this: services like OpenRouter that promise “failover” are pretty much useless except for sandbox testing because models in production are not really interchangeable. Any production harness doing serious agentic work in production is dependent on more model-specific quirks than you would expect. And even if another model works without errors, performance and efficiency is a whole different story…

OpenRouter doesn't fail over to a different model, it fails over a different provider of the same model.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#94

Post by vasco »

user_of_the_wek wrote: post #84
wqaatwt wrote: post #79

Earlier quoted context omitted.

You are reading it wrong. Ask your LLM to read and summarize based on your style preferences. Better yet don’t read anything at all, just tell your agent to convert it to a skill file for it’s future reference..

Unironically, I think in the future we will have the option to run filters in our browsers that can reword articles to your preferred writing style. Like user stylesheets for text. I also assume it already exists out there, I've just been to lazy so far to look for it. It's a relatively obvious application of LLMs.

I've used that for about 15 years because I live abroad, it's called Google translate.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#95

Post by SwtCyber »

Its ironic that under an article with a ton of deep infrastructure insights half the comments are crying about the "forced writing style". What does it matter if claude helped the author clean up the text when inside is a ready-to-use blueprint on how to save 30% of the api budget and fix empty file reads?

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#96

Post by SwtCyber »

kristianp wrote: post #6

> Numbers like that buy a model a real migration effort. Such a silly choice of words. I wish the human directing the LLM writing the article put some effort into rewriting the worst examples of LLM style. > But it did extremely well, and the promise was immediate and specific: builds finishing in less than half the wall-clock time, at 27% lower cost, scoring at or above our incumbent on completed work. The way the L…

I would rather read an article with actual production experience migrating an agent, even if it is written in this style, than a perfectly crafted long read from another evangelist that has nothing but high level fluff and general phrases about the bright future of ai

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#97

Post by SwtCyber »

lcampbell wrote: post #65

> The fix that worked is a schema transform at the provider boundary. For OpenAI-family models only, we rewrite every optional property to be required but nullable, using anyOf: [T, null], which gives the model an explicit way to say “not using this.” I admit, I've only used a bastardized form of MCP, but this smells... wrong? It's not clear to me why the Typescript type definitions would have any influence on (what…

The thing is this isn't a schema generation or Typescript bug at all. This is just how openai's function calling works under the hood. Their weights were fine-tuned for tool use to output the most complete data structures possible. If the model sees a parameter name in the system prompt context it will try to fill it with a value, even if it is not in the required array

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#98

Post by frio »

justAnotherHero wrote: post #21
w4yai wrote: post #10

Earlier quoted context omitted.

Can we get over the detective work about if the text was written by LLM or not in 2026 already ? This is a lost cause, and we could instead focus on substance over syntax.

To me it's a useful signal not to read an article that someone didn't bother to write. Which is a shame as real insights are buried inside some of these articles, which if the author bothered to write in his own words could have reached an audience that would have appreciated them. Writing is one of the areas where I want no LLM involvement.

I keep coming back to this https://tombedor.dev/human-attention-and-human-effort/

The number of things that make it to the top of HN/Reddit/wherever now that are devoid a human's touch is exhausting. Whether it's a site that's got that Claude frontend smell, or a repo that's got a burst of 10 claude commits before getting shared and abandoned, or a series of blog posts that were written by LLMs... it's all, at this point, a flag for me that the human behind the LLM doesn't really want to engage with others or share; in some ways it dehumanises their entire (supposed) audience.

IDK. Maybe having Claude contribute writing about something novel to the general blogosphere is useful in some dimension, but it usually gives me no confidence in the truth of the post.

Re: Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

#100

Post by Diti »

yulker wrote: post #83
wqaatwt wrote: post #79

Earlier quoted context omitted.

You are reading it wrong. Ask your LLM to read and summarize based on your style preferences. Better yet don’t read anything at all, just tell your agent to convert it to a skill file for it’s future reference..

this is probably sarcasm, but might actually try this. the visceral negative reaction i have to llm writing makes me instantly want to close the tab

If written sarcasm isn’t properly labeled as sarcasm, per Poe’s law, you may consider that message you replied to be a genuine opinion.

I would have downvoted the sarcasm (it doesn’t contribute to the conversation), but I believe it actually is the author’s opinion.

Post reply on HN