I'd not discount the adversarial end of the spectrum.
Better Models: Worse Tools
71–80 of 90 posts
Re: Better Models: Worse Tools
#72Earlier quoted context omitted.
This will cause an extra round trip to the LLM. Which means more $ spent.
So? What alternative do you suggest? Let the LLM get it wrong forever? Remove the tool? Automatically try to patch the syntax? Almost no "solutions" in engineering/programming comes for free, one way or another, it's all a balancing act between different solutions with different tradeoffs. In this case, another request/response seems preferable to the other tradeoffs.
Re: Better Models: Worse Tools
#73Re: Better Models: Worse Tools
#74Different but related: When you use a Codex subscription in an agent like Pi or OpenCode, all the requests and tool call execution go through a sandbox owned by Codex app server, and all the tool calls function somewhat differently, and you can't read files outside of the sandbox as easily. It's currently tripping me up a bit when building a model router.
That is not the case. There are some subtle differences between subscription and regular inference API, but not to the degree that behaviors change entirely. In Pi we're doing tests against both API and subscription API regularly to see how they behave.
Re: Better Models: Worse Tools
#75Re: Better Models: Worse Tools
#76This is easily solved with good error messages. Claude always gets the syntax wrong on my tool calls. So I did a revolutionary thing and made the error output print helpful guidance on how to correctly call the tool . The agent tries again and always gets it right. Total time “wasted”: 1-2 seconds. It happens every session, but it only happens once per context window. After that the agent holds on to the lesson. To d…
I've built a library that makes creating rich feedback systems easier, check this out: https://tool2agent.org/
Re: Better Models: Worse Tools
#77This is easily solved with good error messages. Claude always gets the syntax wrong on my tool calls. So I did a revolutionary thing and made the error output print helpful guidance on how to correctly call the tool . The agent tries again and always gets it right. Total time “wasted”: 1-2 seconds. It happens every session, but it only happens once per context window. After that the agent holds on to the lesson. To d…
Re: Better Models: Worse Tools
#78Earlier quoted context omitted.
This will cause an extra round trip to the LLM. Which means more $ spent.
So? What alternative do you suggest? Let the LLM get it wrong forever? Remove the tool? Automatically try to patch the syntax? Almost no "solutions" in engineering/programming comes for free, one way or another, it's all a balancing act between different solutions with different tradeoffs. In this case, another request/response seems preferable to the other tradeoffs.
Re: Better Models: Worse Tools
#79Re: Better Models: Worse Tools
#80I want dark window chrome and light contents but browsers seem completely unwilling to let me have this option.
Edge has it in edge://flags no extension needed. Firefox & brave requires settings and extension like chrome. I haven't used opera or Vivaldi in ages to help with them, but they will have an option because customizability is a key part of their selling points