Live data from Hacker News

Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

armature.tech

121–130 of 175 posts

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#121
post #85
post #42

Earlier quoted context omitted.

I've noticed that too. Maybe the normal Write tool has to output the entire file and this is an attempt to reduce token usage?

> this is an attempt to reduce token usage? Wouldn't generating a Python script to edit files waste more tokens than using the built-in tool?

depends on the breadth of the edit. anything that involves multiple files might be better done with python (e.g. renaming a function, along with changing all call sites.)

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#122
post #100

I remember when the SEO nightmare started, it looked like an innocent intelectual investigation exercise like this.

We don't need to reproduce the same errors! Anyway I do think it is going to be different this time because generating content is becoming so easy today that the entire web would just become 99.99% slop very quickly if things don't change. That being said the solution isn't that trivial, curious if you have thoughts on it?

Youtube at least, is already 99% for new content, outside the channels you already subscribed. The amount of channels that are basically and AI animation with a voice-over of a curious wikipedia article is staggering, but those are the good ones.

The worse part is a deluge of stupid boomer fanfic (The ones about ungrateful kids, ungrateful employers that fired someone who secretly was a load-bearing (ha!) element for a contract, or HOA drama), self-help stuff, and red-pill incel fanfics.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#123
post #48

For some reason Claude Code keeps using awk, sed, and even Python to do basic file editing. Anyone know why that changed with the 5 series?

Actually, yes. Probably this https://github.com/anthropics/claude-code/issues/88041#issue...

The comments on this issue are unbearable.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#124
post #59
post #48

Earlier quoted context omitted.

Actually, yes. Probably this https://github.com/anthropics/claude-code/issues/88041#issue...

They love adding flags to fix issues that users have without telling their users about the flags. It very much feels like: As long as our staff can have a good user experience, we're happy. We don't care about anyone else.

That's because they code their AI tool with AI so they just didn't notice what it added and they forgot about it.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#126

For some reason Claude Code keeps using awk, sed, and even Python to do basic file editing. Anyone know why that changed with the 5 series?

Funny enough this gets around content exclusion filters my company has set (for things like missing copyrights), so i actually like it

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#127

Earlier quoted context omitted.

how does one do that from their comfy chair?

1. Download ollama and give it a try. It doesn't have to be that one but it's an easy on-ramp. Just get a feel for what open source/open weights is capable of 2. Mention it whenever it comes up. Most people have no clue this is a thing and I think it's useful to make people aware. We need access to uncensored / unbiased LLM models - information wants to be free but there are plenty of businesses gunning for regulator…

> Download ollama and give it a try

Weren't people pissed off at them for a variety of reasons? Not giving attribution etc.

In case anyone wants other good alternatives, there's llama.cpp and vLLM, each harder to setup but opens the door for squeezing more performance out of your hardware.

I've also heard okay things about LM Studio and I think Unsloth had their own thing as well: https://unsloth.ai/docs/new/studio

> Mention it whenever it comes up.

You could also vote with your valley and support orgs that release open weights of their near-SOTA models, though nowadays that means giving cash to primarily Chinese companies (e.g. Moonshot and Z.ai). For what it's worth, people are also complaining about them decreasing usage quotas on their subscription offerings as well so seems like the squeeze is everywhere, even DeepSeek raised their prices (which is better than them going broke, I guess).

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#128

Earlier quoted context omitted.

how does one do that from their comfy chair?

1. Download ollama and give it a try. It doesn't have to be that one but it's an easy on-ramp. Just get a feel for what open source/open weights is capable of 2. Mention it whenever it comes up. Most people have no clue this is a thing and I think it's useful to make people aware. We need access to uncensored / unbiased LLM models - information wants to be free but there are plenty of businesses gunning for regulator…

One issue is that models are only one part of the equation. Search is also extremely important, and for that you pretty much have to depend on a third-party service.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#129

Earlier quoted context omitted.

1. Download ollama and give it a try. It doesn't have to be that one but it's an easy on-ramp. Just get a feel for what open source/open weights is capable of 2. Mention it whenever it comes up. Most people have no clue this is a thing and I think it's useful to make people aware. We need access to uncensored / unbiased LLM models - information wants to be free but there are plenty of businesses gunning for regulator…

> Download ollama and give it a try Weren't people pissed off at them for a variety of reasons? Not giving attribution etc. In case anyone wants other good alternatives, there's llama.cpp and vLLM, each harder to setup but opens the door for squeezing more performance out of your hardware. I've also heard okay things about LM Studio and I think Unsloth had their own thing as well: https://unsloth.ai/docs/new/studio >…

sglang is also worth mentioning. Fills a similar role as vLLM, but with less fiddling at the knobs to get a working setup

For a GUI experience that also serves an OpenAI-compatible API, Unsloth studio or LM Studio is probably the way to go

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#130
post #123
post #48

Earlier quoted context omitted.

Actually, yes. Probably this https://github.com/anthropics/claude-code/issues/88041#issue...

The comments on this issue are unbearable.

The claudespeak immediately irks me now, then there’s also the irony of using Claude to complain about Claude
Post reply on HN