Live data from Hacker News

Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

armature.tech

141–150 of 175 posts

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#141

I keep telling people that we are living in the golden age of AI - like the first year or two of google. It is all down hill as these companies push for profit and lock-in.

Yes. Grab those open-weight models while you still can.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#142

I keep telling people that we are living in the golden age of AI - like the first year or two of google. It is all down hill as these companies push for profit and lock-in.

How is this comment relevant and why is it the top post on this thread.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#144

I keep telling people that we are living in the golden age of AI - like the first year or two of google. It is all down hill as these companies push for profit and lock-in.

luckily I have purchased a used amd mi50 32gb card for pretty cheap back then. while I haven't used it extensively, it feels pretty great having a backup plan that does not depend on any external 3rd parties.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#145
post #123
post #48

Earlier quoted context omitted.

Actually, yes. Probably this https://github.com/anthropics/claude-code/issues/88041#issue...

The comments on this issue are unbearable.

Agreed, but reminds me of the unfortunate usage of English as the de facto global standard. Ironically funny to see computers chattering in this odd piecemeal of a language. (I am a native speaker of English)

Would be interesting to see LLMs talk in something more terse like Vietnamese.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#147
post #20
post #2

Hey! Disclaimer: I am a Co-Founder of Armature (YC P26) which sells growth services to dev tools. This study is part of our broader work on how to influence coding agents choices and get products picked. To understand how agents pick tools we measured close to 17k sessions on an environment where agents run exactly like in the real world, on various repositories, talking to different personas (vibe-coder, junior or s…

> Claude Code rarely searches the web while Codex almost always does I’m trying to understand why they are opposite. I think it is true, I find myself giving a secondary prompt to Claude to “research this” and only then will it fetch. Codex is bang on fetching already.

More likely the harness than the model or a search deal. In Claude Code, WebFetch prompts for permission per domain and WebSearch is a separately gated tool, so the cheapest path for the agent is almost always the files already in the repo. Codex has no equivalent friction in front of a fetch.

Worth checking against your own permission settings before reading it as a model preference: allowlist a domain and the same agent will reach for it a lot more.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#148
post #79
post #67

Earlier quoted context omitted.

By not harassing projects with AI generated pull requests.

A pull request is a communication to the project. AI or no AI, a poorly communicated request is a burden. IMHO AI prs are fine as long as the submitter has done the work to refine that communication to make it easy to read and assess.

AI PRs aren't fine. Open a issue and propose a change, the maintainers decide what to do next with their own AI if they want.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#150

I keep telling people that we are living in the golden age of AI - like the first year or two of google. It is all down hill as these companies push for profit and lock-in.

How is this comment relevant and why is it the top post on this thread.

It's cynical and critical of marketing? Many of us are cynical, and there's an argument that being cynical is lazy because most of its arguments are obvious because they are rooted in truth.
Post reply on HN