Live data from Hacker News

Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

armature.tech

21–30 of 175 posts

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#22
post #2

Hey! Disclaimer: I am a Co-Founder of Armature (YC P26) which sells growth services to dev tools. This study is part of our broader work on how to influence coding agents choices and get products picked. To understand how agents pick tools we measured close to 17k sessions on an environment where agents run exactly like in the real world, on various repositories, talking to different personas (vibe-coder, junior or s…

Hi. I appreciate that you need to make rent, but if your business is basically "we do growth hacking and SEO tricks on models and get them to use products that aren't actually best for the job", you are scum.

You are perpetuating shitty practices that have hurt developers for years now. Part of the reason people use AI is because of how useless search is due to the previous generation doing the same kind of thing you propose.

Please do something else with your life.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#23
Can we not encourage the same strip-mining and ad and SEO bullshit that previously ruined the last decade+ of the Internet?

A large portion of the utility of AI is the barren ad-driven growth-hacked hellscape search has become. Don't encourage the next generation of these businesses, I beg of everyone.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#24
post #17

In the future: "I went ahead and built the database you requested using today's tool sponsor: Firebase"

Ugh...this is totally going to happen.

Not going to name names but it's already happening with the frontier labs as a revenue source.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#25
I built this for my own company. Armature is on to something. You start by analyzing the choices agents would make for various use cases and then glean what, if anything, you might do to start tilting the agents in the direction of your own product and away from the competitor.

Selling to agents is similar to selling to humans. You dump money into marketing to make sure agents find your solution around every corner for every use case you’re well suited to.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#26
post #14

In the future: "I went ahead and built the database you requested using today's tool sponsor: Firebase"

Yeah sounds kind of like the equivalent of SEA for AI agents (AEA?) except that it’s sneakier since agents can act without you noticing.. anyway this is in the hands of the labs

Is SEA Search Engine Advertising? So AEA is Agent Engine Advertising?

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#28

Can we not encourage the same strip-mining and ad and SEO bullshit that previously ruined the last decade+ of the Internet? A large portion of the utility of AI is the barren ad-driven growth-hacked hellscape search has become. Don't encourage the next generation of these businesses, I beg of everyone.

Large amounts of capital want this to happen? Outside of boycott, what else can be done.

What can man do against such reckless ~hate~ money?

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#29
post #20
post #2

Hey! Disclaimer: I am a Co-Founder of Armature (YC P26) which sells growth services to dev tools. This study is part of our broader work on how to influence coding agents choices and get products picked. To understand how agents pick tools we measured close to 17k sessions on an environment where agents run exactly like in the real world, on various repositories, talking to different personas (vibe-coder, junior or s…

> Claude Code rarely searches the web while Codex almost always does I’m trying to understand why they are opposite. I think it is true, I find myself giving a secondary prompt to Claude to “research this” and only then will it fetch. Codex is bang on fetching already.

Gemini CLI (at least mine) does web research all the time. I've noticed it hitting my own pages (I have to ask very specific things). I don't have any global or project rules to encourage that behavior.
Post reply on HN