Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

armature.tech

Post reply on HN
Print view View original

11–20 of 175 posts

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#11

Post by kouteiheika »

screm wrote: post #9
josephg wrote: post #5

Earlier quoted context omitted.

The data was cool. Then I tried to tap on one of the other tabs. “This content is easier to read while full screen!” - Ok I’m game. “Hey this is what makes armature special!” - I don’t care, I’m here to look at data, not onboard onto some random platform. It took ages to find the tiny “skip tour” button, hiding in black on black text. Then it gave me another popup, which I dismissed without reading. Then the full scr…

Hey, thanks for the feedback, the leaderboards aren't displaying well on mobile indeed, we are currently shipping a fix that should help with that. Thanks anyway!

FWIW I had the same reaction to the popups. Immediately closed the tab.

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#14

Post by screm »

ex-aws-dude wrote: post #12

In the future: "I went ahead and built the database you requested using today's tool sponsor: Firebase"

Yeah sounds kind of like the equivalent of SEA for AI agents (AEA?) except that it’s sneakier since agents can act without you noticing.. anyway this is in the hands of the labs

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#16

Post by screm »

kouteiheika wrote: post #11
screm wrote: post #9

Earlier quoted context omitted.

Hey, thanks for the feedback, the leaderboards aren't displaying well on mobile indeed, we are currently shipping a fix that should help with that. Thanks anyway!

FWIW I had the same reaction to the popups. Immediately closed the tab.

Yep makes sense I’m relaxing them

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#19

Post by screm »

screm wrote: post #16
kouteiheika wrote: post #11

Earlier quoted context omitted.

FWIW I had the same reaction to the popups. Immediately closed the tab.

Yep makes sense I’m relaxing them

It should be better now, including in mobile, thanks both for the feedback!

Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out

#20

Post by hbarka »

screm wrote: post #2

Hey! Disclaimer: I am a Co-Founder of Armature (YC P26) which sells growth services to dev tools. This study is part of our broader work on how to influence coding agents choices and get products picked. To understand how agents pick tools we measured close to 17k sessions on an environment where agents run exactly like in the real world, on various repositories, talking to different personas (vibe-coder, junior or s…

> Claude Code rarely searches the web while Codex almost always does

I’m trying to understand why they are opposite. I think it is true, I find myself giving a secondary prompt to Claude to “research this” and only then will it fetch. Codex is bang on fetching already.

Post reply on HN