[dead]
Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
111–120 of 175 posts
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#112Earlier quoted context omitted.
A pull request is a communication to the project. AI or no AI, a poorly communicated request is a burden. IMHO AI prs are fine as long as the submitter has done the work to refine that communication to make it easy to read and assess.
True, the problem is that AI ones are 500x longer and at a first glance look fine, so they waste much more time. Moreover a human contributor can learn and do better in the next PR, while the AI won't, unless the prompt is changed, but the operator won't learn.
A large submission without a breakdown or explanation, or a pass to minimize the code change is junk. The operator can literally ask the ai to compose it better, refactor in to smaller PRs, or do it themself. The annoyance is to have to communicate and enforce expectations to drive by submitters. In the end every project has to figure out what they accept. If, at a glance the PR is drive by junk being thrown over the wall, a response of this doesn't meet our pr submission standards delete, or try again, to me is not overly burdensome.
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#113Earlier quoted context omitted.
Unsubscribe from Anthropic because they block third party harness on subscriptions. As long as you keep providers replaceable things will be fine. Google, Facebook, Apple etc were much better deals around 2010 before they became entrenched and irreplaceable, and thus able to extract & enshitify without people leaving.
I agree on Google and Apple being irreplaceable. But Facebook is easy to leave.
For you, sure. But there are a lot of communities running entirely there. Our local farmer's market is preorder only, and is entirely run off Facebook. I would have to skip going there altogether.
And it's not viable to propose any alternative. There is no platform, closed or open, where there are enough people registered to be actually usable, and nobody will make a separate account for this.
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#114Earlier quoted context omitted.
Unsubscribe from Anthropic because they block third party harness on subscriptions. As long as you keep providers replaceable things will be fine. Google, Facebook, Apple etc were much better deals around 2010 before they became entrenched and irreplaceable, and thus able to extract & enshitify without people leaving.
I agree on Google and Apple being irreplaceable. But Facebook is easy to leave.
In many countries Meta platforms—Facebook, Instagram, WhatsApps—are primary means of communication. If you want to find interesting events happening this weekend, you need to be on Facebook. In this regard, Google and Apple are much easier to leave because they offer personalised services, and you can always move your email and photos elsewhere. But you cannot move other people from Facebook or Instagram.
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#115For some reason Claude Code keeps using awk, sed, and even Python to do basic file editing. Anyone know why that changed with the 5 series?
Oh and don't forget: it keeps chaining a bazillion commands together so any whitelisted commands still need approval because they're nested in such a convoluted way.
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#116Earlier quoted context omitted.
Exactly why everyone needs to be hyper-focused on ensuring that the open-source ecosystem is healthy and that we don't let them shut that down.
> on ensuring that the open-source ecosystem There are no open source models. Only open weights . No one is giving you the source (training data). And yeah, no one is giving you the compute to train the models.
https://ifm.ai/blog/k2 is actually open source as I understand.
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#117Which sandboxes do you yourself use to run those agents? And how did you choose this provider?
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#118Which sandboxes do you yourself use to run those agents? And how did you choose this provider?
We decided to use three different providers so we could verify that this choice doesn't impact the result of our experiments (E2B, Blaxel and Daytona)
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#119[flagged]
Re: Which tools do Claude, Codex and Cursor choose? We measured 17k runs to find out
#120Earlier quoted context omitted.
I agree on Google and Apple being irreplaceable. But Facebook is easy to leave.
In many countries Meta platforms—Facebook, Instagram, WhatsApps—are primary means of communication. If you want to find interesting events happening this weekend, you need to be on Facebook. In this regard, Google and Apple are much easier to leave because they offer personalised services, and you can always move your email and photos elsewhere. But you cannot move other people from Facebook or Instagram.
It’s not that easy to leave Google or Apple. As an example I wanted to leave iCloud and stop paying storage tax for Apple. But they have made it almost impossible to migrate the photos. There is no API to download the photos programmatically and the only way is to sync all the photos to MacBook and then move it. However, the photos are close to 1TB of storage and my MacBook doesn’t have enough storage to sync all those photos locally.
Same goes for Gmail. I have used my Gmail address for countless services and it’s almost part of my official identity. The benefits of moving away from Gmail doesn’t justify the effort I have to put in