Viewing profile — dakshgupta

Apart from the job-related stuff others have already said, there is a bit of novelty/bragging rights in landing a PR into a major open source project.

Not yet - but we want to do this. Similarly true for the ephemeral unit tests that greptile writes.

The signal-to-noise ratio problem is unexpectedly difficult. We wrote about our approach to it some time ago here - https://www.greptile.com/blog/make-llms-shut-up Much has changed…

Thanks! We go over that on many other pages. Here are some: https://www.greptile.com/benchmarks https://www.greptile.com/greptile-vs-coderabbit https://www.greptile.com/greptile-vs…

I agree that none perform _super_ well. I would argue they go far beyond linters now, which was perhaps not true even nine months ago. To the degree you consider this to be evidenc…

2. There is plenty of evidence for this elsewhere on the site, and we do encourage people to try it because like with a lot of AI tools, YMMV. You're totally right that PR reviews …

> Independence It is, but when a model/harness/tools/system prompts are the same/similar in the generator and reviewer fail in similar ways. Question: Would you trust a Cursor revi…

We have ways to approximate our impact on code quality, because we track: - Change in number of revisions made between open and merge before vs. after greptile - Percentage of grep…

Apologies, that is poor wording on our part. It's internal data from engineers that use Greptile, which are tens of thousands of people from a variety of industries. As opposed to …

Most of our customers are enterprises, so I feel relatively comfortable assuming they have some decent testing and QA in place. Perhaps I am too optimistic?

Thanks! The first 4 charts as well as Chart 2.3 are all from our data!

This is a good one, wish we had included it. I'd run some analysis on this a while ago and it was pretty interesting. An interesting subtrend is that Devin and other full async age…

How would you measure code quality? Would persistence be a good measure?

This is a great suggestion. I'll note it down for next years. Curious, do you think this would be a good proxy for code quality?

This is per month, I see now that's not super clear on the chart!

We're careful not to draw any conclusions from LoC. The fact is LoCs are higher, which by itself is interesting. This could be a good or bad thing depending on code quality, which …

We weren’t able to find a good quality measure. LLM-as-judge dint feel right. You’re correct that without that the data is interesting but not particular insightful.

We weren’t able to agree on a good way to measure this. Curious - what’s your opinion on code churn as a metric? If code simply persists over some number of months, is that indicat…