PR-Agent — extension that adds AI chat to code reviews on GitHub • Hacker News Board

Re: PR-Agent — extension that adds AI chat to code reviews on GitHub

#11

Post by johnnyanmac » Tue, Sep 10, 2024, 5:04 PM UTC

boredtofears wrote: post #8

lvncelot wrote: post #3

I'm sorry if this makes me sound like a cranky old man but I find the idea of AI-generated PR description and reviews entirely misses the mark of what they're for. The PR description should contain the context that made a change necessary, which is something that can not be contained in the change itself and thus can't reliably be inferred from it. And if I request a PR review, I trust you , as my peer, to understand…

I find AI summaries to be useful when writing PR's as a starting point. Having it generate a bulleted list summarizing the changes is a good way to make sure you've covered your entire PR (and it's easy to trim down unnecessary things). You can add context as needed. I'd never trust an unrevised version though.

Yeah, thars the big issue. Really only takes one unengaged or lazy reviewer to not take the time to revise that AI output and it will ruin the entire Org. Honestly it's a theme for all LLMs: they are great as a guide but people inevitably use them as if they are a replacement. The companies marking it as such don't help either.

As is, getting in revised LLMs responses seems like it'll be Gen Alpha's "let me Google that for you" swipe. Except at least Googling means you still need to put in leg work.

Re: PR-Agent — extension that adds AI chat to code reviews on GitHub

#12

Post by lucabetelci » Tue, Sep 10, 2024, 5:43 PM UTC

Most of the reviews for this extension look like they were generated with LLM.

Re: PR-Agent — extension that adds AI chat to code reviews on GitHub

#13

Post by aravindputrevu » Tue, Sep 10, 2024, 5:57 PM UTC

Looks interesting at the same moment, I don't know why it should be a chrome extension and not a hook into my workflow like Coderabbit dot ai.

What I love with these tools, I'm getting productive. Although, I'd still like to do the review myself.

Re: PR-Agent — extension that adds AI chat to code reviews on GitHub

#14

Post by gengstrand » Tue, Sep 10, 2024, 7:46 PM UTC

Has anyone here tried out https://github.com/freeedcom/ai-codereviewer which I suspect is something similar only in GHA form?

Re: PR-Agent — extension that adds AI chat to code reviews on GitHub

#15

Post by mass_and_energy » Tue, Sep 10, 2024, 8:12 PM UTC

Wow there really is nothing that people won't shoehorn AI into these days eh? What is the point of this? What is the net business benefit, other than "but, but it's got AI"?

Re: PR-Agent — extension that adds AI chat to code reviews on GitHub

#16

Post by nextworddev » Wed, Sep 11, 2024, 1:59 AM UTC

This looks like a security nightmare

Re: PR-Agent — extension that adds AI chat to code reviews on GitHub

#17

Post by talrid » Wed, Sep 11, 2024, 2:02 PM UTC

lvncelot wrote: post #3

I'm sorry if this makes me sound like a cranky old man but I find the idea of AI-generated PR description and reviews entirely misses the mark of what they're for. The PR description should contain the context that made a change necessary, which is something that can not be contained in the change itself and thus can't reliably be inferred from it. And if I request a PR review, I trust you , as my peer, to understand…

Hi @lvncelot

I am Tal, one of the developers of this extension.

See our FAQ regarding your concerns about the PR description, and the review process: https://pr-agent-docs.codium.ai/faq/#answer1

In general, PR-Agent is designed to assist, not replace, human reviewers.

Many of the flows and processes we deployed are aimed at meeting this goal. We try not to overclaim, or overpromise. PR-Agent should not be the sole reviewer of a PR. We believe it can definitely enhance and improve the reviewing process.