The Cost of Human-Centric Tools in LLM Workflows

#1

Post by bckmn » Sun, Jul 13, 2025, 3:37 PM UTC

The Cost of Human-Centric Tools in LLM Workflows
joshbeckman.org

Re: The Cost of Human-Centric Tools in LLM Workflows

#2

Post by zdw » Sun, Jul 13, 2025, 3:53 PM UTC

Having used multiple code review tools (Gerrit, Phabricator), GitHub's code review is frankly one of the worst UX's for humans to use for this purpose (go try to review a rebased patchset, or have to wade through the inefficient use of space in the UI), so I'm not surprised AI has trouble with it as well.

Re: The Cost of Human-Centric Tools in LLM Workflows

#3

Post by bckmn » Sun, Jul 13, 2025, 4:49 PM UTC

zdw wrote: post #2

Having used multiple code review tools (Gerrit, Phabricator), GitHub's code review is frankly one of the worst UX's for humans to use for this purpose (go try to review a rebased patchset, or have to wade through the inefficient use of space in the UI), so I'm not surprised AI has trouble with it as well.

Agreed. I think this is why we’re seeing a lot of new wrappers being built like Graphite.

Re: The Cost of Human-Centric Tools in LLM Workflows

#4

Post by jacobegold » Sun, Jul 13, 2025, 5:51 PM UTC

bckmn wrote: post #3

zdw wrote: post #2

Having used multiple code review tools (Gerrit, Phabricator), GitHub's code review is frankly one of the worst UX's for humans to use for this purpose (go try to review a rebased patchset, or have to wade through the inefficient use of space in the UI), so I'm not surprised AI has trouble with it as well.

Agreed. I think this is why we’re seeing a lot of new wrappers being built like Graphite.

a lot? what are the other ones?

Re: The Cost of Human-Centric Tools in LLM Workflows

#5

Post by bckmn » Sun, Jul 13, 2025, 6:31 PM UTC

jacobegold wrote: post #4

bckmn wrote: post #3

Earlier quoted context omitted.

Agreed. I think this is why we’re seeing a lot of new wrappers being built like Graphite.

a lot? what are the other ones?

In exploring `gh` CLI extensions recently I found at least 2 devoted to being a better PR review interface. I've also seen [Trag](https://usetrag.com/) and others pop up.

Re: The Cost of Human-Centric Tools in LLM Workflows

#6

Post by codeapprove » Sun, Jul 13, 2025, 9:27 PM UTC

jacobegold wrote: post #4

bckmn wrote: post #3

Earlier quoted context omitted.

Agreed. I think this is why we’re seeing a lot of new wrappers being built like Graphite.

a lot? what are the other ones?

Some others which are good:

  * Reviewable
  * Codestream (formerly GitContext)
  * Codelantis
  * CodeApprove (biased, obviously)

Re: The Cost of Human-Centric Tools in LLM Workflows

#7

Post by edvaldodfreitas » Mon, Jul 14, 2025, 5:16 PM UTC

zdw wrote: post #2

Having used multiple code review tools (Gerrit, Phabricator), GitHub's code review is frankly one of the worst UX's for humans to use for this purpose (go try to review a rebased patchset, or have to wade through the inefficient use of space in the UI), so I'm not surprised AI has trouble with it as well.

You can try out Kodus (https://kodus.io)