Live data from Hacker News

Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

github.com

61–70 of 117 posts

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#61
Incredible work, this is the most exciting AI dev tool I've come across!

Do you have a strategy to supplement ChatGPT to handle post-2021 updates to languages and libraries? I tried it on a NextJS repo and it came up with something that looked like it would have been correct a few versions ago, but I had to make some manual changes. Certain fast-moving ecosystems might frequently have this issue.

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#62

Incredible work, this is the most exciting AI dev tool I've come across! Do you have a strategy to supplement ChatGPT to handle post-2021 updates to languages and libraries? I tried it on a NextJS repo and it came up with something that looked like it would have been correct a few versions ago, but I had to make some manual changes. Certain fast-moving ecosystems might frequently have this issue.

Thank you! We're working on integrating external browsing using another agent. For now we do have link processing, so if you drop a publicly accessible link in the issue, Sweep will actually gather context from that link.

You can give Sweep docs about a framework and it should help a lot.

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#63
post #54

Earlier quoted context omitted.

The code produced in the "getInitials" function handles absolutely no corner cases whatsoever. It also didn't add any tests to the PR. All this does is making sure your website will crap all over itself 2 weeks into using this tool (death by a thousand cuts style) and you'll need to hire more people to fix whatever this thing fucks up. Just about the opposite of what automation is supposed to help with. Good luck!

That's completely right, the testimonials will look really strange if the names have 3+ words in them. That's why we're targeting really strong developers to review Sweep's PRs. An experienced dev(like you) will be able to read the code, think "hey this needs tests and edge cases" and then request changes instead of merging it.

Thanks for staying constructive and on topic. Super interesting tool and amazing video!

Is Sweep also taking in suggestions and then incorporates them with follow-up commits to the PR?

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#64
Excellent, this solves the #1 problem I've had with LLM development assist -- providing context of the existing application source when making new requests. Delivering the output via a PR is a nice touch. Already created 2 PRs. Still need a tiny bit of tweaking manually before I merge these, but definitely saved at least 30 mins. Here are the 2 PRs that it generated for others curious to see its capabilities: https://github.com/3DStreet/3dstreet/pull/324 https://github.com/3DStreet/3dstreet/pull/325

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#65

Earlier quoted context omitted.

I just had it fix some outdated copy in a part of the UI. The nice thing is I didn't have to find the file myself, I just described what was wrong like I would a junior eng and let it find and fix it. Worked on the first try!

That's exactly the use case we want. We also let you specify the file path (ex: "main.py"). We noticed that Sweep's search works way better if there are comments, because the comments match up really well with the search queries (language language is easier than language code)

Did you consider first asking LLM to explain what a code snippet does and use that instead?

It'd significantly increase the costs though.

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#67
post #64

Excellent, this solves the #1 problem I've had with LLM development assist -- providing context of the existing application source when making new requests. Delivering the output via a PR is a nice touch. Already created 2 PRs. Still need a tiny bit of tweaking manually before I merge these, but definitely saved at least 30 mins. Here are the 2 PRs that it generated for others curious to see its capabilities: https:/…

These are nice PRs, also github.3dstreet.org is super cool! I'm glad it's passing the GitHub actions. Do you have any workflows that would be more helpful to you?

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#68

How is your experience with Modal? And I'm curious to know more about your costs of deployment and running on Modal.

Modal is great, it's been able to handle us chunking 10k files/second. Most of the costs come from embedding(couple hundred to embed tens of thousands of repos a month). Our chunker was in the tens of dollars as well.

The developer experience is also great, so we highly recommend it :)

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#69

Earlier quoted context omitted.

That's completely right, the testimonials will look really strange if the names have 3+ words in them. That's why we're targeting really strong developers to review Sweep's PRs. An experienced dev(like you) will be able to read the code, think "hey this needs tests and edge cases" and then request changes instead of merging it.

Thanks for staying constructive and on topic. Super interesting tool and amazing video! Is Sweep also taking in suggestions and then incorporates them with follow-up commits to the PR?

Yes Sweep does! It's through file comments and PR comments. We also handle failing GitHub actions.

Re: Launch HN: Sweep (YC S23) – A bot to create simple PRs in your codebase

#70

Earlier quoted context omitted.

That's exactly the use case we want. We also let you specify the file path (ex: "main.py"). We noticed that Sweep's search works way better if there are comments, because the comments match up really well with the search queries (language language is easier than language code)

Did you consider first asking LLM to explain what a code snippet does and use that instead? It'd significantly increase the costs though.

I didn't mention this point, but we actually do that during the modification. We ask the LLM to extract the necessary subcontext from the main context. It doesn't increase the costs much, but it does help performance because the unnecessary context is stripped away.
Post reply on HN