Earlier quoted context omitted.
Ingesting multiple code files will take forever in prompt processing without a GPU though, tg will be the least of your worries. Especially when you don't append but change it in random places so caching doesn't work.
A FIM or completion model like this won't have a large prompt and caching doesn't work anyways (per their notes). It'll get maybe a few thousand tokens in a prompt, maximum. For a 1.5B model, you should expect usable CPU-only inference on a modern CPU, like at least hundreds of tokens per second of prefill and tens of tokens per second of generation, which is decently usable in terms of responsiveness.
Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
111–120 of 160 posts
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#112Hi, I tried the model and I am super impressed by the performance/quality. Thanks for making this open source! I am the author of this Neovim plugin for edit completions. I was able to integrate it with the Sweep Edit model. For anyone who is interested: https://github.com/leonardcser/cursortab.nvim
Is there a port of this to Emacs or integration with gptel?
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#113I've been trying my hands at implementing an emacs package for inline completions with this. I have it mostly working and performance is good enough but I haven't been blown away by the quality of its suggestions unfortunately. Which I guess is expected from a 1.5B model. I'd love to see them making a larger model in the 10-20b range maybe? I know most people wouldn't be able to run that on their machines, but some c…
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#114I've been trying my hands at implementing an emacs package for inline completions with this. I have it mostly working and performance is good enough but I haven't been blown away by the quality of its suggestions unfortunately. Which I guess is expected from a 1.5B model. I'd love to see them making a larger model in the 10-20b range maybe? I know most people wouldn't be able to run that on their machines, but some c…
Do you care to share your implementation?
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#115Sometimes when I use a plugin like this I get reminded just how much of a productivity nerf it is to code without an autocomplete AI. Honestly in my opinion if you write a lot of boilerplate code this is almost more useful than something like Claude Code, because it turbocharges your own train of thought rather than making you review someone else's, which may not align with your vision. This is a really good plugin.…
I have always said this and had people on HN reply that they don't get much use out of autocomplete, which puzzled me. I'm starting to understand that there are two cultures. Developers who are mostly writing new code get the most benefit from autocomplete and comparatively less from Claude Code. CC is neat but when it attempts to create something from nothing the code is often low quality and needs substantial work.…
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#116Sometimes when I use a plugin like this I get reminded just how much of a productivity nerf it is to code without an autocomplete AI. Honestly in my opinion if you write a lot of boilerplate code this is almost more useful than something like Claude Code, because it turbocharges your own train of thought rather than making you review someone else's, which may not align with your vision. This is a really good plugin.…
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#117Earlier quoted context omitted.
I am curious about how both of you think Jetbrains is dropping the ball so much that you are no longer buying the tool. You are still using it but no longer getting updates?
I use free RustRover for my open source work. I have not purchased a (new) license for my commercial work, because I haven't been getting as much value as it since my flow has switched to primarily agentic. Mainly, they're pushing Junie and it just isn't that good or compelling, when faced off against the competition. The key thing for me is that I think they had an opportunity here to really rethink how LLMs could i…
I still buy a personal Ultimate license because I want to see them succeed even if like 80% of my time is spent either in a CLI or Visual Studio Code (for quicker startup and edits), a bit unfortunate that Fleet never got to be really good but oh well.
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#118Hi, I tried the model and I am super impressed by the performance/quality. Thanks for making this open source! I am the author of this Neovim plugin for edit completions. I was able to integrate it with the Sweep Edit model. For anyone who is interested: https://github.com/leonardcser/cursortab.nvim
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#119Earlier quoted context omitted.
I use free RustRover for my open source work. I have not purchased a (new) license for my commercial work, because I haven't been getting as much value as it since my flow has switched to primarily agentic. Mainly, they're pushing Junie and it just isn't that good or compelling, when faced off against the competition. The key thing for me is that I think they had an opportunity here to really rethink how LLMs could i…
> I have not purchased a (new) license for my commercial work, because I haven't been getting as much value as it since my flow has switched to primarily agentic. I still buy a personal Ultimate license because I want to see them succeed even if like 80% of my time is spent either in a CLI or Visual Studio Code (for quicker startup and edits), a bit unfortunate that Fleet never got to be really good but oh well.
I dislike VSCode very much, but I do think the foundational pieces of the JetBrain's IDEs are starting to show their age.
Re: Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete
#120I've been waiting for something like this for ages. Cursor making me pay $20/month when all I use from it is autocomplete was always a little annoying, especially as they changed the UI to push agents more and it got in the way. I was even considering doing it myself but wasn't sure about gambling on models small enough to run locally being smart enough to do anything useful. I threw together a vscode extension to ru…