Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

news.ycombinator.com

Post reply on HN
Print view View original

81–90 of 100 posts

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#81

Post by simpaticoder »

geepytee wrote: post #50
simpaticoder wrote: post #13

Was an early adopter of Github Copilot but I quickly turned it off because of the noise. I really like AI for "gap filling" (for example, I used AI extensively to help me write my bash deployment scripts for simpatico.io) and porting tasks, both of which lend themselves to copy/paste into a browser.

When you say noise do you mean the autocomplete just spamming you all the time, like for example in the middle of writing a comment?

Yes, it would often offer unwanted and/or incorrect suggestions that I found distracting. It did not justify the 10% of useful suggestions it made. My usage pattern turns out to be quite copy/paste friendly - it leaves my editor quiet but still gives me the ability to answer "knowledge gap" type questions.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#82

Post by __rito__ »

Even the free ChatGPT-3.5 beats paid GitHub Copilot in code quality and problem solving.

I used Copilot for a while, and it's no more than very smart autofill and good at generating boilerplate.

ChatGPT actually solves (some, minor) problems. I kept using Copilot because of comfort, and it having the context. But I stopped using it 2-3 months ago, and haven't looked back.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#83

Post by lolc »

mediaman wrote: post #40
burkaman wrote: post #8

I don't think it's the best assistant by ability, but if you're like me and you bought a lifetime Tabnine subscription for $29 when it debuted on HN in 2018 ( https://news.ycombinator.com/item?id=18393364 ), maybe reinstall it and try it out. I've been using it and I would say it is better than nothing.

The creator of tabnine also just released supermaven. I’ve liked it so far because it’s fast and holds a lot more of my project in context (300k tokens) so it’s better at using data structures or functions I’ve defined elsewhere.

What I like most about Supermaven is how it's trying to complete the diff, not the file. It knows the field I just added in another file. And it works towards a commit. I still have to figure out which files to open, and I hope there will be solutions to that.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#84

Post by singularity2001 »

SOLAR_FIELDS wrote: post #62
geepytee wrote: post #47

Earlier quoted context omitted.

The issue with local IMO is that you'll going to have to compromise on quality. And I really don't want to waste my time talking with inferior models when better models are widely available.

Yeah, at the time of writing this comment it feels like if you want to easily convince me that your local LLM is good enough, just do a side by side comparison of prompts with your LLM vs GPT4. It doesn’t even have to be better. It just has to be kind of in the same ballpark

people who think that their local LLM's are in the same ballpark as GPT or Claude are delusional

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#85

Post by singularity2001 »

shakabrah wrote: post #10

Cursor is really great. It will do codebase search as well as actually apply the code it suggest from the chat interface. Some other neat features like checking your staged changes for bugs.

One thing that's really annoying is that it doesn't offer suggestions or fixes for (compile) errors which some other plug-ins do

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#86

Post by joshstrange »

geepytee wrote: post #37
cheema33 wrote: post #12

I have been a big user of ChatGPT-4 ever since it came out. I have used in various forms. Through the chatbot, through GitHub Copilot etc. For the past year, I have looked high and low to see an alternative that performed better. Nothing came close. Until a few days ago with Anthropic released Claude 3. For software development work, it is very very impressive. I've been running GPT-4 and Claude 3 Opus side by side f…

+1, Claude 3 Opus is a game changer. Since OP asked about a Copilot product, we (YC W23) actually built https://double.bot to do exactly this: high quality UX + most capable models. Although we don't have a subscription right now, it's free for the time being :)

Don’t have a subscription? What about this? [0]

Not that I mind a subscription, I’d pay it in a heartbeat if there were a JetBrains plugin.

[0] https://docs.double.bot/pricing

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#87

Post by xpe »

geepytee wrote: post #37
cheema33 wrote: post #12

I have been a big user of ChatGPT-4 ever since it came out. I have used in various forms. Through the chatbot, through GitHub Copilot etc. For the past year, I have looked high and low to see an alternative that performed better. Nothing came close. Until a few days ago with Anthropic released Claude 3. For software development work, it is very very impressive. I've been running GPT-4 and Claude 3 Opus side by side f…

+1, Claude 3 Opus is a game changer. Since OP asked about a Copilot product, we (YC W23) actually built https://double.bot to do exactly this: high quality UX + most capable models. Although we don't have a subscription right now, it's free for the time being :)

For those who have read Vonnegut, the Claude logo is hilarious.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#88

Post by 3abiton »

fzzzy wrote: post #76
3abiton wrote: post #53

Earlier quoted context omitted.

Haven't found any good local model yet that rivals or come close to gpt-4

Have you tried miqu q5

I have dabbled with the quant version (exl), still not the same. Which quant/version are you using? There are so many that the output shifts dramatically!

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#89

Post by onel »

willsmith72 wrote: post #45
switchbak wrote: post #29

Earlier quoted context omitted.

I see a whole lot of potential in these tools, and in some domains they are starting to deliver on some of the promise. But by and large I agree with this statement - they're actually costing me time because I have to do the research to see where they went wrong. I'm better off learning it properly and idiomatically from scratch right now.

I don't get this at all. What kind of code are you writing that you have to literally go and research what it spat out? In my experience 90% of code is 90% the same as another piece of code in the same repo, with small differences, and copilot will make you fly writing that code. If you can't read the output code, does it mean the rest of your codebase is similarly unreadable? The complexity in a codebase or a system…

This can happen when you are working with new codebases or APIs. For example, recently I tried to build this small gnome extension [0] but I had 0 experience with the API. So I tried chat gpt.

Even though the structure of the code in the file was ok, it called some APIs that did not exist, it created a new var `this._menu` for the dropdown that was not needed (this.menu already exists) and in the end I still had to go through gnome extensions docs to figure out how to do it right.

Overall I don't regret using it but the experience wasn't magical, as I guess we all want it.

[0]: https://github.com/onel/keyboard-cat-defense

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#90

Post by fzzzy »

3abiton wrote: post #88
fzzzy wrote: post #76

Earlier quoted context omitted.

Have you tried miqu q5

I have dabbled with the quant version (exl), still not the same. Which quant/version are you using? There are so many that the output shifts dramatically!

I'm using gguf q5 and I find the output degrades going to even q4. Mistral has said they still intend to open newer bigger models, so I'm really looking forward to that.
Post reply on HN