Ask HN: What is the, currently, best Programming LLM (copilot) subscription? • Hacker News Board

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#31

Post by wanderingbit » Thu, Mar 07, 2024, 10:06 PM UTC

SOLAR_FIELDS wrote: post #5

OpenAI API key with GPT4 plus aider[1]: https://github.com/paul-gauthier/aider For reference against the actual product called “Copilot”, I would say this is actually useful, vs Copilot which I would use words like “glorified autocomplete” and “slightly better intellisense” to describe. Only really good for saving you some rote typing periodically. The primary limit with “aider” is the GPT4 context window, so really…

I switched from GitHub Copilot to Sourcegraph and have not wanted to switch back yet.

The output is more or less of similar quality as far as I can tell. However, what makes me like Sourcegraph's Cody more is the more advanced interface it gives me in VSCode. It allows me to do all the things I want (get quick answers to code-related questions, refactor code, write tests, and explain code that's confusing) all one hot key away.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#32

Post by jdale27 » Thu, Mar 07, 2024, 10:09 PM UTC

AlexanderNull wrote: post #19

Neither Github Copilot nor GPT4 are worth your time. At best they partially guess the name of a function you're thinking about typing, at worst they give you almost a correct answer. I've been shocked by how close those models will get to almost understanding what you're attempting to do, while still fundamentally getting it wrong. Last month, after a while of realizing I was spending more time correcting suggestions…

This resonates with my recent experience using Bard (not the latest version of Gemini). It would produce something that initially seemed surprisingly good, but then when I actually tried to run it it turned out to be totally broken. I'd ask it to fix the error; it would magically do so but then be broken in a different way. It felt like pair programming with a junior programmer who just didn't quite get it.

This was just me interacting through text prompts. I could imagine some kind of more integrated solution where you can provide some basic test cases, and the system would run those cases through code proposed by the LLM could go a long way towards improving this.

For now it seems mainly useful as a way of getting a quick first draft of some code which I then have to fix up and get fully working myself.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#33

Post by oksurewhynot » Thu, Mar 07, 2024, 10:10 PM UTC

Supermaven slaps

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#34

Post by brunooliv » Thu, Mar 07, 2024, 10:10 PM UTC

Is Claude 3 on a pay per use case or a fixed monthly fee? I’ve used it a bit with the free 5USD they have and it’s looking so so much better than gpt 4… the problem is I have the feeling it’s also extremely more expensive

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#35

Post by infecto » Thu, Mar 07, 2024, 10:12 PM UTC

tomwojcik wrote: post #16

Filligree wrote: post #14

Earlier quoted context omitted.

How do you get access to Claude 3? It doesn’t seem to be available yet.

Isn't it available via bedrock already?

Only Sonnet, unless there is a special release group that have access to the other models.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#36

Post by infecto » Thu, Mar 07, 2024, 10:14 PM UTC

vector_rotcev wrote: post #2

The AI Assistant in JetBrains is the best I've encountered. In Pycharm, specifically. I've tried using my OpenAI subscription directly to use GPT4, but copy-pasting between the browser and the lack of context (that GPT has of my code) is limiting. I've tried Copilot, but it just produces large amounts of junk code, and it gets irritating. JetBrain's AI Assistant is built into the IDE I use, it melds well with all the…

I need to try it out. I have been using a mixture of the Copilot plugin for autocomplete and then a third party package that uses an API key for OpenAI. I enjoy the third party package because I can just use 3.5/4 directly with my own system prompt instead of the garbage interface for Copilot or ChatGPT directly.

Edit: Just tried it out again, honestly pretty disappointing. It works and good they released it, Github has been ignoring the Jetbrains experience. Their implementation has bloated UI and I don't like the way they handle prewritten prompts.

I really like this implementation. https://github.com/didalgolab/chatgpt-intellij-plugin

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#37

Post by geepytee » Thu, Mar 07, 2024, 10:14 PM UTC

cheema33 wrote: post #12

I have been a big user of ChatGPT-4 ever since it came out. I have used in various forms. Through the chatbot, through GitHub Copilot etc. For the past year, I have looked high and low to see an alternative that performed better. Nothing came close. Until a few days ago with Anthropic released Claude 3. For software development work, it is very very impressive. I've been running GPT-4 and Claude 3 Opus side by side f…

+1, Claude 3 Opus is a game changer.

Since OP asked about a Copilot product, we (YC W23) actually built https://double.bot to do exactly this: high quality UX + most capable models. Although we don't have a subscription right now, it's free for the time being :)

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#38

Post by fragmede » Thu, Mar 07, 2024, 10:18 PM UTC

in my limited testing, greptile, posted here recently, was really good for understanding an existing codebase, Reich is a large part of real-world programming.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#39

Post by yumraj » Thu, Mar 07, 2024, 10:18 PM UTC

geepytee wrote: post #37

cheema33 wrote: post #12

I have been a big user of ChatGPT-4 ever since it came out. I have used in various forms. Through the chatbot, through GitHub Copilot etc. For the past year, I have looked high and low to see an alternative that performed better. Nothing came close. Until a few days ago with Anthropic released Claude 3. For software development work, it is very very impressive. I've been running GPT-4 and Claude 3 Opus side by side f…

+1, Claude 3 Opus is a game changer. Since OP asked about a Copilot product, we (YC W23) actually built https://double.bot to do exactly this: high quality UX + most capable models. Although we don't have a subscription right now, it's free for the time being :)

Free is even better ;), will take a look thanks..

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#40

Post by mediaman » Thu, Mar 07, 2024, 10:19 PM UTC

burkaman wrote: post #8

I don't think it's the best assistant by ability, but if you're like me and you bought a lifetime Tabnine subscription for $29 when it debuted on HN in 2018 ( https://news.ycombinator.com/item?id=18393364 ), maybe reinstall it and try it out. I've been using it and I would say it is better than nothing.

The creator of tabnine also just released supermaven. I’ve liked it so far because it’s fast and holds a lot more of my project in context (300k tokens) so it’s better at using data structures or functions I’ve defined elsewhere.