Live data from Hacker News

Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

news.ycombinator.com

71–80 of 100 posts

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#71

Earlier quoted context omitted.

How do you get access to Claude 3? It doesn’t seem to be available yet.

Another option: Kagi's chat feature lets you choose Claude 3 Opus (or GPT-4 or Mistral).

You have to pay for Kagi Ultimate ($25/month) to access it I think.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#72

Earlier quoted context omitted.

Isn't it available via bedrock already?

Not sure what bedrock is, but last time I looked at their website it claimed it isn't available in my region. I'm in Ireland, so I interpreted that as "Not out yet".

> I'm in Ireland, so I interpreted that as "Not out yet".

What I interpret it as is "Not compliant with GDPR yet".

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#73

I'm biased, but Sourcegraph Cody has changed the way I write code. https://sourcegraph.com/cody And we just shipped support for Claude 3 (Opus and Sonnet) as well as using any local LLM via Ollama for completions and chat.

Does the Claude 3 support only apply to the VSCode plugin right now? I'm using the Jetbrains plugin and I don't see an option to use Claude 3.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#74

Earlier quoted context omitted.

The issue with local IMO is that you'll going to have to compromise on quality. And I really don't want to waste my time talking with inferior models when better models are widely available.

Yeah, at the time of writing this comment it feels like if you want to easily convince me that your local LLM is good enough, just do a side by side comparison of prompts with your LLM vs GPT4. It doesn’t even have to be better. It just has to be kind of in the same ballpark

I'd like to try this, do you have some prompts you like to use for evaluation?

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#75

I have been a big user of ChatGPT-4 ever since it came out. I have used in various forms. Through the chatbot, through GitHub Copilot etc. For the past year, I have looked high and low to see an alternative that performed better. Nothing came close. Until a few days ago with Anthropic released Claude 3. For software development work, it is very very impressive. I've been running GPT-4 and Claude 3 Opus side by side f…

How do you get access to Claude 3? It doesn’t seem to be available yet.

https://double.bot for VS Code works really well for me. https://writingmate.ai/labs for typical browser chat ui (looks ok on mobile too).

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#76
post #53

In addition to paid subscriptions, you might want to consider running an LLM locally. One of a number of projects enabling this approach is "continue" - https://github.com/continuedev/continue

Haven't found any good local model yet that rivals or come close to gpt-4

Have you tried miqu q5

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#77

Cursor is really great. It will do codebase search as well as actually apply the code it suggest from the chat interface. Some other neat features like checking your staged changes for bugs.

Copilot++ in Cursor is a beast, it's my favorite feature of this app.

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#78
for that answer of greatest validity you should e. g. check out "HumanEval" LLM benchmark on HuggingFace website. That is one of the best objective source of info on this issue. Currently Claude 3 is the best, far superior to other models. (85% correct code tasks done. ChatGPT 4 has 65% aprox. This is a giant difference (35% errors vs 15% , so Claude 3 is x2.5 better in terms of code quality losses)

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#79

I was asking myself the same question not so long ago because Github Copilot's bugs kept bothering me and this is what got us to go into YC and build https://double.bot If what you are looking for a high quality UX + access to the most capable models (today that'd be the GPT-4 killer, Claude 3 Opus), then I think you'll like what we've built. Double ha similar features to all the other Copilots, code autocomplete, ch…

A lot of us are already paying for API access from openai/azure/claude

Can double's plugin accept bring your own key like cursor.sh ?

Would love to use an extension with my favorite editor instead of adapting a whole separate editor like cursor.sh

Thanks

Re: Ask HN: What is the, currently, best Programming LLM (copilot) subscription?

#80

I have been a big user of ChatGPT-4 ever since it came out. I have used in various forms. Through the chatbot, through GitHub Copilot etc. For the past year, I have looked high and low to see an alternative that performed better. Nothing came close. Until a few days ago with Anthropic released Claude 3. For software development work, it is very very impressive. I've been running GPT-4 and Claude 3 Opus side by side f…

+1, Claude 3 Opus is a game changer. Since OP asked about a Copilot product, we (YC W23) actually built https://double.bot to do exactly this: high quality UX + most capable models. Although we don't have a subscription right now, it's free for the time being :)

Looks great! Would you have plans to release a jetbrains plugin in future?
Post reply on HN