Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

JetBrains AI

jetbrains.com

Post reply on HN
Print view View original

71–80 of 113 posts

Re: JetBrains AI

#71

Post by rf15 »

ilc wrote: post #66
rf15 wrote: post #56

Earlier quoted context omitted.

Give it another year. In theory it's not going to be difficult, but sampling speed/power consumption is prohibitive for normal hardware at the moment.

Honestly, with a 3090 costing like $700 used. It is within reach of many on this site quite easily, assuming they have a machine to plug the 3090 into. People seem to think the hardware for this stuff is way out there... it is getting to be within reach VERY quickly.

Yes, but if you're looking for code completion at the quality level of Codex/Github Copilot, that's still a bit off.

Re: JetBrains AI

#72

Post by tildef »

boh wrote: post #55
irrational wrote: post #14

Earlier quoted context omitted.

One thing to note is Copilot Chat does not work in JetBrains IDEs, yet. You have to use a text editor like Visual Studio Code instead.

You can apply to get beta access to Chat. It took about a week to get approval for me (I did it last month).

I think the time it takes to get access varies wildly. I signed up for the waitlist for copilot chat in intellij as soon as it became available, and still haven't gotten access. Just cancelled my subscription and will be moving to jetbrains ai, assuming the trial experience isn't too-too horrible.

Re: JetBrains AI

#73

Post by _boffin_ »

rf15 wrote: post #71
ilc wrote: post #66

Earlier quoted context omitted.

Honestly, with a 3090 costing like $700 used. It is within reach of many on this site quite easily, assuming they have a machine to plug the 3090 into. People seem to think the hardware for this stuff is way out there... it is getting to be within reach VERY quickly.

Yes, but if you're looking for code completion at the quality level of Codex/Github Copilot, that's still a bit off.

Can you show me the metrics for that, please.

Additionally, what's your company's IP policy? Do they let you send their code to a remote company or do they see that as a breach of security?

Re: JetBrains AI

#74

Post by ilc »

_boffin_ wrote: post #67
ilc wrote: post #64

Earlier quoted context omitted.

Been using CodeGPT a while myself. Great tool, send e-mail to the author, seems like a good person. I actually hook it up to my Windows gaming rig. The 4090 gets the job done, when I'm not gaming. (I just start the server when I go work, and then stop it when I want to game. It isn't that big a deal. I haven't hit the use-case where I want to use the AI to develop game mods yet. But I'll cross that bridge when I get…

Which model are you using? I tried the deepseek 34b or whatever, but it goes nuts at times. Also, what params do you have for Prompt Context Size and Max Completion Tokens?

Currently Phind_Phind-CodeLlama-34B-v2, gonna try CodeBooga because, I can... that's the point. Use what ya like.

4k/32k, if I remember right. An interesting thing to do is actually try to use a true coding model in a chat. I had one model puking out its stack overflow training data, down to including user IDs.

Oops.

Re: JetBrains AI

#75

Post by LordDragonfang »

justinclift wrote: post #53

Does AI Assistant send data and code fragments from my IDE? When you use AI-powered features, the IDE needs to send your requests and code to the LLM provider. In addition to the prompts you type, the IDE may send additional details, such as pieces of your code, file types, frameworks used, and other information that may be necessary for providing the LLM with sufficient context. That'll eliminate its use from a lot…

That isn't news, that's how all code-completion LLMs work. Unless you're running the LLM locally, in which case the difference is that you are the "LLM provider".

Re: JetBrains AI

#76

Post by ilc »

rf15 wrote: post #71
ilc wrote: post #66

Earlier quoted context omitted.

Honestly, with a 3090 costing like $700 used. It is within reach of many on this site quite easily, assuming they have a machine to plug the 3090 into. People seem to think the hardware for this stuff is way out there... it is getting to be within reach VERY quickly.

Yes, but if you're looking for code completion at the quality level of Codex/Github Copilot, that's still a bit off.

Don't fall into the trap of: It has to be the best or it is useless.

The question for me is: Does it help me get my job done. Does it assist me in ways I find useful.

Re: JetBrains AI

#77

Post by dragonwriter »

rf15 wrote: post #56
_boffin_ wrote: post #26

I will only want to use this if i'm able to host the LLM locally. Currently using CodeGPT and running CodeBooga 34b @ 4bit on my work laptop. This is good enough for me, but i'd love some more advanced functionality, such as code completion. CodeGPT - Repo: https://github.com/carlrobertoh/CodeGPT - Plugin: https://plugins.jetbrains.com/plugin/21056-codegpt

Give it another year. In theory it's not going to be difficult, but sampling speed/power consumption is prohibitive for normal hardware at the moment.

> sampling speed/power consumption is prohibitive for normal hardware at the moment.

For the top-end of existing consumer hardware for the purpose, that might be in the process of changing quite quickly:

https://huggingface.co/blog/optimum-nvidia

Re: JetBrains AI

#78

Post by rf15 »

ilc wrote: post #76
rf15 wrote: post #71

Earlier quoted context omitted.

Yes, but if you're looking for code completion at the quality level of Codex/Github Copilot, that's still a bit off.

Don't fall into the trap of: It has to be the best or it is useless. The question for me is: Does it help me get my job done. Does it assist me in ways I find useful.

I have been using github copilot for a while now, but when I first tested these, together with the code AI offering from Amazon, they were... kinda useless. Only after a few updates did it get to a point that was a net positive in my daily work. And I still occasionally check the local models, and they're still not on a level in their auto-complete capabilities that I'd like to use, at least last time I checked. But I work with other LLMs and the recent advances in speed and the stricter nature of code means that soon-ish we should have a good and fast local model, we're just not there yet.

Re: JetBrains AI

#79

Post by jawngee »

WillPostForFood wrote: post #49
reactordev wrote: post #16

As someone who has been test driving this, I feel like this should just be value-add to the IDE. A reason for the subscription beyond DataGrip and Refactor tooling. It's decent for what it does but an extra $10/mo or $100/yr on top is a hard pill to swallow when VS Code is free and Copilot is $10/mo.

Is it at least as good as using Copilot in the Jetbrains IDE?

I've been futzing with it for the last hour and it's a hard no so far.
Post reply on HN