Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

JetBrains AI

jetbrains.com

Post reply on HN
Print view View original

41–50 of 113 posts

Re: JetBrains AI

#41

Post by _boffin_ »

janice1999 wrote: post #33
_boffin_ wrote: post #26

I will only want to use this if i'm able to host the LLM locally. Currently using CodeGPT and running CodeBooga 34b @ 4bit on my work laptop. This is good enough for me, but i'd love some more advanced functionality, such as code completion. CodeGPT - Repo: https://github.com/carlrobertoh/CodeGPT - Plugin: https://plugins.jetbrains.com/plugin/21056-codegpt

> running CodeBooga 34b @ 4bit on my work laptop. How much RAM or VRAM does that require?

Max ram is saying 22.72GB. They gave me a laptop with a M2 MAX and 64GB of ram. I'm loving the fact that i can toss any piece of code in there without having to worry about data privacy issues and or any retention policies of service providers.

Re: JetBrains AI

#42

Post by bluish29 »

yunohn wrote: post #30
bluish29 wrote: post #24

Earlier quoted context omitted.

I bet you can get more utility from a $10 coffee if you are making it at home/office. That doesn't mean the price isn't good, I just hate the coffee comparison so much I couldn't resist replying.

What? No, I don’t understand your reply at all. I wouldn’t value a one off coffee greater than a month of AI assistance. In fact, I could compile a long list of things that I pay 10$/month for that are less valuable. You’re a developer - no matter how low your salary is, 10$ is incredibly cheap.

> I wouldn’t value a one off coffee greater than a month of AI assistance.

My point is that if you are making coffee and not buying it ready from some expensive place just because the name then $10 wouldn't give only two cups. I bet you might spend about $10 per whole month in many places if you making it yourself.

> You’re a developer - no matter how low your salary is, 10$ is incredibly cheap.

That's a good argument, my point was not saying that price is expensive. Just the coffee comparison is not true. Also one can talk about people working as programmers outside NA and EU but well probably they will probably not be using jetbrains IDEs but they are free for students. I really hoped they would have some education discount.

Re: JetBrains AI

#43

Post by topka »

stetrain wrote: post #7

Pricing seems to be $10/mo or $100/yr. Personally I find that a bit steep when I'm already paying $100/yr for the Rider IDE (multi year concurrent discounted rate). Commercial pricing is $250/yr+ for just the IDE. I know that's about the same as Github Copilot, but the downside to Jetbrains is if I switch to another IDE to get AI features (ie VSCode), then I'll stop paying their IDE subscription as well. Edit: It als…

trial for commercial means for paying customers, including individuals.

Re: JetBrains AI

#44

Post by ctvo »

ta988 wrote: post #38
ctvo wrote: post #36

> We take data and code security seriously! Our products do not send more data to the LLMs than needed. Neither we nor our service providers use your data or code for training any generative models. For stricter requirements, we will make it possible for you to use your preferred on-premises models (coming soon) and connect them to the JetBrains AI service AI and the JetBrains products that your team uses. Until they…

That's the same as what Copilot does.

I don't use Copilot and know a handful of Fortune 50 companies that won't use it either. Developers do silly things like hard coding credentials when they're testing, as a very basic example, and it's hard to imagine how this is safe.

Re: JetBrains AI

#45

Post by CodeNest »

JCharante wrote: post #25

I used it and then immediately stopped using it. The experience is even worse than just copy pasting code into chatgpt on your own.

I completely agree; they just developed a UI for ChatGPT, that's all.

Re: JetBrains AI

#46

Post by yunohn »

bluish29 wrote: post #42
yunohn wrote: post #30

Earlier quoted context omitted.

What? No, I don’t understand your reply at all. I wouldn’t value a one off coffee greater than a month of AI assistance. In fact, I could compile a long list of things that I pay 10$/month for that are less valuable. You’re a developer - no matter how low your salary is, 10$ is incredibly cheap.

> I wouldn’t value a one off coffee greater than a month of AI assistance. My point is that if you are making coffee and not buying it ready from some expensive place just because the name then $10 wouldn't give only two cups. I bet you might spend about $10 per whole month in many places if you making it yourself. > You’re a developer - no matter how low your salary is, 10$ is incredibly cheap. That's a good argumen…

If you want to make coffee at home, sure the amortized cost could be less than $10/mo. But, I wouldn’t consider that a fair comparison - probably running a code LLM locally could also turn out cheaper.

We’re talking about paying others for the work instead of doing it ourselves. If not a coffee, eating out at a restaurant or buying an tshirt - anything can easily blow through $10 in one go.

The problem is that the upfront GPU hardware is expensive, both for training and inference. You could save on electricity by relocating datacenters, but probably wouldn’t make a big difference. Sadly, geo-based pricing might be difficult for LLMs.

Re: JetBrains AI

#47

Post by unshavedyak »

Sidenote, are there any videos of a real world developer just programming real stuff, and using AI integrations like these sprinkled in? I'd be really curious to see how someone uses this.

I use GPT/etc (currently through Kagi's Ultimate) so i have long seen value in them, but i've not yet figured out how to bridge the gap with integrating it directly into my code. Too often i feel like i'm writing logic and i don't trust LLMs to be accurate enough there. Sometimes i'm doing weird refactors, so maybe that is the place?

Alas my editor of choice (Helix) doesn't support this so i'm sort of stuck left wondering. Would love to see it in real-world action.

Re: JetBrains AI

#48

Post by rf15 »

janice1999 wrote: post #33
_boffin_ wrote: post #26

I will only want to use this if i'm able to host the LLM locally. Currently using CodeGPT and running CodeBooga 34b @ 4bit on my work laptop. This is good enough for me, but i'd love some more advanced functionality, such as code completion. CodeGPT - Repo: https://github.com/carlrobertoh/CodeGPT - Plugin: https://plugins.jetbrains.com/plugin/21056-codegpt

> running CodeBooga 34b @ 4bit on my work laptop. How much RAM or VRAM does that require?

In my experience the vastly oversimplified-beyond-actual-usability calculation is that you take the parameter number (34) and count that as the amount in GB you'd need for an 8 bit model. with a 4-bit quantization that's halved, so your ball park is 17 GB plus a few GB for context. You can run these in RAM, but it's not very fast with (if I had to guess) slightly less than 1 Token/sec. on most non-apple consumer devices.

Re: JetBrains AI

#49

Post by WillPostForFood »

reactordev wrote: post #16

As someone who has been test driving this, I feel like this should just be value-add to the IDE. A reason for the subscription beyond DataGrip and Refactor tooling. It's decent for what it does but an extra $10/mo or $100/yr on top is a hard pill to swallow when VS Code is free and Copilot is $10/mo.

Is it at least as good as using Copilot in the Jetbrains IDE?
Post reply on HN