Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub Copilot loses an average of $20 per user per month

thurrott.com

Post reply on HN
Print view View original

71–80 of 214 posts

Re: GitHub Copilot loses an average of $20 per user per month

#71

Post by baq »

uxp8u61q wrote: post #41
bhouston wrote: post #36

Earlier quoted context omitted.

For some developers for sure, but not all. I am a senior developer with +20 years of experience and I find Github Copilot amazing. It significantly boosts my productivity. I do not expect the world from it, and I do run into limitations, but it helps me tremendously to be productive in languages and tools which I have low/no familiarity. I think Github Copilot paired with ChatGPT fails the most in idiosyncratic code…

It's also amazing to write documentation or unit tests. Or repetitive editing tasks that are hard to automate (e.g. "invert this if condition").

It even does an ok job with ‘rewrite this callback heavy code as async/await’ if you tell it which functions to use instead of ones accepting callbacks.

Re: GitHub Copilot loses an average of $20 per user per month

#72

Post by dist-epoch »

bhouston wrote: post #33

Thus, the price of Github Copilot is going to go up, 2x to 5x. For all of the criticism of Github Copilot, for a lot of developers (but not all), the value Github Copilot is incredibly high, much more than $20/month. The current rock bottom pricing is low compared to the value provided for those users. As such there is a big opportunity to multiply the price here being charged. Probably an increase between 3x to 5x.…

Mark my words, developers will soon pay $5k per month for access to GPT-7 Copilot.

Re: GitHub Copilot loses an average of $20 per user per month

#73

Post by zarzavat »

linuxftw wrote: post #6

Copilot is useless compared to chat-gpt4. There's really no comparison. As far as the costs, it seems like transmitting things repeatedly would be more expensive than the chat model where you just transmit things when you want them.

I disagree. I have both but I use Copilot a lot more. Editing the results of ChatGPT takes as long as it would take for me to write the code myself. Whereas Copilot is autocomplete, you can choose whether to accept it or not line by line.

Re: GitHub Copilot loses an average of $20 per user per month

#74

Post by visarga »

bloopernova wrote: post #11

The article says Microsoft wants computers to one day have Neural Processing Units (NPU) like most have GPUs. If that led to faster suggestions for copilot, I'd be all for it. Right now, a GPU is an NPU. Does anyone how an NPU would differ from a graphics card?

> Does anyone how an NPU would differ from a graphics card?

Compare NVIDIA to Groq TSP (Tensor Streaming Processor)

This is how an AI chip should be designed, you write the neural net compiler first, then design the chip. These guys have combined a number of smart ideas in their product: synchronous operation makes memory and network operations simpler to plan and optimise; all software defined memory access, no caches; a simple set of primitive operations that can express every model architecture - so they can simply make it pytorch compatible, no need to write kernels, no need to have 100 versions of 2D conv, for all sizes and shapes.

https://groq.com/groq-tensor-streaming-processor-architectur...

Groq recently demonstrated 240T/s for LLaMA-2 70B. Probably world record, the next best I know is 40T/s at labs.perplexity.ai

https://youtu.be/hk4QGpQAvSY?t=57

Re: GitHub Copilot loses an average of $20 per user per month

#75

Post by volkk »

tedivm wrote: post #13
linuxftw wrote: post #6

Copilot is useless compared to chat-gpt4. There's really no comparison. As far as the costs, it seems like transmitting things repeatedly would be more expensive than the chat model where you just transmit things when you want them.

Copilot is chat gpt4, and has been since roughly April. It's built on top of it.

Is that actually true? I remember Copilot-X being containing the GPT4 version and I'm pretty sure that wasn't out back in April. I don't even think it was out this summer

Re: GitHub Copilot loses an average of $20 per user per month

#76

Post by dist-epoch »

linuxftw wrote: post #39
tedivm wrote: post #13

Earlier quoted context omitted.

Copilot is chat gpt4, and has been since roughly April. It's built on top of it.

The underlying model might be as good, but how you interface with it seems to deliver wildly different results. I can easily get chat-gpt to give me entire blocks of code. Copilot just trickles out small bits. Copilot is also very distracting because I find myself constantly waiting to see if what it's going to do next is helpful or not, whereas just typing into chat gpt I know I'm going to get something in the direc…

VS Code now has a Copilot Chat panel where you can have large conversations.

Re: GitHub Copilot loses an average of $20 per user per month

#77

Post by DoesntMatter22 »

insanitybit wrote: post #42
bhouston wrote: post #33

Thus, the price of Github Copilot is going to go up, 2x to 5x. For all of the criticism of Github Copilot, for a lot of developers (but not all), the value Github Copilot is incredibly high, much more than $20/month. The current rock bottom pricing is low compared to the value provided for those users. As such there is a big opportunity to multiply the price here being charged. Probably an increase between 3x to 5x.…

I'd probably pay ~2-3x, idk about 5x. I'd consider it though. Hopefully they can cut the costs and meet in the middle.

100 bucks a month I'll gladly pay. It stops me from having to worry about so many annoying coding tasks. I'd maybe consider 2 or 300 a month

Re: GitHub Copilot loses an average of $20 per user per month

#78

Post by criley2 »

js8 wrote: post #24
grogenaut wrote: post #8

Earlier quoted context omitted.

I've used some prototypes that tried it. One of the things it does it regurgitate the old patterns you want to stop using and not the new stuff you do. Basically it's a copy pasta tech debt generator.

That's a problem with all LLMs. They will average what they are trained on, without any reflection what is good and what is not. They shouldn't be called intelligent (AI), they're information meatgrinders.

>That's a problem with all LLMs. They will average what they are trained on, without any reflection what is good and what is not. They shouldn't be called intelligent (AI), they're information meatgrinders.

This is an issue with your prompting not the models.

If you tell someone "Do this thing" they'll just do it, LLM's too. And how it is done will probably be terrible.

If you ask someone "come up with 5 ways to accomplish this, compare and contrast between them, list pros and cons, think through best practices, maintainability, readability, security, performance and cost. Come to a final decision and then do it" their response will be different. So too will the LLM's. You can even have the LLM present its opinions and recommendation but pause and wait for your choice on the go-ahead.

Re: GitHub Copilot loses an average of $20 per user per month

#79

Post by antoineMoPa »

bhouston wrote: post #33

Thus, the price of Github Copilot is going to go up, 2x to 5x. For all of the criticism of Github Copilot, for a lot of developers (but not all), the value Github Copilot is incredibly high, much more than $20/month. The current rock bottom pricing is low compared to the value provided for those users. As such there is a big opportunity to multiply the price here being charged. Probably an increase between 3x to 5x.…

I feel like part of the productivity is just moved to reviewers. Every once in a while, I have to review large PRs and find out which comment is AI-generated nonsense.

LLMs are really good at fooling us into thinking that code comments make sense.

That's why I prefer if devs don't use copilot, but instead cherry pick good output from ChatGPT.

Re: GitHub Copilot loses an average of $20 per user per month

#80

Post by infecto »

bhouston wrote: post #36
LeicaLatte wrote: post #26

GitHub’s CoPilot is the most disappointing of AI products out there.

For some developers for sure, but not all. I am a senior developer with +20 years of experience and I find Github Copilot amazing. It significantly boosts my productivity. I do not expect the world from it, and I do run into limitations, but it helps me tremendously to be productive in languages and tools which I have low/no familiarity. I think Github Copilot paired with ChatGPT fails the most in idiosyncratic code…

Agree with you there. I find it pretty useful especially for the price and where it might evolve in the future.

I am not sure why so many people have hard time getting value out of it.

Post reply on HN