Live data from Hacker News

GitHub Copilot loses an average of $20 per user per month

thurrott.com

81–90 of 214 posts

Re: GitHub Copilot loses an average of $20 per user per month

#81
post #63

AI is such a huge expectations dichotomy. For those of us used to the continual disappointment that pre-LLM AI was, the current crop of LLM's are amazing, mind blowing things. We start raving about them, so other people take a look expecting that modern LLM's are the greatest thing since sliced bread. They're not quite that, so we get HN comments complaining that AI sucks.

I think the problem is that they aren’t mind-blowing, but an improvement. I resent some LLM implementations on principle, but decided to give these code helpers a try. What I found was they’re reasonably bad, and I kept telling them the solution doesn’t work, only to be presented with a little tweak. So I don’t see the point of outsourcing my thinking, I’d rather remain intelligent and do the search/try/tweak on my o…

> I think the problem is that they aren’t mind-blowing, but an improvement.

You seem to be doing what GP is pointing out.

GP's claim is that the relative improvement itself is mind-blowing, not that the tech is mind-blowing in an absolute sense.

I tend to agree: much of the detraction hangs on current-state rather than a probable potential-state informed by recent relative advancements.

In other words, many proponents are chuffed because of that potential; not because actuality. Likewise, skeptics are reserved because of the actuality, and not because of potential, for whatever reason (there are at least a few main ones, I think).

Re: GitHub Copilot loses an average of $20 per user per month

#84
post #10

How came that usually privacy-minded hn crowd uses run-by-someone-else models so cheerfully and carelessly? You do realize any data sent to MS/openai/anyone will be stored forever and probably be used against you in the (near) future?

HN's privacy-minded crowd and HN's AI-obsessed crowd don't have much crossover, I don't think.

Re: GitHub Copilot loses an average of $20 per user per month

#85

Thus, the price of Github Copilot is going to go up, 2x to 5x. For all of the criticism of Github Copilot, for a lot of developers (but not all), the value Github Copilot is incredibly high, much more than $20/month. The current rock bottom pricing is low compared to the value provided for those users. As such there is a big opportunity to multiply the price here being charged. Probably an increase between 3x to 5x.…

I don't think so. It helps increase productivity but it's just too inaccurate and generates too much stupid output. Not that I could do better but it's just not good enough yet.

Re: GitHub Copilot loses an average of $20 per user per month

#86
post #13

Earlier quoted context omitted.

Copilot is chat gpt4, and has been since roughly April. It's built on top of it.

The underlying model might be as good, but how you interface with it seems to deliver wildly different results. I can easily get chat-gpt to give me entire blocks of code. Copilot just trickles out small bits. Copilot is also very distracting because I find myself constantly waiting to see if what it's going to do next is helpful or not, whereas just typing into chat gpt I know I'm going to get something in the direc…

For me it is very different use cases. Copilot often prevents me from needing to write mundane blocks of code, as it will often fill in what I'm looking for after I write the function name.

If I'm still unsure how I might approach a certain problem, or if it isn't immediately clear to me how I'd write the function I want, I might type in a prompt to ChatGPT and see what it comes up with. But it would really slow down my workflow if I had to prompt ChatGPT for every mundane function I plan to write.

Re: GitHub Copilot loses an average of $20 per user per month

#88
post #24

Earlier quoted context omitted.

I've used some prototypes that tried it. One of the things it does it regurgitate the old patterns you want to stop using and not the new stuff you do. Basically it's a copy pasta tech debt generator.

That's a problem with all LLMs. They will average what they are trained on, without any reflection what is good and what is not. They shouldn't be called intelligent (AI), they're information meatgrinders.

For me, "intelligence"[0] is a real-valued vector rather than a boolean.

If it was a boolean, the limits you describe would certainly exclude some of the human programmers whose nonsense I have had to fix.

[0] and "generality", though "AGI when?" is a separate topic

Re: GitHub Copilot loses an average of $20 per user per month

#89
post #51

So the service costs MSFT an average of $30/user/month. So if they want to make a business with decent margins out of this, they're going to need to charge $60/user/month or more. That's not too much if it's adding a lot of value but it's also definitely a lot of money. It would be the most expensive SaaS my team pays for (and we have a lot of subscriptions).

Also, that is assuming that the group willing to pay $60/month includes many who use the service less than average. It's possible that only heavy users would stick around after a 6x price increase.

Re: GitHub Copilot loses an average of $20 per user per month

#90
post #13
post #6

Copilot is useless compared to chat-gpt4. There's really no comparison. As far as the costs, it seems like transmitting things repeatedly would be more expensive than the chat model where you just transmit things when you want them.

Copilot is chat gpt4, and has been since roughly April. It's built on top of it.

It’s built on it, and pretrained on most of the open source code on GitHub.
Post reply on HN