Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub Copilot loses an average of $20 per user per month

thurrott.com

Post reply on HN
Print view View original

131–140 of 214 posts

Re: GitHub Copilot loses an average of $20 per user per month

#131

Post by TillE »

baq wrote: post #68
insanitybit wrote: post #47

Earlier quoted context omitted.

I don't think most dev laptops have 8GB+ of GPU memory, which (based on ollama requirements) seems like it's on the low-mid end of the requirements. I've tried experimenting with some local models and: a) They're much slower on my 6GB laptop GPU b) The seem to not be as good, functionally b) I can't make use of larger models I haven't done more than just some experimentation but I can see how this would make sense to…

MacBooks especially pros are in a very privileged position due to their memory architecture. With some dedicated hardware it may be reasonable to run, perhaps even train, useful LLMs on device. I guess we’ll see in a year or two. This must be on everyone’s radar now, Apple won’t be the odd man out.

AMD is probably best positioned to make a laptop/desktop SoC with the same kind of unified memory. Though I wouldn't be surprised if Intel's little experiment in budget dedicated GPUs is also a byproduct of similar R&D.

Lisa Su was interviewed at Code recently, and the AI discussion focused on competing against NVIDIA in big datacenters, but I hope they're also thinking about client-side stuff like that.

Re: GitHub Copilot loses an average of $20 per user per month

#132

Post by yjftsjthsd-h »

cabirum wrote: post #56
weikju wrote: post #52

Earlier quoted context omitted.

> upload the full source code of the app you are writing The full code that’s already uploaded via “git push”?

... via git push to a trusted origin, which is not github.

I suppose it happens, but I suspect the set of people who distrust github/MS enough to not use them for git hosting but still use copilot is quite small.

Re: GitHub Copilot loses an average of $20 per user per month

#134

Post by aryadee »

GitHub Copilot is not using GPT-4 (yet)! I'm seeing a lot of people under the wrong impression.

For code completions it uses an improved version of Codex[1], and for chat beta (part of Copilot X), it uses 3.5-Turbo[2].

However, they're claiming to have "early adoption of OpenAI's GPT-4" for Copilot X on their marketing page[3], which is confusing/deceptive. To be fair, it's still in beta, but they should state outright what model you currently get if you sign up for it.

[1]: https://github.blog/2023-07-28-smarter-more-efficient-coding...

[2]: https://github.com/orgs/community/discussions/56975#discussi...

[3]: https://github.com/features/preview/copilot-x

Re: GitHub Copilot loses an average of $20 per user per month

#135

Post by bloopernova »

visarga wrote: post #74
bloopernova wrote: post #11

The article says Microsoft wants computers to one day have Neural Processing Units (NPU) like most have GPUs. If that led to faster suggestions for copilot, I'd be all for it. Right now, a GPU is an NPU. Does anyone how an NPU would differ from a graphics card?

> Does anyone how an NPU would differ from a graphics card? Compare NVIDIA to Groq TSP (Tensor Streaming Processor) This is how an AI chip should be designed, you write the neural net compiler first, then design the chip. These guys have combined a number of smart ideas in their product: synchronous operation makes memory and network operations simpler to plan and optimise; all software defined memory access, no cach…

Very cool stuff, thank you for the new information

Re: GitHub Copilot loses an average of $20 per user per month

#136

Post by monocasa »

jrockway wrote: post #106
monocasa wrote: post #99

Doesn't copilot slurp up oodles of the code in your workspace for non corporate accounts? Is that data acquisition maybe worth the cost to Microsoft? I know they have github, but tiny scripting glue tasks like copilot excels at aren't the best represented on GitHub.

I use Copilot in Emacs and it doesn't send Github any data other than my prompt.

The vast majority of people using copilot aren't using it that way.

Re: GitHub Copilot loses an average of $20 per user per month

#137

Post by yeck »

habosa wrote: post #51

So the service costs MSFT an average of $30/user/month. So if they want to make a business with decent margins out of this, they're going to need to charge $60/user/month or more. That's not too much if it's adding a lot of value but it's also definitely a lot of money. It would be the most expensive SaaS my team pays for (and we have a lot of subscriptions).

As users' codebases grown over time, the average usage of users will probably continue to grow. By a static price increase alone won't be a great model. They need to make their models and infrastructure more efficient first.

Or create a pricing model where the monthly sub covers a certain amount of tokens and then beyond that is pay-as-you-go. Sucks for users, but a scalable model.

Re: GitHub Copilot loses an average of $20 per user per month

#138

Post by WillPostForFood »

SadWebDeveloper wrote: post #129

I would gladly pay for copilot 5 USD a month (its an specific use case IA), but the current price point 20 month is incredible expensive it only add costs if the developer you are hiring requires it to properly function... thats the only value it adds. IMHO If you are a code monkey copilot makes you a 5x developer, 10x if you have 5+ years of experience on the business Maybe selling tokens/search could be benefitial…

$20 a month is incredibly expensive? If it saves 15 minutes over a month, it pays for itself (assuming your work is ~$100/hr). If it can provide any positive value, it is going to be worth more the $5 a month.

Re: GitHub Copilot loses an average of $20 per user per month

#140

Post by tristanb »

I use Copilot... Or rather I pay for it. I pretty much always end up using ChatGPT4. I honestly haven't had a very good experience with Copilot. It never "learns" anything. It doesn't remember where my imports are, it gives me the wrong paths all the time. Sure occasionally it will write a nice comment for me when I make a new prop, but other than that it's not as good for writing code as GPT4, and its auto suggestions are pretty weak. Wondering if others have different opinions.
Post reply on HN