Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub Copilot loses an average of $20 per user per month

thurrott.com

Post reply on HN
Print view View original

11–20 of 214 posts

Re: GitHub Copilot loses an average of $20 per user per month

#11

Post by bloopernova »

The article says Microsoft wants computers to one day have Neural Processing Units (NPU) like most have GPUs. If that led to faster suggestions for copilot, I'd be all for it.

Right now, a GPU is an NPU. Does anyone how an NPU would differ from a graphics card?

Re: GitHub Copilot loses an average of $20 per user per month

#12

Post by thsksbd »

cabirum wrote: post #10

How came that usually privacy-minded hn crowd uses run-by-someone-else models so cheerfully and carelessly? You do realize any data sent to MS/openai/anyone will be stored forever and probably be used against you in the (near) future?

Todays HN is as interesting as it was back in 2011. But it is not privacy minded like it once was (was it ever?) at all.

Re: GitHub Copilot loses an average of $20 per user per month

#13

Post by tedivm »

linuxftw wrote: post #6

Copilot is useless compared to chat-gpt4. There's really no comparison. As far as the costs, it seems like transmitting things repeatedly would be more expensive than the chat model where you just transmit things when you want them.

Copilot is chat gpt4, and has been since roughly April. It's built on top of it.

Re: GitHub Copilot loses an average of $20 per user per month

#15

Post by dragontamer »

bloopernova wrote: post #11

The article says Microsoft wants computers to one day have Neural Processing Units (NPU) like most have GPUs. If that led to faster suggestions for copilot, I'd be all for it. Right now, a GPU is an NPU. Does anyone how an NPU would differ from a graphics card?

GPUs are a SIMD architecture designed for 4x4 float32 matrix multiplications found in video games.

But NPUs (like Googles NPU) are systolic arrays designed for 16x16 or even 256x256 float16 or even int8 matrix multiplications instead.

-------

NVidia builds larger matrix multiplications out of the 4x4 float16 base that a SM is designed for. After all, a 8x8 matrix multiplication is just four of the smaller 4x4 matrix multiplications.

Re: GitHub Copilot loses an average of $20 per user per month

#16

Post by tandav »

Does anyone know vscode extension that can use OpenAI API to perform code completions like Copilot?

There are several ChatGPT-like UIs that you can self host and pay only for API and not for ChatGPT plus. For example, I'm using https://github.com/Yidadaa/ChatGPT-Next-Web. It would be nice to use Copilot in the same way.

Re: GitHub Copilot loses an average of $20 per user per month

#17

Post by Squarex »

bloopernova wrote: post #11

The article says Microsoft wants computers to one day have Neural Processing Units (NPU) like most have GPUs. If that led to faster suggestions for copilot, I'd be all for it. Right now, a GPU is an NPU. Does anyone how an NPU would differ from a graphics card?

isn't it what neural engine on apple silicon is?

Re: GitHub Copilot loses an average of $20 per user per month

#18

Post by tmikaeld »

tedivm wrote: post #13
linuxftw wrote: post #6

Copilot is useless compared to chat-gpt4. There's really no comparison. As far as the costs, it seems like transmitting things repeatedly would be more expensive than the chat model where you just transmit things when you want them.

Copilot is chat gpt4, and has been since roughly April. It's built on top of it.

To be fair, before they switched to GPT-4 it was pretty bad..

Re: GitHub Copilot loses an average of $20 per user per month

#19

Post by yjftsjthsd-h »

cabirum wrote: post #10

How came that usually privacy-minded hn crowd uses run-by-someone-else models so cheerfully and carelessly? You do realize any data sent to MS/openai/anyone will be stored forever and probably be used against you in the (near) future?

Are you sure it's the same people? That said, even if it is, there's something to be said for intentionally sharing a constrained set of code vs using something that spies on you in real life.

Re: GitHub Copilot loses an average of $20 per user per month

#20

Post by noodlesUK »

I feel like the centralisation of server resources for something like copilot doesn’t really make sense. Many (most) professional developers are working on beefy laptops. If ever there were a case to run these models client side, a software developer’s laptop is probably the ideal place. What are the specs that are needed to run inference on these models?
Post reply on HN