Host Your Own Copilot

#1

Post by LarsDu88 » Tue, Aug 20, 2024, 3:52 PM UTC

Re: Host Your Own Copilot

#2

Post by LarsDu88 » Tue, Aug 20, 2024, 3:52 PM UTC

I've been experimenting recently with replacing Github Copilot with one of the open source and open weight alternatives. This post goes over how to set these up!

Re: Host Your Own Copilot

#3

Post by [deleted] » Tue, Aug 20, 2024, 4:38 PM UTC

[deleted]

Re: Host Your Own Copilot

#4

Post by arunabha » Tue, Aug 20, 2024, 5:14 PM UTC

I'm confused. The article ends up using a cloud service (NVidia NIM) as the backend anyway, so is it still self hosted?

Re: Host Your Own Copilot

#5

Post by darknavi » Tue, Aug 20, 2024, 5:15 PM UTC

FYI the syntax highlighting on some of the code blocks makes it unreadable.

Re: Host Your Own Copilot

#6

Post by mistrial9 » Tue, Aug 20, 2024, 5:33 PM UTC

arunabha wrote: post #4

I'm confused. The article ends up using a cloud service (NVidia NIM) as the backend anyway, so is it still self hosted?

the article talks about a dozen options.. the one you mention is just one of those

Re: Host Your Own Copilot

#7

Post by LarsDu88 » Tue, Aug 20, 2024, 5:54 PM UTC

darknavi wrote: post #5

FYI the syntax highlighting on some of the code blocks makes it unreadable.

I've been trying to figure out how to change the color in my Hugo based static site generator, but its damn near impossible to locate the appropriate CSS

Re: Host Your Own Copilot

#8

Post by LarsDu88 » Tue, Aug 20, 2024, 5:56 PM UTC

arunabha wrote: post #4

I'm confused. The article ends up using a cloud service (NVidia NIM) as the backend anyway, so is it still self hosted?

Actually self-hosting without using the cloud at all involves building a multi-gpu rig.

NIMs are just to try out the concept.

Honestly, doing it this way is still a bit more secure than using OpenAI or Anthropic directly because its a slight guard against your code being used in future training sets for the next iteration of their AI.

Re: Host Your Own Copilot

#9

Post by lostmsu » Tue, Aug 20, 2024, 8:11 PM UTC

Too bad in the model comparison table they did not include the GitHub Copilot itself.

Re: Host Your Own Copilot

#10

Post by ramon156 » Tue, Aug 20, 2024, 8:52 PM UTC

LarsDu88 wrote: post #8

arunabha wrote: post #4

I'm confused. The article ends up using a cloud service (NVidia NIM) as the backend anyway, so is it still self hosted?

Actually self-hosting without using the cloud at all involves building a multi-gpu rig. NIMs are just to try out the concept. Honestly, doing it this way is still a bit more secure than using OpenAI or Anthropic directly because its a slight guard against your code being used in future training sets for the next iteration of their AI.

And that's bad because? You want to use a product without improving it?