Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

FauxPilot – an attempt to build a locally hosted version of GitHub Copilot

github.com

Post reply on HN
Print view View original

81–86 of 86 posts

Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot

#81

Post by [deleted] »

Mo3 wrote: post #65
moyix wrote: post #50

Earlier quoted context omitted.

It is possible to fine-tune CodeGen using Huggingface Transformers! Then you'd be able to fine-tune it on your own code and use the resulting model. However, training is more expensive -- you'd need an A6000 or better to train the 6B model. Something like the following should work: deepspeed --num_gpus 1 --num_nodes 1 run_clm.py --model_name_or_path=Salesforce/codegen-6B-multi --per_device_train_batch_size=1 --learni…

I train models 24/7 right now and PLEASE do not use AWS for it. You're going to pay out of your backside for it. Better alternatives: Google Colab, Paperspace Gradient, Lambdalabs Cloud, Vultr GPU instances Colab will give you a T4, K80, V100 or P100 (alternatively their own TPUs) for free - $50 for 24h uninterrupted background jobs, Gradient will give you free A6000s and sometimes even free A100s for a $40 subscript…

[deleted]

Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot

#82

Post by bp89 »

moyix wrote: post #50
low_tech_punk wrote: post #12

Bravo! I'm so glad this is born. I'm curious about its model, SalesForce CodeGen. Does it train on all the public repos on GitHub? Does Copilot have access to private repos that CodeGen cannot access? Also, it would be really cool if I can personalize FauxPilot by feeding it with all my repos on GitHub. Sometimes I just need to reimplement a function I've written before but it's really hard to find where my old code…

It is possible to fine-tune CodeGen using Huggingface Transformers! Then you'd be able to fine-tune it on your own code and use the resulting model. However, training is more expensive -- you'd need an A6000 or better to train the 6B model. Something like the following should work: deepspeed --num_gpus 1 --num_nodes 1 run_clm.py --model_name_or_path=Salesforce/codegen-6B-multi --per_device_train_batch_size=1 --learni…

Thank you for sharing the command for finetuning! Is it possible to share your ds_config.json? I tried to finetune the 2B model on A100 (40GB) using your command, but got a CUDA out of memory error. The ds_config I used was the one from huggingface (https://github.com/huggingface/transformers/blob/main/tests/...).

Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot

#83

Post by BrandonJung »

runxel wrote: post #34
stagas wrote: post #23

Tangential, maybe someone here knows; how complicated would be to implement an autocompleter that just understands syntax + patterns and can offer me suggestions but based on my own stuff? Like what is the simplest version of Copilot that doesn't require huge amounts of training but just does a decent job at recognizing tokens and trying to fill in the structure based on some input code. e.g: `app.get('/',|` {}`, may…

That's exactly the thing I would be looking for, too. Especially since I'm working in proprietary niche language, it would be so great to have my own code to be the corpus of the model. It could be so easy: stuff your codebase into a model generator and out comes some sensible autocomplete. Well, at least I hope we will see something like this soon.

If you would like a custom model on your code (or language) this is one of the unique capabilities of Tabnine. We have done this on lots of code already and do it all the time for companies across the globe. Your code is your code. Transparently I am with Tabnine.

Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot

#84

Post by BrandonJung »

triyambakam wrote: post #62
stagas wrote: post #23

Tangential, maybe someone here knows; how complicated would be to implement an autocompleter that just understands syntax + patterns and can offer me suggestions but based on my own stuff? Like what is the simplest version of Copilot that doesn't require huge amounts of training but just does a decent job at recognizing tokens and trying to fill in the structure based on some input code. e.g: `app.get('/',|` {}`, may…

The plugin TabNine does what you're looking for. I've been using it enjoyably for about two years.

Clarification - a user can run Tabnine on their laptop only OR as a part of Tabnine Enterprise we can run the large cloud models in your VPC (on GPU's) for your entire team of developers. Your code is your code and you can run it anywhere.

Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot

#86

Post by runxel »

BrandonJung wrote: post #83
runxel wrote: post #34

Earlier quoted context omitted.

That's exactly the thing I would be looking for, too. Especially since I'm working in proprietary niche language, it would be so great to have my own code to be the corpus of the model. It could be so easy: stuff your codebase into a model generator and out comes some sensible autocomplete. Well, at least I hope we will see something like this soon.

If you would like a custom model on your code (or language) this is one of the unique capabilities of Tabnine. We have done this on lots of code already and do it all the time for companies across the globe. Your code is your code. Transparently I am with Tabnine.

I've tested Tabnine but found it significantly slowing down my whole PC down to barely usable at all. Maybe this issue has been fixed and I can have another look at it. Also it seemed to me that the suggestions were only based on the existing code, whereas Github's Copilot appears to be "smarter".
Post reply on HN