man I finally got a 3080 and. ow you're telling me I need a second?! haha seriously though, I'm kinda sad the model size is 2GB then straight to 13GB.
you can get it running with resizable bar
FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
11–20 of 86 posts
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#12Bravo! I'm so glad this is born. I'm curious about its model, SalesForce CodeGen. Does it train on all the public repos on GitHub? Does Copilot have access to private repos that CodeGen cannot access?
Also, it would be really cool if I can personalize FauxPilot by feeding it with all my repos on GitHub. Sometimes I just need to reimplement a function I've written before but it's really hard to find where my old code is.
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#13I wonder what code corpus the SalesForce CodeGen model (which this uses) was trained on.
From the paper[1]:
> The family of CODEGEN models is trained sequentially on three datasets: THEPILE, BIGQUERY, and BIGPYTHON.
> The natural language dataset THEPILE is an 825.18 GiB English text corpus collected by Gao et al. (2020) for language modeling. The dataset is constructed from 22 diverse high-quality subsets, one of which is programming language data collected from GitHub repositories with >100 stars that constitute 7.6% of the dataset.
> The multi-lingual dataset BIGQUERY is a subset of Google’s publicly available BigQuery dataset, which consists of code in multiple programming languages such as C, Python, Ruby. For the multi-lingual training, the following 6 programming languages are chosen: C, C++, Go, Java, JavaScript, and Python.
> The mono-lingual dataset BIGPYTHON contains a large amount of data in the programming language, Python. We have compiled public, non-personal information from GitHub consisting of permissively licensed Python code in October 2021.
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#14Bravo! I'm so glad this is born. I'm curious about its model, SalesForce CodeGen. Does it train on all the public repos on GitHub? Does Copilot have access to private repos that CodeGen cannot access? Also, it would be really cool if I can personalize FauxPilot by feeding it with all my repos on GitHub. Sometimes I just need to reimplement a function I've written before but it's really hard to find where my old code…
A comment below mentions those details are in the paper:
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#15I don't understand the point of dedicating so many resources just so that you can have a Clipper add-on second-guess your code and make bad suggestions.
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#16I don't understand the point of dedicating so many resources just so that you can have a Clipper add-on second-guess your code and make bad suggestions.
You have to start somewhere and the AI suggestions are already a big time saver.
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#17man I finally got a 3080 and. ow you're telling me I need a second?! haha seriously though, I'm kinda sad the model size is 2GB then straight to 13GB.
In theory the 2B model should be somewhere in between, whenever it gets fixed.
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#18Next step is to train a model exclusively on leaks of proprietary Microsoft source code. Fair use, right Microsoft?
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#19Maybe this is a dumb question, what would be the most common use-case for this?
Any company that are not allowed to share code with third parties either by internal or customer policy. This should be a lot of companies.
Or just not wanting to live in a surveillance-first, service-first world.
Re: FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
#20Maybe this is a dumb question, what would be the most common use-case for this?
Well, do you prefer services over inspectable code you can run yourself? I don't. In fact, I strongly dislike having to rely on services.