Before anyone working on commercial code bases thinks to use this, stop. Uploaded code becomes part of OpenAI.
[dead]
Show HN: GPT Repo Loader – load entire code repos into GPT prompts
81–90 of 162 posts
Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#82Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#83I’m thinking if GPT can write entire programs professionally and iterate, it would be OpenAI that benefit the most and would be a guarded asset I.e not open to public till it’s safe for release. Most of us probably don’t need to worry about work after that as that could well be AGI
OpenAI already has access to any prompts anybody uses to write programs using GPT.
Who’s to say GPT-4 isn’t some ploy to gather data to train private AGI?
Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#84I am skeptical about using the method of generating a large amount of repository data and sending it, because there may be too many files in the repository. I think a better approach might be for OpenAI to open an interface for transferring GIT repositories, and then let OpenAI analyze the repository data, which is similar to what [chatpdf](https://www.chatpdf.com/) is doing.
Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#85Earlier quoted context omitted.
I don't see programming going away for this reason. Think about it, if you have to carefully describe what you want to do to an AI - you are just writing a program. Only a program is deterministic and will do what you tell it to, whereas an AI may or may not. The future that I see, coding and AI are divided into two camps. The one is what we would call "script kiddies" today - people who don't understand how to write…
I'm already at the point where I get frustrated when GPT writes some incorrect code - despite it saving me enormous amounts of time. The appetite for productivity seems to be insatiable. I want to be able to create a million lines of code per month by myself.
> I want to be able to create a million lines of code per month by myself.
That sounds terrible. Who is going to read all that code when you need to understand and modify it? The LLMs, I guess?
I'd much rather be able to write 10,000 lines of code that can do what your million lines of code does. Better programming languages, libraries, and other abstractions are what we need.
Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#86Earlier quoted context omitted.
Just remember the API charge is 6c per input token [1]. If you push 32k input tokens in, you're looking at $2000 per API call just as input. You... might wanna consider a self hosted alternative for that use case, or at least do like, a `| wc` to get an idea of what you're potentially sending before calling the api. [1] - https://help.openai.com/en/articles/7127956-how-much-does-gp...
6c per thousand tokens, so $2 per maxed out API call
Still super expensive.
You cant build a business arround it with these rates. It should be at least 1000 times cheaper if not more.
Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#87How much text can you feed GPT-4? Our codebase is 1 million lines of code. Can we feed the documentation to it? What are the limits? Is it possible to train it on our data without doing prompt engineering? How? Otherwise are we supposed to use embeddings? Can someone explain how these all work and the tradeoffs?
This is what llama-index was designed for! https://gpt-index.readthedocs.io/en/latest/
Would love to incorporate this Github repo loader into LlamaHub
Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#88nice. general question: how many lines of code (at 120 char col len) could you send in one prompt?
also, the entire thing is literally 60 lines of python. sometimes i don't get what gets upvoted on HN anymore
Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#89Rather than prompting GPT into implementing a solution, can we prompt it to try to preemptively find issues with the codebase or missing-functionality? Also, do we know what languages GPT-4 "understands" at a sufficient level? What knowledge does it have of post-2021 language features, like in C23?
It has no post-2021 knowledge, but while playing with it, I found that you can just paste the documentation (no need to even format it) and it'll just "learn" it. For example, safetensors wasn't available back then apparently, I just copied the docs into it and was able to get it write pretty good pytorch code that incorporates safetensors.
i just asked it about safetensors today! also, got a response that amounted to "i don't know what that is. i'm guessing it's X"
Re: Show HN: GPT Repo Loader – load entire code repos into GPT prompts
#90Earlier quoted context omitted.
Indeed, but it’s a much more legally dubious proposition when it comes to entire repos. A repo has more potentially creative structure for copyright to attach to. For example the class graph, or the filesystem layout are creative decisions that could potentially be protected. Current LLMs are nowhere near powerful enough to reimplement an entire repo without violating copyright. For an individual function I can total…
Sounds like clean room, and if you can do that for GPL code, you can also do that for proprietary code, which is fair in a sense. Or maybe the question is whether you can re-label the code so written as GPL or MIT ......Or, you should let GPT pick a license that it likes.
You can also decompile a proprietary binary, ask GPT to rewrite it, and then re-release it as your own work.
Somehow I feel the lawyers won't agree.