Live data from Hacker News

Show HN: GPTDuck – Ask questions about any GitHub repo

gptduck.com

31–40 of 58 posts

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#32
post #18

I thought I'd throw it a curveball: https://github.com/chbarts/particle-abcs And my question: > What language is this written in? The answer: > This appears to be a poem written in English. It is written in a form that is often used for teaching purposes, in which each letter of the alphabet is associated with a concept related to a particular field of study. In this case, the poem is about quantum field theory and p…

How curious: I have a small children's book I picked up at the California Academy of Sciences entitled, "The ABCs of particle physics," made by a joint collaboration between Fermilab and SLAC [1], and here I find another poem in the same vein!

[1] https://www.symmetrymagazine.org/article/the-abcs-of-particl...

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#33
When it works it’s impressive, but sometimes it just makes things up:

For one of my repos: https://github.com/drpriver/macwatch

> Does this program work on windows?

No, macwatch is a program designed specifically for Mac computers and is not compatible with Windows systems. The program is designed to provide users with a comprehensive overview of their Mac's performance, including CPU usage, memory usage, disk usage, and more. It can also be used to monitor network activity and alert users when a process is consuming too much system resources. Additionally, the code provided is written in Objective-C and C, which are not supported on Windows systems.

---

The first sentence is correct, the rest is just completely wrong.

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#35

How did you implement this ? Would love to learn more

From what I can see, they download the repo to their server, generate per-function semantic embeddings (which will no doubt cost them at scale) [1], then use some combination of GPT-3 and Codex prompted with something like "Here's the source code of a git repo. Answer the following questions about it: {USER_QUESTION}." [1] https://beta.openai.com/docs/guides/embeddings

Thanks for sharing this!

I found this guide/example from OpenAI which was pretty clear:

https://github.com/openai/openai-cookbook/blob/main/examples...

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#36
post #19

This appears to be quite nice assuming it works, but I wonder: how does this work? I thought ChatGPT could only process a very limited context (a few thousand words or so) and this claims to work for repositories The site says: "we will download [the repo] to the server and create embeddings against the code". What kind of embeddings are these?

It uses the OpenAI embedding models to get around the context window problem. You can compress large amounts of text/code into just a few tokens.

Can you elaborate on this? What is the input to the GPT in that case? I was under the impression that GPT is given an array of tokens and it produces one token as its output.

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#38
Is it broken?

I tried adding https://github.com/torvalds/linux and asking it to write a simple kernel module for me, but it gave me this error:

"Something went wrong, please try again later. If the problem persists, please contact us."

Edit: looks like it is, I see it's making a POST request to https://gptduck-production.up.railway.app/query which responds with a 500 Internal Server Error when I use a URL that looks like a GitHub repository (whether it actually exists or not), and "invalid repo" otherwise.

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#39
post #19

This appears to be quite nice assuming it works, but I wonder: how does this work? I thought ChatGPT could only process a very limited context (a few thousand words or so) and this claims to work for repositories The site says: "we will download [the repo] to the server and create embeddings against the code". What kind of embeddings are these?

It uses the OpenAI embedding models to get around the context window problem. You can compress large amounts of text/code into just a few tokens.

Would love some more information on how to do this. Can you share details or point to a resource?

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#40

Earlier quoted context omitted.

It uses the OpenAI embedding models to get around the context window problem. You can compress large amounts of text/code into just a few tokens.

Would love some more information on how to do this. Can you share details or point to a resource?

https://beta.openai.com/docs/guides/embeddings/use-cases
Post reply on HN