Live data from Hacker News

Show HN: GPTDuck – Ask questions about any GitHub repo

gptduck.com

21–30 of 58 posts

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#21
post #17

Hey guys - creator here. Have hit the Github rate limit and currently not working! Am trying to fix! Thanks for all the support!

Might be worth asking users to "login with GitHub" to get past the rate limits (the anonymous rate limits are lowwww like 10 per hour). Logging with GitHub is still lowish but like 1k per hour or so. (IIRC)

I didn't expect this many people to try it out haha - with hindsight, absolutely should have

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#22
post #18

I thought I'd throw it a curveball: https://github.com/chbarts/particle-abcs And my question: > What language is this written in? The answer: > This appears to be a poem written in English. It is written in a form that is often used for teaching purposes, in which each letter of the alphabet is associated with a concept related to a particular field of study. In this case, the poem is about quantum field theory and p…

Wow. I googled part of your poem to see if maybe it had been on the web previously and GPT was regurgitating text around it (eg: analysis, comments).

I am very impressed with your test - and the result.

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#24

I've been thinking about something similar. GPT-3 has dated knowledge on a lot of libraries. If you could feed it the latest source code and docs pages, would it be able to help you write code faster? As others have mentioned, it seems down at the moment. But will be curious to give this a go and see how well it works.

This tool that allows you to add in a web scrape to a ChatGPT prompt is quite cool: https://twitter.com/DataChaz/status/1610556519531089921

Ooh, that is quite interesting. Thanks for sharing.

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#25
post #19

This appears to be quite nice assuming it works, but I wonder: how does this work? I thought ChatGPT could only process a very limited context (a few thousand words or so) and this claims to work for repositories The site says: "we will download [the repo] to the server and create embeddings against the code". What kind of embeddings are these?

It uses the OpenAI embedding models to get around the context window problem. You can compress large amounts of text/code into just a few tokens.

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#27
it seems to have some issue. i asked about a repo (the hive / cortex) and it returned me:

It is difficult to answer this question without knowing more about the context provided. It appears to be a PGP public key block, but without additional information it is impossible to answer the question.

it seems it might not be able to read it?? (its got a normal readme and docs etc.)

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#28
post #18

I thought I'd throw it a curveball: https://github.com/chbarts/particle-abcs And my question: > What language is this written in? The answer: > This appears to be a poem written in English. It is written in a form that is often used for teaching purposes, in which each letter of the alphabet is associated with a concept related to a particular field of study. In this case, the poem is about quantum field theory and p…

I imagine that it might already know how to answer that question for non-Github related texts, which presumably are often not programs. I'd be more interested to see what it responds to "What programming language is this written in?" to see if it will question the premise of the question (although there's always that it might make an educated guess that the poem is valid Perl!)

Re: Show HN: GPTDuck – Ask questions about any GitHub repo

#29

How did you implement this ? Would love to learn more

From what I can see, they download the repo to their server, generate per-function semantic embeddings (which will no doubt cost them at scale) [1], then use some combination of GPT-3 and Codex prompted with something like "Here's the source code of a git repo. Answer the following questions about it: {USER_QUESTION}."

[1] https://beta.openai.com/docs/guides/embeddings

Post reply on HN