Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

github.com

Post reply on HN
Print view View original

31–40 of 100 posts

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#31

Post by shagie »

keithwhor wrote: post #30
shagie wrote: post #21

Earlier quoted context omitted.

One idea would be to use a much cheaper (and faster) classifier to come back with a "yes" or "no" if the question asked is about your product documentation. Using Ada or Babbage is about 1% of the cost of Davinci (and Curie is 10% the cost of Davinci). Without any real tuning, this responds quite promptly (and the various tests I've done, correctly): curl https://api.openai.com/v1/completions \ -H "Content-Type: appl…

It's way easier and cheaper to use embeddings for these sorts of use cases.

It probably is - I just haven't toyed with that part of the system yet.

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#32

Post by jsf01 »

atonse wrote: post #5

Where can one go to learn how to build something like this with chatgpt? Are people asking a question under the hood? Like “explain these 30 code files to me”

Openai has documentation and guides in their blog about how to interface with the GPT API. But in this case, you can also look directly at the source code published here.

https://platform.openai.com/docs/introduction

https://github.com/arc53/docsgpt/tree/main/application

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#33

Post by Taek »

osullip wrote: post #17
ib33 wrote: post #11

Yesterday, an undergraduate from Sri Lanka released KnowledgeGPT[1] which allows you to upload your docs and get answers from ChatGPT. It also uses FAISS so I'm wondering if DocsGPT is somehow related or inspired by the former. It also appears the Github library for DocsGPT was created shortly after the release of KnowledgeGPT. 1: https://github.com/mmz-001/knowledge_gpt

I will support and pay for this project. I thought about the same problem. Companies have lots of marketing material and data sheets that are not easily queried but would be very useful to support staff when dealing with customer's questions. I didn't build it, they did. They get my support.

Anything that relies on the ChatGPT API is subject to being insta-killed the moment OpenAI decides its not good to have them around.

Productivity tools shouldn't depend on external parties like that.

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#34

Post by Vespasian »

jacooper wrote: post #18

Man, imagine If you can run it locally and let it parse all of your documents, so you can ask it questions like when does my passport expires, or what is my Wife's ID number and so on.

The future will most likely be "upload it to the cloud and ask the question there".

Really sad but but it seems like most people seem to not care about privacy even for the most sensitive parts of their lives.

Or even worse they mistrust "the government" but place great trust in "companies which are easily pressured or raided by more than one government".

It doesn't make sense at all.

(Edit: I don't think a well run government in a functioning democracy is inherently evil but pretending that companies are not collaborating because they are "private entities" is foolish)

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#35

Post by aioprisan »

ib33 wrote: post #11

Yesterday, an undergraduate from Sri Lanka released KnowledgeGPT[1] which allows you to upload your docs and get answers from ChatGPT. It also uses FAISS so I'm wondering if DocsGPT is somehow related or inspired by the former. It also appears the Github library for DocsGPT was created shortly after the release of KnowledgeGPT. 1: https://github.com/mmz-001/knowledge_gpt

They're both just based on langchain embedding and search logic from a built index. No real difference in the two except stylistic code approaches.

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#36

Post by osullip »

Taek wrote: post #33
osullip wrote: post #17

Earlier quoted context omitted.

I will support and pay for this project. I thought about the same problem. Companies have lots of marketing material and data sheets that are not easily queried but would be very useful to support staff when dealing with customer's questions. I didn't build it, they did. They get my support.

Anything that relies on the ChatGPT API is subject to being insta-killed the moment OpenAI decides its not good to have them around. Productivity tools shouldn't depend on external parties like that.

I agree.

But the problem will be solved regardless of GPT.

I don't think the whole stack relies on GPT for this solution.

Some parts maybe, but the whole of the project is more than that.

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#37

Post by aioprisan »

jacooper wrote: post #18

Man, imagine If you can run it locally and let it parse all of your documents, so you can ask it questions like when does my passport expires, or what is my Wife's ID number and so on.

All you need is to 1. convert documents to embeddings (OpenAI or some other local library for this), 2. store all embeddings in an index like (SaaS like Pinecone or FAISS locally), 3. run query against embeddings. Just a document search is likely good enough, but if not you can use a completion algorithm in a simple LLM of the docs to generate answers.

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#38

Post by danvass »

atonse wrote: post #5

Where can one go to learn how to build something like this with chatgpt? Are people asking a question under the hood? Like “explain these 30 code files to me”

If you're looking for a low-code solution, I've written up how we handle this here: https://relevanceai.com/blog/use-all-of-your-blog-posts-and-...

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#39

Post by mdmglr »

So just so I understand- this is all based on taking input from the user, injecting it in a template prompt that instructs chatgpt to answer the question based on providing it all the source material? What happened to building your own models to run offline?

Re: Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries

#40

Post by hackernewds »

Taek wrote: post #33
osullip wrote: post #17

Earlier quoted context omitted.

I will support and pay for this project. I thought about the same problem. Companies have lots of marketing material and data sheets that are not easily queried but would be very useful to support staff when dealing with customer's questions. I didn't build it, they did. They get my support.

Anything that relies on the ChatGPT API is subject to being insta-killed the moment OpenAI decides its not good to have them around. Productivity tools shouldn't depend on external parties like that.

that's not a viable model. OpenAI has been most successful marketing, but these learning models are not unique.

If not OpenAI, Google will sell general use AI APIs

Post reply on HN