Live data from Hacker News

Show HN: Customizable, embeddable Chat GPT based on your own documents

libraria.dev

91–100 of 135 posts

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#91

How does this work considering the token limitation of gpt? Or does the gpt api let you create your own models through their API? I'm admitting my ignorance of OpenAI's offering here.

Wondering about this too. I thought GPT3.5 didn't offer any custom training. And it has a pretty small token limit, at least when talking about dumping all your documentation into it.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#92
Love the idea. Would suggest my co. pay for it if a. know what it costs and b. there is details about how data is handled and plausible assurance it is not fed into a model and is secure.

The only way I would be convinced is if it is free/open source and self hosted, but that makes charging for it more difficult

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#93
post #50

Earlier quoted context omitted.

I feel it is impolite to hijack someone else’s Show HN to promote your own, like-for-like product, that too as a top level comment. Not sure about HN norms around this though.

It's a for-profit app being posted here to get free advertising. Other people jumping on to get free advertising too is fair game and definitely the HN norm. Besides, I always bookmark threads for apps that look interesting and check back later when everyone else has posted their similar apps and been commented on, then I can compare and choose whichever one looks best (or whichever is open source).

I can see your point of view.

Personally, if I find that my app is similar to an ongoing Show HN, I like to wait for an opening where I can respond with a plug for my own app.

I don't feel comfortable talking up my own app unprompted. Feels like making a big attention grabbing announcement at someone else's wedding.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#94
post #44

I wonder if you’ve considered academics as a target market. We have a lot of pdfs and might like help in “thinking” about them.

Yep. This is such an obvious use case. Have you seen the best thing out there that does this? Where can I load 100gb of pdfs and ask questions about what's in them??

Yes, this is the next step I'm looking forward to, and what would probably make LLMs really take off. Let me dump my own knowledge base or source code into ChatGPT and have it use that as its source of knowledge. I can only imagine the cost and resources required to train and run these individual models on a large scale must still be prohibitively large.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#95

Earlier quoted context omitted.

Is this Ok to upload all your messages and your contacts to these services? I'm very worried about that, really

I’d assume it has exactly the consequences you think it does, but I don’t know that and it becomes more of an unknown as more third parties are layered between you and the LLM. I’d assume the right prompt by another user of the same underlying LLM on another platform could well expose your private information / content / passwords and would treat this with a lot of caution until you get satisfactory evidence otherwis…

Yes, that's what concerns me. Since it's not really clear what's going on, how can we trust a third party service by uploading personal data?

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#96

On the website it states: “Step 1 Import or sync documents into Libraria, or add API integrations like Google and Shopify (beta). Bring the docs - let GPT-3.5 do the heavy lifting.” I might be reading it wrong, or might have missed it on the website, but is it actually GPT-3.5 running over those imported documents? (As in, are you using OpenAI or another third party provider in the background?). If you’re running a l…

> If you’re running a local LLM then the privacy implications are clearly pretty different than if you’re essentially sending people’s documents verbatim into an external LLM.

Is it?

You are basically entering a contractual relationship with them regarding the propagation of your document and they are themselves entering a contractual relationship with their suppliers. It's not different from hosting in the cloud.

Do you expect every webapps you use to tell you if they use Azure, AWS or GCP?

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#97

On the website it states: “Step 1 Import or sync documents into Libraria, or add API integrations like Google and Shopify (beta). Bring the docs - let GPT-3.5 do the heavy lifting.” I might be reading it wrong, or might have missed it on the website, but is it actually GPT-3.5 running over those imported documents? (As in, are you using OpenAI or another third party provider in the background?). If you’re running a l…

> If you’re running a local LLM then the privacy implications are clearly pretty different than if you’re essentially sending people’s documents verbatim into an external LLM. Is it? You are basically entering a contractual relationship with them regarding the propagation of your document and they are themselves entering a contractual relationship with their suppliers. It's not different from hosting in the cloud. Do…

> Do you expect every webapps you use to tell you if they use Azure, AWS or GCP?

In their privacy policies, yes. And I expect them to have signed a DPA with those and other vendors.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#98

This is amazing! I would love to have an AWS expert handy at all times, so I tried to upload all AWS documentation using this: https://docs.aws.amazon.com/sitemap_index.xml . I can no longer use the site, so I suspect that busted something. In hindsight, that was not cool and I'm sorry about it.

Most AWS documentation is on GitHub: https://github.com/awsdocs/

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#99
post #83
post #44

I wonder if you’ve considered academics as a target market. We have a lot of pdfs and might like help in “thinking” about them.

That would be really really cool if I could able to serve that space. I'd be curious to know what kind of features you'd want to have, what would be deal-breakers, etc!

Basic setup: point it at a folder of PDFs, have it recurse in and read them all, then ask it questions like:

* Summarize these papers on chimpanzee cooperation in the wild. What other papers should I be reading?

* Suggest an interesting master's thesis topic on the early modern economy.

* How good are polygenic scores at predicting educational attainment, and how has this developed over time?

Bonus: integrate it with e.g. google scholar, so it can go and find and read new papers.

Pricing: it is probably easier to start selling this to individual academics. Then when you've got a compelling product and the word is out, you could sell it to the whole lab (at a much higher price because people can put it in their grant budgets).

Gotchas: privacy. Nobody wants their hot unpublished paper to be scooped by a large language model.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#100

On the website it states: “Step 1 Import or sync documents into Libraria, or add API integrations like Google and Shopify (beta). Bring the docs - let GPT-3.5 do the heavy lifting.” I might be reading it wrong, or might have missed it on the website, but is it actually GPT-3.5 running over those imported documents? (As in, are you using OpenAI or another third party provider in the background?). If you’re running a l…

Also curious before I use. Tbh I have managed to build this minus the nicer interface using langchain. Was surprisingly easy as someone who doesn't dev daily. https://blog.langchain.dev/retrieval/

This is the first "real" app people make after initially getting familiar the OpenAI API. I don't see how this can be sustained without an expensive feature race with the horde of similar services that are appearing, and with more than one programmer.
Post reply on HN