Live data from Hacker News

Show HN: Customizable, embeddable Chat GPT based on your own documents

libraria.dev

121–130 of 135 posts

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#123

Earlier quoted context omitted.

This is the first "real" app people make after initially getting familiar the OpenAI API. I don't see how this can be sustained without an expensive feature race with the horde of similar services that are appearing, and with more than one programmer.

Yea I mean it is going to get commoditized to the point where its just an Azure service - throw some docs/links etc, maybe tune some parameters (if your and advanced user) and off you go - Q&A bot against your own material.

Given their office copilot demo they’ve already got something better.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#124

Earlier quoted context omitted.

I’m downvoted but I still believe the position doesn’t make sense. You state and negotiate the level of protection you want for your data with your direct interlocutor. They then enforce that with their own suppliers. You are free to want to know the whole chain of companies involved in providing you a service but that’s very unusual.

It's hardly that unusual. https://cloud.google.com/terms/subprocessors https://aws.amazon.com/compliance/sub-processors/ https://www.cloudflare.com/gdpr/subprocessors/ https://www.atlassian.com/legal/sub-processors https://slack.com/slack-subprocessors https://www.linkedin.com/legal/l/customer-subprocessors https://grafana.com/legal/list-of-subprocessors/

Looking at your answer, I surmised it was a legal obligation and yes, it's indeed part of the European GDPR. I learnt something new today.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#125

This definitely seems like a huge untapped space: ChatGPT for my stuff that answers questions correctly. Sure there are privacy concerns for some things but unless you are going to train your own LLM on premise (yeah right) this will always be an issue. I broke it trying to upload a PDF but that is ok, I'll try it again at some point.

Can I train a LORA on premise instead?

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#126
post #44

I wonder if you’ve considered academics as a target market. We have a lot of pdfs and might like help in “thinking” about them.

There's http://chatpdf.com already

Interesting and cool, but here's why serious academics should avoid it:

When you post Contributions, you grant us a license (including use of your name, trademarks, and logos): By posting any Contributions, you grant us an unrestricted, unlimited, irrevocable, perpetual, non-exclusive, transferable, royalty-free, fully-paid, worldwide right, and license to: use, copy, reproduce, distribute, sell, resell, publish, broadcast, retitle, store, publicly perform, publicly display, reformat, translate, excerpt (in whole or in part), and exploit your Contributions (including, without limitation, your image, name, and voice) for any purpose, commercial, advertising, or otherwise, to prepare derivative works of, or incorporate into other works, your Contributions, and to sublicense the licenses granted in this section. Our use and distribution may occur in any media formats and through any media channels.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#127
post #123

Earlier quoted context omitted.

Yea I mean it is going to get commoditized to the point where its just an Azure service - throw some docs/links etc, maybe tune some parameters (if your and advanced user) and off you go - Q&A bot against your own material.

Given their office copilot demo they’ve already got something better.

Thanks I hadn't got around to watching that yet just did. My to-read/watch list is getting ridiculous now as I just cant keep up with the pace given job/life!

https://www.youtube.com/watch?v=S7xTBa93TX8

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#128
That's a pretty cool service. But as usual with these services today, it's totally trivial to make it do something completely different than what's intended:

https://i.imgur.com/VKrfWYm.png

which would make me very wary of hooking it up with an API-key that I'm paying for, since I'd basically be paying for free GPT access for anyone who visits my site, while I would probably only be interesting in paying when they are asking questions related to my topics.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#129
post #128

That's a pretty cool service. But as usual with these services today, it's totally trivial to make it do something completely different than what's intended: https://i.imgur.com/VKrfWYm.png which would make me very wary of hooking it up with an API-key that I'm paying for, since I'd basically be paying for free GPT access for anyone who visits my site, while I would probably only be interesting in paying when they ar…

hi, try the same with Zappy! As mentioned in another comment, Dumbledore was set up to "enable" GPT: https://ibb.co/8sQh1X6 . I give you the option to "only" use your own documents.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#130
post #125

This definitely seems like a huge untapped space: ChatGPT for my stuff that answers questions correctly. Sure there are privacy concerns for some things but unless you are going to train your own LLM on premise (yeah right) this will always be an issue. I broke it trying to upload a PDF but that is ok, I'll try it again at some point.

Can I train a LORA on premise instead?

You can do anything on premise if you have the necessary skills and hardware.
Post reply on HN