Live data from Hacker News

Show HN: Customizable, embeddable Chat GPT based on your own documents

libraria.dev

101–110 of 135 posts

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#101
post #37
post #31

I asked Dumbledore something from the books[0] and got something somewhat innovative, somewhat wrong: "How can I turn a staircase into a slide?" > To turn a staircase into a slide, you can use the spell 'Tergeo' to remove any dirt or grime from the stairs, and then use the spell 'Lubricus' to make the stairs slippery. Lubricus is an incantation, which can be cast with a wand and by reciting the word 'Lubricus' while…

:D LOL. The dumbledore example is interesting. I left "GPT" enabled, so it's not just pulling from the documents. I think I'll add settings for users to be able to change the temperature etc. for the assistants in the future as well

The first thing I did was try and get it to hallucinate or talk about things that aren't in the harry potter books.

This is the main concern for me with chatgpt bots: they make things up and can be prompt hacked to get outside their bounds.

So just some feedback that your demos should show how you tackle this too.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#102

Earlier quoted context omitted.

Also curious before I use. Tbh I have managed to build this minus the nicer interface using langchain. Was surprisingly easy as someone who doesn't dev daily. https://blog.langchain.dev/retrieval/

This is the first "real" app people make after initially getting familiar the OpenAI API. I don't see how this can be sustained without an expensive feature race with the horde of similar services that are appearing, and with more than one programmer.

Yea I mean it is going to get commoditized to the point where its just an Azure service - throw some docs/links etc, maybe tune some parameters (if your and advanced user) and off you go - Q&A bot against your own material.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#103
It appears the only way to sign up is with a Google account. (I know that is a solution suggested by OpenAI for user authentication.)

Will there be an option for email, for those of us who don't use Google, or other large corporations?

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#108
post #50
post #39

Congrats on the launch. We are building something similar at https://trypromptly.com that allows chatbot building on user's own documents powered by GPT. We also allow users to build AI powered apps without writing code. For example, https://trypromptly.com/app/9da10a4f-6d20-431e-98f7-048fab81... is a chatbot built on Coursera video transcript. Similarly https://trypromptly.com/app/d478594d-2082-46c9-bee7-f057f4bc...…

I feel it is impolite to hijack someone else’s Show HN to promote your own, like-for-like product, that too as a top level comment. Not sure about HN norms around this though.

It is useful for users to learn about the alternatives.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#109

Earlier quoted context omitted.

> If you’re running a local LLM then the privacy implications are clearly pretty different than if you’re essentially sending people’s documents verbatim into an external LLM. Is it? You are basically entering a contractual relationship with them regarding the propagation of your document and they are themselves entering a contractual relationship with their suppliers. It's not different from hosting in the cloud. Do…

> Do you expect every webapps you use to tell you if they use Azure, AWS or GCP? In their privacy policies, yes. And I expect them to have signed a DPA with those and other vendors.

I’m downvoted but I still believe the position doesn’t make sense. You state and negotiate the level of protection you want for your data with your direct interlocutor. They then enforce that with their own suppliers.

You are free to want to know the whole chain of companies involved in providing you a service but that’s very unusual.

Re: Show HN: Customizable, embeddable Chat GPT based on your own documents

#110
post #74

I did this for my email and Google docs. It’s about 15 lines of Python with langchain.

Doesn't it cost a lot of money to finetune on so many documents?

Yes however langchain is not finetuning, it's basically indexing!
Post reply on HN