The app is very intuitive and easy to use, it seems the code is in PHP. I made a similar app findrGPT.com for website and pdf
Run and create custom ChatGPT-like bots with OpenChat
11–20 of 63 posts
Re: Run and create custom ChatGPT-like bots with OpenChat
#12Glad to see this pop up. Local models are vital for privacy!
This isn't a local model though, is it?
Re: Run and create custom ChatGPT-like bots with OpenChat
#13This may be a naive question. But is there a way to embed a chat bot like this that only queries the data we feed it, and not the universe of other stuff in gpt? Like I don’t want people using the chatbot in our product to query a good strawberry shortcake recipe. We just want them to query about data we allow it to query which is native to our business.
Is this feasible? Thx.
Re: Run and create custom ChatGPT-like bots with OpenChat
#14This may be a naive question. But is there a way to embed a chat bot like this that only queries the data we feed it, and not the universe of other stuff in gpt? Like I don’t want people using the chatbot in our product to query a good strawberry shortcake recipe. We just want them to query about data we allow it to query which is native to our business. Is this feasible? Thx.
I don't think you can really 100% prevent it. even openai has issues with gpt responding in an undesired way (google Dan, where people try to hack instructions to get responses that are undesired by the openai team). However I think you can make it more difficult (as in the person trying to misuse your chatbot will need to put in some effort to get the strawberry cake, if you have instructed it before to only give information about your product)
Re: Run and create custom ChatGPT-like bots with OpenChat
#15Read the README and the code. This is a breathless pronouncement of a thin wrapper of some other wrappers. We really need to watch the hype, lest we kill the actually important stuff going on in ML
to be fair the author mentions in the README that the project was built to validate the idea. I think if you're just trying to validate an idea it's totally fine to be using thin wrappers
Re: Run and create custom ChatGPT-like bots with OpenChat
#16Disclaimer: I am curating LLM-tools on github [1]
A few thoughts:
* allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3]
* look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index
* Don't use a single embedding per content item, use multiple to increase retrieval quality
1 https://github.com/underlines/awesome-marketing-datascience/...
Re: Run and create custom ChatGPT-like bots with OpenChat
#17Disclaimer: I am curating LLM-tools on github [1] A few thoughts: * allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3] * look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index * Don't use a single embedding per content item, use multiple to increase retrieval quality 1 https:/…
* Don't use a single embedding per content item, use multiple to increase retrieval quality
Can you share some specific examples of what you mean by this? How would you process specific info types (eg: news article, or web page, or product catalogue data) this way, and how would you handle retrieval that makes the quality "better"?
*Edit: Thanks for all replies so far - yes I am aware about splitting or chunking the data, but interested in a good write-up of techniques and pros/cons of each with examples. Eg: Chunking sentences vs. paragraphs, providing context around the embedding result, asking GPT to generate questions to chunks and embedding that instead, combining interaction data (eg: purchases or clicks after search queries) with actual content data before embedding, embedding attributes around data, and so on.
Re: Run and create custom ChatGPT-like bots with OpenChat
#18This may be a naive question. But is there a way to embed a chat bot like this that only queries the data we feed it, and not the universe of other stuff in gpt? Like I don’t want people using the chatbot in our product to query a good strawberry shortcake recipe. We just want them to query about data we allow it to query which is native to our business. Is this feasible? Thx.
There’s no foolproof way to do what you want at this point. You could have a separate model trained to infer whether a query is relevant to your product, and then reject the query if it’s predicted to be irrelevant. That’s not 100%, though.
Re: Run and create custom ChatGPT-like bots with OpenChat
#19This may be a naive question. But is there a way to embed a chat bot like this that only queries the data we feed it, and not the universe of other stuff in gpt? Like I don’t want people using the chatbot in our product to query a good strawberry shortcake recipe. We just want them to query about data we allow it to query which is native to our business. Is this feasible? Thx.
Yes, this is feasible.
Look into https://github.com/NVIDIA/NeMo-Guardrails and specifically to your question there are "topical rails" to ensure the conversation stays on a set of topics you greenlighted.
Also takes care of jailbreaks and allows custom conversation flow templates.
Re: Run and create custom ChatGPT-like bots with OpenChat
#20Read the README and the code. This is a breathless pronouncement of a thin wrapper of some other wrappers. We really need to watch the hype, lest we kill the actually important stuff going on in ML
to be fair the author mentions in the README that the project was built to validate the idea. I think if you're just trying to validate an idea it's totally fine to be using thin wrappers
I also think it is a great way to learn from reading the code without noise and overhead added