How is this different from chatbase.co ? (not affiliated)
Run and create custom ChatGPT-like bots with OpenChat
21–30 of 63 posts
Re: Run and create custom ChatGPT-like bots with OpenChat
#22This is a great idea and would love to see something like this succeed! If I understand how all of these OpenAI dependent apps work, none of them actually have the LLM and are doing any kind of heavy processing. AFAIK, they’re all packaging your data, submitting it to OpenAI on every request and then repackaging the output. There’s no real indexing, no real tangible thing, you have to start from scratch every time. S…
For most applications, packaging all the data and submitting it to OpenAI won't be feasible due to the limited token window size. I think the most common design pattern nowadays goes like this: 1. Chunk all your data (e.g. per paragraph of content) 2. Generate an embedding for each chunk 3. Index embeddings in a vector database 4. When a query comes in, find chunks relevant to the query (based on embeddings similarit…
Thank you for this.
Re: Run and create custom ChatGPT-like bots with OpenChat
#23This is a great idea and would love to see something like this succeed! If I understand how all of these OpenAI dependent apps work, none of them actually have the LLM and are doing any kind of heavy processing. AFAIK, they’re all packaging your data, submitting it to OpenAI on every request and then repackaging the output. There’s no real indexing, no real tangible thing, you have to start from scratch every time. S…
This seems to be mainly a wrapper around the OpenAI API From the repo they want to integrate Open Source LLMs in the future too. I feel lately - GPT-4 is superb in performance, but locked up. Using a weaker model feels better because I can just spin up a server and run it on my own. Recent Twitter/Reddit changes remind that relying on others can be a bad thing.
Yea, agree.
Re: Run and create custom ChatGPT-like bots with OpenChat
#24Re: Run and create custom ChatGPT-like bots with OpenChat
#25Disclaimer: I am curating LLM-tools on github [1] A few thoughts: * allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3] * look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index * Don't use a single embedding per content item, use multiple to increase retrieval quality 1 https:/…
* Don't use a single embedding per content item, use multiple to increase retrieval quality Can you share some specific examples of what you mean by this? How would you process specific info types (eg: news article, or web page, or product catalogue data) this way, and how would you handle retrieval that makes the quality "better"? *Edit: Thanks for all replies so far - yes I am aware about splitting or chunking the…
Presumably, they're referring to chunking up the data into discrete semantic units—smaller vectorizable subsections (e.g., paragraphs) more precisely capturing different parts of the data.
Re: Run and create custom ChatGPT-like bots with OpenChat
#26Re: Run and create custom ChatGPT-like bots with OpenChat
#27Shouldn't the title be "Run and create custom GPT-3 bots with OpenChat"
Because it doesn't run "ChatGPT-like chatbots" which implies a non-OpenAI model with similar results, it just runs OpenAI tech in a wrapper?
Re: Run and create custom ChatGPT-like bots with OpenChat
#28Disclaimer: I am curating LLM-tools on github [1] A few thoughts: * allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3] * look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index * Don't use a single embedding per content item, use multiple to increase retrieval quality 1 https:/…
* Don't use a single embedding per content item, use multiple to increase retrieval quality Can you share some specific examples of what you mean by this? How would you process specific info types (eg: news article, or web page, or product catalogue data) this way, and how would you handle retrieval that makes the quality "better"? *Edit: Thanks for all replies so far - yes I am aware about splitting or chunking the…
I'm curious about more sophisticated answers to this question, but the obvious approach would be to split the article or web page into sentences and do an embedding per sentence.
Re: Run and create custom ChatGPT-like bots with OpenChat
#29" Support offline open-source models (e.g., Alpaca, LLM drivers )" is already on the roadmap, which is great! There's just so much cool stuff we can try with LLMs now… What's the best discussion forum to exchange ideas, experiences and to collaborate on using and customizing (local) LLMs for (indy) gaming and other cool projects?
This was the goal with ConvoStack which allows people to implement our IAgent Express js interface with any custom Langchain agent. We saw this as an issue with other chatbot platforms which were limiting for developers. Comes with pre-built React components and Redis for caching as well to easily have production-ready chat interface. It's completely open-source too so can be self-hosted and modified to your liking. As a disclaimer, I helped develop this but would love for you to check it out and see if this is something you're looking for.
https://github.com/ConvoStack/convostack
Re: Run and create custom ChatGPT-like bots with OpenChat
#30This is a great idea and would love to see something like this succeed! If I understand how all of these OpenAI dependent apps work, none of them actually have the LLM and are doing any kind of heavy processing. AFAIK, they’re all packaging your data, submitting it to OpenAI on every request and then repackaging the output. There’s no real indexing, no real tangible thing, you have to start from scratch every time. S…
This seems to be mainly a wrapper around the OpenAI API From the repo they want to integrate Open Source LLMs in the future too. I feel lately - GPT-4 is superb in performance, but locked up. Using a weaker model feels better because I can just spin up a server and run it on my own. Recent Twitter/Reddit changes remind that relying on others can be a bad thing.
Mentioned this in a preview reply but this was something Convostack wanted to solve by allowing anyone to integrate their Langchain agent with a production-ready chatbot. It's completely open-source and also has pre-built React UI components. As a disclaimer I helped work on the project but curious to hear what you guys think: https://github.com/ConvoStack/convostack