31–40 of 82 posts
Earlier quoted context omitted.
The linked GitHub page mentions “Language Learning Models”, so GP is saying that it seems like the authors of this project wrote the whole thing while not knowing what LLM actually stands for.
Or it was a simple typo.
This looks sweet. Totally irrelevant but ... "Language Learning Model" ? Probably just some brainfart or I'm missing something but it would be hilarious if the authors of this did this whole project without knowing what LLM stands for.
I noticed you put LiteLLM in your list of providers. Was that just marketing, or did you re-implement model support for all the models LiteLLM already supports separately?
How do you ensure "privacy by default" if you are also providing cloud models?
Privacy by default means "if you use the defaults, it's private".
Obviously, if your computer is low-end or you really have been loving GPT-4o or Claude you _can_ use just that external component while still using a local vector db, document storage, etc.
So its basically like opt-in for external usage of any particular part of the app, whether that be an LLM, embedder model, vector db, or otherwise.
LLM will become like web frameworks in the future, in the sense that they will be free, open source, and everybody will be able to build on them. Sure, there will be paid options, such as there are paid web frameworks, but most of the time free options will be more than good enough for most of the jobs.
What is your argumentation for that? It seems that building LLMs is very costly, and that will probably remain so for quite some time. I think it is equally likely that LLMs will perform worse in the future, because of copyright reasons and increased privacy awareness, leading to less diverse data sets to train on.
I hope to be right or I will be jobless lol
$ docker pull mintplexlabs/anythingllm Using default tag: latest Error response from daemon: Get " https://registry-1.docker.io/v2/ ": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
what kind of pc does it need ? ram, etc?
Maybe you want to run privately, but can only manage a Gemma-2B - then great, you can use that also.
This looks really great. Are you planning on adding shortcut keys anytime soon?
WIP!
Downloaded and checked it out. Looks great so far. Tried using it to read a bunch of regulatory PDFs using GPT-4o. Some quick and early feedback: 1. The citations seem to be a bit dicey. The response seems to give largely correct answers but the citations window seems to show content that's a bit garbled. 2. Please please add a text search to search within existing chat content. Like if I searched for something about…