71–80 of 82 posts
Question on the anythingllm hosted. So is the $50/mo just basically you are logging into some sort of Remote Desktop environment and run an anythingllm instance from there that you guys manage? Everything else is still the same like it’s still byok and all that right? Or do you get some sort of “ai/token” usage with the monthly fee as well? Oh and the other question would be in your hosted version does the instance h…
What a coincidence, I just setup AnythingLLM yesterday for trying it on an enterprise level. I'm super impressed with most of the stuff I used so far. I just wish there was an option to properly include custom CSS. The default interface looks a little bit.. dated. Keep up the amazing work!
A bigger feature that would add a lot of value might also be a prompt manager with a shareable prompt list.
LLM will become like web frameworks in the future, in the sense that they will be free, open source, and everybody will be able to build on them. Sure, there will be paid options, such as there are paid web frameworks, but most of the time free options will be more than good enough for most of the jobs.
Earlier quoted context omitted.
I am genuinely baffled at how someone could come up with this take? I suppose it's because I went ahead and copped a $500 card about a month ago, and I can already literally do more than the big paid models presently can. I lack some of the bells and whistles, but I think more importantly, they lack uncensored models. "AI" as we're calling it is aggressively defacto open-source, and I can see in no way how that compe…
Training and inference are two different things. The incentive to make some model open is unrelated to hardware cost. Perhaps you are missing something in my arguments that I can clear up?
Yes, it would cost kabillions to recreate Linux from scratch. But no one has to anymore because it's here and anyone can just grab it.
Same with the models. What I can download right now from Huggingface is going to be 90% or more already there, and I can tweak them at home, despite how much it may have cost to make them in the first place.
where is the desktop app download ? or need to install source code from github ?
This looks sweet. Totally irrelevant but ... "Language Learning Model" ? Probably just some brainfart or I'm missing something but it would be hilarious if the authors of this did this whole project without knowing what LLM stands for.
It was indeed a brainfart on my end that has then been in there since the dawn of time. Pretty funny honestly
Earlier quoted context omitted.
Training and inference are two different things. The incentive to make some model open is unrelated to hardware cost. Perhaps you are missing something in my arguments that I can clear up?
No, what I'm saying is -- it's kind of like Linux. Yes, it would cost kabillions to recreate Linux from scratch. But no one has to anymore because it's here and anyone can just grab it. Same with the models. What I can download right now from Huggingface is going to be 90% or more already there, and I can tweak them at home, despite how much it may have cost to make them in the first place.
To be useful in practice, one must train with new data, say every year or so. Who is going to pay for harvesting and cleaning all that data? And as I understand it, some form of RLHF is also required, which involves some manual labour as well.
Perhaps some day this will all be very cheap, and it might even be done by AI systems instead of humans, but I wouldn't bet my horse on it.
Earlier quoted context omitted.
No, what I'm saying is -- it's kind of like Linux. Yes, it would cost kabillions to recreate Linux from scratch. But no one has to anymore because it's here and anyone can just grab it. Same with the models. What I can download right now from Huggingface is going to be 90% or more already there, and I can tweak them at home, despite how much it may have cost to make them in the first place.
I see. But what about adding new knowledge to the models? To be useful in practice, one must train with new data, say every year or so. Who is going to pay for harvesting and cleaning all that data? And as I understand it, some form of RLHF is also required, which involves some manual labour as well. Perhaps some day this will all be very cheap, and it might even be done by AI systems instead of humans, but I wouldn'…
As in, I may not be able to do "general knowledge," but who will pay for that anyway (e.g. instead of baking it in to their Google killer?)