Live data from Hacker News

Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

github.com

61–70 of 82 posts

Re: Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

#61

Can this roll into home assistant and provide alexa at home in any capacity?

i need this too. doesn't need to be alexa - i just want my sonos systems at home to be more smart than just adding stuff to shopping lists with hit and miss transcriptions (why is "oat milk" always added as "oatmeal"?

Re: Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

#63

This looks sweet. Totally irrelevant but ... "Language Learning Model" ? Probably just some brainfart or I'm missing something but it would be hilarious if the authors of this did this whole project without knowing what LLM stands for.

Thinking about this a bit, Language Learning Model might be a better TLA than Large Language Model since "Large" is a subjective, period-dependant adjective whereas language learning is precisely what these models achieve (with all the derivatives that come as features when you map the world with language)

Re: Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

#64

This looks really great. Are you planning on adding shortcut keys anytime soon?

We actually are planning to really lean into the "Desktop assistant" style of things, so yes absolutely. Like how on Mac you can cmd+space to launch spotlight, we can offer the same functionality alongside everything else. WIP!

One way of doing this that might save you some effort is writing a plugin for Raycast, but I have no idea whether this covers the use cases you have in mind.

Seems doable: https://github.com/raycast/extensions/blob/main/extensions/o...

(Not affiliated, I just have Raycast installed and use it sometimes)

Re: Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

#65
post #58
post #21

Earlier quoted context omitted.

What is your argumentation for that? It seems that building LLMs is very costly, and that will probably remain so for quite some time. I think it is equally likely that LLMs will perform worse in the future, because of copyright reasons and increased privacy awareness, leading to less diverse data sets to train on.

I am genuinely baffled at how someone could come up with this take? I suppose it's because I went ahead and copped a $500 card about a month ago, and I can already literally do more than the big paid models presently can. I lack some of the bells and whistles, but I think more importantly, they lack uncensored models. "AI" as we're calling it is aggressively defacto open-source, and I can see in no way how that compe…

Training and inference are two different things. The incentive to make some model open is unrelated to hardware cost.

Perhaps you are missing something in my arguments that I can clear up?

Re: Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

#66
What a coincidence, I just setup AnythingLLM yesterday for trying it on an enterprise level. I'm super impressed with most of the stuff I used so far.

I just wish there was an option to properly include custom CSS. The default interface looks a little bit.. dated.

Keep up the amazing work!

Re: Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

#68
I’ve been attempting to deploy a customized AnythingLLM instance within an enterprise env. TimC (and presumably dev crew) are top notch and very responsive.

Waiting for EntraID integration. Post-that, a customized version of AnythingLLM can tick the boxes for most of the lowest hanging use cases for an org.

Thanks for the killer app TimC and crew!

Re: Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

#69

Downloaded and checked it out. Looks great so far. Tried using it to read a bunch of regulatory PDFs using GPT-4o. Some quick and early feedback: 1. The citations seem to be a bit dicey. The response seems to give largely correct answers but the citations window seems to show content that's a bit garbled. 2. Please please add a text search to search within existing chat content. Like if I searched for something about…

For your 2nd suggestion, this would be solved if previous chats were (automatically) added to the vector database. Is this possible in this or similar apps?

Yes, like Mem0.

https://news.ycombinator.com/item?id=41447317

Re: Show HN: AnythingLLM – Open-Source, All-in-One Desktop AI Assistant

#70
post #35
post #21

Earlier quoted context omitted.

What is your argumentation for that? It seems that building LLMs is very costly, and that will probably remain so for quite some time. I think it is equally likely that LLMs will perform worse in the future, because of copyright reasons and increased privacy awareness, leading to less diverse data sets to train on.

Building software was very costly and hard 30 years ago. Things get cheaper and simpler with time. LLM will become a tool to use in your work, such as frameworks or libraries. Some people will, other people won't (mostly those to maintain projects without them). I hope to be right or I will be jobless lol

> Building software was very costly and hard 30 years ago. Things get cheaper and simpler with time

No, it's just as complex as it was 30, 50 years ago. Because complexity is limited by developers' brains. As there was no noticeable evolution in last years the humans abilities stay the same. But there are many more humans involved in development. This makes the total complexity much higher.

> LLM will become a tool to use in your work

Not sure where you live, it's already very useful at work. Saves a lot of time. The effect is like from the internet with search engines. It doesn't make the work easier or lower the requirements. It makes developers, in this case, more productive.

Post reply on HN