Live data from Hacker News

OpenLLM

github.com

101–110 of 175 posts

Re: OpenLLM

#101

Hello can someone provide usecase for me as an user of this? Is it better because it is cheaper than commercially available apis?

Imo its not cheaper (or has better quality) and is only worth it

i) if you want to toy around with it

ii) don't want to depend on the api to be available (or don't want to be censored or share sensitive information with a third party)

iii) finetune your own model that you need to deploy by yourself

Re: OpenLLM

#103
post #12

Hi all, I'm the main maintainer from the OpenLLM team here. I'm actively developing the fine-tuning feature and will release a PR soon enough. Stay tuned. In the meanwhile, the best way to track the development workflow is at our discord, so feel free to join!!

Thanks for the great project! Any chance, your team might consider more open platform than Discord for posting updates? I personally find Discord hard to use, and there’s no way to have sensible subscription (like RSS). Discord is usually muted.

I know this isn't a great time for reddit, but I just made this on your behalf:

https://www.reddit.com/r/OpenLLM/

I much prefer the HN/Reddit discussion format to Discord and even Stack Overflow.

Re: OpenLLM

#104
post #82

Earlier quoted context omitted.

Isn't there something really nice about it though? It seems to me that most every community gradually evolves into one where every new message from a new-ish member is answered by something like "Duplicate, please search first!". And this in turn makes those newcomers either go away, become passive lurkers, or become part of the "hive-mind" (as only likeminded questions get answered). On the other hand, if people hav…

I just recently saw a post where someone said something similar about Reddit versus traditional forums. There's a balance between engaging with new members and not turning it into a time sink for older members. This is probably a good use case for LLMs.

LLMs could indeed address the first part, but not the second, of bringing the newcomers in via actual conversation with the older members. The only good solution I encountered to this is of having some (preferably not too experienced) member(s) actively take upon themselves the role of welcoming newcomers and answering their questions, whether that's in an official or unofficial capacity.

This to me is the real way through this "Eternal September", where in every "cohort" of newcomers, one or more choose to stay close to the doorway to welcome and guide the next cohort.

Re: OpenLLM

#105
post #79

Earlier quoted context omitted.

> That didn't stop IRC being popular in the 1990s. IRC chats, especially in opensource projects channels, could and would be archived, published over the web and indexed by search engines.

So just like Discord then..

No

Re: OpenLLM

#106
post #63

Earlier quoted context omitted.

So all knowledge is lost and questions have to be asked and answered again and again?

Isn't there something really nice about it though? It seems to me that most every community gradually evolves into one where every new message from a new-ish member is answered by something like "Duplicate, please search first!". And this in turn makes those newcomers either go away, become passive lurkers, or become part of the "hive-mind" (as only likeminded questions get answered). On the other hand, if people hav…

The best of both worlds - a friendly community that welcomes newbies, with a searchable archive - is possible. Limiting to only chat-based support means that support is bottle-necked by the folks who are available and engaged at the time of the question, and that knowledge will "drop out" of the community as people forget it.

Re: OpenLLM

#107
post #45

Earlier quoted context omitted.

Side question : why are people working on open source project communicating through discord a lot noawadays ? are discord conversations persisted and indexed on search engines ?

I find Discord quite versatile and a bit overwhelming at the same time. As to SEO, see https://news.ycombinator.com/item?id=36383773 AFAIK most of the gamers choose it for voice chat (Anyone remember TeamSpeak?)

In Europe, TeamSpeak is still very popular.

Re: OpenLLM

#108
post #63

Earlier quoted context omitted.

So all knowledge is lost and questions have to be asked and answered again and again?

That didn't stop IRC being popular in the 1990s. There has long been a place in the ecosystem for ephemeral chat. Often alongside non-ephemeral things like written documentation.

People didn't put documentation in IRC channels because they didn't want to answer the same questions over and over. Info went into a wiki, and you would get flamed for asking a question on IRC that was answered on the wiki. Discord is not a good place to stash documentation.

Re: OpenLLM

#109
post #12

Hi all, I'm the main maintainer from the OpenLLM team here. I'm actively developing the fine-tuning feature and will release a PR soon enough. Stay tuned. In the meanwhile, the best way to track the development workflow is at our discord, so feel free to join!!

What's the rationale for telemetry tracking?

https://github.com/bentoml/OpenLLM/blob/main/src/openllm/uti...

Re: OpenLLM

#110

Earlier quoted context omitted.

I find Discord quite versatile and a bit overwhelming at the same time. As to SEO, see https://news.ycombinator.com/item?id=36383773 AFAIK most of the gamers choose it for voice chat (Anyone remember TeamSpeak?)

In Europe, TeamSpeak is still very popular.

I used to play EVE Online a fair bit, and always thought it interesting how some of the groups used Discord but only for text communications. Voice was still done over Teamspeak or Mumble.
Post reply on HN