Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenLLM

github.com

Post reply on HN
Print view View original

131–140 of 175 posts

Re: OpenLLM

#131

Post by joot82 »

pmoriarty wrote: post #72
user432678 wrote: post #26

Earlier quoted context omitted.

Thanks for the great project! Any chance, your team might consider more open platform than Discord for posting updates? I personally find Discord hard to use, and there’s no way to have sensible subscription (like RSS). Discord is usually muted.

Discord is a black hole where information goes to die. Its search and scrollback is awful. It's awful at being an archive, as finding anything that was asked more than a day or two ago is impractical. To use Discord in good faith and with open eyes, you have to prioritize communication in the present, and give up hope of archiving anything that was said for people who might need the information in the future.

Discord is just a rich IRC replacement. You can log and search in IRC too but nobody seriously tries to archive information for research later. And big difference is it's all closed and operated by one entity that can change conditions at will. Don't even try to use it for anything else than real time chat.

Re: OpenLLM

#132

Post by bredren »

pmontra wrote: post #63
cinntaile wrote: post #47

Earlier quoted context omitted.

Because it's easy, free and it just works. Very few people actually care about indexing the conversations.

So all knowledge is lost and questions have to be asked and answered again and again?

Not lost enough to use as a transient space for sharing secret intelligence reports.

Re: OpenLLM

#133

Post by dluc »

user432678 wrote: post #26
aarnphm wrote: post #12

Hi all, I'm the main maintainer from the OpenLLM team here. I'm actively developing the fine-tuning feature and will release a PR soon enough. Stay tuned. In the meanwhile, the best way to track the development workflow is at our discord, so feel free to join!!

Thanks for the great project! Any chance, your team might consider more open platform than Discord for posting updates? I personally find Discord hard to use, and there’s no way to have sensible subscription (like RSS). Discord is usually muted.

good alternative: https://www.linen.dev/

Re: OpenLLM

#134

Post by windyfly »

falcor84 wrote: post #104
Zak wrote: post #82

Earlier quoted context omitted.

I just recently saw a post where someone said something similar about Reddit versus traditional forums. There's a balance between engaging with new members and not turning it into a time sink for older members. This is probably a good use case for LLMs.

LLMs could indeed address the first part, but not the second, of bringing the newcomers in via actual conversation with the older members. The only good solution I encountered to this is of having some (preferably not too experienced) member(s) actively take upon themselves the role of welcoming newcomers and answering their questions, whether that's in an official or unofficial capacity. This to me is the real way t…

Newcomers are also different. Some are actually experienced vs some are real newbies.

I’m wondering how could learn from games, making the content also adaptive to user levels/experiences.

It’s prob also the key agenda in education.

Re: OpenLLM

#135

Post by countspongebob »

samstave wrote: post #121
nologic01 wrote: post #29

Earlier quoted context omitted.

s/rd/urse/g

HAHA this was one of my panel interview questions at Goooog' Q: "How do you do a search and replace for a string in VI" Me: I cant recall right now, i'd just google it"

Alt proposed answer "I'd install emacs".

Re: OpenLLM

#136

Post by mdaniel »

samstave wrote: post #121
nologic01 wrote: post #29

Earlier quoted context omitted.

s/rd/urse/g

HAHA this was one of my panel interview questions at Goooog' Q: "How do you do a search and replace for a string in VI" Me: I cant recall right now, i'd just google it"

What an insulting interview question, I hope it was just in jest or at the end looking to pad the time

However, it did make me realize hidden therein is an actual interesting interview question, similar to the "describe what happens when you type an address into the browser's URL bar and hit enter": describe what happens after you type `:s/foo/bar` and hit enter. Followup version: what about `:%s/foo/bar`? The kind of thing that can be interesting to watch them reason through even if they don't know the answer, or even know what those syntaxes do.

Re: OpenLLM

#137

Post by sputr »

tomschwiha wrote: post #99
sputr wrote: post #96

Question: for someone that wants to play around with self-hosted text generation but has a crap laptop – are there any hosting providers (like a VPS) where I can run open source models?

You can rent pretty easy a server with a GPU using runpod, vast.ai or datacrunch. Or maybe even use something Like Google Colab.

Thanks!

Re: OpenLLM

#138

Post by wanderingbit »

geysersam wrote: post #77
Kiro wrote: post #73

Earlier quoted context omitted.

I find their search amazing. What's your issue with it?

The issue is it's not indexed by Google

There was a recent post about an open source tool for indexing Discord content and making it available for Google search:

https://news.ycombinator.com/item?id=36383773

Re: OpenLLM

#139

Post by pmoriarty »

joot82 wrote: post #131
pmoriarty wrote: post #72

Earlier quoted context omitted.

Discord is a black hole where information goes to die. Its search and scrollback is awful. It's awful at being an archive, as finding anything that was asked more than a day or two ago is impractical. To use Discord in good faith and with open eyes, you have to prioritize communication in the present, and give up hope of archiving anything that was said for people who might need the information in the future.

Discord is just a rich IRC replacement. You can log and search in IRC too but nobody seriously tries to archive information for research later. And big difference is it's all closed and operated by one entity that can change conditions at will. Don't even try to use it for anything else than real time chat.

"Discord is just a rich IRC replacement"

That's only half true. Yes, Discord does allow a "rich" chat experience, with channels and servers, but there the similarities end.

IRC is based on an open protocol, with many open source clients available for it, and a decentralized server infrastructure.

Discord is closed and centralized, with only a single client available for it.

You can easily log IRC channels, but there is no easy way to do that on Discord, if it can be done at all.

I've logged every channel I've ever visited on IRC, and I can use powerful text tools to regex search through all of my conversations on IRC and have the results appear instantly. Nothing remotely like that is possible with Discord.

Paging through IRC logs is virtually instant on a modern terminal, while Discord makes you wait a long time between every other page load, so if you need to look through more than a handful of pages it's incredibly slow and painful.

Some IRC channels have their logs published on the web, making them fully searchable through web search engines, but to my knowledge no Discord channels do that.

What happens in Discord stays in Discord.

Re: OpenLLM

#140

Post by tangjurine »

treprinum wrote: post #52
Havoc wrote: post #23

This sounds promising. Smaller but custom trained/tuned models would be ideal - works for the task without the overhead

Unfortunately, for transformer-based LLMs the magic starts only when they are trained by more that 10^22 TFlops (preferably 10^24) so smaller models might not cut it even for fine-tuned tasks.

Any references on this?
Post reply on HN