121–130 of 175 posts
Earlier quoted context omitted.
Thanks for the great project! Any chance, your team might consider more open platform than Discord for posting updates? I personally find Discord hard to use, and there’s no way to have sensible subscription (like RSS). Discord is usually muted.
s/rd/urse/g
Q: "How do you do a search and replace for a string in VI"
Me: I cant recall right now, i'd just google it"
Earlier quoted context omitted.
Discord is a black hole where information goes to die. Its search and scrollback is awful. It's awful at being an archive, as finding anything that was asked more than a day or two ago is impractical. To use Discord in good faith and with open eyes, you have to prioritize communication in the present, and give up hope of archiving anything that was said for people who might need the information in the future.
I find their search amazing. What's your issue with it?
They stem words aggressively, so searching for "repeater", which is a less common, specific term, gives you results including "repeat", a commonly used word. And there's no way to do an exact word search.
Earlier quoted context omitted.
So just like Discord then..
I wasn't aware that was being done. Can you show me how to access the archives of the ask-for-help channel on the openllm Discord server? Right now they're discussing "loading models on CPU vs GPU". No matter how explicit I got, google did not find the discussion.
I like the idea of having a standard API for interacting with LLMs over the network. Many models need to run on beefy hardware and would benefit from offloading to a remote (possibly self-hosted) server, and I think makes logical sense to separate the code for running LLMs from the UI for accessing them.
Earlier quoted context omitted.
You might want to glance again because all of those results are for a different product.
Top of the results page says: "Showing results for how to use openlm Search instead for how to use openllm"
Hi all, I'm the main maintainer from the OpenLLM team here. I'm actively developing the fine-tuning feature and will release a PR soon enough. Stay tuned. In the meanwhile, the best way to track the development workflow is at our discord, so feel free to join!!
What's the rationale for telemetry tracking? https://github.com/bentoml/OpenLLM/blob/main/src/openllm/uti...
Earlier quoted context omitted.
That didn't stop IRC being popular in the 1990s. There has long been a place in the ecosystem for ephemeral chat. Often alongside non-ephemeral things like written documentation.
People didn't put documentation in IRC channels because they didn't want to answer the same questions over and over. Info went into a wiki, and you would get flamed for asking a question on IRC that was answered on the wiki. Discord is not a good place to stash documentation.
Earlier quoted context omitted.
Very cool, btw it's not mentioned in the readme so I assume it's only for running full precision models or do quantized GGML/GPTQ/etc. also work with it?
Hi there, 8bit and 4bit is currently supported on main. GPTQ is working in progress, as well as GGML