131–134 of 134 posts
I’m really excited for lmster and to try it out. It’s essentially what I want from ollama. Ollama has deviated so much from their original core principles. Ollama has been broken and slow to update model support. There’s this “vendor sync” I’ve been waiting (essentially update ggml) for weeks.
Earlier quoted context omitted.
Yeah, it’s not going to compare to Codex-5.2 or Opus 4.5. Some non-programming use cases are interesting though, e.g. text to speech or speech to text. Run a TTS model overnight on a book, and in the morning you’ll get an audiobook. With a simple approach, you’d get something more like the old books on tape (e.g. no chapter skipping), but regardless, it’s a valid use case.
Which TTS would you suggest? Anything out there that is able to properly see/handle modulation, punctuation and overall sentence 'mood'? I've been looking for something easy to set up but most is either extremely complex or is producing output of relatively poor quality.
Earlier quoted context omitted.
I just "invested heavily" (relatively modest, but heavy for me) in a PC for local inference. The RAM was painful . Anyway, for my focused programming tasks the 30B models are plenty good enough.
I am extremely fortunate having bought 64GB of CL30 DDR5 Ram for ~200 USD just 4 months ago! My computer is now worth more than when I bought it
Is there an iOS/Android app that supports the LM Studio API(s) endpoints? That seems to be the "missing" client, especially now with llmster (tbh I haven't looked very hard)