Viewing profile — BoredomIsFun

yes. you can even parallelize two cards and get 1.7 times the speed.

It is very bad with any svgs.

Throw in 5060ti. By the way 5090 is 32 GiB.

True, but local setups can run LLM requests in parallel too. In this case efficiency gap is much narrower.

There is a finetune Qwen3.6-27B-Fable-Fus-711-UnHeretic-NM-DAU-NEO-MAX-NEO which seems to be as good at coding as vanilla Qwen, but way, way better at creative writing than Qwen an…

A good plenty of counterexamples on eqbench.com.

eerily looks like output of LLM with wrong chat template, when EOM is not detected and all kind plausible trash starts streaming out of it.

they, rightfully so, have no faith in LLMs.

West has though a history of supporting regimes far more hideous than Chinese, and ready to push narrative whenever possible. It is well known idea BTW in political thought that de…

> especially base ones Did you actually try them? I did.They generated even more "slopey" text than instruction-tuned ones.

/r/localllama is not like that at all.

> I get hallucinated tool call parameters and bizarre invocations tweaking sampler might help

It would be true, if model providers did not throttle their models. I do not have definitive proof they do but the rumors are abundant.

> Chemical reactions are just math. No, it is quantum mechanics. Physical world is not reducible to math, it has been long proven since early 20th century.

LFM models I've tried all seemed to be suffering from serious coherence issues. I found Gemmas the best at tasks requiring rock solid coherent output; even Qwen's not comparable.

> Qwen 3.6 burns it to the ground. Not for creative writing or NLP.

It feels like a pointless conversation, if no sampler settings (min_p, temperature etc.) mentioned.

> An LLM is a router and completely stateless aside from the context you feed into it. Not the latest SSM and hybrid attention ones.

good old illustrtation: https://www.ml6.eu/en/blog/large-language-models-to-fine-tun... The it- one is the yellow smiling dot, the pt- is the rightmost monster head.

> If I offend anyone I will not be apologising for it. What you said is simply counterfactual, so no reason to be offended.

Asimov is a widespread lastname in ex-USSR, esp. Central Asia. I personally know three unrelated Asimovs.

> Local model enthusiasts often assume that running locally is more energy efficient than running in a data center, It is a well known 101 truism in /r/Localllama that local is rar…

Hmm...no. These two things are orthogonal. Regardless, Olmo are opensource.

1 and 3 contradict each other. Last thing people need is anti-AI hysteria.