Viewing profile — oxcidized

While true, you do still technically get pop up ads occasionally when set that way.

Thanks for the info! Definitely much better than I expected.

Admittedly I've not tried running on system RAM often, but every time I've tried it's been abysmally slow (< 1 T/s) when I've tried on something like KoboldCPP or ollama. Is there …

> That's small enough to run well on ~$5,000 of hardware... Honestly curious where you got this number. Unless you're talking about extremely small quants. Even just a Q4 quant ggu…

Considering there were two generations (around 4.5 years) of top-tier consumer GPUs (3090/4090) stuck at 24GB VRAM max, and the current one (5090) "only" bumped it up to 32GB, I th…

I believe double-jeopardy laws wouldn't allow this, but I could be wrong.