Viewing profile — rs38

404?

is there a realistic way to distill 2 consumer hardware friendly models with max ~200B and ~20B? Qwen did it, but would it be possible for 3rd parties (unsloth etc)?

[flagged]

wanna chime in, recently tried vLLM to consume a NVFP4 Gemma4 safetensor model and see how the batching can show up in nice t/s numbers. it's slow to start, it's Linux only, it doe…

my latest experiments with local LLM (mistral coder variations) fitting in older 6 GB GTX1060 were disappointing as long as you try to hook Copilot (CLI or VScode) to it and are us…

both 5.4 were best bang (-mini even more as I found it usually same well performing!!!) for the buck before. Now they face cost reality it seems.

e.g. if on an annual plan? 0x will be gone, but there are okay 1x and 0.3x models left. I am pretty much curious how the early may test invoicing will look like. current setup of t…

not sure how much resources it took from my WinARM Win11 as store app, but it's buggy in either release or beta since months as it loses network connectivity after some time...

I think it's more Dave that "sucks"...click baiting titles, no need to and ever and ever repeating that he was at MS. He should do Podcasts as there is no value in videos only spea…

Stackoverflow usage down to 10%

at least the naming implies factor ~20 less :)

this paper is going through mass media meanwhile as it alledgely shows how Skynet started to take over...

found my glasses and there is a candidate AVX optimized to 1 GB/s

do I need glasses, or not a single c#/.net implementation?

nice one: https://www.youtube.com/watch?v=ejA0wKTRHH4 Presentation shown to new Mercedes salsman in the late 1980s and early 90s. Covers lots of sales tips and techniques to help p…

great!