Viewing profile — cafkafk

Hey, author here, not sure how popular this article is gonna be with HN, but want it to get out there. This mostly just establishes some words that I'm using when discussing NixOS …

Author here. This came out of reading Denmark's national biological threat assessment (first update since 2020), which splits its AI finding in two: not much help for people withou…

That "I actually don't have any personal criticisms of Jarred" made me do a spit take, because a majority of what I had just read was absolutely a personally targeted criticism of …

Hi HN. Follow-up to the Xeon post from a couple of weeks ago. A lot of people came away from that one with a 25-flag command and no real idea which flags materially did anything, a…

Loading will take some minutes, but at 96 you can squeeze the model in and have some headroom around like ~10 GB, although depending on the Xeon, you may have to downgrade to E4B i…

If you get the inference engine to route the heavy matrix math to the GPU and the speculative drafting to the CPU without choking on latency it's probably gonna be very fast. Would…

That is a very fair point! I just ran a not very scientific benchmark with the system under load, and posted the raw logs in a sibling comment above, but the short answer is that i…

Honestly, at this point you're probably looking at a smaller model, for the Gemma series I'd go with Gemma 4 E4B with drafters, but that's just a hunch from using it on my laptop (…

> (purple on black is really hard to read) Noted, and agree (it looks like it has also already been clicked, which I dislike). I honestly I need to redo the themes. > You say it ru…

Hi HN. I wrote this post after getting frustrated by the lack of ways to run the new Gemma 4 Drafter models, and mainstream tools not prioritizing this, and hiding all the performa…

Often the problems for me come when: - It starts thinking for itself when I asked it to do something specific. - It reads its own wrong code comments and ignores my corrections. - …

Not really, beyond using them as a downstream provider through openrouter at some point (IIRC). It worked? ¯\_(ツ)_/¯

Google Vertex (or Google AI Studio) might be a potential alternative, but the UX is a lot worse, and it can be hard to estimate cost since it's typically lagging. One of the advant…

I think a lot of the problem with the current discourse is how black-and-white it is. Either you're a luddite or "ai pilled". In most cases, LLMs can get you 80-95% of the way, som…

I didn't realize the single spinning coin was actually a loading animation. Might make sense to add text indicating it is loading, or a loading bar. Without this, and considering t…

Recommending Hetzner as an alternative here is a mistake. It just exposes you to a different problem. There is a reason for the term "Hetznered" existing. Hetzner can suddenly and …

I get that everyone wants to be cynical about this, but you really can't deny that both the visualization and sheer scale of data is impressive. The way the "my life in weeks" is d…

I don't really believe in the specific numbers he gives, but I appreciate moving the conversation away from “should” and into the consequences — including those that arise from del…

VitVio | Senior Full-Stack Engineer (Elixir, NixOS, React) | Remote (EU Timezones) | Full-Time | vitvio.com We're building AI-powered systems to make hospital operating rooms safer…