Viewing profile — samwho

You are extremely welcome.

Sam Rose here. Thank you <3

I gave my boss every opportunity to stop me.

Single browser.

I learned that etcd wasn’t required while making webernetes! I’d always thought it was, was cool to learn some clusters use other storage backends.

Completely agree! Wasn’t trying to discourage, hope it doesn’t have that effect.

Thank you! To address the earlier comment: I didn’t go down the “implement the OS-level stuff required to get k8s to compile to wasm” path due to bundle size, honestly and truly. M…

I’d guess that about 90% of the webernetes code is ported directly from the Kubernetes codebase. In that sense it is a port of Kubernetes to the browser. But the CRI and CNI are fa…

I’m 100% confident it would be possible to do a worker-per-pod runtime. If you’re serious about trying to make it then slide into my DMs, would love to talk about it. I also think …

This is it. If you’re building something novel, and you want to rely on LLMs, you need to invest heavily in making tests. You don’t have the luxury of a reference implementation li…

I have some potentially bad news for you: https://samwho.dev/load-balancing https://encore.dev/blog/queueing

For some projects I think only reading the tests is probably fine. In this project I didn’t think it was enough purely because it’s a port of existing code, so there was a need to …

Web workers were on my mind from the start but I never found myself needing them. They were always my ace-in-the-hole if this ended up being too CPU hungry on the main thread but i…

Sadly Katacoda got paywalled (totally get why they did it, these things have costs). I think some other similar platforms disappeared because they ran out of people willing to fund…

Looking really good! Great work.

You’re welcome! Thanks so much for the kind words.

Thank you!

“Zero point” is how I saw it referred to in the literature, so that’s what I went with. I personally prefer to think of it as an offset, but I try to stick with terms folks are lik…

Definitely could be, but in the time I spent talking to the 4-bit models in comparison to the 16-bit original it seemed surprisingly capable still. I do recommend benchmarking quan…

Thank you! I was really surprised how robust models are to losing information. It seems wrong that they can be compressed so much and still function at all, never mind function qui…

Thanks for linking to my silly little quiz in the article! :)

I wrote a tool called llmwalk ( https://github.com/samwho/llmwalk ) that’ll deterministically show you the likelihood the top N answers are for a given open model and prompt. No he…