Viewing profile — charles_irl

Very cool! > Unless you've actually watched tokens stream at those rates, the numbers are hard to internalize. This is the rendering. I built something similar recently, for the sa…

To clarify: we do content-based hashing, and when we say "shared bytes aren’t guaranteed to be in the exact same container image layer", what we mean is that FROM some/image RUN pi…

You're absolutely right!

Yep! That should start in ten seconds or so -- about a second per gigabyte of weights, plus a second to start the container and a few seconds to load the memory snapshot. There are…

Cutting latencies by 40x! Unfortunately couldn't fit the whole title in the character limit :<

> Ed Zitron also called out the business model of GPU-as-a-service middleman companies like modal deeply unsustainable, and I also don't see how they can make a profit if they are …

Sorry to lead with a bunch of jargon! Wanted to make it obvious that we'd give concrete recommendations instead of palaver. The technical terms there are later explained and diagra…

oof ty, willfix

Inspired by https://float.exposed , which was on the front page recently, I put together this visualizer for lower precision/quantized floating point numbers -- specifically, all o…

Thanks! I think computers are fun and I want reading about them to be fun too. I was also reminded of HazyResearch's MegaKernels. Didn't want to distract from the main thrust of th…