Viewing profile — mzl

Skills for creating good and repeatable benchmarking scripts. A knowledge base for my research area, with tools for paper ingestion and search. An md file to html presentation tool…

If you modify the work, that creates a derived work from whatever copyright the original works has, not a new work that is fully copyrightable. As the article says in the Tl;DR at …

Kimi K2.5 and K2.6 are both >1T

It is tricky to build good infrastructure for prompt caching.

Which version of Kimi and served from where?

Composer-2 is based on Kimi K2.5, but with extensive RL. Cursor estimated 3x more compute on their RL than the original K2.5 training run (some details in https://cursor.com/blog/c…

I've been prescribed slightly more than 5g per day (2 x 650mg tablets every 6 hours) for pain after an operation jointly with ibuprofen, which is scarily close to the limits.

I've heard people saying the study is bad, but whenever I've asked about why the answers have been pretty bad. Do you have a good source for why we should disregard it?

Dan Luu had some interesting analysis about car safety, comparing how different auto-makers fared on newly introduced crash tests: https://danluu.com/car-safety/ The main take-away…

There was an interesting scandal in Sweden where Oracle managed to sell the Millenium system to a regions hospitals even though they did not fulfill the requirements, and then when…

No, but a lot of AI-adjsuted wordings have the very idiosyncratic AI-style that is prevalent in the AI-slop that is everywhere, and that style has quickly become associated with wr…

As others have said, this is more of a constraint programming system than Wave Function Collapse. Whatever one wants to call it, I liked it. For guiding the search, you might want …

I have a (very slight) beef with the name Algorithm X, as it is more of a data-structure to manage undo-information for the backtracking than an algorithm. It is a very fun, useful…

In my view, Scrum is a way to force dysfunctional teams to have some process, it is not useful for a team that is already delivering and working in a samll-a agile manner.

Are you using the Model GPU memory snapshotting for this?

I like the intelligence per watt and intelligence per joule framing in https://arxiv.org/abs/2511.07885 It feels like a very useful measure for thinking about long-term sustainable…

The cost of running things like prompt caching is defined by the implementation as that gives the infrastructure costs.

Saying that it is just in index from string prefixes into KV Cache misses all the fun, interesting, and complicated parts of it. While technically the size of the prompt-pointers i…

The prompt cache caches KV Cache states based on prefixes of previous prompts and conversations. Now, for a particular coding agent conversation, it might be more involved in how c…

Depends on which cache you mean. The KV Cache gets read on every token generated, but the prompt cache (which is what incurs the cache read cost) is read on conversation starts.

Technically, Cerebras solution is really cool. However, I am skeptical that it will be economically useful for models that are larger in size, as the requirements on the number of …

I find it interesting that the spark version seems worse than the gpt-oss version ( https://simonwillison.net/2025/Aug/5/gpt-oss/ )