Viewing profile — grohan

Here's a reverse engineer of the Claude token counter API as well as the model's vocabulary. Fast, offline, 96% accurate.

Bellard has trained various models, so it may not be the specific 169M parameter LLM, but his Transformer-based `nncp` is indeed #1 on the "Large Text Compression Benchmark" [1], w…

They appear to have Python bindings which seems reasonable from an API / usability perspective? https://github.com/deepseek-ai/smallpond In terms of fast FUSE - also my first quest…

Impressive numbers. Does anyone have any read or anecdotes on how much a small/mid/large company loses from low quality of software/bad practices (or conversely profits from the op…