I always love these posts. Great job to the interns. Building a tokenizer with a handcrafted automaton instead of a regex sounds like a cool project. And I found it interesting that Jane Street has a frontend for interacting with different AI services and LLMs. I'm curious how that's used. But to be honest, what surprised me most about that was that Jane Street cares about counting the token usage in its API calls. I…
You have it the wrong way around, it's because of that concern that they have billions of dollars. Obsessively making things a tiny bit more efficient is their business. Works both for software and for markets