Earlier quoted context omitted.
All LLMs use obscene tokens just programmers are more aware of it
That’s not true. The different use cases of LLMs objectively use different amounts of tokens. AI coding agents can parse half a dozen or more files on each request, plus use a ton for thinking. Writing an email barely uses any in comparison.
LLM doesn't think
> AI coding agents can parse half a dozen or more files on each request
yeh people never ever ask LLMs to write emails based on a number of docs and spreadsheets and other emails and Slack chats plus some websites and definitely won't iterate on it multiple times...
and parsing source code is peanuts compared to parsing a PDF