Viewing profile — floriangoebel
floriangoebel
HN member- Joined
- Wed, Jan 21, 2026, 3:39 PM UTC
- HN karma
- 5
- Public activity
- 2 items
- HN profile
- View on Hacker News ↗
About floriangoebel
No profile information was provided.
Recent public activity
-
comment
Comment #49256271
A while ago I benchmarked different tokenizers with a few common C++ coding styles. Depending on the combination I was able to reduce the token usage by as much as 5% just by auto …
-
comment
Comment #47648015
Wouldn't this increase your token usage because the tokenizer now can't process whole words, but it needs to go letter by letter?