Viewing profile — Trinicode
Trinicode
HN member- Joined
- Tue, Mar 03, 2026, 8:04 PM UTC
- HN karma
- 1
- Public activity
- 2 items
- HN profile
- View on Hacker News ↗
About Trinicode
No profile information was provided.
Recent public activity
-
comment
Comment #47239097
A letter is not a token, is it? Redundancy could hit 75% in long sentences, but Shannon was not predicting tokens or words, he was predicting letters (characters).
-
story
Low-entropy tokens tolerate substitution with and 0.1 PPL cost across models
I investigated whether an explicit entropy signal in token embeddings—beyond implicit frequency effects—carries independent information in modern LLMs, and if it could enable infer…