This is very interesting. I don't see much discussion of interpretability in day to the day discourse of AI builders. I wonder if everyone assumes it to either be solved, or to be too out of reach to bother stopping and thinking about.
Show HN: Steerling-8B, a language model that can explain any token it generates
101–104 of 104 posts
Re: Show HN: Steerling-8B, a language model that can explain any token it generates
#102Just wanted to say i think most interpretability research it's just a smoke show nowadays but this is actually the first one that i think has a very serious potential. I love that the SAE is actually constrained and not just slapped unsupervised posthoc. How granular can you get the source data attribution? Down to individual let's say Wikipedia topics? Probably not urls? Would be interested to see this scale to 30/7…
+1 this does seem to be a genuine attempt to actually build an interpretable model, so nice work! Having said that, I worry that you run into Illusion of Conscious issues where the model changes attrition from “sandbagging” to “unctuous” when you control its response because the response is generated outside of the attribution modules (I don’t quite understand how cleanly everything flows through the concept modules…
Re: Show HN: Steerling-8B, a language model that can explain any token it generates
#103So maybe one day we'll see coding agents like Claude Code create and update an ATTRIBUTION.md, citing all the open source projects and their licenses used to generate code in your project?
The key design choice is that it does not automate anything. The agent surfaces a prompt, the user decides yes or no. No bulk starring, no forced actions. The spec also deliberately stays out of licensing territory. It is purely a social recognition layer.
It is at v0.1 and no agent supports it yet, but the spec and schema are published and open for feedback: https://github.com/attributionmd/attribution.md