Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
1–10 of 73 posts
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#2Shouldn’t we expect a convergence as models become more powerful ?
There is an optimal answer to any question. Something that maximizes utility and minimizes tokens.
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#3Stolen data was stolen. Oh no! Anyway.
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#4How do you do cross entropy analysis for Claude without logits?
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#5Stolen data was stolen. Oh no! Anyway.
Can you elaborate?
This looks very similar to the claim that distilling a model from Anthropic is the same thing as Anthropic distilling the model from information on the internet.
Which is very flawed, since distillation requires the thing to exist in the thing it’s distilled from. And no LLM model existed in the information Anthropic used to train the model. Instead the model was built using information and utilizing new technology including hardware, software, transformer architecture, etc.
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#6How do you do cross entropy analysis for Claude without logits?
[deleted]
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#7This looks to be more behavior based, not logit based? What is the actual claim?
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#8How do you do cross entropy analysis for Claude without logits?
I assume Kimi does provide logits. You can do cross entropy both ways. With slightly different results.
Edit: No that doesn't seem to be what's happening here. I think it's some kind of word frequency analysis.
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#9I didn’t participate in the discussion yesterday because I find it implausible Fable was available long enough (3-4 weeks cumulative?) to get data and train and have it fundamentally affect.
But I don’t grok training enough to know that’s silly.
If my new prior is you can…that’s a pretty thin moat that’s essentially indefensible.
Re: Writing fingerprint analysis of responses reveals Kimi's similarity to Claude
#10All frontier models have been trained without any regards for IP protection laws. I don't see how anyone can argue in good faith that distillation is not fair game and does not ultimately "benefit humanity™"