Cardan grille
en.wikipedia.org
Cardan grille
1–9 of 9 posts
Re: Cardan grille
#2Cars on…
Carson City.” -John Cusack in Con Air
Re: Cardan grille
#3Re: Cardan grille
#4This would be a perfect fit for a LLM (albeit a bit complicated by byte-pair tokenization and decoder models rather than bidirectional). You can clamp the grille words, and just generate samples with those as requirements until they reach a good likelihood and are highly fluent and indistinguishable from non-message carrying text.
Re: Cardan grille
#5This would be a perfect fit for a LLM (albeit a bit complicated by byte-pair tokenization and decoder models rather than bidirectional). You can clamp the grille words, and just generate samples with those as requirements until they reach a good likelihood and are highly fluent and indistinguishable from non-message carrying text.
You can clamp tokens (instead of letters / words) in the grille, I guess?
Re: Cardan grille
#6Re: Cardan grille
#7This would be a perfect fit for a LLM (albeit a bit complicated by byte-pair tokenization and decoder models rather than bidirectional). You can clamp the grille words, and just generate samples with those as requirements until they reach a good likelihood and are highly fluent and indistinguishable from non-message carrying text.
> (albeit a bit complicated by byte-pair tokenization and decoder models rather than bidirectional) You can clamp tokens (instead of letters / words) in the grille, I guess?
(And you can't replace the grill positions with relative indexes like 'the ith, mth, and nth tokens' because the tokenizations will all change... Maybe a more complicated relative index like 'whitespace separated character-ranges'... Well, whatever you do, it'll be annoying when it's a BPE LLM instead of a character-level model.)
Re: Cardan grille
#8Earlier quoted context omitted.
> (albeit a bit complicated by byte-pair tokenization and decoder models rather than bidirectional) You can clamp tokens (instead of letters / words) in the grille, I guess?
No, it's the other ones that are the problem, the ones you're trying to find. You need to maintain a fixed width of characters , and while you know what characters the secret words tokenize from, and so there's no problem there (you just record the # of characters, turn them into tokens, and you're fine), all of the possible chaff text could have the wrong character size. You sample a possible text of tokens, and the…
I was assuming you have a grille over the tokens.
Re: Cardan grille
#9In the age of dragnet surveillance and megaflops it seems incredibly weak, especially with smaller messages.