Viewing profile — jgammell

> hybrid Mamba/Gated linear attention layers, Do any large-scale architectures use mamba? I was under the impression that people don't use it yet due to lack of efficient implement…

When sampling from an LLM people normally truncate the token probability distribution so that low-probability tokens are never sampled. So the model shouldn't produce really weird …

> Generative models are probabilistic: the output will be less likely to satisfy complex requirements, particularly This is a misinformed 'critique' which always gets on my nerves,…

My university made us learn to code 'close to the metal' and IMO this is a great way to gain an understanding of what is actually going on. Program in C, no IDE, no AI tools. The A…