Viewing profile — snats

did a pretty similar thing last month for the text rendering library last month. trained and made a viz for the model and then made it displace text. should probably do a proper wr…

you can also have removed layers of models and keep the same score in benchmarks [1]. i feel that sometimes a lot of the layers might just be redundant and are not fully needed onc…

personal website: snats.xyz weblog: weblog.snats.xyz

I also did a couple of experiments with pruning LLMs[1] using genetic algorithms and you can just keep removing a surprising amount of layers in big models before they start to hav…

i get it. i want one of those. the problem is that most cellphones are not actual cellphones, they are entertainment machines. they are a pocket tv / social media feed place. most …

I am working on the https://moviemovie.club/about , it's a tiny website about film review. It works like a run club, where you have to make a review first to see other people's rev…

Not an insider but imo the work on diffusion language models like LLaDA is really exciting. It's pretty obvious that LLMs are good but they are pretty slow. And in a world where pe…

It's pretty funny to test in-distribution for AI models. But they fail horribly once you push them a bit[1]. I recently made LLMs play Minesweeper and ALL LLMs that I tested had a …

yup, if i went to do a PhD interpretability is the only interesting subject for academia IMO right now

It's more of a distilled model, not a fair 1:1 comparison

I use .XYZ because it was pretty cheap when I bought it