Viewing profile — stevenwalton

> To any Linux users, I have a Macbook Air and I pretty much use it as an ssh machine. It is definitely over priced for that, but it at least beats the annoyance of having to deal …

> Once you have it on disk, how do you get it away from your phone? Since we're talking about Android, a great method is to just use Termux and rsync. You can write a pretty quick …

Sure, but this doesn't really scale very well. Distributing those APKs without internet access is pretty hard.

> so we could not hop on WiFi and message each other using Signal. I have a feature request for this actually. I think if it got a harder push they would consider it. It's not full…

I've really been trying to get Signal to get some decentralization[0] but unfortunately I pissed off some mods. I do understand their reasoning for staying away from full decentral…

> Why on earth, when you go to 192.168.whatever:8096 does it ask you what server you want to connect to? I don't know what the answer is, but I ran into this when I was trying to h…

> how much are GenAI companies willing to invest to get eyeball reflections right? Willing to? Probably not much. Should? A WHOLE LOT. It is the whole enchilada. While this might n…

> But the constraint that both eyes should have consistent reflection patterns is just another statistical regularity that appears in real photographs Hi, author here of a model th…

I'm just curious, why not build ontop of another app like Signal?[0] My understanding is that there's nothing stopping anyone from using the same app and creating their own server …

Yeah so I can get how that might be confusing. Sometimes code is clearer. So in the vanilla transformer you do a patch and then embed operation, right? A quick way to do that is ac…

Logged into my personal account for this one! I'm a lead author on a paper that explored exactly. It does enable faster training and smaller model sizes. For reference, you can get…

Sure thing. Also if you're getting into transformers I'd recommend lucidrains's GitHub[0] since it has a large collection of them with links to papers. It's nice that things are co…

> Are transformers competitive with (for example) CNNs on vision-related tasks when there's less data available? They can be, there's current research into the tradeoffs between lo…

Lots of people transfer learn with transformers. ViT[0] originally did CIFAR with it. Then DeiT[1] introduced some knowledge transfer (note: their student is larger than the teache…