Viewing profile — snippyhollow

We changed RoPE's theta from 10k to 1m and fine-tuned with 16k tokens long sequences.

Thanks for the feedback, we'll fix this.

The models are here: https://github.com/facebookresearch/wav2letter/tree/master/r... https://github.com/facebookresearch/wav2letter/tree/master/r...

It is like `cp`.

Quite usable, all of TorchCraftAI uses it https://torchcraft.github.io/TorchCraftAI/ :)

Compulsory "Spikey Spheres" notebook http://nbviewer.jupyter.org/urls/gist.githubusercontent.com/...

Similar to https://arxiv.org/abs/1311.2901

paper: https://s3.amazonaws.com/fairseq/papers/convolutional-sequen... code: https://github.com/facebookresearch/fairseq pre-trained models: https://github.com/facebookresearch/fai…

https://newsroom.fb.com/news/h/comments-on-research-and-ad-t...

A few years ago SpringRTS, and in particular the BalancedAnnihilation mod [0] were active and playable. There is also Planetary Annihilation [1] (that I used to play competitively …

I did a quick "visualization" hack a while ago http://nbviewer.jupyter.org/urls/gist.githubusercontent.com/...

[2014]

Part 2 was never finished but supposed to be text around this http://nbviewer.jupyter.org/github/syhw/DL4H/blob/master/DNN...

I wrote this quite some time ago exactly to hold the hands of neophytes who want to do such endeavour. http://nbviewer.jupyter.org/github/syhw/DL4H/blob/master/fro...

I have 300/100mbps down/up fiber in Paris. As important as the bandwidth is the latency. Basically it means I do most of my work SSHed (mosh'ed actually) to a cluster and don't not…

Wow that site still exists! :) I did one when I was 17 (I'm 28 now), I first modelised everything in 1) an optics simulator 2) Solidworks, and then assembled it with a wooden case:…

The second chapter "High-Dimensional Space" talks about the problem of spikey spheres[0] (how most of the mass is near the surface), I made an ipython notebook to illustrate it[1].…