Viewing profile — exgrv

We can! At Kyutai, we released a real-time, on-device speech translation demo last week. For now, it is working only for French to English translation, on an iPhone 16 Pro: https:/…

Samples: https://huggingface.co/spaces/kyutai/hibiki-samples Inference code: https://github.com/kyutai-labs/hibiki Models: https://huggingface.co/collections/kyutai/hibiki-fr-en-67…

Except it does? After Equation 2: "v_w and v'_w are the input and output vector representations of w."

This is probably due to our preprocessing of Wikipedia that did not get rid of all the '}' from the markup.

We decided to keep the casing, as it is useful for some applications such as named entity recognition. Regarding the punctuation, as pointed out in another comment, these tokens mi…

These models were trained in an unsupervised way, and thus cannot be used with the "predict" mode of fastText. The .bin models can be used to generate word vectors for out-of-vocab…

Hi, because we trained these vectors on Wikipedia, we released models corresponding to the 90 largest Wikipedia first (in term of training data size). More models are on the way, i…

Regarding the size of the word vectors files: the text files are sorted by frequency, so it is possible to easily load the top k words only. We might also release smaller models in…

These models were trained on Wikipedia. It should be "Western Frisian" instead of "Western" ( https://en.wikipedia.org/wiki/West_Frisian_language ). Thanks for the catch!

Models are trained independently for each language. So unfortunately, you cannot directly compare words from different languages using these vectors. If you have a bilingual dictio…

The graph algorithm described in the blogpost is more related to label propagation (which is more than 10 years old), than to "retrofitting". And the Google paper linked in the blo…

If the dataset is public, could you post a link? Otherwise, could you please send me an email? (My address can be found on the github README). Thanks!

Thanks for pointing this out. We design this library on large datasets and some static variables may not be well tuned for smaller ones. For example the learning rate is only updat…

It is possible to chose between negative sampling (ns), softmax or hierarchical softmax (hs) by using the -loss option.

At train time, the code supports multiple labels by sampling one of the k label at random. At test time, it only predicts the most probable label for each example. We will add more…

Except it is not the equality operator, but a special case of an indicator function (c.f. comment by pash).

A lot of people play the lottery. Only one person did this experiment. When you test multiple hypothesis (as in your lottery example), you need to perform a correction[2,3]. [1] ht…

Members of the editorial board of scientific journals are not paid. So nothing prevents having a completely free and open access journal, which is peer reviewed. As a matter of fac…