Earlier quoted context omitted.
Google Translate is state of the art, so I’m not sure why that would be surprising. That said, is there something wrong with the translations offered?
> That said, is there something wrong with the translations offered? I think in French hello = "bonjour" and hi = "salut"... not sure where "bonjours" and "salutations" came from.
Using aligned word vectors for instant translations with Python and Rust
11–20 of 38 posts
Re: Using aligned word vectors for instant translations with Python and Rust
#12Re: Using aligned word vectors for instant translations with Python and Rust
#13> For example, here are the results of translating the English word "hello": > Language: fr, Translation: bonjours > Language: fr, Translation: bonsoir > Language: fr, Translation: salutations > Language: it, Translation: buongiorno > Language: it, Translation: buonanotte > Language: fr, Translation: rebonjour > Language: it, Translation: auguri > Language: fr, Translation: bonjour, > Language: it, Translation: buona…
Re: Using aligned word vectors for instant translations with Python and Rust
#14> For example, here are the results of translating the English word "hello": > Language: fr, Translation: bonjours > Language: fr, Translation: bonsoir > Language: fr, Translation: salutations > Language: it, Translation: buongiorno > Language: it, Translation: buonanotte > Language: fr, Translation: rebonjour > Language: it, Translation: auguri > Language: fr, Translation: bonjour, > Language: it, Translation: buona…
The word vectors have been aligned in multiple languages. Using an approximate nearest neighbor search we are able to find the nearest vector to the input in multiple languages very quickly.
To keep the example simple, we did not try to filter the data through hand-built language dictionaries. In fact, we simply drop words in other languages that also appear in the English .vec file. Words like "ciao" appear frequently enough in otherwise English sentences that the example code drops it from Italian, and so is not shown in the results:
% curl -s "https://dl.fbaipublicfiles.com/fasttext/vectors-aligned/wiki..." | grep -n ciao 50393:ciao 0.0120 ...
One improvement would be to filter out any words that do not appear in a hand-curated dictionary instead of filtering out words that already appear in English. We decided not to show how to do this because we'd already introduced a few concepts, like aligned word vectors, approximate nearest neighbour searches, and wanted to keep the example as simple as possible.
Re: Using aligned word vectors for instant translations with Python and Rust
#15> For example, here are the results of translating the English word "hello": > Language: fr, Translation: bonjours > Language: fr, Translation: bonsoir > Language: fr, Translation: salutations > Language: it, Translation: buongiorno > Language: it, Translation: buonanotte > Language: fr, Translation: rebonjour > Language: it, Translation: auguri > Language: fr, Translation: bonjour, > Language: it, Translation: buona…
Google Translate is state of the art, so I’m not sure why that would be surprising. That said, is there something wrong with the translations offered?
For French/English/German, DeepL is much better IME.
Re: Using aligned word vectors for instant translations with Python and Rust
#16Earlier quoted context omitted.
Google Translate is state of the art, so I’m not sure why that would be surprising. That said, is there something wrong with the translations offered?
> That said, is there something wrong with the translations offered? I think in French hello = "bonjour" and hi = "salut"... not sure where "bonjours" and "salutations" came from.
Re: Using aligned word vectors for instant translations with Python and Rust
#17Only as an adverb, it should be "rapide" otherwise.
Re: Using aligned word vectors for instant translations with Python and Rust
#18We've released the underlying Rust implementation here: https://github.com/InstantDomain/instant-distance with Python bindings at https://pypi.org/project/instant-distance — feedback welcome!
Re: Using aligned word vectors for instant translations with Python and Rust
#19We've released the underlying Rust implementation here: https://github.com/InstantDomain/instant-distance with Python bindings at https://pypi.org/project/instant-distance — feedback welcome!
cp target/release/libinstant_distance.so instant-distance-py/test/instant_distance.so
and it works. Built and running. The main tree was MacOS only.
Here's resource consumption in a sample run.
Time: 4.49s, Memory: 1552 mb.
Single word. Three langs including en.
Re: Using aligned word vectors for instant translations with Python and Rust
#20At first glance at the title, I thought it was translating Python code to Rust code.