Live data from Hacker News

Claude 3 beats Google Translate

arxiv.org

51–60 of 127 posts

Re: Claude 3 beats Google Translate

#51
post #18

People trust Google Translate to not go off-topic or "hallucinate" and there is still a lot of value in something semi-deterministic like that. (Edit: To clarify, maintaining semantics is held sacrosanct in classical methods of machine translation)

Unlike Google translate, you can ask for more work if you're dissatisfied with a translation or want an explanation of a word choice or grammatical construct. This makes it much more versatile.

Re: Claude 3 beats Google Translate

#52
post #18

People trust Google Translate to not go off-topic or "hallucinate" and there is still a lot of value in something semi-deterministic like that. (Edit: To clarify, maintaining semantics is held sacrosanct in classical methods of machine translation)

I think it was around 2018 when Google Translate translated Chinese 万 (ten thousand) to “million” for me, making the stats I was looking at completely nonsensical. I was shocked it managed be so wrong about something so basic. I wouldn’t call it trustworthy.

Re: Claude 3 beats Google Translate

#53

I still find it amazing how LLM translation capabilities are an almost accidental feature. Yet they still managed to leapfrog decades of research and billions of investment dollars in traditional machine translation.

And still, there are people saying that LLMs are useless. I find that even more amazing.

Re: Claude 3 beats Google Translate

#54
LLMs also have a wider range of targets than you'd expect. QNTAL is known for putting medieval poetry to modern beats and when I put the old Galician lyrics to Vedes Amigo into Google translate it chokes since it isn't trained in that. But GPT-3 and Claud can both do great, I assume mostly by being fluent in both Portugues and Spanish and being able to interpolate.

https://genius.com/Qntal-vedes-amigo-lyrics

Re: Claude 3 beats Google Translate

#55

Earlier quoted context omitted.

>People trust Google Translate to not go off-topic or "hallucinate" Then "people" have no idea what they're doing. Google Translate and Deepl "hallucinate" way more than the likes of GPT-4 and Claude 3 for Translation.

I’m fascinated by this since I use translate regularly. Do you have an example of google translate doing this?

https://i.imgur.com/e1aeLej.png

Re: Claude 3 beats Google Translate

#56
post #14

I still find it amazing how LLM translation capabilities are an almost accidental feature. Yet they still managed to leapfrog decades of research and billions of investment dollars in traditional machine translation.

Translation is the reason transformer models exist. Every other use case is basically an accidental feature

The original Transformer, indeed for translation, was an encoder-decoder architecture. Most current LLMs, like Claude 3, are "decoder only". So in a sense the decoder-only translation is kinda accidental feature too.

Re: Claude 3 beats Google Translate

#57
post #52
post #18

People trust Google Translate to not go off-topic or "hallucinate" and there is still a lot of value in something semi-deterministic like that. (Edit: To clarify, maintaining semantics is held sacrosanct in classical methods of machine translation)

I think it was around 2018 when Google Translate translated Chinese 万 (ten thousand) to “million” for me, making the stats I was looking at completely nonsensical. I was shocked it managed be so wrong about something so basic. I wouldn’t call it trustworthy.

This is why for things that matter, human translators will always have a job.

Re: Claude 3 beats Google Translate

#58
post #18

People trust Google Translate to not go off-topic or "hallucinate" and there is still a lot of value in something semi-deterministic like that. (Edit: To clarify, maintaining semantics is held sacrosanct in classical methods of machine translation)

>People trust Google Translate to not go off-topic or "hallucinate" Then "people" have no idea what they're doing. Google Translate and Deepl "hallucinate" way more than the likes of GPT-4 and Claude 3 for Translation.

Maybe some ppl do know what they are doing? You sound unhinged

Re: Claude 3 beats Google Translate

#59

Google translate was always bad, at least from and into Russian, German and English. I've used it on and off from 2007 - 2020 just to see how it improved. It didn't. Don't benchmark against something that makes a sophomore sigh. Get 4 years of multicultural students @ universities that focus on language studies. Feed LLM's the translation exercises. Record the sessions with the teachers and professors. Let the studen…

yandex translate has been better than google translate for as long as I can remember, at least as far as languages of the former ussr

I'm curious how it stacks up against claude

Post reply on HN