People trust Google Translate to not go off-topic or "hallucinate" and there is still a lot of value in something semi-deterministic like that. (Edit: To clarify, maintaining semantics is held sacrosanct in classical methods of machine translation)
Claude 3 beats Google Translate
51–60 of 127 posts
Re: Claude 3 beats Google Translate
#52People trust Google Translate to not go off-topic or "hallucinate" and there is still a lot of value in something semi-deterministic like that. (Edit: To clarify, maintaining semantics is held sacrosanct in classical methods of machine translation)
Re: Claude 3 beats Google Translate
#53I still find it amazing how LLM translation capabilities are an almost accidental feature. Yet they still managed to leapfrog decades of research and billions of investment dollars in traditional machine translation.
Re: Claude 3 beats Google Translate
#54Re: Claude 3 beats Google Translate
#55Earlier quoted context omitted.
>People trust Google Translate to not go off-topic or "hallucinate" Then "people" have no idea what they're doing. Google Translate and Deepl "hallucinate" way more than the likes of GPT-4 and Claude 3 for Translation.
I’m fascinated by this since I use translate regularly. Do you have an example of google translate doing this?
Re: Claude 3 beats Google Translate
#56I still find it amazing how LLM translation capabilities are an almost accidental feature. Yet they still managed to leapfrog decades of research and billions of investment dollars in traditional machine translation.
Translation is the reason transformer models exist. Every other use case is basically an accidental feature
Re: Claude 3 beats Google Translate
#57People trust Google Translate to not go off-topic or "hallucinate" and there is still a lot of value in something semi-deterministic like that. (Edit: To clarify, maintaining semantics is held sacrosanct in classical methods of machine translation)
I think it was around 2018 when Google Translate translated Chinese 万 (ten thousand) to “million” for me, making the stats I was looking at completely nonsensical. I was shocked it managed be so wrong about something so basic. I wouldn’t call it trustworthy.
Re: Claude 3 beats Google Translate
#58People trust Google Translate to not go off-topic or "hallucinate" and there is still a lot of value in something semi-deterministic like that. (Edit: To clarify, maintaining semantics is held sacrosanct in classical methods of machine translation)
>People trust Google Translate to not go off-topic or "hallucinate" Then "people" have no idea what they're doing. Google Translate and Deepl "hallucinate" way more than the likes of GPT-4 and Claude 3 for Translation.
Re: Claude 3 beats Google Translate
#59Google translate was always bad, at least from and into Russian, German and English. I've used it on and off from 2007 - 2020 just to see how it improved. It didn't. Don't benchmark against something that makes a sophomore sigh. Get 4 years of multicultural students @ universities that focus on language studies. Feed LLM's the translation exercises. Record the sessions with the teachers and professors. Let the studen…
I'm curious how it stacks up against claude