Live data from Hacker News

DeepL's LLM Outperforms Google Translate, ChatGPT-4, and Microsoft

deepl.com

1–10 of 21 posts

Re: DeepL's LLM Outperforms Google Translate, ChatGPT-4, and Microsoft

#2
> DeepL’s models are trained on the highest-quality linguistic data, with an unwavering focus on excellence. Combining world-class AI with the expertise of thousands of hand-picked language specialists who “tutor” the model, DeepL consistently provides best-in-class translation.

> In fact, recent blind tests show that language experts routinely prefer DeepL's translations. According to the data, DeepL’s translation is preferred: 1.3x more often than Google Translate, 1.7x more often than ChatGPT-4, 2.3x more often than Microsoft

There's no way that's true, because GPT-4 is vastly superior to Google Translate in general -- so if Google Translate is "preferred by experts" over GPT-4, to that extent, this would imply that the test they're using is somehow contrived or unrepresentative of the average use case.

Re: DeepL's LLM Outperforms Google Translate, ChatGPT-4, and Microsoft

#4
I think it’s notable that they left out Claude, which in my experience has been the best general purpose hosted LLM to date. Given how well known Claude is in the LLM space, it makes me wonder if Claude is actually better than the DeepL specialized LLM at translation tasks.

Re: DeepL's LLM Outperforms Google Translate, ChatGPT-4, and Microsoft

#6
post #4

I think it’s notable that they left out Claude, which in my experience has been the best general purpose hosted LLM to date. Given how well known Claude is in the LLM space, it makes me wonder if Claude is actually better than the DeepL specialized LLM at translation tasks.

Claude suffered a bit for me in Italian, not translation directly but asking generic tasks such as "reproduxlce this graph in vanilla JavaScript and html"

That was a few weeks ago however and I didn't test if for direct translations.

Re: DeepL's LLM Outperforms Google Translate, ChatGPT-4, and Microsoft

#7
I've used DeepL as an attempt to de-Google my use of Google Translate.

Prior to LLMs, they're pretty good.

The Google Translate UI is still better for Chinese, since it provides the Pinyin underneath both the target and the source language.

The quality of translation using the traditional DeepL varies; sometimes it is better than Google Translate, other times it is worse. They are both quite terrible for Chinese, since they provide literal translation: The product is essentially someone speaking English with Chinese words, disregarding natural expression, nuance, and distiction between spoken and written language.

I would still recommend DeepL for these reasons:

  1) If you pay them money, they say they will respect your privacy to some degree.
  2) They allow for API integration, so you can embed them into your tools and apps.
  3) Google Translate + DeepL (when they disagree) give a better result than either one alone.
I've used LLMs (GPT, Claude) to express succinct statements in other languages.

This has worked amazingly well. I look forward to try DeepL's LLMs.

Re: DeepL's LLM Outperforms Google Translate, ChatGPT-4, and Microsoft

#8

> DeepL’s models are trained on the highest-quality linguistic data, with an unwavering focus on excellence. Combining world-class AI with the expertise of thousands of hand-picked language specialists who “tutor” the model, DeepL consistently provides best-in-class translation. > In fact, recent blind tests show that language experts routinely prefer DeepL's translations. According to the data, DeepL’s translation i…

Yeah exactly, and surely it would also vary depending on the languages being translated from/to. I don't see how you can make claims like that and not link to the studies backing them up, this is so disingenuous.

Re: DeepL's LLM Outperforms Google Translate, ChatGPT-4, and Microsoft

#9

> DeepL’s models are trained on the highest-quality linguistic data, with an unwavering focus on excellence. Combining world-class AI with the expertise of thousands of hand-picked language specialists who “tutor” the model, DeepL consistently provides best-in-class translation. > In fact, recent blind tests show that language experts routinely prefer DeepL's translations. According to the data, DeepL’s translation i…

> GPT-4 is vastly superior to Google Translate in general

You mean in translation? It might depend on the chosen language pair but for my use cases DeepL > Google Translate > ChatGPT4

Post reply on HN