Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

Post by [deleted] » Tue, Jul 22, 2025, 6:26 AM UTC

aprilthird2021 wrote: post #5

sivers wrote: post #3

to save you a lookup: The Arabic text "رجمة نانسي قنقر" translates to English as: "Nancy Qanqar's translation" or "Translation by Nancy Qanqar" "رجمة" means "translation" and "نانسي قنقر" is the name "Nancy Qanqar"

And it seems to be because the training data is largely unofficial subtitles from movies. Which often have a string like "Translated by X" at the end of the movie which is often silent while credits roll.

Post by MrGilbert » Tue, Jul 22, 2025, 6:36 AM UTC

rob74 wrote: post #11

aprilthird2021 wrote: post #5

Earlier quoted context omitted.

And it seems to be because the training data is largely unofficial subtitles from movies. Which often have a string like "Translated by X" at the end of the movie which is often silent while credits roll.

Looks like they used more official sources for German - there, silence is apparently hallucinated as "Untertitelung des ZDF für funk, 2017" according to one of the comments on the issue. Which makes sense, as the public broadcasters' "Mediathek" is probably the largest freely available resource of subtitled videos in Germany. I wonder if the ZDF gave its approval for it being used for LLM training though?

Post by Zacharias030 » Tue, Jul 22, 2025, 6:38 AM UTC

rob74 wrote: post #11

aprilthird2021 wrote: post #5

Earlier quoted context omitted.

And it seems to be because the training data is largely unofficial subtitles from movies. Which often have a string like "Translated by X" at the end of the movie which is often silent while credits roll.

Looks like they used more official sources for German - there, silence is apparently hallucinated as "Untertitelung des ZDF für funk, 2017" according to one of the comments on the issue. Which makes sense, as the public broadcasters' "Mediathek" is probably the largest freely available resource of subtitled videos in Germany. I wonder if the ZDF gave its approval for it being used for LLM training though?

Post by userbinator » Tue, Jul 22, 2025, 6:42 AM UTC

Lucasoato wrote: post #13

In Italian as well there are random hallucination when parsing silence, something like: “Thank you for watching”, “Subtitles by…”

Post by vanschelven » Tue, Jul 22, 2025, 6:45 AM UTC