Live data from Hacker News

Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

github.com

81–90 of 354 posts

Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

#81

Earlier quoted context omitted.

Indeed, with another model I would get persistent transcriptions of silent parts into 'Thanks for watching!' or '[MUSIC]'. Pretty dumb that this failure mode wasn't caught in some QA process, and there are now multiple transcription models suffering from the same issue. Having silent parts in your input audio seems like it should be a very common occurrence...

whisper MUST be combined with silence detection / VAD

Ah, the good old "you're holding it wrong".

What good is a speech recognition tool that literally hears imaginary voices?

Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

#83
post #58

Title should be changed to "OpenAI publishes evidence they trained on pirated movies".

How is this evidence of that fact? Honest question.

I can see how this might show that subtitles from online sub communities are used, or that maybe even original subtitles from e.g. DVDs are used. But isn't it already known and admitted (and allowed?) that AI uses all sorts of copyrighted material to train models?

Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

#85
post #29

Neat, we finally know the answer! What is the sound of one hand clapping? Translation by Nancy Qunqar.

I can clap with one hand (fingers on palm) and it produces a clapping sound.

Your brain merely hallucinates a clapping sound as "Translation by Nancy Qunqar" enters your ears.

Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

#86

Earlier quoted context omitted.

Just like the people forced to pay for ZDF under threat of imprisonment.

This person refers to the German television and radio fee (Rundfunkgebühren).[1] It is a state-mandated system that ensures free (as in free speech) and (relatively) neutral public broadcasting institutions. There is a constant and engaged discussion, because every household in Germany has to pay this fee. Exceptions are made only for low-income households. [1] https://en.wikipedia.org/wiki/ARD_ZDF_Deutschlandradio_B…

A constant discussion, lately fueled by extremist parties (AfD) who feel treated unfairly by (amongst others) the public broadcasters (which has parallels to Trump's recent campaign against public broadcasters in the US).

Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

#87

In Russian it often hallucinates "Субтитры сделал DimaTorzok" ("Subtitles by DimaTorzok") at the end of things. Interestingly, I wasn't able to find any YouTube videos with that name in the subtitles, so it's not like it's in a lot of training data.

Could it be someone distributing subs online, e.g. showing up in the opensubtitles.org dataset?

Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

#88

I wonder if hallucinated copyright claims (esp. like the ZDF one at the bottom of the OP) will be introduced as evidence in one of the court cases against "big AI"

Evidence against what?

"Big AI" is transparent and open about the fact they use all sorts of copyrighted material to train the data. How would "we see an exact chunk of text from our copyrighted material" add to that?

Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

#89
post #45

Earlier quoted context omitted.

It's absolutely insane that these companies can't be held liable for what is obvious piracy.

That's the magic of money. Download your favorite artist's discography for personal use? If the MPAA had its way (and it occasionally has), torrenting that could bankrupt you. The AI industry - soaking up every bit of media available online for commercial purposes, often reproducing it nearly identically - has enough money and capital to influence things its way. And only its way, in case anyone was hoping this might…

> Download your favorite artist's discography for personal use? If the MPAA had its way (and it occasionally has), torrenting that could bankrupt you.

I don't think that there are any clear examples of cases where ONLY downloading has resulted in huge fines. All the big bankrupting level fines have been for both downloading and sharing.

You mention that 'torrenting' could bankrupt you, and that is true, but the main reason for the huge fines are that you are taking part in distribution rather than just 'downloading for personal use'.

Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic

#90
post #11

Earlier quoted context omitted.

And it seems to be because the training data is largely unofficial subtitles from movies. Which often have a string like "Translated by X" at the end of the movie which is often silent while credits roll.

Looks like they used more official sources for German - there, silence is apparently hallucinated as "Untertitelung des ZDF für funk, 2017" according to one of the comments on the issue. Which makes sense, as the public broadcasters' "Mediathek" is probably the largest freely available resource of subtitled videos in Germany. I wonder if the ZDF gave its approval for it being used for LLM training though?

A more appropriate output might be ``4'33" -- John Cage, 1952``
Post reply on HN