Earlier quoted context omitted.
Just like the people forced to pay for ZDF under threat of imprisonment.
Just like any other public service paid for with public funds?
Oh it's like any other. Then just add another one!
Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
91–100 of 354 posts
Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
#92Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
#93Earlier quoted context omitted.
Indeed, with another model I would get persistent transcriptions of silent parts into 'Thanks for watching!' or '[MUSIC]'. Pretty dumb that this failure mode wasn't caught in some QA process, and there are now multiple transcription models suffering from the same issue. Having silent parts in your input audio seems like it should be a very common occurrence...
whisper MUST be combined with silence detection / VAD
What's VAD?
Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
#94Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
#95Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
#96I've spent some time with whisper, and indeed this happens all the time. To my untrained eye it seems like:
- they indeed seem to have trained on movies/subtitles
- you absolutely positively must use Voice Activity Detection (VAD) in front of whisper
Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
#97Earlier quoted context omitted.
How is this overfitting, rather than a data quality / classification issue?
If the model was able to generalise, you’d expect it to output something like “[silence]” or “…”, in response to silence. Instead, it reverted to what it has seen before (in the training data), hence the overfit.
Right, maybe my definition of overfitting was wrong, I always understood it more as trying to optimize for a specific benchmark / use case, and then it starts failing in other areas.
But the way you phrase it, it’s just “the model is not properly able to generalize”, ie it doesn’t understand the concept of silence also makes sense.
But couldn’t you then argue that any type of mistake / unknown could be explained as “overfitting” ? Where do you draw the line ?
Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
#98Earlier quoted context omitted.
Well, now in this brave new age of AI we can enjoy computer programs crashing with an Error: division by please upvote, share and like!
This also works; I upvoted your comment.
I have discovered a truly marvelous proof of how to smash that like and subscribe button, which this comment box is too small to contain.
Re: Complete silence is always hallucinated as "ترجمة نانسي قنقر" in Arabic
#99The same happens with whisper-large-v3 on Chinese transcription: silence is transcribed to something like "please upvote, share and favourite this video". I suspect they trained the model on some random YouTube video without carefully picking really useful data.
In Chinese, it always added something like "For study/research purpose only. Please delete after 48 hours." This is what those volunteers added in subtitles of (pirated) movies/shows.