Live data from Hacker News

AI could end foreign-language subtitles

axios.com

11–20 of 221 posts

Re: AI could end foreign-language subtitles

#11

Translation barely works with text, it's still too literal, doubt this can be human-equivalent for a long time.

heck, auto-generated English captions on YouTube still struggle to keep up most the time...

https://knowyourmeme.com/memes/youtube-automatic-caption-fai...

Re: AI could end foreign-language subtitles

#13

I would much rather we use AI to improve subtitling. Better auto speech recognition, per-word millisecond synchronization, positioning based on speaker/screen content-- all these could improve the subtitled experience and would be way less creepy than deepfake voices.

Yes! My perennial problem is that most Chinese TV content has excellent subtitles, but they're burned in to the videos. So if I want to watch a Chinese show with a friend who doesn't read Chinese, there's no option even for auto-translated subtitles. I've often thought of writing a script to generate subtitle files using text recognition, but haven't gotten around to it.

There's also the problem of content which doesn't have subtitles to begin with---YouTube's automatic subtitle generation is great, but could be improved and expanded to languages other than English.

Re: AI could end foreign-language subtitles

#14
post #6
post #3

This would be a lovely option to have and I find it hilarious that anyone imagines that subtitles are some kind of problem we are trying to get out of. Adding text to movies has a huge array of advantages: it preserves the original performances, it makes the dialog accessible to people with hearing or auditory processing disabilities, they can be multiplexed in a way that audio cannot, etc. Obviously it would be wond…

Coming from a non english country I can assure you that dubbing is the worst. When we were kids we would actively avoid watching anything that was dubbed as soon as we could read. It’s actually funny seeing how frustrated with subtitles my American girlfriend gets when we watch anything foreign. “You mean this basic skill every 7 year old has is hard for you, an educated super smart 30 year old? Bwahahaha” I still pr…

It depends of the country.

French have great dubs and most of the movie released are watched dubbed.

Re: AI could end foreign-language subtitles

#15
On a tangential note: As far as training data for text and speech driven machine learning models go, isn't srt files truly remarkable?

They are time stamped hence annotated precisely, hash and file matching makes media content to subtitle matching exact and overall there are language variations.

Re: AI could end foreign-language subtitles

#16

What’s really surprising to me is that synching subtitles isn’t a solved problem. Why can’t someone just loosely transcribe without time stamps and sync it to the video?

Have you turned on Google Meet subtitles recently? They're so good it's uncanny.

Re: AI could end foreign-language subtitles

#17
This will not happen for many, many years to come.

That is, companies will try it, there will be some bad and ridiculous results, there will be pusheback and the tech will largely be ignored for a decade or so.

Main problems will be intonation and inflection. What is a question to an English speaker is a regular sentence to a Russian. And so on. "Petabytes of data from primarily English-speaking libraries" mean jack shit if you wnt to actually do voice translation into/from foreign languages

Re: AI could end foreign-language subtitles

#18
An adjacent concern: Ads bad, yeah, but I appreciate the growing trend of subtitling them. I'm surprised there isn't some existing regulation on that, in the same way that streaming services are required to include them. The lower the cost of accessibility features, the more inclusive the media we consume can become.

Re: AI could end foreign-language subtitles

#19
post #3

This would be a lovely option to have and I find it hilarious that anyone imagines that subtitles are some kind of problem we are trying to get out of. Adding text to movies has a huge array of advantages: it preserves the original performances, it makes the dialog accessible to people with hearing or auditory processing disabilities, they can be multiplexed in a way that audio cannot, etc. Obviously it would be wond…

I can confirm as an anime fan, when watching One Piece I prefer to watch it in Japanese as the dubbed version sounds odd.

it was an advantage growing up watching Hollywood movies in English with Arabic subtitles, it helped me learn the language.

Re: AI could end foreign-language subtitles

#20
I think it's a great option but their is an art to translations. This applies especially to books (I'm reading an English translation of https://en.wikipedia.org/wiki/Zorba_the_Greek which is very well done) and while you do have less dialog with movies, I wonder if some subtleties will be missed, particularly around humour.
Post reply on HN