Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open-source tool translates and dubs videos into other languages using AI

github.com

Post reply on HN
Print view View original

91–100 of 119 posts

Re: Open-source tool translates and dubs videos into other languages using AI

#91

Post by pjc50 »

pizza234 wrote: post #36
Kiro wrote: post #13

Earlier quoted context omitted.

Strange submission to post this comment on. It's not like translating and dubbing videos is the highest form of labor.

Voice acting (dubbing) is acting, which is a "high form of labor". In some languages/countries, most of the dubbing is performed by a few extremely good voice actors.

This is true - and it's why only a tiny, tiny fraction of content is ever translated at all.

We get both "cheaper, worse versions of material that would be dubbed anyway" but also "material that nobody would ever pay a human to dub".

Re: Open-source tool translates and dubs videos into other languages using AI

#92

Post by CaptainFever »

skeledrew wrote: post #86
kevingadd wrote: post #79

Earlier quoted context omitted.

Are you saying it's a bad thing if the creator of a work decides they want it localized or dubbed into other languages? I don't understand why you want to take that choice out of their hands. Which languages someone speaks isn't simply a matter of "individual preference". Learning a new language takes a lot of time and energy, and people only have the time to learn a handful of languages in most cases unless they can…

Nah the localization itself is fine. Where it becomes problematic is when there's no opt-out at the app level. Or perhaps it should even be opt-in.

Opt out? Do you mean you want content creators to be able to ban certain texts from being translated? That sounds like a terrible idea.

Re: Open-source tool translates and dubs videos into other languages using AI

#93

Post by Am4TIfIsER0ppos »

CaptainFever wrote: post #92
skeledrew wrote: post #86

Earlier quoted context omitted.

Nah the localization itself is fine. Where it becomes problematic is when there's no opt-out at the app level. Or perhaps it should even be opt-in.

Opt out? Do you mean you want content creators to be able to ban certain texts from being translated? That sounds like a terrible idea.

No. The parent means that software and media should not only be available in French in France, for example. French produced things can be in French in France but GGP is talking about American services like google which used to always default to French for me and be resistant to changing.

But also yes a creator should be able to ban translations.

Re: Open-source tool translates and dubs videos into other languages using AI

#94

Post by pjc50 »

fleischhauf wrote: post #73
vouaobrasil wrote: post #2

Unlike other methods of automation, AI is replacing human beings too fast. And before you say, "new jobs will be created" -- look at history. After the computer, new jobs have been created, but what kind of jobs? Every year, we are becoming more entwined in wage slavery as the wealth accumulates at the top and jobs become more meaningless. So, no, new jobs will not be created, except the kind of jobs that crush the h…

the reaction is wrong. it shouldnt be "oh no, jobs are being removed" but "nice, less work more automatization, let's make sure we all benefit through less work and not only the rich with more profits"

> let's make sure we all benefit through less work and not only the rich with more profits

It's fairly clear by now that that is not what happens and that the real AI risk is not the "grey goo" one of everything being converted to nanomush, but the age-old one of landlordism soaking up all the returns to economic activity.

Re: Open-source tool translates and dubs videos into other languages using AI

#95

Post by pjc50 »

Am4TIfIsER0ppos wrote: post #93
CaptainFever wrote: post #92

Earlier quoted context omitted.

Opt out? Do you mean you want content creators to be able to ban certain texts from being translated? That sounds like a terrible idea.

No. The parent means that software and media should not only be available in French in France, for example. French produced things can be in French in France but GGP is talking about American services like google which used to always default to French for me and be resistant to changing. But also yes a creator should be able to ban translations.

> software and media should not only be available in French in France

Seems reasonable. However, given French media quotas e.g. https://www.independent.co.uk/arts-entertainment/music/news/... , companies may be providing stuff only in French to ensure that it meets a legal requirement.

> But also yes a creator should be able to ban translations.

We've been round and round this for at least twenty years; creators like being able to ban accessibility measures like "read aloud this document" or "display it in a more readable format" or "fix the audio mix so the dialogue is audible" or "buy the DVD from a different country", but that's not exactly welfare-maximising. Are translations an accessibility measure? What about a translation into ASL?

(on the other hand, the reputational risk of a poor translation is real, and in the extreme can result in someone being cancelled for something they never even wrote)

Re: Open-source tool translates and dubs videos into other languages using AI

#96

Post by tomw1808 »

skeledrew wrote: post #87
netsharc wrote: post #12

Huh, if it's good enough, movies/TV shows dubbed with AI-clone of the original voice would be great (if we can ignore the ethics of using the actor's voice and the loss of work for the dubbing companies and actors). For example here's how weird Friends is in German: https://www.youtube.com/watch?v=nCoNSZV--z0 . Or Italian: https://www.youtube.com/watch?v=wO5qTzvyQ1s Can AI detect the emotional tone of sentences yet,…

In my experience, human dubbing never captures the original tone anyway. Probably never can unless it's done by people fluent in both source and target languages and're also good at voice acting. And so I have a huge preference for subs so I can appreciate the nuance in the original voices.

Sometimes, very rare, the dub is actually better (yes, subjective, but still) than the original. E.g. I do find Fear and Loathing in Las Vegas in German absolutely hilarious, start to finish. Then I watched the english version - was I surprised how serious this is in original voice. It's an entirely different movie in its original tone.

Re: Open-source tool translates and dubs videos into other languages using AI

#97

Post by skummetmaelk »

pjc50 wrote: post #90
skummetmaelk wrote: post #75

Localization and dubbing is a sad endeavour. By trying to accomodate everyone's individual preference for information transmission we accomplish nothing more than reducing our ability to understand each other in the long run. Having a Babelfish is all well and good. Until it stops working, and you realise no one can understand each other any more. Ironically localization is often pushed by well meaning Americans who…

This is a terrible take, and you should have at least included the "forced" dub disclaimer from your comment below. Without at least one of sub/dub, foreign (relative to your current location!) language content basically doesn't get consumed at all except by a very small minority of people who are very keen on the content anyway - or are speakers of the language anyway. Now, as veterans of anime forum wars will know,…

A big reason for the Dutch and Nordic populations being better at English than the Germans, Italians, and Spaniards, is that they were simply forced to consume media in English. They had no other option. Turns out to be an advantage.

Re: Open-source tool translates and dubs videos into other languages using AI

#99

Post by birktj »

cubbic wrote: post #4

Oh I made something similar but for Netflix! https://github.com/cubbK/dubbing_ai_netflix_client I want to learn swedish and because there are so few dubbed movies in Swedish I take the subtitles(Netflix is good at having subtitles in different languages) and text-to-speech it :)

Why not simply watch native Swedish content instead? There should be quite a lot globally available for free from SVT.

Re: Open-source tool translates and dubs videos into other languages using AI

#100

Post by carlosjobim »

skummetmaelk wrote: post #97
pjc50 wrote: post #90

Earlier quoted context omitted.

This is a terrible take, and you should have at least included the "forced" dub disclaimer from your comment below. Without at least one of sub/dub, foreign (relative to your current location!) language content basically doesn't get consumed at all except by a very small minority of people who are very keen on the content anyway - or are speakers of the language anyway. Now, as veterans of anime forum wars will know,…

A big reason for the Dutch and Nordic populations being better at English than the Germans, Italians, and Spaniards, is that they were simply forced to consume media in English. They had no other option. Turns out to be an advantage.

Subtitled media in English, that is.
Post reply on HN