Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open-source tool translates and dubs videos into other languages using AI

github.com

Post reply on HN
Print view View original

11–20 of 119 posts

Re: Open-source tool translates and dubs videos into other languages using AI

#11

Post by chompychop »

RIMR wrote: post #5
nickthegreek wrote: post #3

Earlier quoted context omitted.

>AI is replacing human beings too fast. citation needed.

This is a subjective statement. If you disagree with it, counter it. Asking for a citation doesn't make sense here.

How is it subjective? Can't terms like "replacing" and "fast" be quantified by metrics related to rates of unemployment and adoption of AI systems for tasks previously manned by humans? I'm not saying the data is readily available, but I do see a route to objectively measuring this.

Re: Open-source tool translates and dubs videos into other languages using AI

#12

Post by netsharc »

Huh, if it's good enough, movies/TV shows dubbed with AI-clone of the original voice would be great (if we can ignore the ethics of using the actor's voice and the loss of work for the dubbing companies and actors).

For example here's how weird Friends is in German: https://www.youtube.com/watch?v=nCoNSZV--z0 . Or Italian: https://www.youtube.com/watch?v=wO5qTzvyQ1s

Can AI detect the emotional tone of sentences yet, and recreate it in the target language?

Re: Open-source tool translates and dubs videos into other languages using AI

#13

Post by Kiro »

vouaobrasil wrote: post #2

Unlike other methods of automation, AI is replacing human beings too fast. And before you say, "new jobs will be created" -- look at history. After the computer, new jobs have been created, but what kind of jobs? Every year, we are becoming more entwined in wage slavery as the wealth accumulates at the top and jobs become more meaningless. So, no, new jobs will not be created, except the kind of jobs that crush the h…

Strange submission to post this comment on. It's not like translating and dubbing videos is the highest form of labor.

Re: Open-source tool translates and dubs videos into other languages using AI

#14

Post by programjames »

netsharc wrote: post #12

Huh, if it's good enough, movies/TV shows dubbed with AI-clone of the original voice would be great (if we can ignore the ethics of using the actor's voice and the loss of work for the dubbing companies and actors). For example here's how weird Friends is in German: https://www.youtube.com/watch?v=nCoNSZV--z0 . Or Italian: https://www.youtube.com/watch?v=wO5qTzvyQ1s Can AI detect the emotional tone of sentences yet,…

Yes, pop in a normalizing flow that removes tone and recreates it with a small audio sample as context.

https://arxiv.org/abs/2312.01479

Re: Open-source tool translates and dubs videos into other languages using AI

#15

Post by wongarsu »

Kiro wrote: post #13
vouaobrasil wrote: post #2

Unlike other methods of automation, AI is replacing human beings too fast. And before you say, "new jobs will be created" -- look at history. After the computer, new jobs have been created, but what kind of jobs? Every year, we are becoming more entwined in wage slavery as the wealth accumulates at the top and jobs become more meaningless. So, no, new jobs will not be created, except the kind of jobs that crush the h…

Strange submission to post this comment on. It's not like translating and dubbing videos is the highest form of labor.

It's not like it's mindless drudgery either. Losing as little as possible in translation while fitting within the constraints of subtitles (people can only read so fast) can be very challenging. And decent dubbing tries to approximately match the mouth movements, which puts further constraints on the translation and often requires creative text changes.

There is a point about industry size (not that many countries dub all their movies), but it is one of the intellectually more challenging professions.

Re: Open-source tool translates and dubs videos into other languages using AI

#16

Post by insane_dreamer »

Kiro wrote: post #13
vouaobrasil wrote: post #2

Unlike other methods of automation, AI is replacing human beings too fast. And before you say, "new jobs will be created" -- look at history. After the computer, new jobs have been created, but what kind of jobs? Every year, we are becoming more entwined in wage slavery as the wealth accumulates at the top and jobs become more meaningless. So, no, new jobs will not be created, except the kind of jobs that crush the h…

Strange submission to post this comment on. It's not like translating and dubbing videos is the highest form of labor.

It actually requires a fair bit of skill to do it correctly and accurately

Re: Open-source tool translates and dubs videos into other languages using AI

#17

Post by insane_dreamer »

vouaobrasil wrote: post #2

Unlike other methods of automation, AI is replacing human beings too fast. And before you say, "new jobs will be created" -- look at history. After the computer, new jobs have been created, but what kind of jobs? Every year, we are becoming more entwined in wage slavery as the wealth accumulates at the top and jobs become more meaningless. So, no, new jobs will not be created, except the kind of jobs that crush the h…

The problem is that we are hurtling towards the unknown without a plan, driven by the “need” to make higher returns for shareholders and to capture the new market. It may be that some new types of employment magically appear that soak up the jobs lost, but you can be sure there is no one working on solving that problem since the goal is to eliminate labor not create it.

Re: Open-source tool translates and dubs videos into other languages using AI

#18

Post by devindotcom »

netsharc wrote: post #12

Huh, if it's good enough, movies/TV shows dubbed with AI-clone of the original voice would be great (if we can ignore the ethics of using the actor's voice and the loss of work for the dubbing companies and actors). For example here's how weird Friends is in German: https://www.youtube.com/watch?v=nCoNSZV--z0 . Or Italian: https://www.youtube.com/watch?v=wO5qTzvyQ1s Can AI detect the emotional tone of sentences yet,…

they're workin on it
Post reply on HN