Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open-source tool translates and dubs videos into other languages using AI

github.com

Post reply on HN
Print view View original

101–110 of 119 posts

Re: Open-source tool translates and dubs videos into other languages using AI

#101

Post by carlosjobim »

skeledrew wrote: post #87
netsharc wrote: post #12

Huh, if it's good enough, movies/TV shows dubbed with AI-clone of the original voice would be great (if we can ignore the ethics of using the actor's voice and the loss of work for the dubbing companies and actors). For example here's how weird Friends is in German: https://www.youtube.com/watch?v=nCoNSZV--z0 . Or Italian: https://www.youtube.com/watch?v=wO5qTzvyQ1s Can AI detect the emotional tone of sentences yet,…

In my experience, human dubbing never captures the original tone anyway. Probably never can unless it's done by people fluent in both source and target languages and're also good at voice acting. And so I have a huge preference for subs so I can appreciate the nuance in the original voices.

When was the last time you experienced human dubbing? They do it with amazingly high quality in some languages today. I actually feel sorry for the dubbers who now have to be actors as well, making every grunt, sigh and laugh of the people they are dubbing.

They are even dubbing reality survival shows, so somebody has to sit in a studio and groan as if they are climbing a slippery hill in Alaska.

Re: Open-source tool translates and dubs videos into other languages using AI

#102

Post by carlosjobim »

birktj wrote: post #99
cubbic wrote: post #4

Oh I made something similar but for Netflix! https://github.com/cubbK/dubbing_ai_netflix_client I want to learn swedish and because there are so few dubbed movies in Swedish I take the subtitles(Netflix is good at having subtitles in different languages) and text-to-speech it :)

Why not simply watch native Swedish content instead? There should be quite a lot globally available for free from SVT.

You can only watch Nordic government channels within the Nordic countries. Unless you get a VPN for it, I guess.

Re: Open-source tool translates and dubs videos into other languages using AI

#103

Post by Am4TIfIsER0ppos »

pjc50 wrote: post #95
Am4TIfIsER0ppos wrote: post #93

Earlier quoted context omitted.

No. The parent means that software and media should not only be available in French in France, for example. French produced things can be in French in France but GGP is talking about American services like google which used to always default to French for me and be resistant to changing. But also yes a creator should be able to ban translations.

> software and media should not only be available in French in France Seems reasonable. However, given French media quotas e.g. https://www.independent.co.uk/arts-entertainment/music/news/... , companies may be providing stuff only in French to ensure that it meets a legal requirement. > But also yes a creator should be able to ban translations. We've been round and round this for at least twenty years; creators like…

I don't mean you should be technically prevented from performing a translation, edit, or filter on something you own. I mean creators should be able to prevent the publication of a translation whether that is a different language, subtitles, or signing through the usual copyright mechanisms.

Re: Open-source tool translates and dubs videos into other languages using AI

#104

Post by latexr »

IG_Semmelweiss wrote: post #62
vouaobrasil wrote: post #54

Earlier quoted context omitted.

If it is such a fallacy, then why are there fewer and fewer options for those who don't want to be entrenched in technology?

Who's upset here about the hordes of horse manure cleaners that lost their jobs due to the advent of cars? Does anyone miss the stench of a 1800s street in the summer heat? No. Lets ask the influencers, the twitch celebs, the podcasters id they would prefer to shovel horse crap, or play with their e-device all day. And to be completely fair, the manufacturing jobs may be gone because elected leaders were told it was…

> Lets ask the influencers, the twitch celebs, the podcasters id they would prefer to shovel horse crap, or play with their e-device all day.

That reads like the premise of a joke: “What’s the difference between a manure cleaner and a social media influencer? The former reduces the amount of shit in your life, the latter adds to it”.

Preferences aside, if we take into account both physical and mental damage, I wonder which job is more harmful. Not only to the practitioner, but society in general. I’m not advocating for bringing back the job of horse manure cleaner, but I don’t think social media influencer should be a job either.

You made a good point regarding exporting jobs.

Re: Open-source tool translates and dubs videos into other languages using AI

#105

Post by vouaobrasil »

skeledrew wrote: post #89
vouaobrasil wrote: post #67

Earlier quoted context omitted.

> Who's upset here about the hordes of horse manure cleaners that lost their jobs due to the advent of cars? False dichotomy. Not every modern-day twitch celeb would be shoveling manure. And another false dichotomy: I was not arguing for either NOW or THE TIME before cars. And I wonder how many people would trade their modern influence job for shoveling manure in return for living in an area with cleaner air. Also, a…

Technology disappears when it becomes ubiquitous. It never actually becomes less, because people don't want less. I can't see for example people wanting there to be fewer lightbulbs, or even refrigerators (mainly for those in warm areas). Everybody wants safe lighting and their food unspoiled after a day (once exposed to these things), and likely won't consider the means to be "tech". And it only improves over time.…

> because people don't want less.

I do, the Amish do, and quite a few other people against technology DO want less. In fact, even ordinary people (non-techies) often tell me technology is too entrenched. What about those people ditching smartphones for dumphones. I don't think that tech improves things and I DO want less.

Re: Open-source tool translates and dubs videos into other languages using AI

#106

Post by vouaobrasil »

SoftTalker wrote: post #58
vouaobrasil wrote: post #2

Unlike other methods of automation, AI is replacing human beings too fast. And before you say, "new jobs will be created" -- look at history. After the computer, new jobs have been created, but what kind of jobs? Every year, we are becoming more entwined in wage slavery as the wealth accumulates at the top and jobs become more meaningless. So, no, new jobs will not be created, except the kind of jobs that crush the h…

> After the computer, new jobs have been created, but what kind of jobs? Um, jobs where someone under age 30 can be earning hundreds of thousands of dollars a year programming them?

> Um, jobs where someone under age 30 can be earning hundreds of thousands of dollars a year programming them?

Not a very fulfilling job in my opinion, except for the money.

Re: Open-source tool translates and dubs videos into other languages using AI

#107

Post by giorgiobalduino »

skummetmaelk wrote: post #97
pjc50 wrote: post #90

Earlier quoted context omitted.

This is a terrible take, and you should have at least included the "forced" dub disclaimer from your comment below. Without at least one of sub/dub, foreign (relative to your current location!) language content basically doesn't get consumed at all except by a very small minority of people who are very keen on the content anyway - or are speakers of the language anyway. Now, as veterans of anime forum wars will know,…

A big reason for the Dutch and Nordic populations being better at English than the Germans, Italians, and Spaniards, is that they were simply forced to consume media in English. They had no other option. Turns out to be an advantage.

As an Italian I honestly prefer dubbed versions and most Italians feel the same way. We have great dubbers whose voice we associate an actor with, so much that hearing Sylvester Stallone or Eddie Murphy speaking in his native English feels weird, almost a fraud, the breaking of a bond that's not there anymore. Perhaps I would change my view on this if I lived in USA, UK or Australia, but I don't and thus that might be the reason I can't relate with originals. Just my 2 cents.

Re: Open-source tool translates and dubs videos into other languages using AI

#108

Post by giorgiobalduino »

netsharc wrote: post #12

Huh, if it's good enough, movies/TV shows dubbed with AI-clone of the original voice would be great (if we can ignore the ethics of using the actor's voice and the loss of work for the dubbing companies and actors). For example here's how weird Friends is in German: https://www.youtube.com/watch?v=nCoNSZV--z0 . Or Italian: https://www.youtube.com/watch?v=wO5qTzvyQ1s Can AI detect the emotional tone of sentences yet,…

> For example here's how weird Friends is in German: https://www.youtube.com/watch?v=nCoNSZV--z0 . Or Italian: https://www.youtube.com/watch?v=wO5qTzvyQ1s

Can't talk for the German dubbing, but the Italian version sounds natural to us Italians while the original, English version, is hard to relate to and create a bond with. The dubbing makes it "close" to home if that makes sense. You might feel it's weird because you've grown accustomed to watching the original version while also immersed in everything that sitcom portrays.

Re: Open-source tool translates and dubs videos into other languages using AI

#109

Post by inkcapmushroom »

skeledrew wrote: post #89
vouaobrasil wrote: post #67

Earlier quoted context omitted.

> Who's upset here about the hordes of horse manure cleaners that lost their jobs due to the advent of cars? False dichotomy. Not every modern-day twitch celeb would be shoveling manure. And another false dichotomy: I was not arguing for either NOW or THE TIME before cars. And I wonder how many people would trade their modern influence job for shoveling manure in return for living in an area with cleaner air. Also, a…

Technology disappears when it becomes ubiquitous. It never actually becomes less, because people don't want less. I can't see for example people wanting there to be fewer lightbulbs, or even refrigerators (mainly for those in warm areas). Everybody wants safe lighting and their food unspoiled after a day (once exposed to these things), and likely won't consider the means to be "tech". And it only improves over time.…

I would like fewer lightbulbs. Modern omnipresent light pollution is harmful to ourselves and our environment, and probably doesn't need to be at the level it is now for "safe lighting". It's okay to have some darkness sometimes, inside your house and inside your neighborhood.

Re: Open-source tool translates and dubs videos into other languages using AI

#110

Post by bdzr »

Am4TIfIsER0ppos wrote: post #103
pjc50 wrote: post #95

Earlier quoted context omitted.

> software and media should not only be available in French in France Seems reasonable. However, given French media quotas e.g. https://www.independent.co.uk/arts-entertainment/music/news/... , companies may be providing stuff only in French to ensure that it meets a legal requirement. > But also yes a creator should be able to ban translations. We've been round and round this for at least twenty years; creators like…

I don't mean you should be technically prevented from performing a translation, edit, or filter on something you own. I mean creators should be able to prevent the publication of a translation whether that is a different language, subtitles, or signing through the usual copyright mechanisms.

I'd never heard this before, but it's really interesting. This reminds me a lot of when Hollywood tried (successfully?) to bully Netflix out of adding a playback speed button. I'm not sure to what extent creators should be allowed to control how people consume their media.
Post reply on HN